Unable to Read Parquet Files from S3 Bucket

未关闭

#638 创建于 2024年4月15日 0 条评论 0 个 reaction 已指派 0 人在 GitHub 查看

还没有人认领这个 Issue。

评估

难度: 3/5
预计耗时: 1-2 天
新手友好度: 30/100

Issue 类型: 缺陷
描述清晰度: 需要澄清
活跃度: 停滞
技术栈: aws, python
领域: cloud

调研方向

Start with the mentioned SessionContext.register_object_store and read_parquet entry points, then compare the linked Python object-store documentation with the Rust S3 documentation. Reproduce the reported "No suitable object store found" error and determine whether the Python usage is supported or needs documentation or a tested correction.

由索引模型根据 Issue 内容生成。

描述

bug

escription:
I'm attempting to read Parquet files from an S3 bucket using DataFusion in Python. Below is the code snippet I'm using:

python
Copy code
import datafusion
from datafusion import SessionContext

s3 = object_store.object_store.AmazonS3("s3://test/", "us-east-2")
ctx = SessionContext()
ctx.register_object_store("s3", s3)
df = ctx.read_parquet("s3://test/00001.parquet")
Error Encountered:
I'm encountering the following error:

css
Copy code
dataFusion error: Internal("No suitable object store found for s3://test/00001.parquet")
Issue Investigation:
I've tried to find relevant documentation or support resources but haven't been successful in locating any.

Resources Reviewed:
While researching, I came across the following Rust documentation which appears relevant but unfortunately doesn't have a corresponding Python counterpart:

DataFusion Rust Documentation
DataFusion ObjectStore S3 Rust Documentation
Request for Assistance:
Could someone please guide me on how to resolve this issue in Python? Any assistance or pointers to relevant documentation would be greatly appreciated. Thank you!

主要语言: Python
星标: 605
派生: 176
平均合并: 1 天 23 小时
30 天内合并 PR: 8