Error when generating metadata of file with 155 columns
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 35/100
Research direction
Start by reproducing the failure with empty_parquet.parquet in S3 and the ANALYZE TABLE s3.empty_parquet refresh METADATA command, then inspect error_drill_metadata.log for the generated-source failure. The work is done when metadata generation succeeds for the 156-column file without the Java "code too large" error.
Written by the indexing model from the issue text.
Description
Hello!
I have problems to generate the metadata of a Parquet file in S3 with 156 columns (some with long names). Drill version is 1.21.1
In my IDE I see the error:
"SQL Error: INTERNAL_ERROR ERROR: Code generation error - likely code error.
Fragment: 0:0"
I attach the complete log (error_drill_metadata.log) where you can see much more detail.
For example:
"Caused by: java.lang.Exception: File 'org.apache.drill.exec.compile.DrillJavaFileObject[StreamingAggregatorGen1872.java]', Line 13982, Column 18: StreamingAggregatorGen1872.java:13982: error: code too large".
error_drill_metadata.log
Step to reproduce:
- Upload the empty_parquet.parquet ( inside empty_parquet.zip) file to an S3 bucket. For example. "s3://your-bucker/empty_parquet/empty_parquet.parquet
- Configure Drill to access the bucket
- Execute the command "ANALYZE TABLE s3.empty_parquet refresh METADATA;".
- Dominant language
- Java
- Stars
- 2k
- Forks
- 989
- Avg merge
- 1d 8h
- Merged PRs (30d)
- 5
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from apache/drill
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
bug
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
bug
Difficulty 4/5 3-5 days Newbie friendliness 28/100
-
bug
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
-
Difficulty 1/5 Under an hour Newbie friendliness 88/100
checkstyle/test-configs#263 ·
-
bug
Difficulty 1/5 Under an hour Newbie friendliness 90/100
apache/cloudstack#14222 ·
-
[BUG]茶杯方块在取茶时会引发崩溃 Open
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
1.0.0-alpha2 Type/Improvement
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
wso2/dpdp-accelerator#272 ·