Convention of Metadata Placement

Open
#107 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
1-2 days
Newbie friendliness
45/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Quiet
Domain
data-engineering, testing

Research direction

Inspect data/alltypes_dictionary.parquet at byte 80 and compare its column-chunk metadata placement with other Parquet files. Read the linked canonical data-pages specification first; done means confirming whether this fixture violates the stated back-to-back column-chunk convention and documenting or correcting the fixture accordingly.

Written by the indexing model from the issue text.

Description

At byte 80 of alltypes_dictionary, there is another instance of the column_chuck metadata. This does not seem to be consistent with other parquet files and the convention of this seems to go against the canonical spec where all column chunks should be written back to back and be separate from the metadata itself.

Dominant language
Python
Stars
90
Forks
79
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from apache/parquet-testing

All issues in apache/parquet-testing

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.