apache/pinot
What's the root cause to wiki's recommendation: "Pause consumption when add a new column"?
クローズ
#12,652 opened on 2024/03/14
documentationgood first issuetroubleshooting
Repository metrics
- Stars
- (4,937 個のスター)
- PR merge metrics
- (PR metrics pending)
説明
In the ingestion transformation wiki page, it mentioned that
If a new column is added to table or schema configuration during ingestion, incorrect data may appear in the consuming segment.
To ensure accurate values are reloaded, do the following: Pause consumption (and wait for pause status success)
Is it only limited to table which has ingestion transform config? If not, it seems a breaking change since we need to pause consumption for every schema update.
Another question: In which scenario the data will incorrectly appears?