apache/pinot

Pinot can't skip creating derived column when configured in transform functions

オープン

#7,627 opened on 2021/10/25

 (0 件のコメント) (0 件のリアクション) (0 人の担当者)Java (1,234 件のフォーク)batch import
help wanted

Repository metrics

Stars
 (4,937 個のスター)
PR merge metrics
 (PR metrics pending)

説明

When reloading segments, pinot will skip many segments when derived column not configured in schema or segments metadata , which will cause some segments not synced latest new columns

We got the following error message when query from table: image

Code need remove:

for (String argument : arguments) {
  ColumnMetadata columnMetadata = _segmentMetadata.getColumnMetadataFor(argument);
  if (columnMetadata == null) {
    LOGGER.warn("Skip creating derived column: {} because argument: {} does not exist in the segment", column,
        argument);
    return false;
  }
  argumentsMetadata.add(columnMetadata);
}

コントリビューターガイド