apache/pinot

Pinot can't skip creating derived column when configured in transform functions

開放

#7,627 建立於 2021年10月25日

 (0 則留言) (0 個反應) (0 位負責人)Java (1,234 個分叉)batch import
help wanted

倉庫指標

星標
 (4,937 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

When reloading segments, pinot will skip many segments when derived column not configured in schema or segments metadata , which will cause some segments not synced latest new columns

We got the following error message when query from table: image

Code need remove:

for (String argument : arguments) {
  ColumnMetadata columnMetadata = _segmentMetadata.getColumnMetadataFor(argument);
  if (columnMetadata == null) {
    LOGGER.warn("Skip creating derived column: {} because argument: {} does not exist in the segment", column,
        argument);
    return false;
  }
  argumentsMetadata.add(columnMetadata);
}

貢獻者指南