apache/pinot

Choose which fields get flattened by complexType

オープン

#10,549 opened on 2023/04/05

 (1 件のコメント) (0 件のリアクション) (1 人の担当者)Java (1,234 件のフォーク)batch import
featurehelp wanted

Repository metrics

Stars
 (4,937 個のスター)
PR merge metrics
 (PR metrics pending)

説明

Say we have the following event structure:

{
	"...",
	"auditFields": {
		"a": "b",
		"c": "d"
	},
	"results": [
		{
			"name": "result1",
			"value": 33.2
		},
		{
			"name": "result2",
			"value": 45.6
		}
	]
}

We want to create the following columns:

results.name
results.value
auditFields

At the moment I don't think that's possible as auditFields will be flattened into:

audiFields.a
auditFields.c

By this line of code - https://github.com/apache/pinot/blob/master/pinot-segment-local/src/main/java/org/apache/pinot/segment/local/recordtransformer/ComplexTypeTransformer.java#L176

Can we make the columns that get flattened configurable, like the fields to unnest can be configured?

コントリビューターガイド