apache/pinot

Choose which fields get flattened by complexType

开放

#10,549 创建于 2023年4月5日

 (1 条评论) (0 个反应) (1 位负责人)Java (1,234 个派生)batch import
featurehelp wanted

仓库指标

星标
 (4,937 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Say we have the following event structure:

{
	"...",
	"auditFields": {
		"a": "b",
		"c": "d"
	},
	"results": [
		{
			"name": "result1",
			"value": 33.2
		},
		{
			"name": "result2",
			"value": 45.6
		}
	]
}

We want to create the following columns:

results.name
results.value
auditFields

At the moment I don't think that's possible as auditFields will be flattened into:

audiFields.a
auditFields.c

By this line of code - https://github.com/apache/pinot/blob/master/pinot-segment-local/src/main/java/org/apache/pinot/segment/local/recordtransformer/ComplexTypeTransformer.java#L176

Can we make the columns that get flattened configurable, like the fields to unnest can be configured?

贡献者指南