`es search --input-file` drops top-level `aggs` (and any unrecognised key) without an error
维护者通常 1 天内回复
评估
- 难度
- 3/5
- 预计耗时
- 1-2 天
- 新手友好度
- 55/100
- Issue 类型
- 缺陷
- 描述清晰度
- 描述清楚
- 活跃度
- 活跃
- 技术栈
- elasticsearch, typescript
- 领域
- cli
调研方向
Start by reproducing with the body.json snippet and comparing the CLI result with the direct Elasticsearch call. Then read src/es/request-builder.ts:163-169 and src/lib/json-schema-args.ts:193-206 to see how only schema-declared keys are copied, and check src/lib/ajv-validate.ts for validation behavior. Decide between forwarding and rejecting unknown top-level keys, and handle aggs as an alias of aggregations; done means aggs works and a misspelt key no longer silently returns unfiltered results, with tests for both.
由索引模型根据 Issue 内容生成。
描述
Related to elastic/cli#803
Summary
The ES request builder rebuilds the request body from the keys declared in the command's schema. Any other top-level key in --input-file is dropped before the request is sent. The command exits 0 and prints no warning.
The most common case is aggs. Elasticsearch accepts both aggs and aggregations, and most docs and examples use aggs. The search schema declares only aggregations, so a body written with aggs returns hits and no aggregations key.
A misspelt key fails the same way. Elasticsearch would answer 400 to a misspelt query; the CLI sends the request without it and returns unfiltered results.
Reproduction (v0.7.0, also unchanged on main at fd3359d)
cat > body.json <<'JSON'
{"size":0,"aggs":{"by_day":{"date_histogram":{"field":"@timestamp","calendar_interval":"day"}}}}
JSON
elastic es search --index my-index --input-file body.json | jq 'has("aggregations")'
# false (exit 0, empty stderr)
curl -s -H "Authorization: ApiKey $KEY" -H 'Content-Type: application/json' \
"$ES/my-index/_search" -d @body.json | jq 'has("aggregations")'
# true
jq '.aggregations=.aggs | del(.aggs)' body.json | elastic es search --index my-index --input-file - | jq 'has("aggregations")'
# true
Misspelt key:
echo '{"qeury":{"term":{"event.action":"no-such-value"}}}' | elastic es count --index my-index --input-file -
# returns the full index count, exit 0
# Elasticsearch directly: 400 "request does not support [qeury]"
Scope observed
| Command | Unknown top-level key |
|---|---|
es search |
dropped |
es count |
dropped |
es esql query |
dropped |
es async-search submit |
dropped (checked against a local capture server: body keys ["query","size"]) |
es msearch |
bodies inside searches pass through, including aggs |
kb … |
forwarded (src/kb/request-builder.ts) |
Nested keys are not affected: sub-aggregations under aggregations keep aggs.
Mechanism
src/es/request-builder.ts:163-169copies only schema-derived arguments (src/lib/json-schema-args.ts:193-206) into a new body. Keys outside the schema never reach it.search.request.jsonin@elastic/schemas0.10.0 declaresproperties.aggregationsbut noaggs.- AJV does not remove the key (
src/lib/ajv-validate.tssets noremoveAdditional), so--no-validatemakes no difference.
Conflicts with AGENTS.md
The input rules in AGENTS.md ("Command Authoring Requirements" → "Input") say:
Reject unknown keys: Input with undefined keys MUST produce a validation error naming the unknown field(s). Silent stripping is not acceptable.
For ES commands, an unknown top-level key is neither rejected nor sent. Applied as written, that rule would make aggs a validation error, which still breaks the most common Elasticsearch body shape. Accepting aggs as an alias of aggregations, and rejecting other unknown keys, satisfies both.
Root cause
Two layers, both needed:
@elastic/schemasdoesn't carry the spec's alias. The specification marksaggregationswith@aliases aggs(SearchRequest.tsL414-L419). The JSON Schema output drops it, soaggsreaches the CLI as an unknown key. Reported upstream: elastic/schemas-js#125.- The ES request builder drops unknown keys instead of rejecting them (see Mechanism). This is a CLI defect independent of the schemas: a misspelt
queryreturns unfiltered results with exit 0.
If the upstream fix emits aggs as a declared property, the CLI picks it up with no change. If it adds an annotation instead, the CLI must read that annotation. Fixing (2) turns any remaining unknown key into a validation error, as AGENTS.md requires.
Expected
Either option would avoid wrong results with exit 0:
- Forward unknown top-level body keys, as the Kibana builder does, and let Elasticsearch accept or reject them. At minimum, accept
aggsas an alias ofaggregations. - Or fail (or warn on stderr) when
--input-filecontains a top-level key the command will not send.
Related
- elastic/cli#170 and elastic/cli#223: rejection of unknown fields, fixed by moving to passthrough schemas. This report is the opposite symptom: no rejection, the key is silently omitted.
- elastic/cli#699: malformed JSON passing validation. It mentions
aggs, but not this omission. - elastic/cli#786: request-routing unification. It keeps service-specific behaviour, so it doesn't appear to change this.
- 主要语言
- TypeScript
- 星标
- 53
- 派生
- 28
- 平均合并
- 22 小时 48 分钟
- 30 天内合并 PR
- 48
环境准备
- 没有 Dockerfile 或 Docker Compose 文件
- 没有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
elastic/cli 的其他 Issue
-
tracking
难度 2/5 1-3 小时 新手友好度 77/100
维护者通常 1 天内回复
-
feat: ship skills/elastic/SKILL.md for agent invocation可能已有人在做 @onatozmenn 于 31 天前认领。 未关闭enhancement
难度 2/5 1-3 小时 新手友好度 88/100
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 72/100
维护者通常 1 天内回复
-
难度 3/5 1-2 天 新手友好度 63/100
维护者通常 1 天内回复
-
tracking
难度 5/5 一周以上 新手友好度 35/100
维护者通常 1 天内回复
相似的 Issue
-
难度 1/5 1 小时以内 新手友好度 78/100
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 78/100
liberation-data/drivine#428 · 1 条评论 ·
维护者通常 1 天内回复
-
GitLab: a merge request closed without merging keeps the Git toolbar on View MR instead of Create MR未关闭
难度 2/5 1-3 小时 新手友好度 82/100
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 76/100
code-yeongyu/oh-my-openagent#11731 ·
维护者通常 1 天内回复
-
难度 1/5 1 小时以内 新手友好度 78/100