Portable attachment provenance and exact rerun metadata
还没有人认领这个 Issue。
评估
- 难度
- 5/5
- 预计耗时
- 一周以上
- 新手友好度
- 35/100
- Issue 类型
- 功能
- 描述清晰度
- 需要澄清
- 活跃度
- 活跃
- 技术栈
- json
- 领域
- testing-qa
调研方向
Start with CTRF section 12.3 and the linked capture and serialization code in TestResultCapture.cs and CtrfReportEngine.JsonTestWriter.cs. Review the relationship to #61 and PR #57. Done means the issue's questions about portable attachment provenance, integrity metadata, and exact rerun metadata have clear guidance on standardized fields versus namespaced extra data.
由索引模型根据 Issue 内容生成。
描述
Producer context
Microsoft.Testing.Platform produces reports in local development, CI shards, multi-module runs, and retry processes. The CTRF report can then be merged and retained after the producing machine is gone.
For attachments, MTP currently emits the attachment name, MIME type, and the producer's absolute local file path:
- capture: https://github.com/microsoft/testfx/blob/main/src/Platform/Microsoft.Testing.Extensions.CtrfReport/TestResultCapture.cs#L88-L116
- serialization: https://github.com/microsoft/testfx/blob/main/src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportEngine.JsonTestWriter.cs#L277-L298
Section 12.3 now clearly resolves one question: attachments[].path may be a URL or file path, has no prescribed URI/path semantics, and must be treated as opaque. That permits MTP to emit an artifact URI instead of a local path when one is available.
Two portability gaps remain.
Questions
Attachment provenance and integrity
- When both a producer-local path and a durable artifact URI exist, is
pathexpected to contain only the durable reference, with the local path moved to namespacedextra, or is a standardized way to carry both desirable? - Is there an intended representation for a content digest (algorithm plus hash) so consumers can verify, deduplicate, or retrieve content-addressed attachments?
attachmentIdidentifies a reference instance, so it does not appear to be a content identity. - Would portable artifact metadata belong directly on Attachment, or should producers use a namespaced object under
attachments[].extra?
Exact rerun / reproduction metadata
A failed test is not always reproducible from name, suite, and testId alone. MTP may need the test application/module, target framework, architecture, filter or UID, working directory, relevant runner options, and a safe reference or digest for configuration/runsettings. The exact original command line can also contain secrets and machine-local paths.
- Does exact rerun/reproduction metadata belong in CTRF as a standardized object, or is it intentionally producer-specific
extradata? - If standardized, should it describe a redacted invocation (
executable,arguments,workingDirectory, configuration references) or a higher-level portable recipe (module,test selector,target,environment/configuration digests)? - How should this relate to the pre-v1 environment/initiator redesign being discussed in #61 and to the provenance/derivation work explicitly left out of scope by PR #57?
Why these belong together
Both questions determine whether a CTRF document remains actionable after it leaves the worker that produced it: can a consumer retrieve and verify the evidence, and can it reproduce the failing execution without parsing framework-specific prose or logs? We are not proposing a specific schema yet; guidance on first-class fields versus namespaced extra would unblock a correct MTP mapping.
- 主要语言
- 没有语言数据
- 星标
- 100
- 派生
- 4
- 平均合并
- 1 小时 3 分钟
- 30 天内合并 PR
- 2
环境准备
- 没有 Dockerfile 或 Docker Compose 文件
- 没有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
ctrf-io/ctrf 的其他 Issue
-
难度 1/5 1 小时以内 新手友好度 76/100
-
难度 3/5 半天 新手友好度 32/100
-
难度 4/5 1-2 天 新手友好度 48/100
-
难度 5/5 一周以上 新手友好度 35/100
-
难度 5/5 一周以上 新手友好度 30/100
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 78/100
jessepollak/home#2223 ·
维护者通常 1 天内回复
-
grep fixture corpus test follows the corpus's loop symlink under the receipt runner (fails on main)未关闭
难度 2/5 1-3 小时 新手友好度 68/100
code-yeongyu/senpi#3756 ·
维护者通常 1 天内回复
-
难度 2/5 1-3 小时 新手友好度 66/100
rheeloaded/paperpull#116 ·
维护者通常 1 天内回复
-
bug
难度 2/5 1-3 小时 新手友好度 82/100
维护者通常 1 天内回复
-
bug dependencies github_actions
难度 2/5 1-3 小时 新手友好度 84/100
ChristianHandy/FleetPilot#233 ·
维护者通常 1 天内回复