Workbench: live measurements leave no versioned trace
维护者通常 1 天内回复
评估
- 难度
- 4/5
- 预计耗时
- 3-5 天
- 新手友好度
- 48/100
- Issue 类型
- 功能
- 描述清晰度
- 基本清楚
- 活跃度
- 活跃
- 技术栈
- typescript
调研方向
Start with workbench/README.md, especially “La prise réelle,” then inspect baseline.ts and workbench/lib/cassette.ts. The issue calls for manually verified --update-baseline runs for the real-take scenarios, followed by capturing the provider’s usage block in the recording proxy. Done should include tracked, verified measurements and a clear decision in the README about whether judged-PR cassettes should be committed.
由索引模型根据 Issue 内容生成。
描述
Split out of #428, which is being closed — its core ask is done, this is the adjacent point that was never in scope for it.
What's left
workbench/runs/ and workbench/reports/ are gitignored, and only three baselines are committed (consent.json, describe-project.json, wizard-enhance.json). Every live measurement made against this bench — including the ones behind #431, #432, #440, #452, #453, #454 and #456 — leaves no trace anyone else can replay without re-running it themselves, on their own key, against whatever the provider resolves that day.
Concretely, that means:
- A cassette recorded during a PR review (e.g.
workbench/cassettes/judge-migration-*.json) replays offline for whoever has the file, but nothing forces it to reachmain— it's a byproduct of one session, not a tracked measurement. - The three real-take scenarios (
real-wizard-enhance,real-zooms,real-zoom-grounding) have never been judged at all, because the take itself (workbench/fixtures/) is gitignored and absent from every clone. See #457's sibling problem andworkbench/README.md§ "La prise réelle" for what that costs on a fresh checkout (44 L0 tests fail on the missing fixture, silently, since CI never runs the bench). - A baseline's
behaviour/dslnumbers, once written, are never re-verified against anything — nothing reads them back (baseline.tsonly compares check ids), so they drift into being an unlabelled archive, which is exactly what happened towizard-enhance.jsonbefore #453 said so explicitly.
First step, as noted when this was flagged
Freeze the real-take scenario baselines (--update-baseline, verified by hand rather than trusted), then capture the provider's usage block in the recording proxy (workbench/lib/cassette.ts) — the token count every context-size argument in this codebase wants is already in the response the recorder sees pass through, uncaptured.
Also worth deciding here, not in #428
Whether cassettes from a judged PR review should be committed as a matter of course (the way judge-migration-*.json were, by convention rather than by rule) or whether that's noise the repo doesn't want. workbench/README.md doesn't currently say either way.
- 主要语言
- TypeScript
- 星标
- 3.7k
- 派生
- 231
- 平均合并
- 15 小时 10 分钟
- 30 天内合并 PR
- 324
环境准备
- 没有 Dockerfile 或 Docker Compose 文件
- 有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
getopenscreen/openscreen 的其他 Issue
-
Native review wanted: machine-translated recording bar tooltips (14 locales)可能重新可做 @auberginewly 于 21 天前认领,目前没有进行中的 PR。 未关闭good first issue help wanted
难度 2/5 1-3 小时 新手友好度 68/100
getopenscreen/openscreen#913 · 5 条评论 ·
维护者通常 1 天内回复
-
[Bug]: Windows update click opens the full NSIS wizard instead of a UAC prompt可能已有人在做 @EtienneLescot 今天认领。 未关闭bug
难度 2/5 1-3 小时 新手友好度 30/100
getopenscreen/openscreen#1437 ·
维护者通常 1 天内回复
-
enhancement
难度 3/5 1-2 天 新手友好度 45/100
getopenscreen/openscreen#1436 ·
维护者通常 1 天内回复
-
enhancement
难度 4/5 3-5 天 新手友好度 45/100
getopenscreen/openscreen#1435 ·
维护者通常 1 天内回复
-
QA: e2e pass on v2.2.0-rc.1 (macOS, Windows)可能已有人在做 关联的 PR 仍在进行中或已合并。 未关闭
难度 2/5 1-3 小时 新手友好度 55/100
getopenscreen/openscreen#1431 · 4 条评论 ·
维护者通常 1 天内回复
查看 getopenscreen/openscreen 的全部 Issue
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 85/100
Automattic/data-liberation-agent#1115 ·
维护者通常 1 天内回复
-
bug
难度 2/5 1-3 小时 新手友好度 88/100
维护者通常 1 天内回复
-
CSS enhancement good first issue
难度 2/5 1-3 小时 新手友好度 70/100
pychess/pychess-variants#2448 ·
维护者通常 1 天内回复
-
[architect] Stale planning/scratch files at repo root (COMPONENT_SPLIT_SUMMARY.md etc.) describe already-completed work可能已有人在做 @hivecommons-hive 今天认领。 未关闭agent/architect architecture help wanted stage/040-covered-by-pr tech-debt
难度 2/5 1-3 小时 新手友好度 85/100
kubestellar/console#24716 ·
维护者通常 1 天内回复
-
helm-knative-apply.sh fails with Helm 4可能已有人在做 关联的 PR 仍在进行中或已合并。 未关闭area: triage theme: undefined
难度 2/5 1-3 小时 新手友好度 85/100
jhipster/generator-jhipster#35895 ·
维护者通常 1 天内回复