skillopt-sleep: make transcript sources and backends pluggable (entry points), and fail on unknown backend names
维护者通常 2 天内回复
还没有人认领这个 Issue。
评估
- 难度
- 5/5
- 预计耗时
- 一周以上
- 新手友好度
- 32/100
- Issue 类型
- 功能
- 描述清晰度
- 基本清楚
- 活跃度
- 活跃
- 技术栈
- python
调研方向
Start by reading harvest_sources.harvest_for_config() and backend.get_backend(), then trace how --source and --backend choices are built. The proposal spans plugin registration, module loading, checkpoint keys, and a public helper API; the author offers to implement parts 1–3 and 5 with tests. Done means existing names still work, plugins can register sources and backends, and unknown backend names raise an error.
由索引模型根据 Issue 内容生成。
描述
Problem
harvest_sources.harvest_for_config() and backend.get_backend() are fixed if-chains. Every new harness needs a change to core: open right now are #153 (Antigravity), #266 (DeepSeek Harness, from #225), #282 (Codex CLI rollouts), #114 (Hermes as backend and source), plus #97 (VS Code Copilot). Also, get_backend() returns MockBackend() for any name it does not know, so a typo or an out-of-tree backend silently produces a 0.0 -> 0.0 night instead of an error.
Motivating case
On one macOS machine we run a nightly cycle over claude, codex, cursor, opencode and copilot_cli natively, plus three stores upstream cannot read:
- zcode: an OpenCode fork whose
db.sqlitelacks theagentandmetadatacolumnsharvest_opencoderequires, so it finds 0 sessions. - Antigravity: per-conversation SQLite with protobuf steps; we also read the
antigravity-cliandantigravity-acpconversation dirs, which #153 does not. - Crush: a per-project
crush.dblisted inprojects.json.
Today these reach the engine only by pre-writing digests.json into the handoff dir before round 1. Every model call goes through the handoff backend plus an external answerer, because no backend can be registered from outside. The adapters and the runner are public: https://github.com/djbclark/djbclark-ade/blob/master/bin/skillopt_sources.py and https://github.com/djbclark/djbclark-ade/blob/master/bin/skillopt-night
Proposal
- Two entry-point groups, consulted after the built-ins:
skillopt_sleep.sources(name ->harvest(cfg, *, since_iso, limit, scope, invoked_project) -> list[SessionDigest]) andskillopt_sleep.backends(name ->factory(cfg) -> Backend).--sourceand--backendaccept any registered name, andchoices=lists come from the registry. --source-module pkg.mod:funcand--backend-module pkg.mod:Classfor unpackaged adapters.get_backend()raises on an unknown name instead of returningMockBackend(keepmockexplicit).- Key the harvest checkpoint by
(project, source)(#312) so several sources can feed one project. - A small public helper API (
is_headless_replay,is_agent_session,is_meta_prompt,detect_feedback,redact_secrets), so external sources apply the same filters and redaction as built-in ones.
The existing sources would register through the same mechanism, and per-source PRs such as #153 and #266 would become optional plugins instead of core changes.
Offer
I am happy to send a PR implementing 1-3 and 5 with tests (keeping every current --source and --backend name working), and 4 separately if #312 is accepted. Tell me if you prefer a different shape, for example a config-file registry instead of entry points.
Version context: main at 343db229dbd5ddaf9df6b1d5540d8bcdb2604d5c.
- 主要语言
- Python
- 星标
- 18.2k
- 派生
- 1.7k
- 平均合并
- 4 天 1 小时
- 30 天内合并 PR
- 10
环境准备
- 没有 Dockerfile 或 Docker Compose 文件
- 没有 Pull Request 模板
- 阅读贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
microsoft/SkillOpt 的其他 Issue
-
难度 3/5 1-2 天 新手友好度 45/100
维护者通常 2 天内回复
-
难度 3/5 1-2 天 新手友好度 66/100
维护者通常 2 天内回复
-
难度 4/5 3-5 天 新手友好度 25/100
维护者通常 2 天内回复
-
Clarification on Rollout Timeouts, Inference Concurrency, and Their Impact on SkillOpt Evaluation未关闭
难度 4/5 3-5 天 新手友好度 12/100
维护者通常 2 天内回复
-
skillopt-sleep: max_tokens_per_night is defaulted and documented but never enforced可能已有人在做 @Thanatos9404 于 2 天前认领。 未关闭
难度 4/5 3-5 天 新手友好度 55/100
维护者通常 2 天内回复
查看 microsoft/SkillOpt 的全部 Issue
相似的 Issue
-
bot-triaged module: LrScheduler module: optimizer triaged
难度 2/5 1-3 小时 新手友好度 70/100
维护者通常 1 天内回复
-
documentation glm5 llm-model
难度 2/5 1-3 小时 新手友好度 78/100
vllm-project/vllm-ascend#19062 ·
维护者通常 1 天内回复
-
author-page correction
难度 2/5 1-3 小时 新手友好度 68/100
acl-org/acl-anthology#10496 · 1 条评论 ·
维护者通常 1 天内回复
-
Issue Type: Bug Report
难度 2/5 1-3 小时 新手友好度 82/100
维护者通常 1 天内回复
-
enhancement good first issue
难度 2/5 1-3 小时 新手友好度 76/100
SasanLabs/VulnerableApp#836 ·
维护者通常 1 天内回复