Copilot CLI: confirm the agentStop hook sends the agent back on a broken test

未关闭 适合新手
#135 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 1 天内回复

还没有人认领这个 Issue。

评估

难度
2/5
预计耗时
1-3 小时
新手友好度
72/100
Issue 类型
文档
描述清晰度
描述清楚
活跃度
活跃
技术栈
github, node.js, typescript

调研方向

先阅读 docs/agent-installation.md#github-copilot,然后在一个带有测试套件的临时仓库中运行 npx "@diffci.com/diffci@latest" init,并检查生成的 .github/hooks/diffci.json,了解 agentStop 处理器如何调用 diffci agent-stop --agent copilot。在 Copilot CLI 中运行每个场景,如果可以,包装 hook 命令以捕获其 stdin payload。完成意味着发布一份报告,涵盖 Copilot CLI 版本、OS、步骤 3 和 4 的结果、经过脱敏的 stdin payload,以及与文档的任何偏差。

由索引模型根据 Issue 内容生成。

描述

help wanted integration

Part of #132. Nobody has run DiffCI's GitHub Copilot setup in a real session yet. This is the first check, and the one that matters most: does Copilot CLI's agentStop hook send the agent back when its change breaks a test?

You need: Copilot CLI signed in to an account with Copilot, Node.js, and any small repository with a test suite (JS/TS, Python or Go).

Steps

  1. In the repository, run npx "@diffci.com/diffci@latest" init and commit nothing yet. Check that .github/hooks/diffci.json exists with an agentStop handler.
  2. Start Copilot CLI in the repository and ask it to make a change that breaks an existing test (for example, change a function's return value without updating its test).
  3. When the agent ends its turn, the hook runs diffci agent-stop --agent copilot. Expected: the agent gets another turn, with DiffCI's failing tests as the reason, and fixes them. After 3 failed attempts in a session, it should hand back to you.
  4. Repeat with a change that keeps the tests passing. Expected: the agent stops normally, with no extra turn.

Please post

  • Copilot CLI version, OS, and the language of the repository.
  • What happened in steps 3 and 4: did the agent continue, what reason did it see, and did it stop when it should?
  • The stdin payload the hook received, if you can capture it (for example by wrapping the command in the hook file to write stdin to a file). Remove anything private first.
  • Anything that didn't match docs/agent-installation.md#github-copilot.

A report is a contribution: it is credited like a PR, and sustained work on the Copilot integration is how the Area maintainer tier is offered (CONTRIBUTING.md).

主要语言
TypeScript
星标
0
派生
4
平均合并
18 小时 41 分钟
30 天内合并 PR
48

环境准备

在 Codespaces 中打开

在浏览器里用你自己的 GitHub 账号启动这个项目的开发容器。

  • 没有 Dockerfile 或 Docker Compose 文件
  • 没有 Pull Request 模板
  • 阅读贡献指南

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

DiffCI/core 的其他 Issue

查看 DiffCI/core 的全部 Issue

相似的 Issue

更多 TypeScript Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。