Docs: "Test your bot before launch" guide
維護者通常 1 天內回覆
還沒有人認領這個 Issue。
評估
- 難度
- 3/5
- 預估耗時
- 1-2 天
- 新手友好度
- 72/100
- Issue 類型
- 文件
- 描述清晰度
- 描述清楚
- 活躍度
- 活躍
- 技術堆疊
- github-actions, typescript, yaml
研究方向
Read website/src/content/docs/core/testing.mdx for the documented eval assertions and GitHub Actions workflow, then check the eval schema in packages/cli/src/test/load.ts. Add the specified guide at website/src/content/docs/getting-started/test-before-launch.mdx, update website/astro.config.mjs and link to it near the top of testing.mdx. Done means the examples and recorded replay are verified, and the docs check and website build pass.
由索引模型根據 Issue 內容生成。
描述
F-07 task 19. chatcops test is documented as a reference in website/src/content/docs/core/testing.mdx: eval files at line 35, the judge at 124, costs at 177, recorded replays at 221, and a GitHub Actions example at 256. What's missing is a guide someone can follow before launch: from no tests to a suite that runs on every pull request for free.
What to do
A new page, website/src/content/docs/getting-started/test-before-launch.mdx, added to the Getting Started sidebar in website/astro.config.mjs after "Index Your Site". It has these steps:
- Write the first eval file: three to five questions your bot has to get right, such as pricing, a lead being captured, and an off-topic question it should decline. Use
contains,calls-tool,lead-capturedand onejudgeassertion.testing.mdxlists them all. - Run it live with
npx chatcops test, and read the pretty output and a failure. - Record it with
--record, commitevals/__cassettes__/, and explain why replay is free and the same every time. - Run it in CI: the workflow from
testing.mdx:256, replaying on every PR with no API keys. When a prompt change breaks replay, re-record. - Add a simulated visitor (
simulate, #512) for one multi-turn case.
End with a short "What to test" list for a typical site bot.
Acceptance criteria
- The page is in the sidebar. Every TypeScript block passes
pnpm docs:check, and every YAML example matches the eval file schema (packages/cli/src/test/load.ts). - You ran the example eval file yourself against a bot (any provider), recorded it, and ran it again with
--replay. Say in the PR what you ran. -
testing.mdxlinks to the new page near the top. -
pnpm --filter @chatcops/website buildpasses. Docs only, so no changeset.
Comment here to be assigned.
- 主要語言
- TypeScript
- 星號
- 13
- 分支
- 7
- 平均合併
- 3 小時 10 分鐘
- 30 天內合併 PR
- 339
環境準備
- 沒有 Dockerfile 或 Docker Compose 檔案
- 有 Pull Request 範本
- 閱讀貢獻指南
從這裡開始
- 先讀完整個 Issue，再讀專案的貢獻指南。
- 在 Issue 下留言說明你要接手 —— 這能避免兩個人做同樣的事。
- Fork 儲存庫，在一個分支上完成修改。
- 送出 Pull Request，並在描述裡引用這個 Issue 編號。
codercops/chatcops 的其他 Issue
-
難度 1/5 1 小時以內 新手友好度 25/100
codercops/chatcops#546 · 4 則留言 ·
維護者通常 1 天內回覆
-
難度 3/5 1-2 天 新手友好度 64/100
codercops/chatcops#542 · 3 則留言 ·
維護者通常 1 天內回覆
-
Server: validate `rateLimit.windowMs` before creating the limiter可能已有人在做 @ashutoshpalhare 於 3 天前認領。 未關閉
codercops/chatcops#452 · 1 則留言 · 已指派 1 人 ·
維護者通常 1 天內回覆
-
Widget: a "New reply" button when the visitor has scrolled up可能已有人在做 @srujankaleru2007 於 4 天前認領。 未關閉enhancement widget
codercops/chatcops#420 · 3 則留言 · 已指派 1 人 ·
維護者通常 1 天內回覆
-
chatcops test: --url to test a deployed server可能已有人在做 @srujankaleru2007 於 4 天前認領。 未關閉enhancement testing
codercops/chatcops#419 · 3 則留言 · 已指派 1 人 ·
維護者通常 1 天內回覆
查看 codercops/chatcops 的全部 Issue
相似的 Issue
-
難度 2/5 1-3 小時 新手友好度 65/100
ehmpathy/rhachet-roles-ehmpathy#1231 ·
維護者通常 1 天內回覆
-
難度 2/5 1-3 小時 新手友好度 66/100
Equal-Vote/bettervoting#1754 ·
維護者通常 2 天內回覆
-
難度 1/5 1 小時以內 新手友好度 82/100
Doist/todoist-sdk-typescript#740 ·
維護者通常 1 天內回覆
-
難度 1/5 1 小時以內 新手友好度 62/100
privatenumber/cleye#47 ·
-
spec-feedback
難度 2/5 1-3 小時 新手友好度 62/100