Identify Test Gaps and Add Coverage
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 38/100
- Issue type
- Feature
- Clarity
- Needs clarification
- Activity status
- Quiet
- Tech stack
- typescript
- Domain
- testing-qa
Research direction
Start by reviewing the listed untested packages, such as agentRpc, agentServer/api, chat-ui, and schema tooling, then build the project because tests run against dist/test/. Use pnpm run test:local and the relevant package entry points to establish current coverage; done means adding focused tests for an agreed gap and having the local suite pass.
Written by the indexing model from the issue text.
Description
Since we're leaning heavily on AI and moving pretty fast, we should make sure we take time to invest in more robust test coverage. A quick scan of our test infra gives this overview :
Test Infrastructure Overview
Framework: Jest + TypeScript
Convention: .spec.ts = unit tests (offline),
.test.ts = integration tests (require API keys)
Root scripts: pnpm run test:local, test:live,
shell:test
Note: Tests run against compiled output in
dist/test/ — you must build first.
Packages WITH Tests
┌───────────────┬───────────────────────────┐
│ Package │ What's Covered │
├───────────────┼───────────────────────────┤
│ │ NFA/DFA compiler, grammar │
│ actionGrammar │ merging, terminal │
│ │ symbols, schema parsing │
├───────────────┼───────────────────────────┤
│ │ TypeScript → JSON Schema │
│ actionSchema │ conversion, type │
│ │ validation │
├───────────────┼───────────────────────────┤
│ cache │ LLM call caching, │
│ │ hit/miss logic │
├───────────────┼───────────────────────────┤
│ │ Action routing, │
│ dispatcher │ input→agent matching, │
│ │ type validation │
├───────────────┼───────────────────────────┤
│ knowPro │ RAG, conversational │
│ │ memory, semantic search │
├───────────────┼───────────────────────────┤
│ │ Individual agent action │
│ agents/* │ handlers (player, │
│ │ calendar, email, list, │
│ │ browser, weather) │
├───────────────┼───────────────────────────┤
│ cli │ Argument parsing, command │
│ │ execution │
├───────────────┼───────────────────────────┤
│ shell │ Electron GUI (via │
│ │ shell:test) │
├───────────────┼───────────────────────────┤
│ testLib │ Shared test utilities and │
│ │ mock factories │
└───────────────┴───────────────────────────┘
Packages With NO Tests
These have zero test files:
- agentRpc — RPC communication protocol between
dispatcher and agents - agentServer / api — Server infrastructure
- chat-ui — Chat UI components
- codeProcessor / coderWrapper — Code
generation - schemaAuthor / actionSchemaCompiler — Schema
authoring tools - knowledgeVisualizer / kp / textPro —
Knowledge/text processing - uriHandler, interactiveApp, montage,
cacheExplorer
Notable Gaps
- IPC/RPC layer (agentRpc) — No tests for the
communication protocol between dispatcher and
agents, which is critical infrastructure - Server layer — agentServer and api have no
coverage; server startup, routing, auth are
untested - UI components — chat-ui has no automated
tests - Schema tooling — Compiler/authoring tools
are untested despite being part of the
development workflow - Error/edge case paths — Integration tests
require live API keys, so CI likely skips them
entirely, leaving a gap between unit tests and
real behavior - End-to-end flows — No apparent e2e tests
that simulate a full user request through
dispatcher → agent → response
- Dominant language
- TypeScript
- Stars
- 740
- Forks
- 106
- Avg merge
- 1d 6h
- Merged PRs (30d)
- 84
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from microsoft/TypeAgent
-
Difficulty 4/5 3-5 days Newbie friendliness 48/100
-
Difficulty 5/5 Over a week Newbie friendliness 15/100
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
-
dispatcher enhancement security
Difficulty 5/5 Over a week Newbie friendliness 35/100
All issues in microsoft/TypeAgent
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
bcgov/bc-wallet-mobile#4761 · 1 comment ·
-
external-issue to-triage
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
area-deployment area-integrations triage:bot-seen
Difficulty 2/5 Half a day Newbie friendliness 86/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
refactor
Difficulty 2/5 1-3 hours Newbie friendliness 84/100