Reduce system prompt token overhead from skill files
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 35/100
- Issue type
- Refactor
- Clarity
- Mostly clear
- Activity status
- Stale
- Tech stack
- typescript
- Domain
- ai
Research direction
Inspect load_all_skills() and the referenced mechanical-illustration-skill.txt and svg-shape-library.txt files, then measure the current skill-text token usage. Compare the suggested loading, trimming, and budget approaches; done means irrelevant skills are excluded for non-mechanical queries and the total skill text meets a defined target.
Written by the indexing model from the issue text.
Description
Priority: P1 | Source: PR #21 self-review (F2)
Problem
PR #21 adds ~9,150 tokens (75% increase) to the system prompt. load_all_skills() concatenates ALL .txt files unconditionally — mechanical diagram guidance is injected even for non-mechanical queries.
- Pre-PR skill text: ~48.9 KB (~12,200 tokens)
- Post-PR skill text: ~85.5 KB (~21,400 tokens)
Suggested Approaches
- Conditional skill loading — only inject
mechanical-illustration-skill.txtandsvg-shape-library.txtwhen the query involves physical/mechanical subjects - Trim the shape library to the 6-8 most common shapes (as the issue proposal itself suggests)
- Establish a token budget target for total skill text
- Dominant language
- TypeScript
- Stars
- 1.6k
- Forks
- 202
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from CopilotKit/OpenGenerativeUI
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
Difficulty 4/5 3-5 days Newbie friendliness 48/100
CopilotKit/OpenGenerativeUI#87 · 2 comments ·
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
Difficulty 4/5 3-5 days Newbie friendliness 45/100
All issues in CopilotKit/OpenGenerativeUI
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
ontola/atomic-server#1625 ·
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
melgarafael/DeskcommCRM#1451 ·
-
Difficulty 1/5 Under an hour Newbie friendliness 82/100
-
bug via-triage
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
bot:ai-assisted component:compact-js status:untriaged
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
midnightntwrk/midnight-sdk#403 ·