NVIDIA/SkillEvaluator
Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.
Is NVIDIA/SkillEvaluator beginner-friendly?
In the last 30 days, NVIDIA/SkillEvaluator merged 27 of 29 pull requests from outside contributors, and its maintainers usually reply within 1 day. No beginner-friendly issue is open right now; the list below has the other issues we hold for it.
- Stars
- 798
- Forks
- 101
- Open beginner issues
- 0
- Indexed issues
- 50
- Avg merge
- 1d 18h
- Merged PRs (30d)
- 347
- Dominant language
- Python
- License
- Apache-2.0
- Last GitHub push
- Nov 12, 2026
- Latest indexed
- Sep 19, 2026
- Contributing guide
- Contributing guide
- Code of conduct
- Code of conduct
- Beginner labels
- No beginner labels indexed
How to contribute to NVIDIA/SkillEvaluator
- Read the contributing guide first: it says how the maintainers want changes proposed, tested and reviewed.
- It ships a Dockerfile or Docker Compose file, so you can run it without installing its whole toolchain.
- Read its code of conduct: it covers issues and pull requests as well as chat.
- Follow the repository to hear when a new beginner-friendly issue opens, or look through the other issues below.
Issues somebody may already be working on are listed last. List everything by date
-
enhancement
Difficulty 4/5 3-5 days Newbie friendliness 45/100
NVIDIA/SkillEvaluator#329 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 4/5 3-5 days Newbie friendliness 52/100
NVIDIA/SkillEvaluator#64 ·
Maintainers usually reply within 1 day
-
roadmap: scale Tier 2 overlap detection for registry-sized catalogsMay be free again @SheenKocher claimed this 82 days ago, and no pull request is open. Open
Difficulty 5/5 Over a week Newbie friendliness 25/100
NVIDIA/SkillEvaluator#41 · 1 comment ·
Maintainers usually reply within 1 day
-
ux: add consolidated Tier 1 scanner preflight and guided bootstrapMay be free again @rookepoole claimed this 87 days ago, and no pull request is open. Open
Difficulty 5/5 Over a week Newbie friendliness 35/100
NVIDIA/SkillEvaluator#42 · 1 comment ·
Maintainers usually reply within 1 day
-
[FEA]: Recognize Node scripts (.mjs, .js) for skill type and the script checksPossibly taken @chrisknvidia claimed this 2 days ago. Open
Difficulty 4/5 3-5 days Newbie friendliness 54/100
NVIDIA/SkillEvaluator#462 · 3 comments · 1 assignee ·
Maintainers usually reply within 1 day
-
[FEA]: Name the Tier 1 token count an estimate, and offer a tokenizer or a set ratioPossibly taken @chrisknvidia claimed this 2 days ago. Open
Difficulty 3/5 1-2 days Newbie friendliness 72/100
NVIDIA/SkillEvaluator#461 · 3 comments · 1 assignee ·
Maintainers usually reply within 1 day