Owner

ktwu01

1 indexed repository · View on GitHub

benchmark-radar
Track 14,810+ AI benchmark, eval, dataset, and data-quality records from 37 public sources, with linked evidence and daily updates.

Python · 234 stars

Beginner friendly Everything

Open All

🗣 Daily social checklist — 2026-09-23 Open

automated traction

Difficulty 1/5 Under an hour Newbie friendliness 90/100

ktwu01/benchmark-radar#683 · Opened Sep 23, 2026
[RFC] Move growing data off GitHub: HF as canonical, Pages as cached browse view Open

enhancement new feature

ktwu01/benchmark-radar#682 · 1 assignee · Opened Sep 22, 2026
🗣 Daily social checklist — 2026-09-22 Open

automated traction

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

ktwu01/benchmark-radar#681 · Opened Sep 22, 2026
Jargon in user-facing text, week of 2026-09-21 Open

automated jargon

Difficulty 2/5 1-3 hours Newbie friendliness 72/100

ktwu01/benchmark-radar#677 · Opened Sep 21, 2026
Absent counters are published as zero in 19 places across ten connectors Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

ktwu01/benchmark-radar#676 · Opened Sep 21, 2026
🗣 Daily social checklist — 2026-09-20 Open

automated traction

Difficulty 2/5 1-3 hours Newbie friendliness 68/100

ktwu01/benchmark-radar#675 · Opened Sep 20, 2026
SEO internal link Open

Difficulty 3/5 1-2 days Newbie friendliness 15/100

ktwu01/benchmark-radar#673 · Opened Sep 20, 2026
SEO make posts for each bench Open

traction

Difficulty 5/5 Over a week Newbie friendliness 25/100

ktwu01/benchmark-radar#671 · Opened Sep 20, 2026
[6 points] rec sys Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

ktwu01/benchmark-radar#660 · Opened Sep 16, 2026
[3 points] There should be a mechanism to update the star fork numbers in our database Open

Difficulty 3/5 1-2 days Newbie friendliness 64/100

ktwu01/benchmark-radar#659 · 3 comments · Opened Sep 16, 2026
feat(metadata): Enrich benchmark records with research reproducibility metadata (ref #651) Open

enhancement new feature

Difficulty 5/5 Over a week Newbie friendliness 38/100

ktwu01/benchmark-radar#656 · 1 comment · Opened Sep 15, 2026
feat(health): Surface granular per-source health, timeouts, and rate limits in health checks (ref #651) Open

enhancement new feature

Difficulty 4/5 3-5 days Newbie friendliness 45/100

ktwu01/benchmark-radar#655 · Opened Sep 15, 2026
feat(catalog): Distinguish validated catalog entries from raw radar leads with status, confidence, and freshness (ref #651) Open

enhancement new feature

Difficulty 5/5 Over a week Newbie friendliness 25/100

ktwu01/benchmark-radar#654 · Opened Sep 15, 2026
feat(search): Enhance benchmark search with alias expansion and semantic retrieval (ref #651) Open

enhancement new feature

Difficulty 5/5 Over a week Newbie friendliness 45/100

ktwu01/benchmark-radar#653 · Opened Sep 15, 2026
🗣 Daily social checklist — 2026-09-15 Open

automated traction

Difficulty 3/5 1-2 days Newbie friendliness 64/100

ktwu01/benchmark-radar#652 · Opened Sep 15, 2026
feedback Open

help wanted

Difficulty 5/5 Over a week Newbie friendliness 25/100

ktwu01/benchmark-radar#651 · 3 comments · Opened Sep 15, 2026
feat(query): Native related-work discovery flow, comparison axes, and BibTeX export with attribution loop (ref #549, #522) Open

Difficulty 5/5 Over a week Newbie friendliness 42/100

ktwu01/benchmark-radar#650 · 1 comment · Opened Sep 15, 2026
replace readme stale badge --> new one Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

ktwu01/benchmark-radar#648 · Opened Sep 15, 2026
add traction source: evaleval community Open

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

ktwu01/benchmark-radar#637 · Opened Sep 13, 2026
[6 points] get their data and leaderboard and so on https://github.com/evaleval/benchmark-saturation Open

traction

Difficulty 4/5 3-5 days Newbie friendliness 35/100

ktwu01/benchmark-radar#636 · Opened Sep 13, 2026
[6 points] SEO: traction Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

ktwu01/benchmark-radar#635 · Opened Sep 13, 2026
[6 points] we need let all of papers, all of benchmarks help us SEO Open

traction

Difficulty 4/5 3-5 days Newbie friendliness 48/100

ktwu01/benchmark-radar#634 · Opened Sep 13, 2026
add lab info source or learn from them Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

ktwu01/benchmark-radar#629 · Opened Sep 13, 2026
Existing posts Open

traction

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

ktwu01/benchmark-radar#626 · Opened Sep 13, 2026
[6 points] add model cards Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

ktwu01/benchmark-radar#607 · Opened Sep 11, 2026
[3 points] data merge and sanitization Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 38/100

ktwu01/benchmark-radar#599 · 3 comments · Opened Sep 11, 2026
SEO of website AND paper (we already did paper keywords SEO in both title and abstract of arXiv submission) Open

traction

Difficulty 4/5 3-5 days Newbie friendliness 35/100

ktwu01/benchmark-radar#593 · Opened Sep 10, 2026
LLM Evaluation on Unseen Questions: Contextual Multidimensional IRT Model 这个找不着 Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

ktwu01/benchmark-radar#592 · Opened Sep 10, 2026
[6 points] 新增信息源 3 points each Open

friends

Difficulty 3/5 1-2 days Newbie friendliness 45/100

ktwu01/benchmark-radar#590 · Opened Sep 10, 2026
[6 points] Past 30 days: no REAL traction signal of the top ranked bench. not know why... Stars: 0 Forks: 0 Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

ktwu01/benchmark-radar#589 · 3 comments · Opened Sep 9, 2026
[3 points] data sanitization: crawl the bench release date for 668 benchmarks Open

bug manus

Difficulty 4/5 3-5 days Newbie friendliness 55/100

ktwu01/benchmark-radar#588 · Opened Sep 9, 2026
[2 points] Add all such data into radar Open

manus

Difficulty 3/5 1-2 days Newbie friendliness 55/100

ktwu01/benchmark-radar#586 · Opened Sep 9, 2026
[2 points] Add the benchmark saturation paper (arXiv:2602.16763) to the radar dataset Open

bug

Difficulty 5/5 Over a week Newbie friendliness 35/100

ktwu01/benchmark-radar#585 · Opened Sep 9, 2026
[3 points] add VBench, VBench++, VBench-2.0, Evaluation Agent, Uni-MMMU Open

bug

Difficulty 2/5 1-3 hours Newbie friendliness 68/100

ktwu01/benchmark-radar#583 · 3 comments · Opened Sep 8, 2026
Suggestion Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

ktwu01/benchmark-radar#582 · Opened Sep 8, 2026
[24 points] model benchmark standard (MBS) Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

ktwu01/benchmark-radar#578 · Opened Sep 8, 2026
[3 points] condense UI of this page, dedup Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

ktwu01/benchmark-radar#571 · Opened Sep 7, 2026
Pareto frontier: is it limited to 70, or full 100? Open

Difficulty 3/5 1-2 days Newbie friendliness 55/100

ktwu01/benchmark-radar#570 · Opened Sep 7, 2026
[12 points] postmortem: data santinization. merge all data together Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

ktwu01/benchmark-radar#562 · 1 comment · Opened Sep 7, 2026
From observation to problem finding Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

ktwu01/benchmark-radar#558 · 1 reaction · Opened Sep 6, 2026
[6 points] 三次进入发现窗口、三次被丢弃：sunblaze-ucb/vero 漏采且无法补录 Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

ktwu01/benchmark-radar#555 · 2 comments · Opened Sep 5, 2026
Add OpenSSF security badges and trust signals Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

ktwu01/benchmark-radar#553 · Opened Sep 5, 2026
apply for https://developers.openai.com/community/codex-for-oss Open

fundraising

Difficulty 5/5 Over a week Newbie friendliness 1/100

ktwu01/benchmark-radar#552 · 1 comment · Opened Sep 5, 2026
apply for https://claude.com/contact-sales/claude-for-oss Open

fundraising

Difficulty 5/5 Over a week Newbie friendliness 1/100

ktwu01/benchmark-radar#551 · 2 comments · Opened Sep 5, 2026
做一个指数来beat AA Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

ktwu01/benchmark-radar#550 · Opened Sep 5, 2026
Tech report 里面的 related work，可以用我们自己做的 CLI 来查 related works Open

tech report

Difficulty 5/5 Over a week Newbie friendliness 35/100

ktwu01/benchmark-radar#549 · 1 comment · Opened Sep 5, 2026
从所有的benchmark repos里面找出来所有contributors Open

traction

Difficulty 5/5 Over a week Newbie friendliness 25/100

ktwu01/benchmark-radar#548 · 2 comments · Opened Sep 5, 2026
[3 points] add OpenAIRE info source Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

ktwu01/benchmark-radar#545 · 3 comments · Opened Sep 4, 2026
[3 points] add DataCite info source Open

Difficulty 4/5 3-5 days Newbie friendliness 66/100

ktwu01/benchmark-radar#544 · 3 comments · Opened Sep 4, 2026
SEO Loki Yan Open

traction

Difficulty 5/5 Over a week Newbie friendliness 15/100

ktwu01/benchmark-radar#543 · Opened Sep 4, 2026

Showing the newest 100

This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.

Open advanced filter

ktwu01

Showing the newest 100

Get new issues in your inbox