Owner
future-agi
1 indexed repository · View on GitHub
-
future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · ...
Python · 2032 stars
Issues somebody may already be working on are listed last. List everything by date
-
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
future-agi/future-agi#4092 · 1 comment ·
Maintainers usually reply within 1 day
-
accepted backend bug evaluations
Difficulty 2/5 1-3 hours Newbie friendliness 80/100
future-agi/future-agi#4090 ·
Maintainers usually reply within 1 day
-
feat(evaluations): add deterministic SymbolicMath function evaluator for exact math verificationOpen
Difficulty 4/5 3-5 days Newbie friendliness 18/100
future-agi/future-agi#4053 ·
Maintainers usually reply within 1 day
-
accepted backend
Difficulty 3/5 Half a day Newbie friendliness 30/100
future-agi/future-agi#4041 ·
Maintainers usually reply within 1 day
-
Difficulty 3/5 1-2 days Newbie friendliness 52/100
future-agi/future-agi#4028 ·
Maintainers usually reply within 1 day
-
Difficulty 4/5 3-5 days Newbie friendliness 38/100
future-agi/future-agi#3871 ·
Maintainers usually reply within 1 day
-
accepted enhancement
Difficulty 5/5 Over a week Newbie friendliness 15/100
future-agi/future-agi#3779 ·
Maintainers usually reply within 1 day
-
Difficulty 1/5 1-3 hours Newbie friendliness 25/100
future-agi/future-agi#3751 ·
Maintainers usually reply within 1 day
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
future-agi/future-agi#3734 ·
Maintainers usually reply within 1 day
-
Difficulty 5/5 Over a week Newbie friendliness 24/100
future-agi/future-agi#3733 ·
Maintainers usually reply within 1 day
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
future-agi/future-agi#3732 ·
Maintainers usually reply within 1 day
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
future-agi/future-agi#3728 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 4/5 3-5 days Newbie friendliness 15/100
future-agi/future-agi#3717 ·
Maintainers usually reply within 1 day
-
Difficulty 4/5 3-5 days Newbie friendliness 12/100
future-agi/future-agi#3716 ·
Maintainers usually reply within 1 day
-
[Bug] : The "Ask AI" Button Cover the "Security" text in the footer Section in the right cornerMay be free again @prabhtheone claimed this 11 days ago, and no pull request is open. Openbug
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
future-agi/future-agi#3690 · 2 comments ·
Maintainers usually reply within 1 day
-
accepted
Difficulty 5/5 Over a week Newbie friendliness 1/100
future-agi/future-agi#3674 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 35/100
future-agi/future-agi#3673 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 25/100
future-agi/future-agi#3579 ·
Maintainers usually reply within 1 day
-
Guardrails: argument-aware "approval" provider (escalate risky tool calls based on their arguments)May be free again @BhanuNidumolu claimed this 24 days ago, and no pull request is open. Openfeature
Difficulty 5/5 Over a week Newbie friendliness 35/100
future-agi/future-agi#3541 · 2 comments ·
Maintainers usually reply within 1 day
-
TH-8038: expose grounded environment contract evidenceMay be free again @pratikverse claimed this 24 days ago, and no pull request is open. Openaccepted feature
Difficulty 4/5 3-5 days Newbie friendliness 45/100
future-agi/future-agi#3441 · 1 comment ·
Maintainers usually reply within 1 day
-
accepted
Difficulty 3/5 1-2 days Newbie friendliness 20/100
future-agi/future-agi#3440 · 1 comment ·
Maintainers usually reply within 1 day
-
fix(observe): recover missing property picker attributes during catalog rolloutMay be free again @karthikeya1220 claimed this 15 days ago, and no pull request is open. Openaccepted
Difficulty 3/5 1-2 days Newbie friendliness 53/100
future-agi/future-agi#3434 · 2 comments ·
Maintainers usually reply within 1 day
-
feature
Difficulty 5/5 Over a week Newbie friendliness 39/100
future-agi/future-agi#3425 ·
Maintainers usually reply within 1 day
-
accepted
Difficulty 5/5 Over a week Newbie friendliness 12/100
future-agi/future-agi#3406 ·
Maintainers usually reply within 1 day
-
accepted
Difficulty 3/5 1-2 days Newbie friendliness 75/100
future-agi/future-agi#3381 ·
Maintainers usually reply within 1 day
-
fi-collector standalone compose cannot ingest: auth requires unseeded Postgres, project_name attr undocumented, non-UUID IDs silently dead-letterMay be free again @pratikverse claimed this 22 days ago, and no pull request is open. Open
Difficulty 4/5 3-5 days Newbie friendliness 56/100
future-agi/future-agi#3321 · 1 comment ·
Maintainers usually reply within 1 day
-
WER/CER evals: add text normalization and CJK-aware tokenization (punctuation, full-width digits and spacing count as errors today)May be free again @par73e claimed this 25 days ago, and no pull request is open. Open
Difficulty 4/5 3-5 days Newbie friendliness 48/100
future-agi/future-agi#3320 · 3 comments ·
Maintainers usually reply within 1 day
-
accepted
Difficulty 4/5 3-5 days Newbie friendliness 58/100
future-agi/future-agi#3182 ·
Maintainers usually reply within 1 day
-
accepted
Difficulty 4/5 3-5 days Newbie friendliness 35/100
future-agi/future-agi#3178 ·
Maintainers usually reply within 1 day
-
bug
Difficulty 5/5 Over a week Newbie friendliness 38/100
future-agi/future-agi#3160 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 3/5 1-2 days Newbie friendliness 58/100
future-agi/future-agi#3126 · 3 comments ·
Maintainers usually reply within 1 day
-
Difficulty 4/5 3-5 days Newbie friendliness 52/100
future-agi/future-agi#3082 ·
Maintainers usually reply within 1 day
-
Difficulty 4/5 3-5 days Newbie friendliness 38/100
future-agi/future-agi#2962 ·
Maintainers usually reply within 1 day
-
Difficulty 4/5 3-5 days Newbie friendliness 42/100
future-agi/future-agi#2955 ·
Maintainers usually reply within 1 day
-
accepted
Difficulty 5/5 Over a week Newbie friendliness 12/100
future-agi/future-agi#2894 ·
Maintainers usually reply within 1 day
-
Tool `strict` is stored in the canonical request but has no field in the Anthropic or Gemini tool typesMay be free again @hadarishav claimed this 56 days ago, and no pull request is open. Openbug
future-agi/future-agi#2890 · 1 assignee ·
Maintainers usually reply within 1 day
-
Falcon AI message rate limiter rejects stop cancellation commandsMay be free again @hadarishav claimed this 57 days ago, and no pull request is open. Open
future-agi/future-agi#2878 · 1 assignee ·
Maintainers usually reply within 1 day
-
Falcon AI stream error frames without message_id fail to surface on active messageMay be free again @hadarishav claimed this 57 days ago, and no pull request is open. Open
future-agi/future-agi#2877 · 1 assignee ·
Maintainers usually reply within 1 day
-
docs: add Chinese README translationMay be free again @hadarishav claimed this 59 days ago, and no pull request is open. Open
future-agi/future-agi#2852 · 1 assignee ·
Maintainers usually reply within 1 day
-
All four aggregate projections on spans store a doubled -State, so no naturally-written aggregate can match them and every such query silently full-scansMay be free again @par73e claimed this 25 days ago, and no pull request is open. Open
Difficulty 5/5 Over a week Newbie friendliness 35/100
future-agi/future-agi#2842 ·
Maintainers usually reply within 1 day
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
future-agi/future-agi#2839 · 4 comments ·
Maintainers usually reply within 1 day
-
test_ch25_typed_json_roundtrip has never run in CI, and its column-type contract may conflict with the test compose fileMay be free again @ZYZ666-RGB claimed this 59 days ago, and no pull request is open. Open
Difficulty 3/5 1-2 days Newbie friendliness 68/100
future-agi/future-agi#2829 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
future-agi/future-agi#2825 ·
Maintainers usually reply within 1 day
-
feat: add CI triage for grouping related issues and pull requestsMay be free again @hadarishav claimed this 60 days ago, and no pull request is open. Open
future-agi/future-agi#2816 · 1 assignee ·
Maintainers usually reply within 1 day
-
Difficulty 5/5 Over a week Newbie friendliness 32/100
future-agi/future-agi#2802 ·
Maintainers usually reply within 1 day
-
Notification sanitizer uses regex blacklist on dangerouslySetInnerHTML sinkMay be free again @hadarishav claimed this 60 days ago, and no pull request is open. Open
future-agi/future-agi#2795 · 1 assignee ·
Maintainers usually reply within 1 day
-
simulate_chat loops forever when models never say "topic resolved"May be free again @hadarishav claimed this 60 days ago, and no pull request is open. Openbug
future-agi/future-agi#2790 · 1 comment · 1 assignee ·
Maintainers usually reply within 1 day
-
agentic_eval: calculate_rouge (RougeScore) returns result as a string, so it can never be flagged as a failureMay be free again @hadarishav claimed this 63 days ago, and no pull request is open. Open
future-agi/future-agi#2738 · 1 assignee ·
Maintainers usually reply within 1 day
-
Observe: attribute-filtered trace list never loads on high-volume projects (short-string SPAN_ATTRIBUTE filters)May be free again @modelpath-dev claimed this 64 days ago, and no pull request is open. Open
Difficulty 5/5 Over a week Newbie friendliness 10/100
future-agi/future-agi#2734 · 10 comments ·
Maintainers usually reply within 1 day
-
agentcc-gateway README: the "fully reproducible" benchmark harness (bench/) is not in the repoMay be free again @hadarishav claimed this 64 days ago, and no pull request is open. Open
future-agi/future-agi#2705 · 1 comment · 1 assignee ·
Maintainers usually reply within 1 day
Showing the newest 100
This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.