Owner

future-agi

1 indexed repository · View on GitHub

future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · ...

Python · 2032 stars

Beginner friendly Everything

Open All

Falcon says it built a dashboard, but nothing appears on the Dashboards page Open

accepted

Difficulty 3/5 1-2 days Newbie friendliness 65/100

future-agi/future-agi#3028 · Opened Sep 24, 2026
Run Prompt fails on every row when a tool from the Datasets form is attached Open

accepted

Difficulty 3/5 1-2 days Newbie friendliness 70/100

future-agi/future-agi#3027 · Opened Sep 24, 2026
Test settings and several test modules default ClickHouse to port 19000 and run DDL there Open

backend bug infra

Difficulty 3/5 1-2 days Newbie friendliness 45/100

future-agi/future-agi#3023 · Opened Sep 24, 2026
Observe graphs answer 500 when ClickHouse closes the connection mid-response (EOFError is not classified) Open

backend bug tracing

Difficulty 2/5 1-3 hours Newbie friendliness 65/100

future-agi/future-agi#3022 · Opened Sep 24, 2026
Security: 2 Critical RCEs + 3 High-Severity Vulnerabilities in code-executor, authentication, and integrations Open

future-agi/future-agi#3011 · 1 comment · 1 assignee · Opened Sep 23, 2026
fix(evals): eval tasks cannot recover stranded work and report skipped rows as completed Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 45/100

future-agi/future-agi#2986 · 1 comment · Opened Sep 22, 2026
perf(observe): release train 6, the older Observe read-path fixes Open

accepted

Difficulty 5/5 Over a week Newbie friendliness 20/100

future-agi/future-agi#2977 · Opened Sep 22, 2026
fix(observe): advertised boolean operators on presence metrics do not compile Open

accepted

Difficulty 3/5 1-2 days Newbie friendliness 65/100

future-agi/future-agi#2976 · Opened Sep 22, 2026
fix(observe): a dashboard widget publishes pending when no refresh is running Open

accepted

Difficulty 3/5 1-2 days Newbie friendliness 65/100

future-agi/future-agi#2975 · Opened Sep 22, 2026
fix(observe): dashboard eval and annotation filters compile against the wrong value type Open

accepted

Difficulty 3/5 1-2 days Newbie friendliness 65/100

future-agi/future-agi#2974 · Opened Sep 22, 2026
fix(observe): bound and declare dashboard breakdown series cardinality Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 45/100

future-agi/future-agi#2973 · Opened Sep 22, 2026
fix(observe): a filtered Session cursor emits pages that deliver nothing Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 45/100

future-agi/future-agi#2972 · Opened Sep 22, 2026
fix(observe): state exactness on every list page, not only completeness Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 45/100

future-agi/future-agi#2971 · Opened Sep 22, 2026
fix(observe): an empty bounded checkpoint must not be labelled a complete query Open

accepted

Difficulty 3/5 1-2 days Newbie friendliness 65/100

future-agi/future-agi#2970 · Opened Sep 22, 2026
OSS fresh install: the first account is unreachable and the installer reports the wrong outcome Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 65/100

future-agi/future-agi#2965 · Opened Sep 22, 2026
fix: Rule B continuation on the session list drops the matches it classified when seed order and result order differ Open

accepted

Difficulty 5/5 Over a week Newbie friendliness 35/100

future-agi/future-agi#2963 · Opened Sep 22, 2026
Legacy CDC Replicated tables collide across databases on one ClickHouse instance (unscoped ZK replica paths); failure silently swallowed by schema-apply try/except Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

future-agi/future-agi#2962 · Opened Sep 22, 2026
perf: Observe release train 5, the candidate-based lanes (#2883 to #2893, #2950) Open

accepted

Difficulty 5/5 Over a week Newbie friendliness 25/100

future-agi/future-agi#2957 · Opened Sep 22, 2026
test: ClickHouse v2 schema apply races Django app startup on a fresh server; one session test diverges locally from CI Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

future-agi/future-agi#2955 · Opened Sep 22, 2026
perf: Observe release train 4, the list rules and lanes (#2812 to #2882) Open

accepted

Difficulty 5/5 Over a week Newbie friendliness 20/100

future-agi/future-agi#2954 · Opened Sep 22, 2026
perf: Users pages filtered on a picked JSON-looking string read the unfiltered whole window; a picked string should match string storage raw and take the matching walk Open

accepted

Difficulty 5/5 Over a week Newbie friendliness 25/100

future-agi/future-agi#2953 · Opened Sep 22, 2026
perf: Observe release train 3, the dev-based Observe fixes (#2783 to #2815, #2797, #2803) Open

accepted

Difficulty 5/5 Over a week Newbie friendliness 25/100

future-agi/future-agi#2952 · Opened Sep 22, 2026
perf: Observe release train 2, the remainder of the filter stack (#2741 to #2749) Open

accepted

Difficulty 5/5 Over a week Newbie friendliness 20/100

future-agi/future-agi#2951 · Opened Sep 22, 2026
perf: user-detail Sessions page with a scalar-attribute filter probes and slices a statement no slice can narrow Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 48/100

future-agi/future-agi#2949 · Opened Sep 22, 2026
Use a platform-owned AgentCC key for hosted harness authoring Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 55/100

future-agi/future-agi#2941 · Opened Sep 21, 2026
Add Google Vertex AI as an AgentCC provider Open

accepted

future-agi/future-agi#2928 · 1 assignee · Opened Sep 21, 2026
bug: alert monitor formats a missing project id as the string 'None' and fails every run Open

Difficulty 3/5 1-2 days Newbie friendliness 72/100

future-agi/future-agi#2925 · Opened Sep 21, 2026
fix: Observe filtered search on a dense project never fills for a short, rare attribute value (production report, 21 Sep) Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 35/100

future-agi/future-agi#2924 · Opened Sep 21, 2026
perf: user-detail traces classifier binds its candidate batch bare Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 10/100

future-agi/future-agi#2921 · Opened Sep 21, 2026
fix(observe): the users graph and the dashboard pick their lane before spending the wall Open

accepted

Difficulty 5/5 Over a week Newbie friendliness 10/100

future-agi/future-agi#2920 · Opened Sep 21, 2026
fix: span and voice lists keep long attribute filters inside the parser limit Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 15/100

future-agi/future-agi#2919 · Opened Sep 21, 2026
perf: session list typed-attribute pages take the bounded walk Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 15/100

future-agi/future-agi#2918 · Opened Sep 21, 2026
perf: filtered user lists walk newest matching activity and total only the published users Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 15/100

future-agi/future-agi#2917 · Opened Sep 21, 2026
perf: list routes return a partial page at their own five-second wall Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 25/100

future-agi/future-agi#2916 · Opened Sep 21, 2026
perf: memory failures on user listings and mid-tenant dashboard widgets Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 15/100

future-agi/future-agi#2915 · Opened Sep 21, 2026
perf: span list gives wide seed slices the population worker budget Open

accepted

Difficulty 3/5 1-2 days Newbie friendliness 15/100

future-agi/future-agi#2914 · Opened Sep 21, 2026
perf: preview surfaces bound the ten-leaf conjunction Open

accepted

Difficulty 5/5 Over a week Newbie friendliness 15/100

future-agi/future-agi#2913 · Opened Sep 21, 2026
perf: user-detail sessions residual at long windows Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 15/100

future-agi/future-agi#2912 · Opened Sep 21, 2026
fix(observe): a filtered graph picks its lane from the index, not from the wall it is about to spend Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 10/100

future-agi/future-agi#2911 · Opened Sep 21, 2026
fix: read unfiltered span metrics from spans, not the hourly rollup Open

accepted

Difficulty 3/5 1-2 days Newbie friendliness 15/100

future-agi/future-agi#2910 · Opened Sep 21, 2026
fix: dashboard drops the attr-rollup latency route its own trace rule forbids Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 15/100

future-agi/future-agi#2909 · Opened Sep 21, 2026
perf: workspace and project user listings bound their scan Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 20/100

future-agi/future-agi#2908 · Opened Sep 21, 2026
perf: span list keeps the probe witness and gains a costed seed width Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 15/100

future-agi/future-agi#2907 · Opened Sep 21, 2026
perf: session list resolves latest state over a bounded slice, not the whole window Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 15/100

future-agi/future-agi#2906 · Opened Sep 21, 2026
perf: trace list bounds long-text negation and presence lanes Open

accepted

Difficulty 5/5 Over a week Newbie friendliness 10/100

future-agi/future-agi#2905 · Opened Sep 21, 2026
perf: user-detail traces seeds one user inside the request window Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 15/100

future-agi/future-agi#2904 · Opened Sep 21, 2026
perf: session list conjunction walk stops paying per-slice round trips Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 20/100

future-agi/future-agi#2903 · Opened Sep 21, 2026
perf: users graph reads or schedules with a background thread budget Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 20/100

future-agi/future-agi#2902 · Opened Sep 21, 2026
perf: users graph resolves latest state in one ordered pass without FINAL Open

accepted

Difficulty 5/5 Over a week Newbie friendliness 15/100

future-agi/future-agi#2901 · Opened Sep 21, 2026
perf: cost-gated exact routing for dashboard trace metrics Open

accepted

Difficulty 4/5 3-5 days Newbie friendliness 20/100

future-agi/future-agi#2900 · Opened Sep 21, 2026

Showing the newest 100

This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.

Open advanced filter

future-agi

Showing the newest 100

Get new issues in your inbox