Owner

monocle2ai

1 indexed repository · View on GitHub

monocle
Monocle is a framework for tracing GenAI app code. This repo contains implementation of Monocle for GenAI apps written in Python.

Python · 340 stars

Beginner friendly Everything

Open All

Update the check_eval API to take common parameter template which supports both string and path Open

Difficulty 3/5 1-2 days Newbie friendliness 58/100

monocle2ai/monocle#790 · 2 comments · Opened Aug 17, 2026
[BUG] OpenAI test-tools runner cannot be imported or return an Agents SDK result Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

monocle2ai/monocle#786 · Opened Aug 16, 2026
Update bedrock-agent core version to 1.6.1 Open

Difficulty 1/5 Under an hour Newbie friendliness 78/100

monocle2ai/monocle#719 · 5 comments · Opened Jul 14, 2026
Fluent test tool API should support has_attribute () Open

Difficulty 3/5 1-2 days Newbie friendliness 64/100

monocle2ai/monocle#714 · 4 comments · Opened Jul 13, 2026
scope.git.turn.* over-reports tracked-file changes (reports whole dirty tree, not the turn) Open

Difficulty 3/5 1-2 days Newbie friendliness 75/100

monocle2ai/monocle#690 · 2 comments · Opened Jul 7, 2026
Improve test generator to add additional types of assertions Open

Difficulty 3/5 1-2 days Newbie friendliness 52/100

monocle2ai/monocle#687 · 4 comments · Opened Jul 6, 2026
monocle_trace_method decorator should support an option to capture input/output Open

good first issue

Difficulty 3/5 1-2 days Newbie friendliness 68/100

monocle2ai/monocle#675 · 2 comments · Opened Jul 1, 2026
Add support for managing monocle traces in Nutanix object stores Open

monocle2ai/monocle#658 · 1 comment · 1 assignee · Opened Jun 24, 2026
Add Generic Template Support for Okahu Evals Open

Difficulty 2/5 1-3 hours Newbie friendliness 72/100

monocle2ai/monocle#654 · 1 comment · 1 reaction · Opened Jun 24, 2026
[Enhancement]: Add test attribute to distinguish test evaluations for the eval engines Open

Difficulty 3/5 1-2 days Newbie friendliness 38/100

monocle2ai/monocle#635 · 3 comments · Opened Jun 18, 2026
[Feature Request]: Custom instrumentation decorator variations — span-only and custom attributes Open

Difficulty 3/5 1-2 days Newbie friendliness 70/100

monocle2ai/monocle#634 · 1 comment · Opened Jun 18, 2026
[Feature Request]: Support reusing trace context for arbitrary Python runtimes Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

monocle2ai/monocle#632 · 1 comment · Opened Jun 18, 2026
Support non-LLM evals for monocle trace framework Open

monocle2ai/monocle#607 · 3 comments · 1 assignee · Opened Jun 8, 2026
Support export of monocle traces to dynatrace easily to match up agentic traces with infra metrics Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

monocle2ai/monocle#571 · 1 comment · Opened May 20, 2026
Guided Monocle install mission in KubeStellar Console Open

Difficulty 5/5 Over a week Newbie friendliness 10/100

monocle2ai/monocle#492 · 1 comment · Opened Mar 18, 2026
Guided Monocle install mission in KubeStellar Console Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

monocle2ai/monocle#490 · 1 comment · Opened Mar 17, 2026
Metamodel Missing Open

Difficulty 2/5 1-3 hours Newbie friendliness 58/100

monocle2ai/monocle#462 · 2 comments · Opened Feb 24, 2026
Inference span not visible in MS agent framework traces Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

monocle2ai/monocle#410 · Opened Jan 13, 2026
Tool name not visible in inference span for openai Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

monocle2ai/monocle#397 · Opened Jan 6, 2026
File Exporter not creating complete spans for llamaindex travel agent Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

monocle2ai/monocle#391 · Opened Dec 23, 2025
Add agent runner for llama index Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

monocle2ai/monocle#384 · 2 comments · Opened Dec 18, 2025
Add crew runner to test framework Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

monocle2ai/monocle#383 · 1 comment · Opened Dec 18, 2025
Add missing agent runners in the test framework Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

monocle2ai/monocle#382 · Opened Dec 18, 2025
Support http exporter as first class exporter for Monocle Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

monocle2ai/monocle#376 · Opened Dec 15, 2025
Allow multiple runs of a given test Open

monocle2ai/monocle#370 · 4 comments · 2 reactions · 1 assignee · Opened Dec 10, 2025
CrewAI finish_reason is always "stop" Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

monocle2ai/monocle#369 · Opened Dec 9, 2025
Enable Monocle test framework to configure any of the supported exported as part of test declarations Open

monocle2ai/monocle#349 · 1 assignee · Opened Nov 25, 2025
Capture agent session id as scope for AWS Strands agent Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

monocle2ai/monocle#342 · Opened Nov 21, 2025
Capture agent session id as scope for LlamaIndex Agent Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

monocle2ai/monocle#341 · Opened Nov 21, 2025
Support sampling of span capture for heartbeat operations Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

monocle2ai/monocle#338 · 2 comments · Opened Nov 19, 2025
Monocle test tool should set the test name as a scope so that it'll recorded in all spans generated by the tests Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

monocle2ai/monocle#336 · Opened Nov 19, 2025
Task 1058: fix assertion tests Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

monocle2ai/monocle#308 · Opened Oct 12, 2025
SDK- monocle Open

Difficulty 5/5 Over a week Newbie friendliness 10/100

monocle2ai/monocle#307 · Opened Oct 12, 2025
Multiple trace files are generated for one client request Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

monocle2ai/monocle#287 · Opened Sep 24, 2025
cannot access local variable 'parsed_provider_url' Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

monocle2ai/monocle#133 · 1 comment · 1 reaction · Opened Mar 3, 2025
[Doc] How to specify where to send the spans data to an external location? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

monocle2ai/monocle#106 · 1 comment · Opened Dec 12, 2024
[Feature] Enable Console Exporter with other Exporters Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

monocle2ai/monocle#83 · Opened Dec 4, 2024
Inconsistencies in cloud exporters Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

monocle2ai/monocle#75 · 2 comments · Opened Nov 15, 2024
Look into the naming of workflow_context_properties Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

monocle2ai/monocle#25 · 3 comments · Opened Aug 8, 2024

monocle2ai

Get new issues in your inbox