What is the expected behavior of the adapter TracerTraceToTriplet?
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 35/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- python
- Domain
- ai, machine-learning
Research direction
Start at TracerTraceToTriplet.adapt and reproduce the behavior with trainer.dev using the spider example and LangGraph. Compare the collected span attributes with the generated Triplets, then trace how prompt, response, and reward fields are populated. Done means the expected field and reward lifecycle is established and documented or the affected behavior is corrected.
Written by the indexing model from the issue text.
Description
While inspecting the generated training data (and potentially modifying it), I ran trainer.dev and set a breakpoint in TracerTraceToTriplet.adapt. I noticed that although the span successfully collected the LLM’s prompt and response, the converted TracerToTriplet had empty prompt and response fields. Is this the intended behavior? If so, when will these fields be populated?
- span attributes:
- Triplets:
Additionally, I observed that only the last Triplet had a non-None reward. Will the other None rewards be filled later with the final reward? Also, if I manually assign non-None intermediate rewards to earlier steps here, will they be overwritten by the final reward?
Note: My project is based on the spider example, and the agent is implemented with LangGraph.
- Dominant language
- Python
- Stars
- 18.4k
- Forks
- 1.6k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 27
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from microsoft/agent-lightning
-
bug v0.x verl
Difficulty 1/5 Under an hour Newbie friendliness 68/100
microsoft/agent-lightning#492 ·
-
enhancement store v0.x
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
microsoft/agent-lightning#372 · 10 comments ·
-
Difficulty 3/5 1-2 days Newbie friendliness 72/100
microsoft/agent-lightning#593 · 6 comments ·
-
Difficulty 3/5 1-2 days Newbie friendliness 68/100
microsoft/agent-lightning#592 · 1 comment ·
-
Difficulty 3/5 1-2 days Newbie friendliness 35/100
microsoft/agent-lightning#570 ·
All issues in microsoft/agent-lightning
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100