Finished tool call is dropped when a parallel tool's guardrail trips
Maintainers usually reply within 1 day
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 35/100
- Issue type
- Bug
- Clarity
- Clearly specified
- Activity status
- Stale
- Tech stack
- python
- Domain
- backend-api-design
Research direction
The report includes a complete ScriptedModel repro but does not name implementation or test files. Start by running the repro and tracing how parallel tool results are handled when the batch raises; check how run_data, session state, and input-list conversion retain completed calls and preceding reasoning items. Done means the run still raises while completed calls remain available to the next turn; an open pull request is already linked.
Written by the indexing model from the issue text.
Description
Please read this first
- Have you read the docs? Yes.
- Have you searched for related issues? Yes. #4125 and #5318 fixed similar losses, but this case still happens on
main.
Describe the bug
When parallel tool calls run and one of them ends the run with an exception, a call that already finished is dropped from the history.
For example, the model calls create_ticket and send_email together. create_ticket finishes. Then a tool input guardrail on send_email trips, and the run raises ToolInputGuardrailTripwireTriggered. The Session ends up with only the user message, so on the next turn the model creates the ticket again. gpt-5-mini did this 10 of 10 times. With a fix, it was 0 of 10.
The input was accepted and create_ticket really ran, so this isn't speculative work. The guardrails docs keep "already-completed tool call and tool output items" when an output guardrail trips. The same loss also happens with a tool output guardrail, with failure_error_function=None, and when on_tool_end raises.
A fix that worked for me: when the tool batch raises, record the outputs of calls that already finished before re-raising, and keep any reasoning item that comes before a kept call.
Debug information
- Agents SDK version: 0.23.1, and
mainat 71c2da4d - Python 3.12.13, macOS 15.6.1, openai 3.24.0
- Model: none, the repro uses
ScriptedModel - Reproduces on the latest release, every time
Repro steps
import asyncio
from agents import (Agent, RunHooks, Runner, SQLiteSession, ToolGuardrailFunctionOutput,
function_tool, set_tracing_disabled, tool_input_guardrail)
from agents.testing import ScriptedModel, assistant_message, function_call
ticket_created = asyncio.Event()
@function_tool
def create_ticket(order_id: str) -> str:
return f"ticket T-1 for {order_id}" # The ticket now exists.
@tool_input_guardrail
async def block_email(data) -> ToolGuardrailFunctionOutput:
await ticket_created.wait() # Trip only after create_ticket has finished.
return ToolGuardrailFunctionOutput.raise_exception(output_info="blocked")
@function_tool(tool_input_guardrails=[block_email])
def send_email(order_id: str) -> str:
return "sent"
class Hooks(RunHooks):
async def on_tool_end(self, context, agent, tool, result) -> None:
ticket_created.set()
def show(items: list) -> list[str]:
return [f"{i['type']}:{i['call_id']}" if "call_id" in i else i.get("role", "?") for i in items]
async def main() -> None:
calls = [function_call(n, {"order_id": "A1"}, call_id=f"call_{n}") for n in ("send_email", "create_ticket")]
model = ScriptedModel([calls, [assistant_message("ok")]])
agent = Agent(name="support", model=model, tools=[send_email, create_ticket])
session = SQLiteSession("demo")
try:
await Runner.run(agent, "Open a ticket for order A1 and email the customer.", session=session, hooks=Hooks())
except Exception as exc:
print("raised: ", type(exc).__name__, "| run_data.new_items:", len(exc.run_data.new_items))
print("session: ", show(await session.get_items()))
await Runner.run(agent, "Please finish the task.", session=session)
print("next request:", show(model.last_call.input))
set_tracing_disabled(True)
asyncio.run(main())
Output on 0.23.1 and on main:
raised: ToolInputGuardrailTripwireTriggered | run_data.new_items: 0
session: ['user']
next request: ['user', 'user']
Expected behavior
The run still raises, but the finished call stays in the Session, run_data, to_input_list() and to_state(), so the next turn sees it:
raised: ToolInputGuardrailTripwireTriggered | run_data.new_items: 2
session: ['user', 'function_call:call_create_ticket', 'function_call_output:call_create_ticket']
next request: ['user', 'function_call:call_create_ticket', 'function_call_output:call_create_ticket', 'user']
A reasoning item before a kept call has to stay too, or the Responses API rejects the next request.
I ran the repro on 0.23.1 and on main.
- Dominant language
- Python
- Stars
- 30k
- Forks
- 4.9k
- Avg merge
- 18h 13m
- Merged PRs (30d)
- 215
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from openai/openai-agents-python
-
Difficulty 2/5 1-3 hours Newbie friendliness 77/100
openai/openai-agents-python#5348 · 2 comments ·
Maintainers usually reply within 1 day
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
openai/openai-agents-python#5353 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 3/5 Half a day Newbie friendliness 70/100
openai/openai-agents-python#5342 · 3 comments ·
Maintainers usually reply within 1 day
-
enhancement
Difficulty 3/5 1-2 days Newbie friendliness 65/100
openai/openai-agents-python#5336 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
openai/openai-agents-python#5322 · 2 comments ·
Maintainers usually reply within 1 day
All issues in openai/openai-agents-python
Similar issues
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
Deltares/imod-python#1940 ·
Maintainers usually reply within 1 day
-
effort: low prio: low ready
Difficulty 1/5 Under an hour Newbie friendliness 82/100
digitalfabrik/integreat-cms#4621 ·
Maintainers usually reply within 5 days
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
Maintainers usually reply within 1 day
-
Difficulty 1/5 Under an hour Newbie friendliness 88/100
ioos/compliance-checker#1375 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
Maintainers usually reply within 1 day