Hacktoberfest 2026: the issues maintainers tagged for October, open and beginner-friendly. Browse Hacktoberfest issues

Support the OpenAI Decisions API

Open
#5,353 0 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
25/100
Issue type
Feature
Clarity
Clearly specified
Activity status
Active
Tech stack
python
Domain
ai, backend

Research direction

The issue names agents.models.openai_decisions/, tests/models/openai_decisions/, docs/decisions.md, and examples/decisions/ as implementation, test, documentation, and example entry points. Start by reviewing the linked implementation branch and its tests, then check how the SDK handles providers, tool input guardrails, needs_approval, and Agent.clone. Done means the typed client, tool risk gate, routing example, and documentation work together with the stated compatibility change.

Written by the indexing model from the issue text.

Description

Please read this first
  • Have you read the docs? Yes. The SDK has no support for the Decisions API today.
  • Have you searched for related issues? Yes. No existing issue or PR covers the Decisions API, in this repo or in openai/openai-agents-js.
Describe the feature

Add support for OpenAI's Decisions API (POST /v1/decisions, public beta since 2026-10-06, model gpt-6-luna) to the Agents SDK:

  1. A typed client for asking predicate, choice, and score questions and reading typed answers by name.
  2. An auto-mode tool risk gate that classifies each call to a guarded function tool before it runs, and either blocks risky calls or sends them to human approval.
  3. A documented routing recipe for picking a model per run.

A complete implementation is available as a possible solution: martimfasantos/openai-agents-python#1 (branch feat/openai-decisions-api). I can't open a pull request here because PRs are limited to collaborators. I'd be glad to open one if you grant access, or a maintainer is welcome to take the branch as is.

Motivation

Agents constantly make small judgment calls around the main model: is this request in scope, which model should handle it, is this tool call safe to run. Today the SDK's answer is another agent with a structured output type (as in examples/agent_patterns/input_guardrails.py), which costs a full generation per check and returns free-form confidence.

The Decisions API is built for exactly these calls. According to the guide, it:

  • answers named questions about an input with typed answers and probabilities instead of generated text;
  • is roughly 10x faster than the Responses API;
  • bills input tokens only ($0.10 per 1M), with no output-token charges;
  • returns a per-question refusal instead of failing the whole request.

LangChain already shipped an integration in langchain-openai 1.7.0 (docs, langchain-ai/langchain#41125) with a client, a model router, and an auto-mode middleware. Agents SDK users currently have no equivalent. The proposal below brings the same capabilities through the SDK's existing seams (input guardrails, tool input guardrails, needs_approval, agent.clone) instead of new runtime machinery.

Proposed API

Everything is importable from agents.models.openai_decisions, a package split by concern (questions.py, result.py, client.py, auto_mode.py) that re-exports its public names from __init__.py, following the SDK's package convention (agents.testing, agents.realtime). Nothing is re-exported from top-level agents, so the beta surface stays out of the released API contract until the Decisions API reaches GA.

Client and questions

from agents.models.openai_decisions import Choice, Level, OpenAIDecisions, Predicate, Score

decisions = OpenAIDecisions("gpt-6-luna")  # optional: openai_client=AsyncOpenAI(...)

result = await decisions.decide(
    "The deploy failed twice and customers see 500 errors at checkout.",
    {
        "urgent": Predicate("Does this need attention right now?"),
        "team": Choice(
            "Which team should own this?",
            {"infra": "Servers, deploys, and uptime.", "billing": "Payments and invoices."},
        ),
        "severity": Score(
            "How severe is the impact?",
            ["Cosmetic", Level("Degraded", "Slower or partly broken."), "Down"],
        ),
    },
    safety_identifier="user-123",  # optional, forwarded to the API
)

result.predicates["urgent"].probability  # 0.91
result.choices["team"].choice            # "infra"
result.scores["severity"].score          # 1.2 (probability-weighted level index)
result.refusals                          # questions the model declined to answer
result.usage, result.request_id
Piece Behavior
Predicate, Choice, Score, Level Frozen dataclasses that serialize to the openai SDK's request types. Choice values may be strings or booleans; descriptions are optional and omitted from the wire when absent. Question names are the mapping keys, so they are unique by construction.
OpenAIDecisions Calls the typed client.decisions.create. The client is resolved lazily, in the same order as OpenAIProvider: the injected client, then set_default_openai_client, then a new AsyncOpenAI using set_default_openai_key or OPENAI_API_KEY on the SDK's shared HTTP pool. Base URL, timeout, retries, and headers are configured on the AsyncOpenAI instance, as elsewhere in the SDK.
DecisionResult answers keyed by question name, using the openai SDK's answer models directly (no duplicated schema, forward compatible with new fields), plus typed views predicates, choices, scores, refusals, and model, usage, request_id.

API-enforced limits (1–200 questions, 2–255 choices, 2–10 levels, input size) are not duplicated client-side; the API rejects invalid requests with its own errors.

Auto mode (tool risk gate)

from agents import Agent
from agents.models.openai_decisions import OpenAIAutoMode

auto_mode = OpenAIAutoMode(model="gpt-6-luna")  # on_risky="reject_content" by default
agent = Agent(name="Files", tools=[*auto_mode.guard([read_file, delete_file])])

# Or escalate risky calls to the existing human-approval flow instead of blocking them:
approving = OpenAIAutoMode(model="gpt-6-luna", on_risky="require_approval", threshold=0.6)
  • guard(tools) returns copies of function tools (the same copy pattern as tool_namespace()); the originals are not modified.
  • Each guarded call asks one is_risky predicate. The classifier sees the run input (the latest 30 items, with images, files, audio, screenshots, and generated images replaced by placeholders), the namespace-qualified tool name, the raw arguments, and the tool description. The default instructions tell it to treat all of that as data and to accept authorization only from explicit user messages.
  • on_risky="reject_content" adds a tool input guardrail: a risky call is not executed, and the model receives a message saying it was blocked.
  • on_risky="require_approval" sets needs_approval: risky calls pause the run as a standard ToolApprovalItem interruption, safe calls run without approval, and an approved call is not classified again on resume.
  • It fails closed: a refusal or missing answer counts as risky, and a Decisions API error stops the run before the tool executes.
  • threshold (default 0.5, LangChain's value) is a parameter because the guide recommends setting thresholds from labelled data.

Routing recipe

route = await decisions.decide(question, {"route": Choice("Which model should answer?", {"fast": "...", "powerful": "..."})})
answer = route.choices.get("route")
model = MODELS[str(answer.choice)] if answer else MODELS["fast"]
result = await Runner.run(agent.clone(model=model), question)

Routing ships as an example rather than a router Model. I implemented and reviewed a Model that classifies once per run and delegates to the chosen model, then removed it. A Model that wraps other models cannot see server-held history after a handoff or resume (with previous_response_id or conversation_id), would resolve model names outside the run's provider, and has to forward settings, retries, streams, and cleanup itself. The pre-run recipe has none of those problems, and Agent.clone re-derives the chosen model's default settings.

Documented limitations
  • Inside an agent run through Agent.as_tool(), the input was written by the calling agent, so guard the outer agent tool rather than the inner agent's tools.
  • With on_risky="require_approval", calls whose arguments the SDK has to convert (enums, dates, models, omitted defaults) always pause for approval without being classified, because the SDK skips needs_approval for them. This fails closed; reject_content classifies every call.
  • Authorization given only inside an attachment, or older than the latest 30 input items, is not seen by the classifier.
  • In approval mode, apply tool_namespace() before guard() so classification uses the namespaced name.
  • RealtimeSession does not populate turn_input, so realtime tool calls are classified without conversation context.
Compatibility
  • The openai floor rises from >=3.0.0 to >=3.26.0, the first release with the typed client.decisions resource (same major version). The lock moves to openai 3.29.0 and jiter 0.17.0.
  • Because of that floor, agents.testing.ScriptedModel no longer sets name on scripted response.function_call_arguments.done events. The field is not part of that event type in openai>=3.26, and nothing in the SDK reads it.
  • No released public API changes.
Testing and review on the branch
  • .agents/skills/code-change-verification/scripts/run.sh: format, lint, mypy, pyright, and make tests pass (12167 passed, 38 skipped).
  • tests/models/openai_decisions/ (19 tests across test_client.py, test_auto_mode.py, test_exports.py): the exact request body and answer parsing for every question type, client resolution order, both auto-mode modes, fail-closed paths, approval resume without re-classification, media stripping, JSON schemas in replayed history, namespaced tool names, the context cap, guarded copies leaving originals untouched, and the package's public exports.
  • tests/models/openai_decisions/test_live.py: opt-in live check (OPENAI_RUN_LIVE_DECISIONS_TESTS=1).
  • examples/decisions/: classify.py (all question types plus a predicate-backed @input_guardrail), tool_risk_gate.py (both auto-mode modes), and model_router.py (the routing recipe).
  • The change went through this repo's high-risk $implementation-final-review process, with two independent reviewers per round, until both returned clean reviews on the final content. It also incorporates the relevant review feedback from langchain-ai/langchain#41125: SDK-native types instead of custom ones, a bounded classification context, and documented media handling.
  • The branch also includes a guide (docs/decisions.md) and an API reference page as separate docs: commits, which can be split into a docs-only PR to match the Documentation Release Timing rule.
Dominant language
Python
Stars
29.9k
Forks
4.8k
Avg merge
22h 17m
Merged PRs (30d)
208

Getting set up

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from openai/openai-agents-python

All issues in openai/openai-agents-python

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.