[Bug] Anthropic models: tool calls fail with "Input tag 'input_json_delta' ... does not match any of the expected tags" (streamed tool_use never assembled)
Personne n'a encore pris cette issue.
Évaluation
- Difficulté
- 4/5
- Temps estimé
- 3-5 jours
- Accessibilité débutants
- 68/100
- Type d'issue
- Bug
- Clarté
- Clairement spécifiée
- Activité
- Active
- Stack technique
- python
- Domaine
- ai, backend-api-design
Piste de recherche
Commencez dans apps/application/flow/tools.py, à _yield_mcp_response(), puis recherchez dans l’arborescence input_json_delta et partial_json comme indiqué. Reproduisez un appel d’outil Anthropic diffusé en streaming et comparez-le au provider fonctionnel structuré comme OpenAI ; c’est terminé lorsque la valeur de l’outil atteint la réponse sans Anthropic BadRequestError.
Rédigé par le modèle d'indexation à partir du texte de l'issue.
Description
MaxKB Version
v2.10.4-lts (also reproduced on v2.10.2-lts)
Problem Description
When an application has a custom tool attached and uses an Anthropic model (model_anthropic_provider), every message that triggers a tool call fails. The Anthropic API rejects MaxKB's follow-up request:
BadRequestError: Error code: 400 - {'type': 'error', 'error': {'type': 'invalid_request_error',
'message': "messages.1.content.1: Input tag 'input_json_delta' found using 'type' does not match any of the expected tags"}}
and, in the other variant:
BadRequestError: Error code: 400 - {'type': 'error', 'error': {'type': 'invalid_request_error',
'message': 'messages: text content blocks must be non-empty'}}
MaxKB returns this to the caller as HTTP 200 with the error text as the answer body, so it reaches end users as the assistant's reply.
Cause
input_json_delta is an Anthropic streaming event type, not a message content type. Anthropic streams tool arguments as a series of content_block_delta events of type input_json_delta, each carrying a partial_json fragment. These must be accumulated and assembled into a completed tool_use content block before the assistant turn is replayed in messages.
MaxKB appears to replay the raw streamed deltas instead. A search of the v2.10.4-lts tree finds no handling for either field:
grep -rn "input_json_delta\|partial_json" apps/ # zero hits
_yield_mcp_response() in apps/application/flow/tools.py handles only OpenAI-shaped tool deltas (tool_call_chunks / tool_calls / invalid_tool_calls). There is no branch for Anthropic content blocks, which is consistent with both error messages: the unassembled delta is sent verbatim, and the accompanying text block is empty.
Steps to Reproduce
- Register an Anthropic model (reproduced with
claude-sonnet-5,model_anthropic_provider). - Create a SIMPLE agent using that model.
- Create a custom Python tool and attach it (
tool_enable: true), e.g.
def live_price(query):
return 'DJI Neo: 4242.42 GEL, in stock.'
- Set the system prompt so the tool is actually used, e.g. "For any question about price or stock you MUST call the live_price tool."
- Call the OpenAI-compatible endpoint with
stream: true(required — with tools attached,stream: falseis unsupported per #6300 / #4846 / #4363):
curl -N "$MAXKB/chat/api/$APP_ID/chat/completions" \
-H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
-d '{"model":"gpt-3.5-turbo","stream":true,"messages":[{"role":"user","content":"How much is the DJI Neo?"}]}'
Expected: the answer quotes the tool's value (4242.42 GEL).
Actual: the answer is the BadRequestError text above.
The same setup works on an OpenAI-shaped provider
Identical agent, identical tool, identical prompt, only the model swapped to model_openai_provider (gpt-4o-mini): no error, and the answer contains 4242.42 GEL, confirming the tool executed. This isolates the defect to the Anthropic provider's streamed tool-call handling rather than to tools, sandboxing, or the endpoint.
Impact
Custom tools and MCP cannot be used at all with Anthropic models. Because tools require stream: true, and streaming is exactly where the assembly fails, there is no working combination for Anthropic users.
Tested on v2.10.2-lts and v2.10.4-lts (CE), Docker, single-node.
- Langage dominant
- Python
- Étoiles
- 22.8k
- Forks
- 3.2k
- Merge moyen
- 46 min
- PR mergées (30 j)
- 322
Guide de contribution
Ouvrir le guide de contribution
Par où commencer
- Lisez l'issue en entier, puis le guide de contribution du projet.
- Signalez en commentaire que vous la prenez — cela évite que deux personnes fassent le même travail.
- Forkez le dépôt et travaillez sur une branche.
- Ouvrez une pull request qui référence le numéro de l'issue.
Autres issues de 1Panel-dev/MaxKB
-
1Panel-dev/MaxKB#7143 · 1 personne assignée ·
-
Difficulté 3/5 1-2 jours Accessibilité débutants 72/100
1Panel-dev/MaxKB#7081 · 1 commentaire ·
-
Status: Awaiting Feedback
1Panel-dev/MaxKB#7069 · 9 commentaires · 1 personne assignée ·
-
Type: Bug
1Panel-dev/MaxKB#7062 · 2 commentaires · 1 personne assignée ·
-
1Panel-dev/MaxKB#7053 · 1 personne assignée ·
Toutes les issues de 1Panel-dev/MaxKB
Issues similaires
-
[Bug] reef-hermes tells me to resume with hermes --resume, which does not work from my shell Ouvertearea: harness bug status: needs-triage
Difficulté 2/5 1-3 heures Accessibilité débutants 75/100
Human-Agent-Society/reef#625 ·
-
Difficulté 2/5 1-3 heures Accessibilité débutants 70/100
-
Difficulté 1/5 Moins d'une heure Accessibilité débutants 80/100
learningequality/kolibri#15351 · 2 commentaires ·
-
Difficulté 2/5 1-3 heures Accessibilité débutants 75/100
-
Name consistency Ouverte
Difficulté 2/5 1-3 heures Accessibilité débutants 75/100
eellak/triplestore#65 · 1 commentaire ·