CLI is passing trancuated snippet from Tool result to LLM

Open
#1,000 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
45/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Quiet
Tech stack
java
Domain
ai, cli

Research direction

Start by tracing the CLI path that handles tool results and the telemetry showing token-based middle truncation. Verify the inline path at the 50KB threshold, then confirm that the full result is available to the LLM through a file while the preview remains inline.

Written by the indexing model from the issue text.

Description

enhancement

CLI is sending the trauncated tool result to LLM instead of writing the file to disk and read the entire text. This results in a incorrect response from LLM since it does not have the entire Tool Result in the context

At 50KB threshold (inline path):
• The tool result was under 50KB, so the CLI passed it inline to the LLM as textResultForLlm
• But the CLI applies token-based truncation before sending to the LLM — you can see this in the telemetry: "truncateBasedOn":"tokenCount","truncateStyle":"middle"
• The LLM receives a truncated version and has no way to read the rest — the full text only existed in memory, never on disk

The real gap is that there's no hybrid: "inline a truncated preview AND save the full content to a file so the LLM can read more if needed." That would be the ideal behavior,

Dominant language
Java
Stars
10.5k
Forks
1.5k
Avg merge
1d 12h
Merged PRs (30d)
133

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from github/copilot-sdk

All issues in github/copilot-sdk

Similar issues

More Java issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.