Chat hangs on "Waiting model" when LLM stream stalls - STOP cannot interrupt blocked I/O
维护者通常 2 天内回复
还没有人认领这个 Issue。
评估
调研方向
Start by reading chat.clj, llm_api.clj, and the streaming provider files to trace how STOP is handled and where each provider reads the response stream. The issue proposes storing the stream for cancellation; verify how that fits the existing callbacks and error handling. Done means STOP cancels a stalled stream, returns chat to idle, and allows a new message.
由索引模型根据 Issue 内容生成。
描述
To upvote this issue, give it a thumbs up. See this list for the most upvoted issues.
This ticket has been created by ECA. There is currently no known way how to reproduce this bug. It just randomly appears (with no error) so I asked Claude to find out what is going on ;-)
Describe the bug
When an LLM provider's streaming response stalls (server keeps connection open but stops sending data), the chat gets
stuck on "Waiting model" indefinitely. Clicking STOP does not recover the chat. Attempting to shut down ECA also
fails with "Timeout while waiting for response. Method: shutdown".
Root cause: .readLine() on the response InputStream blocks forever. STOP sets a :stopping flag, but this flag is only
checked in callbacks that fire after .readLine() returns. Since it never returns, the flag is never checked.
Thread.interrupt() does not work on blocking java.io streams.
Affects all streaming providers (openai_chat, anthropic, ollama, openai).
To Reproduce (not sure if possible)
Steps to reproduce the behavior:
- Start a chat with any streaming LLM provider
- Send a message
- Have the LLM server stall mid-stream (keep connection open, stop sending data)
- Observe chat stuck on "Waiting model"
- Click STOP - chat remains stuck
- Try to stop ECA - get "Timeout while waiting for response. Method: shutdown"
Expected behavior
- Clicking STOP should immediately cancel the request and return chat to idle state, allowing new messages to be sent.
- There should be some timeout (180s?) on streaming response
Additional context
Proposed fix: Store the response InputStream when streaming starts, close it when STOP is pressed. Closing the stream
causes .readLine() to throw IOException, which is already handled via on-error.
Implementation:
- Add cancel-stream* atom to callbacks, store in chat state
- Each provider stores body (InputStream) in the atom before reading
- prompt-stop closes the stream via the atom
~10 lines across chat.clj, llm_api.clj, and each provider file.
- 主要语言
- Clojure
- 星标
- 1k
- 派生
- 82
- 平均合并
- 1 天 14 小时
- 30 天内合并 PR
- 16
环境准备
这个项目没有提供开发容器、Dockerfile 或贡献指南，环境需要你自己搭建：先看它的 README，通用步骤见我们的新手贡献指南。
从这里开始
- 先读完整个 Issue，再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库，在一个分支上完成修改。
- 提交 Pull Request，并在描述里引用这个 Issue 编号。
editor-code-assistant/eca 的其他 Issue
-
bug
难度 2/5 1-3 小时 新手友好度 78/100
editor-code-assistant/eca#661 ·
维护者通常 2 天内回复
-
bug
难度 3/5 1-2 天 新手友好度 68/100
editor-code-assistant/eca#657 ·
维护者通常 2 天内回复
-
bug
难度 4/5 3-5 天 新手友好度 25/100
editor-code-assistant/eca#652 · 1 条评论 ·
维护者通常 2 天内回复
-
难度 5/5 一周以上 新手友好度 12/100
editor-code-assistant/eca#648 · 1 条评论 ·
维护者通常 2 天内回复
-
难度 3/5 1-2 天 新手友好度 35/100
editor-code-assistant/eca#644 · 1 条评论 ·
维护者通常 2 天内回复
查看 editor-code-assistant/eca 的全部 Issue
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 84/100
nrepl/piggieback#163 ·
-
难度 2/5 1-3 小时 新手友好度 78/100
clojure-emacs/orchard#436 ·
-
Priority:P3
难度 1/5 1-3 小时 新手友好度 82/100
metabase/metabase#85025 · 1 条评论 ·
维护者通常 1 天内回复
-
Page titles with `$$`, `$&`, `` $` `` or `$'` change when block refs are resolved可能已有人在做 @RaphaelFakhri 今天认领。 未关闭
难度 2/5 1-3 小时 新手友好度 76/100
-
measured/expr fails for array-typed locals: tag from getCanonicalName ("long[]") cannot be resolved未关闭Bug
难度 2/5 1-3 小时 新手友好度 66/100
hugoduncan/criterium#156 ·