GLM-5.3 Flash: Stream output mixed with random English fragments and shortened reasoning in Kelivo client

Đang mở
  • Có gì không ổn?
#1,039 3 bình luận 0 reaction 0 người được giao Xem trên GitHub

Maintainer thường phản hồi trong vòng 1 ngày

Chưa có ai nhận issue này.

Đánh giá

Độ khó
5/5
Thời gian dự kiến
Hơn một tuần
Mức phù hợp với người mới
25/100
Loại issue
Lỗi
Độ rõ ràng
Khá rõ ràng
Mức độ hoạt động
Sôi nổi
Lĩnh vực
backend-api-design

Hướng nghiên cứu

The report identifies GLM-5.3 Flash through the CommandCode API gateway, used from Kelivo on iOS, with failures especially after web search in long role-play conversations. Start by tracing the API gateway’s streaming and non-streaming response paths and how web search results are passed to the model. Done means reproducing the mixed-language output and instruction-following failure, then identifying a fix that addresses both modes.

Do mô hình lập chỉ mục viết ra từ nội dung của issue.

Mô tả

Summary

When using GLM-5.3 Flash model via CommandCode API gateway on Kelivo client (version 1.3.1 / 80, iOS), the output randomly inserts unexpected fragments of English, Russian, Thai and other languages into Chinese text.
The issue is prominent in streaming mode, and can still happen occasionally after streaming is disabled. Disabling streaming also causes the model to fail to follow instructions and generate uncontrollable content.
I have tested temperature=1.0 and temperature=0.8 for comparison. The problem becomes much worse with web search enabled, mostly appearing in role-play long context conversations after search finishes.

Expected Behavior

The model should output clean Chinese text without unexpected mixed foreign language fragments. The model should faithfully follow user instructions regardless of streaming mode and temperature settings.

Actual Behavior

In streaming mode, GLM-5.3 Flash randomly inserts fragments of English, Russian, Thai and other foreign languages into Chinese sentences. This phenomenon is very obvious when stream is enabled.
Even if streaming is disabled, this bug still occurs occasionally. Moreover, when streaming is turned off, the model cannot fully follow user instructions and produces uncontrollable content.
The problem is much worse when web search is enabled. It mainly happens during long text generation after web search completes in role-play conversations.
Tested temperature: 1.0 makes the bug more obvious; temperature=0.8 reduces the frequency but cannot eliminate it completely.

Steps to reproduce the issue

  1. Use Kelivo client v1.3.1 / 80 on iOS, set API endpoint to CommandCode, select GLM-5.3 Flash model and enable stream mode.

  2. Turn on the web search function in the prompt.

  3. The model completes web search and retrieves reference materials.

  4. After the search phase finishes, the model starts generating long text for role-play.

  5. Observe the streaming output: random fragments of English, Russian, Thai and other foreign languages are inserted inside Chinese sentences.

  6. Additional test: Disable streaming. The foreign fragment bug still occurs occasionally, and the model may not follow instructions properly, producing uncontrollable output.

  7. Compare test: temperature=1.0 makes the bug more obvious; temperature=0.8 reduces the frequency but cannot eliminate it completely.

  8. When web search is disabled, this bug appears far less often.

Command Code Version

API Gateway (web API, not local CLI)

Operating System

Other

Terminal/IDE

Kelivo Mobile Client

Shell

Not applicable

Session file (optional)

No response

Fix prompt (optional)

No response

Additional context

The issue started happening 2-3 days ago. Client: Kelivo version 1.3.1 / 80, iOS system. When web search function is enabled, the mixed-language problem becomes much worse. If web search is disabled, the bug occurs less frequently. I can provide screenshots of mixed-language output if needed. No API keys or account secrets included.

Note: The following content is for testing purposes only and does not represent any position. The user takes no responsibility for any output generated here. It is only used as a bug sample.

Sample broken output example:

Image Image Image
Ngôn ngữ chính
Không có dữ liệu ngôn ngữ
Star
4.2k
Fork
377
Merge trung bình
1 ngày 17 phút
Pull request đã merge (30 ngày)
7

Chuẩn bị môi trường

Dự án này không cung cấp dev container, Dockerfile hay hướng dẫn đóng góp, nên bạn cần tự thiết lập môi trường: hãy bắt đầu từ README và xem hướng dẫn đóng góp lần đầu của chúng tôi để biết các bước chung.

Bắt đầu từ đâu

  1. Đọc hết issue, rồi đọc hướng dẫn đóng góp của dự án.
  2. Bình luận trên issue rằng bạn sẽ nhận — tránh hai người làm cùng một việc.
  3. Fork repository và làm thay đổi trên một nhánh.
  4. Mở pull request có tham chiếu số hiệu của issue.

Issue khác của CommandCodeAI/command-code

Tất cả issue của CommandCodeAI/command-code

Issue tương tự

Thêm issue về Backend & API Design

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.