THUDM

Issues somebody may already be working on are listed last. List everything by date

• Paper suggestions: CLAIP-Emo, S2D and S4D — efficient adaptation for affective computing

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 1/5 1-3 hours Newbie friendliness 55/100

  THUDM/Awesome-Parameter-Efficient-Fine-Tuning-for-Foundation-Models#4 · Opened Oct 27, 2026

• [RFC] Support GLM-5.3-Flash RL Training on Ascend 950 NPUs

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#2495 · Opened Oct 26, 2026

  Maintainers usually reply within 1 day

• loan management System

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 15/100

  THUDM/Awesome-Parameter-Efficient-Fine-Tuning-for-Foundation-Models#3 · 1 comment · Opened Oct 21, 2026

• [Question] Would an adaptive in-reward KL controller fit Slime's PPO/RLHF scope?

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#2387 · Opened Sep 15, 2026

  Maintainers usually reply within 1 day

• Verify evals on Papers with Code

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 35/100

  THUDM/slime#2386 · Opened Sep 14, 2026

  Maintainers usually reply within 1 day

• [Bug] Fully-async multi-agent rollout crashes on nested groups

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  Difficulty 3/5 1-2 days Newbie friendliness 76/100

  THUDM/slime#2344 · Opened Sep 2, 2026

  Maintainers usually reply within 1 day

• [Discussion] Support background evaluation while fully-async training rollout is running

  May be free again @zhuyijie88 claimed this 48 days ago, and no pull request is open. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 30/100

  THUDM/slime#2339 · 2 comments · Opened Aug 31, 2026

  Maintainers usually reply within 1 day

• [Question] Multiple critic updates per actor update (SAO-style faster value update)?

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 35/100

  THUDM/slime#2329 · Opened Aug 26, 2026

  Maintainers usually reply within 1 day

• 如何才能快速训练GLM 5.2

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 4/5 3-5 days Newbie friendliness 35/100

  THUDM/slime#2324 · 1 comment · Opened Aug 24, 2026

  Maintainers usually reply within 1 day

• [Question] 什么时候支持ling3.0呢？

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#2314 · Opened Aug 24, 2026

  Maintainers usually reply within 1 day

• [Agent RL] Qwen3.5 history re-templating causes false trajectory forks

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 30/100

  THUDM/slime#2288 · Opened Aug 19, 2026

  Maintainers usually reply within 1 day

• [Question/Performance] Full message history is re-tokenized on every coding-agent turn

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 35/100

  THUDM/slime#2285 · 3 comments · Opened Aug 19, 2026

  Maintainers usually reply within 1 day

• [Bug] Training/log-prob forward materializes full-vocab fp32 logits over the entire packed sequence → OOM for large-vocab, long multi-turn RL

  May be free again A pull request for this issue was closed without being merged. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  Difficulty 4/5 3-5 days Newbie friendliness 45/100

  THUDM/slime#2253 · 1 comment · Opened Aug 5, 2026

  Maintainers usually reply within 1 day

• [Question] Proposal: Add Train–Inference Consistency Data Collection to slime

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#2244 · 1 reaction · Opened Jul 27, 2026

  Maintainers usually reply within 1 day

• [Question] 请问最新镜像（slimerl/slime:latest）支持A800吗

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 1/5 Under an hour Newbie friendliness 25/100

  THUDM/slime#2232 · 1 comment · Opened Jul 24, 2026

  Maintainers usually reply within 1 day

• [Question]什么时候能支持国产昇腾芯片呢？

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#2225 · 1 comment · Opened Jul 21, 2026

  Maintainers usually reply within 1 day

• [Question]将qwen3.5-27B转换为torch dist后，再转换回hf格式，使用sglang部署，在tp=4/8的情况下模型会输出且只输出大量‘！’

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 4/5 3-5 days Newbie friendliness 30/100

  THUDM/slime#2222 · 3 comments · Opened Jul 20, 2026

  Maintainers usually reply within 1 day

• Your project is on StackMap — a curated map of the AI stack

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 1/5 Under an hour Newbie friendliness 25/100

  THUDM/slime#2214 · 3 comments · Opened Jul 16, 2026

  Maintainers usually reply within 1 day

• [Question] Do we support the SAO method used in the training of GLM-5.2

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#2212 · 7 reactions · Opened Jul 16, 2026

  Maintainers usually reply within 1 day

• Delta weight sync (NCCL) produces NaN weights on Qwen3.5-122B MoE → "probability tensor contains inf/nan" crash

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 42/100

  THUDM/slime#2209 · 1 comment · Opened Jul 15, 2026

  Maintainers usually reply within 1 day

• [Question] Do we support general on-policy distillation?

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 30/100

  THUDM/slime#2202 · Opened Jul 13, 2026

  Maintainers usually reply within 1 day

• GLM-5.2 SparseMLA TileLang backward returns NaN gradients from finite inputs

  May be free again A pull request for this issue was closed without being merged. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 48/100

  THUDM/slime#2201 · 2 comments · Opened Jul 13, 2026

  Maintainers usually reply within 1 day

• [Question] qwen3.6-35B-A3b训练的时候只保存了文本权重，多模态权重没有保存，怎么办

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 4/5 3-5 days Newbie friendliness 25/100

  THUDM/slime#2194 · Opened Jul 10, 2026

  Maintainers usually reply within 1 day

• [Bug] Colocate weight update fails with torch_memory_saver/offload because PyTorch CUDA IPC _share_cuda_ raises cudaErrorInvalidValue

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  Difficulty 4/5 3-5 days Newbie friendliness 45/100

  THUDM/slime#2188 · 2 comments · Opened Jul 8, 2026

  Maintainers usually reply within 1 day

• [Bug] `offload_train` train worker dies on CUDA 13 with `libcudart.so.12: cannot open shared object file` — the torch_memory_saver `LD_PRELOAD` `.so` is chosen by filename, not by CUDA runtime

  May be free again A pull request for this issue was closed without being merged. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  Difficulty 3/5 1-2 days Newbie friendliness 72/100

  THUDM/slime#2186 · 1 comment · Opened Jul 7, 2026

  Maintainers usually reply within 1 day

• [Bug] Using q instead of normalized q in Megatron's DSA MLA indexer for GLM 5 models

  May be free again @n-WN claimed this 105 days ago, and no pull request is open. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  Difficulty 3/5 1-2 days Newbie friendliness 58/100

  THUDM/slime#2165 · 1 comment · Opened Jul 1, 2026

  Maintainers usually reply within 1 day

• [RFC] Shard-level P2P weight sync for non-colocate training

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#2147 · Opened Jun 29, 2026

  Maintainers usually reply within 1 day

• Comprehensive documentation and API stability roadmap needed

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/INFTY#13 · Opened Jun 20, 2026

• Excellent conflict analysis infrastructure design

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 5/5 Over a week Newbie friendliness 10/100

  THUDM/INFTY#12 · Opened Jun 15, 2026

• Inquiry about the release timeline for C-Flat Turbo

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 1/5 Under an hour Newbie friendliness 20/100

  THUDM/INFTY#11 · Opened Jun 14, 2026

• [Question] Need help to support Qwen3.5 dense(/moe) VLM megatron.bridge plugin together

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#2073 · 2 comments · Opened Jun 13, 2026

  Maintainers usually reply within 1 day

• [Question] code agent rl 数据格式问题

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 3/5 1-2 days Newbie friendliness 35/100

  THUDM/slime#2052 · 1 comment · Opened Jun 11, 2026

  Maintainers usually reply within 1 day

• [Question] torch_memory_saver 报错only hook_mode=preload supports

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 4/5 3-5 days Newbie friendliness 28/100

  THUDM/slime#2018 · 1 comment · Opened Jun 4, 2026

  Maintainers usually reply within 1 day

• [Question] Any plans to support pipeline RL to avoid ramp down time during weight update in sglang servers

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 30/100

  THUDM/slime#2007 · 3 comments · Opened Jun 2, 2026

  Maintainers usually reply within 1 day

• [Proposal] TCOD — extending slime's On-Policy Distillation to multi-turn agents

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#2002 · Opened Jun 1, 2026

  Maintainers usually reply within 1 day

• [RFC] Integrate TransferQueue into slime as an Optional Training Data Plane

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#1971 · 3 comments · Opened May 29, 2026

  Maintainers usually reply within 1 day

• [Question] Support for DeepSeek V4?

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#1910 · 3 comments · Opened May 14, 2026

  Maintainers usually reply within 1 day

• [Bug] 保存模型hang住

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  Difficulty 4/5 3-5 days Newbie friendliness 42/100

  THUDM/slime#1908 · Opened May 14, 2026

  Maintainers usually reply within 1 day

• [Question] I found that ois is numerically equivalent to tis during training

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 4/5 3-5 days Newbie friendliness 35/100

  THUDM/slime#1907 · Opened May 13, 2026

  Maintainers usually reply within 1 day

• Segfault in checkpoint save (cudaMemcpyAsync) — regression in v0.2.4, works in v0.2.3

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 45/100

  THUDM/slime#1893 · 1 comment · Opened May 6, 2026

  Maintainers usually reply within 1 day

• [Question] Plan for MagiAttention

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#1872 · 1 comment · Opened Apr 28, 2026

  Maintainers usually reply within 1 day

• [Question] GLM5----MTP training support

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 30/100

  THUDM/slime#1870 · 1 comment · Opened Apr 27, 2026

  Maintainers usually reply within 1 day

• [Question] qwen3-vl转化

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 35/100

  THUDM/slime#1863 · 4 comments · Opened Apr 26, 2026

  Maintainers usually reply within 1 day

• [Question] GLM5模型sglang rollout有概率出现首字token乱码/没有意义

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 4/5 3-5 days Newbie friendliness 32/100

  THUDM/slime#1853 · 3 comments · Opened Apr 23, 2026

  Maintainers usually reply within 1 day

• Qwen3.5-397B-A17B 全异步 H20（96 Actor，64 Rollout）运行正常，但 Rollout 生成的 Response 不正常

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#1852 · 7 comments · Opened Apr 23, 2026

  Maintainers usually reply within 1 day

• [Bug] Wrong inference using docker container's sglang server with Qwen3-VL models

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  Difficulty 4/5 3-5 days Newbie friendliness 38/100

  THUDM/slime#1850 · 1 comment · Opened Apr 21, 2026

  Maintainers usually reply within 1 day

• [Bug] VLM multi-turn rollout: model cannot see images on multi-turns

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  Difficulty 4/5 3-5 days Newbie friendliness 45/100

  THUDM/slime#1847 · 3 comments · Opened Apr 20, 2026

  Maintainers usually reply within 1 day

• Ray OOM when saving checkpoint unless both --no-save-optim and --disable-weights-backuper are enabled

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#1845 · Opened Apr 20, 2026

  Maintainers usually reply within 1 day

• [Question] How to add a custom auxiliary SFT loss to the GRPO training loop （Chord）?

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 25/100

  THUDM/slime#1843 · Opened Apr 20, 2026

  Maintainers usually reply within 1 day

• [Question] Gemma 4 and Olmo 3 models support

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  question

  Difficulty 5/5 Over a week Newbie friendliness 20/100

  THUDM/slime#1830 · 2 comments · Opened Apr 13, 2026

  Maintainers usually reply within 1 day