Assertion `srcIndex < srcSelectDimSize` failed

Assessment

This issue has not been assessed yet.

Description

When I try to run Stage 3 finetuning PPO for qwen 2 0.5B model, I got the following bug:

Assertion srcIndex < srcSelectDimSize failed,
which seems like issue about input dataset sequence length?

I have already set Num_Padding_at_Beginning=0 # this is model related

Getting set up

First steps

1. Read the whole issue, then the project's contributing guide.
2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
3. Fork the repository and make your change on a branch.
4. Open a pull request that references the issue number.

More from deepspeedai/DeepSpeedExamples

• Compute_rewards in PPO:rewards[j, start:ends[j]][-1] += reward_clip[j] is wrong

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 52/100

  deepspeedai/DeepSpeedExamples#996 · Opened Dec 22, 2025

• Step1 failed when I run "bash training_scripts/opt/single_gpu/run_1.3b.sh"

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 25/100

  deepspeedai/DeepSpeedExamples#995 · Opened Dec 16, 2025

• One example, multiple config files

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 52/100

  deepspeedai/DeepSpeedExamples#989 · Opened Sep 8, 2025

• moe example 404

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 25/100

  deepspeedai/DeepSpeedExamples#984 · Opened Jul 25, 2025

• Possible to include an example of DeepNVMe + state dict

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 42/100

  deepspeedai/DeepSpeedExamples#979 · 6 comments · Opened Jun 19, 2025

All issues in deepspeedai/DeepSpeedExamples

Similar issues

• Bug - NLLB-200 fails for Nepali due to incorrect language code (ne vs npi_Deva)

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug needs-triage

  Difficulty 2/5 1-3 hours Newbie friendliness 68/100

  debpalash/VoiceStudio#2624 · Opened Oct 5, 2026

  Maintainers usually reply within 1 day

• Inclusive grid edges pass bounds checks but produce out-of-range indices

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 75/100

  nasa/fmdtools#227 · Opened Oct 5, 2026

  Maintainers usually reply within 1 day

• Only serve restaurant items after they are ready

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 72/100

  ashishps1/awesome-low-level-design#375 · Opened Oct 5, 2026

• Make Catch2 optional when `RDK_BUILD_CPP_TESTS=OFF`

  Possibly taken @pechersky claimed this today. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  Difficulty 2/5 1-3 hours Newbie friendliness 82/100

  rdkit/rdkit#9672 · Opened Oct 5, 2026

  Maintainers usually reply within 2 days

• There are a few redundant calls to `fdesc._setCloseOnExec()`

  Possibly taken @gudnimg claimed this today. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 82/100

  twisted/twisted#12864 · Opened Oct 5, 2026

  Maintainers usually reply within 1 day

More Python issues