Add multi batch size cuda graphs support for M-Bridge in-framework deployment.

Assessment

Research direction

Description

Getting set up

First steps

1. Read the whole issue, then the project's contributing guide.
2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
3. Fork the repository and make your change on a branch.
4. Open a pull request that references the issue number.

More from NVIDIA-NeMo/Export-Deploy

• [ALERT] Access to NVIDIA's Self-Hosted Runners is Expiring

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  nvidia-runners

  Difficulty 2/5 1-3 hours Newbie friendliness 35/100

  NVIDIA-NeMo/Export-Deploy#759 · Opened Aug 30, 2026

• Update ED to use Dynamic Inference Engine from MCore

  May be free again @oyilmaz-nvidia claimed this 150 days ago, and no pull request is open. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  NVIDIA-NeMo/Export-Deploy#693 · 1 assignee · Opened May 22, 2026

• Incorrect handling of reasoning traces for nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 in MBridge format

  May be free again @athitten claimed this 150 days ago, and no pull request is open. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  NVIDIA-NeMo/Export-Deploy#682 · 1 comment · 1 assignee · Opened May 22, 2026

• Server returns empty answer when too many tokens requested

  May be free again @athitten claimed this 189 days ago, and no pull request is open. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  NVIDIA-NeMo/Export-Deploy#652 · 1 assignee · Opened Apr 13, 2026

• VLM endpoint fails when there are no images in the request

  May be free again @meatybobby claimed this 221 days ago, and no pull request is open. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  NVIDIA-NeMo/Export-Deploy#632 · 1 assignee · Opened Mar 12, 2026

All issues in NVIDIA-NeMo/Export-Deploy

Similar issues

• Format always fails on current Node.js: stderr deprecation warning is treated as an error

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 77/100

  mihai-vlc/sublime-jsfmt#56 · Opened Oct 20, 2026

• Plugin load fails with RuntimeError: dictionary changed size during iteration (_evict_modules iterates the live sys.modules dict)

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  comp/cli comp/plugins P2 type/bug

  Difficulty 2/5 1-3 hours Newbie friendliness 75/100

  NousResearch/hermes-agent#141917 · 1 comment · Opened Oct 20, 2026

  Maintainers usually reply within 1 day

• Go device SDK: Whisper transcriber keeps buffering and transcribing audio appended after Stop()

  Possibly taken @apoorvdarshan claimed this today. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 84/100

  BasedHardware/omi#22770 · Opened Oct 20, 2026

  Maintainers usually reply within 1 day

• [Bug] Window options accept invalid integer values

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug needs-acceptance wg/router-models-inference-runtime

  Difficulty 2/5 1-3 hours Newbie friendliness 66/100

  vllm-project/semantic-router#5295 · Opened Oct 20, 2026

  Maintainers usually reply within 1 day

• Webhook domain "discussion" is typed/offered as "discussions", so `hf webhooks create --domain` can't subscribe to discussion events

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 84/100

  huggingface/huggingface_hub#5210 · Opened Oct 20, 2026

  Maintainers usually reply within 1 day

More Python issues