Hacktoberfest 2026：メンテナが10月に向けて印を付けた、オープンで初心者向けの issue。 Hacktoberfest の issue を見る

realtime WS: commit never yields .completed for utterances >= ~1s (0.5s works)

オープン
  • 何か問題がありますか？
#49 コメント 1 件 リアクション 1 件 担当者 0 名 GitHub で見る

メンテナーはふだん 1 日以内に返信

まだ誰も着手していません。

評価

難易度
4/5
見積もり時間
3〜5日
初心者へのやさしさ
52/100
issue の種類
バグ
明瞭さ
おおむね明確
活発さ
活発
技術スタック
cpp
領域
audio-video-rtc, backend

調査の方向性

Start with server/http/http_server.cpp, especially the realtime commit handler and the streaming finish path. Reproduce the issue with the raw WebSocket client using utterances from 0.5 to 2.0 seconds, then inspect how longer streams and endpointing handle finalization. Done means longer utterances emit committed and completed events, with endpointing no longer stalling.

索引モデルが issue の本文から書いたものです。

説明

Summary

The realtime WebSocket transcription path in nemo-speech serve 0.1.0 never emits .completed (or input_audio_buffer.committed) after input_audio_buffer.commit once the streamed utterance reaches ~1 second or more. At 0.5 s it works (+0.19 s finalization); at 1.0 s, 1.5 s, and 2.0 s it hangs forever. Short-utterance success shows the protocol handling is correct, so this looks length-dependent in the streaming finish path.

A second, possibly related symptom: with --asr.endpointing.enable=true and 2 s of trailing zero-PCM silence, no endpoint .completed ever fires and audio_processed stalls partway through the stream.

Environment

  • Binary: nemo-speech 0.1.0 release archive nemo-speech-0.1.0-linux-x86_64-cuda.tar.gz
  • OS/GPU: NixOS 26.11, NVIDIA T1000 4 GB, driver 595.91, CUDA backend (backend=CUDA0)
  • Model: nemotron-speech-streaming-en-0.6b.q8_0.gguf (665 MiB)
  • Serve: nemo-speech serve --asr-model <gguf> --asr.batching.state_arena_slots 1 --host 127.0.0.1 --port 8080
  • Note: default arena slots OOM (cudaMalloc failed: out of memory) with ~2 GB already resident on the 4 GB card; state_arena_slots 1 was required to run at all.

Repro

Raw WebSocket client (stdlib only, masked client frames), repeated per trial on a fresh connection:

  1. GET /v1/realtime handshake, receive session.created.
  2. Send {"type": "session.update", "session": {"sample_rate": 16000, "language": "en-US"}}, receive session.updated.
  3. Stream 16 kHz mono PCM16 as binary frames in 100 ms (3200-byte) chunks, back-to-back.
  4. Send {"type": "input_audio_buffer.commit"}.
  5. Read events.

Audio: 16 kHz mono command utterances; trials used 0.5 s / 1.0 s / 1.5 s / 2.0 s prefixes of the same clip.

Observed

Streamed audio Result after commit
0.5 s .completed in +0.19 s, transcript "What?" (correct for the prefix)
1.0 s no committed, no .completed, no error (25 s wait)
1.5 s same hang
2.0 s same hang

Mid-stream .delta events flow correctly in all cases (full transcript visible within ~0.3 s of arrival, ~6x realtime), so ingestion and decoding work; only finalization never surfaces. Endpointing variant (--asr.endpointing.enable=true --asr.endpointing.stop_history_eou_ms=800, utterance + 2 s trailing silence): audio_processed advances to ~2.0-2.2 s of a 2.66 s stream then stalls; no endpoint final ever arrives.

Additional observation: streaming tail words are unstable across runs on identical input ("Play some Kendrick Lam" vs "Play some Kendrick"), and trailing silence does not flush the remainder.

Notes

  • Current main's server/http/http_server.cpp commit handler (ensure_stream(); emit(stream->finish()); ...committed) is identical to 0.1.0, so this likely reproduces on main (not built here; no toolchain on the test host).
  • Possibly related to #48 (streaming RNNT stall) and #40/#41 (EOU handling), but this repro uses endpointing off, no silence mid-stream, and fails deterministically on utterance length alone.
主要言語
C++
スター
181
フォーク
42
平均マージ
1日 8時間
マージ済み PR（30日）
8

環境構築

はじめの一歩

  1. issue を最後まで読み、次にプロジェクトのコントリビューションガイドを読みます。
  2. 着手することを issue にコメントします — 二人が同じ作業をするのを防げます。
  3. リポジトリをフォークし、ブランチを切って変更します。
  4. issue 番号を参照したプルリクエストを送ります。

NVIDIA/NeMo-Speech.cpp のほかの issue

NVIDIA/NeMo-Speech.cpp の issue をすべて見る

似ている issue

C++ の issue をもっと見る

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。