Cuda implementation broken
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 38/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Active
- Domain
- machine-learning
Research direction
Start with the llama-funasr-sensevoice.exe entry point and reproduce the CPU and CUDA commands using sample.wav. Verify the CUDA command shown in the report and compare its output and logs with the working CPU run. Done means the CUDA backend returns the same transcription for the provided audio.
Written by the indexing model from the issue text.
Description
Notice: In order to resolve issues efficiently, please follow the template and include reproducible details.
🐛 Bug
No output of the transcription
To Reproduce
C:\Users\USER\Downloads\funasr-llamacpp-windows-x64-cuda>llama-funasr-sensevoice.exe -m sensevoice-small-q8.gguf -a sample.wav --backend cuda
ggml_cuda_init: found 1 CUDA devices (Total VRAM: 16310 MiB):
Device 0: NVIDIA GeForce RTX 5060 Ti, compute capability 12.0, VMM: yes, VRAM: 16310 MiB
C:\Users\USER\Downloads\funasr-llamacpp-windows-x64-cuda>dir sample.wav
Volume in drive C has no label.
Volume Serial Number is ---
Directory of C:\Users\USER\Downloads\funasr-llamacpp-windows-x64-cuda
07/19/2026 05:15 AM 1,077,326 sample.wav
1 File(s) 1,077,326 bytes
0 Dir(s) 89,731,526,656 bytes free
C:\Users\USER\Downloads\funasr-llamacpp-windows-x64-cuda>
C:\Users\USER\Downloads\funasr-llamacpp-windows-x64-cuda>llama-funasr-sensevoice.exe -m sensevoice-small-q8.gguf -a sample.wav
I'll record myself in English, no, you don't want.
[sensevoice] done 1.55s
Code sample
C:\Users\USER\Downloads\funasr-llamacpp-windows-x64-cuda>llama-funasr-sensevoice.exe -m sensevoice-small-q8.gguf -a sample.wav --backend cuda
ggml_cuda_init: found 1 CUDA devices (Total VRAM: 16310 MiB):
Device 0: NVIDIA GeForce RTX 5060 Ti, compute capability 12.0, VMM: yes, VRAM: 16310 MiB
C:\Users\USER\Downloads\funasr-llamacpp-windows-x64-cuda>dir sample.wav
Volume in drive C has no label.
Volume Serial Number is FA17-FC47
Directory of C:\Users\USER\Downloads\funasr-llamacpp-windows-x64-cuda
07/19/2026 05:15 AM 1,077,326 sample.wav
1 File(s) 1,077,326 bytes
0 Dir(s) 89,731,526,656 bytes free
C:\Users\USER\Downloads\funasr-llamacpp-windows-x64-cuda>
C:\Users\USER\Downloads\funasr-llamacpp-windows-x64-cuda>llama-funasr-sensevoice.exe -m sensevoice-small-q8.gguf -a sample.wav
I'll record myself in English, no, you don't want.
[sensevoice] done 1.55s
Expected behavior
Should return the audio like the CPU implementation
Error logs
No errors
Environment
- OS: W11
Audio details
It just works with CPU so it should work with GPU.
- Dominant language
- Python
- Stars
- 20.4k
- Forks
- 2k
- Avg merge
- 4h 55m
- Merged PRs (30d)
- 169
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from modelscope/FunASR
-
Difficulty 2/5 1-3 hours Newbie friendliness 86/100
modelscope/FunASR#3704 · 1 comment ·
-
bug needs feedback
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
modelscope/FunASR#3401 · 2 comments ·
-
needs triage question
Difficulty 4/5 3-5 days Newbie friendliness 30/100
modelscope/FunASR#3718 · 3 comments ·
-
Difficulty 3/5 1-2 days Newbie friendliness 48/100
modelscope/FunASR#3717 · 1 comment ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
modelscope/FunASR#3715 ·
All issues in modelscope/FunASR
Similar issues
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
use-agent-os/agent-os#3314 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
BasedHardware/omi#15662 · 1 comment ·
-
documentation help wanted
Difficulty 2/5 1-3 hours Newbie friendliness 90/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
AiursoftWeb/AnduinOS-2#19 ·