Hacktoberfest 2026: los issues que los mantenedores marcaron para octubre, abiertos y aptos para principiantes. Explorar issues de Hacktoberfest

Fish Speech backend using ROCM doesn't work

Abierto
  • ¿Algo no está bien?
#11,579 2 comentarios 0 reacciones 0 asignados Ver en GitHub

Los mantenedores suelen responder en 1 día

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
3/5
Tiempo estimado
1-2 días
Aptitud para principiantes
48/100
Tipo de issue
Error
Claridad
Bastante claro
Estado de actividad
Tranquilo
Stack tecnológico
python
Área
ai, backend

Línea de trabajo

Comienza por /backends/rocm-fish-speech/backend.py alrededor de LoadModel en la línea 201 e inspecciona cómo se proporciona fish_speech.inference_engine en la imagen reportada. Reproduce el fallo de carga del modelo en la configuración de distribución y verifica que Fish Speech se carga sin el ModuleNotFoundError.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

bug unconfirmed

LocalAI version:
localai/localai:master-gpu-hipblas
sha256:f3ff922777a09ec7f63093df7482ebb15d3f94c0f8611d49143fe455b4f7144d

Environment, CPU architecture, OS, and Version:
I'm doing this on unraid 7.3, using portainer.
AMD Ryzen 9 5900X
Radeon AI PRO R9700
Local AI is setup using distribution mode with nodes.

Describe the bug
I tried to use the fish speech backend and this is the error I get failed to route model with internal loader: routing model fishaudio/s2-pro: loading model fish-speech-s2-pro: loading model fishaudio/s2-pro on node rocinante-worker: Failed to load model: No module named 'fish_speech.inference_engine'

this is the docker log

Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="CUDA is not available" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="Using device: cpu, precision: torch.float32, compile: False" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="Loading model from: /models/fish-speech-s2-pro/.artifacts/huggingface/637e4c7713f137cd3cd5969badcf6fa2e2fedd6781c55e4fc5c1a586a64726a0/snapshot" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="[ERROR] Loading model: ModuleNotFoundError: No module named 'fish_speech.inference_engine'" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="Traceback (most recent call last):" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="  File \"/backends/rocm-fish-speech/backend.py\", line 201, in LoadModel" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="    from fish_speech.inference_engine import TTSInferenceEngine" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="ModuleNotFoundError: No module named 'fish_speech.inference_engine'" caller={caller.file="/build/pkg/model/process.go"  caller.L=30

when I try and view the trace for details and click backend log it just has

Model not loaded on any worker

fish-speech-s2-pro isn't currently loaded on any node in the cluster. Check the Nodes page to see which models are running where.

To Reproduce
I try and create a TTS with the fish-speech backend, I get this error

Expected behavior
For it to work

Logs

Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="CUDA is not available" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="Using device: cpu, precision: torch.float32, compile: False" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="Loading model from: /models/fish-speech-s2-pro/.artifacts/huggingface/637e4c7713f137cd3cd5969badcf6fa2e2fedd6781c55e4fc5c1a586a64726a0/snapshot" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="[ERROR] Loading model: ModuleNotFoundError: No module named 'fish_speech.inference_engine'" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="Traceback (most recent call last):" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="  File \"/backends/rocm-fish-speech/backend.py\", line 201, in LoadModel" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="    from fish_speech.inference_engine import TTSInferenceEngine" caller={caller.file="/build/pkg/model/process.go"  caller.L=305 } 
Aug 18 10:47:58 DEBUG GRPC stderr id="fish-speech-s2-pro#0-0.0.0.0:50051" line="ModuleNotFoundError: No module named 'fish_speech.inference_engine'" caller={caller.file="/build/pkg/model/process.go"  caller.L=30
Lenguaje dominante
Go
Estrellas
49.2k
Forks
4.5k
Merge medio
1 d 7 h
PR fusionados (30 d)
357

Preparar el entorno

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de mudler/LocalAI

Todos los issues de mudler/LocalAI

Issues similares

Más issues de Go

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.