ggml-org/llama.cpp

tts : add support for Orpheus

Open

#12,476 opened on Mar 20, 2025

View on GitHub
 (7 comments) (26 reactions) (0 assignees)C++ (110,169 stars) (18,202 forks)batch import
good first issuetts

Description

HF: https://huggingface.co/collections/canopylabs/orpheus-tts-67d9ea3f6c05a941c06ad9d2

These TTS models seem suitable for supporting. To do that, we need to implement the SNAC audio codec: https://github.com/hubertsiuzdak/snac/

Sample implementation using Python-based inference of SNAC: https://github.com/isaiahbjork/orpheus-tts-local

Similar model support (OuteTTS): https://github.com/ggml-org/llama.cpp/pull/10784 Can be used as a reference how to implement this.

Contributor guide

Tech stack
cpp
Domain
machine learningai
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
C++audio codec fundamentalsllama.cpp model integration
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
35
Research direction
Study the linked OuteTTS PR (https://github.com/ggml org/llama.cpp/pull/10784) to understand the pattern for adding new TTS model support. Then implement the SNAC audio codec as described in the SNAC repository (https://github.com/hubertsiuzdak/snac/) and adapt the Orpheus TTS model using the provided HF collection and sample implementation. The implementation will likely involve new model architecture files in the llama.cpp codebase.