[BadCase about the model]: CN-NewsTTS Bench includes MiniMax TTS results - metadata confirmation invited
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 35/100
- Issue type
- Documentation
- Clarity
- Needs clarification
- Activity status
- Quiet
- Domain
- documentation
Research direction
Start by reading SUBMIT.md and the validation commands for data/dev.jsonl and data/test_public.jsonl. Review the public leaderboard entry for minimax_tts and determine whether the model metadata can be confirmed or corrected; done requires an official confirmation, corrected metadata, or an official result/model card.
Written by the indexing model from the issue text.
Description
Basic Information - Models Used
minimax_tts-speech-2.8-hd
Basic Information - Scenario Description
TTS systems still struggle with Chinese news-style text
Is this badcase known and solvable?
- I have followed the GitHub README of the model and found no duplicates in existing issues.
- I have checked Minimax documentation and found no solution.
Information about environment
git clone https://github.com/Jayden-X-L/cn-news-tts-bench.git
cd cn-news-tts-bench
python3 scripts/validate_dataset.py data/dev.jsonl
python3 scripts/validate_dataset.py data/test_public.jsonl
python3 scripts/score_submission.py
--dataset data/test_public.jsonl
--asr-results results/asr_results/public_test/volcengine_tts.asr.jsonl
--model-id volcengine_tts
--output-dir /tmp/cn-news-tts-repro
python3 scripts/aggregate_leaderboard.py
--per-model-dir results/per_model_public_test
--results-dir /tmp/cn-news-tts-leaderboard/results
--site-dir /tmp/cn-news-tts-leaderboard/site
shasum -a 256 -c release/v0.1_core_checksums.sha256
Call & Execution Information
- model_id:
minimax_tts - model name:
speech-2.8-hd - voice:
configured Mandarin news voice
Description
Hi MiniMax team,
I am Shijun Luo from NetEase Cloud Music, where I work on AI news briefing / AI news podcast generation. In our workflow, we use and evaluate major TTS systems to generate spoken news and information podcast content.
During this work, we found that many current TTS systems still struggle with Chinese news-style text, especially compact expressions that frequently appear in real news. These errors are not just voice-quality issues; they can change the information heard by listeners.
For example:
苏-27may be read as "苏负二十七" instead of the intended aircraft model name.96-91may be read as a numeric range instead of a sports score.620N·mmay be read letter by letter or as symbol fragments instead of a torque unit.3.5%may be read as "三点五百分号" or confused with percentage points.AI/CEOmay be expanded into "人工智能" / "首席执行官" when the original abbreviation should be preserved.
This motivated us to release CN-NewsTTS Bench, a raw-input Chinese news TTS benchmark focused on real-world news reading cases such as dates, numbers, units, named entities, mixed-script text, and text normalization.
The current public leaderboard includes a MiniMax TTS entry:
- model_id:
minimax_tts - model name:
speech-2.8-hd - voice:
configured Mandarin news voice
Repository:
https://github.com/Jayden-X-L/cn-news-tts-bench
We would like to invite the MiniMax team to:
- Confirm or correct the public model metadata.
- Submit an official result if the current configuration is not representative.
- Provide a system/model card if available.
Submission guide:
https://github.com/Jayden-X-L/cn-news-tts-bench/blob/main/SUBMIT.md
For questions or corrections, feel free to contact me:
xiaobiluo@gmail.com
Thanks!
Best,
Shijun Luo
- Dominant language
- Python
- Stars
- 1.6k
- Forks
- 284
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from MiniMax-AI/MiniMax-MCP
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
MiniMax-AI/MiniMax-MCP#89 · 1 comment ·
-
Difficulty 1/5 1-3 hours Newbie friendliness 82/100
MiniMax-AI/MiniMax-MCP#88 ·
-
Difficulty 1/5 Under an hour Newbie friendliness 78/100
MiniMax-AI/MiniMax-MCP#78 ·
-
fix(server): music_generation has inconsistent indentation — try block indented inside function body Open
Difficulty 1/5 Under an hour Newbie friendliness 88/100
MiniMax-AI/MiniMax-MCP#69 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 35/100
MiniMax-AI/MiniMax-MCP#105 · 1 comment ·
All issues in MiniMax-AI/MiniMax-MCP
Similar issues
-
documentation help wanted
Difficulty 2/5 1-3 hours Newbie friendliness 90/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 90/100
simonw/sqlite-utils#872 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100