Add winml eval support for audio-classification
@DingmaomaoBJTU is already working on this.
Since Jul 27, 2026.
Assessment
This issue has not been assessed yet.
Description
winml eval currently rejects the audio-classification task before dataset selection, even when winml inspect and winml build resolve/build a standard audio-classification model.
Repro from facebook/mms-lid-256 on current main:
uv run winml eval --schema --task audio-classification
uv run winml eval -m temp\facebook_mms-lid-256_tester\cpu\fp32\model.onnx --model-id facebook/mms-lid-256 --task audio-classification --ep cpu --device cpu
Observed:
Error: Task 'audio-classification' is not supported by `winml eval`.
Error: Evaluation failed: Task 'audio-classification' is not supported.
Expected: an audio-classification eval schema/adapter with dataset preprocessing for raw audio or feature-extractor-normalized waveform input and a task metric such as accuracy.
This blocks Goal-L3 validation for standard Wav2Vec2ForSequenceClassification audio classifiers such as facebook/mms-lid-256.
- Dominant language
- Python
- Stars
- 40
- Forks
- 11
- Avg merge
- 1d 8h
- Merged PRs (30d)
- 50
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from microsoft/winml-cli
-
bug P1 triaged
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
P2 refactor triaged
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
-
Difficulty 4/5 3-5 days Newbie friendliness 52/100
-
Difficulty 4/5 3-5 days Newbie friendliness 38/100
-
Difficulty 4/5 3-5 days Newbie friendliness 45/100
All issues in microsoft/winml-cli
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100