model: MiniMax-M3.1-Flash (minimax-m3 shapes, sparse attention on every layer, text + vision)
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 25/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Active
- Tech stack
- rust
- Domain
- backend, machine-learning
Research direction
Start with the existing MiniMax-M3 model code in crates/model/src/arch/minimaxm3 and compare its attention and FFN assumptions with the four M3.1 Flash differences listed here. The issue calls for a design round covering attention and FFN kinds, GGUF and oracle routing, and placement across two cards plus the host tier; contributors should comment first to coordinate. Done means the maintainers’ design choices are agreed before the text path and then vision work begin.
Written by the indexing model from the issue text.
Description
MiniMax's M3.1 Flash: a multimodal MoE (text + vision), the same shapes as MiniMax-M3. Weights: MiniMaxAI/MiniMax-M3.1-Flash at 76faee1b.
- Safetensors only, 250 GB: MXFP8 weights, NVFP4 routed experts. A 2.3 GB DSpark draft model (5 layers) ships beside it.
- We already describe MiniMax-M3 on the model side (
crates/model/src/arch/minimaxm3). M3.1 Flash differs in four facts: every layer runs MiniMax Sparse Attention (M3 ran it only on the MoE layers), layers 0-2 keep a dense FFN, there is no MTP, and rope theta is 1e7. - No GGUF and no llama.cpp support yet. llama.cpp's
minimax-m3graph ties sparse attention to the leading dense count, so the M3 path would build layers 0-2 wrong. - License: MiniMax's own (custom, not OSI).
The maintainers take this one. We start with a design round: the reader split of attention kind and FFN kind, the GGUF and oracle route, and the placement on two cards plus the host tier. Then the text path, then vision. Contributors are welcome on any stage. Comment first so we do not duplicate work.
(Written with AI help.)
- Dominant language
- Rust
- Stars
- 21
- Forks
- 4
- Avg merge
- 2h 32m
- Merged PRs (30d)
- 530
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from midagedev/bloomery
-
review-bot
Maintainers usually reply within 1 day
-
review-bot
Maintainers usually reply within 1 day
-
model
Difficulty 5/5 Over a week Newbie friendliness 25/100
Maintainers usually reply within 1 day
-
model
Difficulty 5/5 Over a week Newbie friendliness 25/100
midagedev/bloomery#632 · 9 comments ·
Maintainers usually reply within 1 day
-
enhancement
Difficulty 4/5 1-2 days Newbie friendliness 45/100
midagedev/bloomery#617 · 1 comment ·
Maintainers usually reply within 1 day
All issues in midagedev/bloomery
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 85/100
farion1231/cc-switch#8829 ·
Maintainers usually reply within 1 day
-
bug ci good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
Maintainers usually reply within 1 day
-
Difficulty 1/5 Under an hour Newbie friendliness 92/100
longbridge/gpui-kit#3677 ·
Maintainers usually reply within 1 day
-
E-pr-welcome
Difficulty 2/5 1-3 hours Newbie friendliness 77/100
seanmonstar/reqwest#3121 · 2 comments ·
Maintainers usually reply within 1 day
-
Difficulty 1/5 Under an hour Newbie friendliness 68/100
ilya-zlobintsev/LACT#1235 ·
Maintainers usually reply within 1 day