Niko1221/Strata

View on GitHub

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

Is Niko1221/Strata beginner-friendly?

In the last 30 days, Niko1221/Strata merged 30 of 502 pull requests from outside contributors, and its maintainers usually reply within 1 day. No beginner-friendly issue is open right now; the list below has the other issues we hold for it.

Stars: 11.6k
Forks: 1k
Open beginner issues: 0
Indexed issues: 101
Avg merge: 7h 46m
Merged PRs (30d): 30

Dominant language: C++
License: MIT
Last GitHub push: Oct 4, 2026
Latest indexed: Oct 5, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

How to contribute to Niko1221/Strata

There is no contributing guide, so start from the README and a few recently merged pull requests to see how changes are proposed.
Your contributions will be published under the project's MIT license.
Follow the repository to hear when a new beginner-friendly issue opens, or look through the other issues below.

Beginner friendly Everything

Open All

Issues somebody may already be working on are listed last. List everything by date

Linux + RTX 50 (sm_120): an engine compiled with CUDA 13.2 answers garbage (IQ1_S/IQ2_S/IQ3_S miscompile); CUDA 13.0 works
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 48/100

Niko1221/Strata#892 · Opened Oct 5, 2026

Maintainers usually reply within 1 day
SYCL port v0.1.39 fails to compile: session.cpp ThreadAffinity type errors
Open
- Is something wrong?
Difficulty 3/5 1-2 days Newbie friendliness 68/100

Niko1221/Strata#891 · Opened Oct 5, 2026

Maintainers usually reply within 1 day
HIP: "parallel": 2 + --layer-split on 2x R9700 exits (code 1) after "captured the batch window over slots 0,1"
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 45/100

Niko1221/Strata#890 · Opened Oct 5, 2026

Maintainers usually reply within 1 day
HIP gfx1030, 2x RX 6900 XT: verify hangs after a long prompt when MMQ prompt path, adaptive expert swaps and SDMA meet (any one off avoids it)
Open
- Is something wrong?
Difficulty 5/5 Over a week Newbie friendliness 25/100

Niko1221/Strata#884 · 2 comments · Opened Oct 5, 2026

Maintainers usually reply within 1 day
[Windows / AMD] RX 6800M (gfx1031) runs with a self-built HIP engine — plus 2 Windows bugs found (packaging encoding, vision `vcvars`)
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 35/100

Niko1221/Strata#881 · Opened Oct 5, 2026

Maintainers usually reply within 1 day
All-logits-NaN degeneration (one repeated token forever) still fires on 0.1.39b / current main — first poison traced to the MoE output rows: garbage bits, varying layer
Open
- Is something wrong?
Difficulty 5/5 Over a week Newbie friendliness 25/100

Niko1221/Strata#879 · 1 comment · Opened Oct 5, 2026

Maintainers usually reply within 1 day
P40 + 3070 (mixed Pascal/Ampere pair): `layer_split: auto` vs forced splits on 0.1.39, with hit rates (follow-up to #604)
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 35/100

Niko1221/Strata#875 · 1 comment · Opened Oct 5, 2026

Maintainers usually reply within 1 day
A lot of disk write when vision is on.
Open
- Is something wrong?
Difficulty 3/5 1-2 days Newbie friendliness 42/100

Niko1221/Strata#874 · Opened Oct 5, 2026

Maintainers usually reply within 1 day
Session RESTARTS COMPUTER after 25-30 mins (gfx1100)
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 35/100

Niko1221/Strata#872 · 1 comment · Opened Oct 5, 2026

Maintainers usually reply within 1 day
Fresh prompts over --short-read decode !!!! (token 0) when the GPU holds 100% of the experts (48 GB card)
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 35/100

Niko1221/Strata#871 · Opened Oct 5, 2026

Maintainers usually reply within 1 day
Intel Arc Pro B60 (e211), 24 GB: first run on 0.1.39 + 4 fixes for current main
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 45/100

Niko1221/Strata#870 · Opened Oct 5, 2026

Maintainers usually reply within 1 day
Intel SYCL port on 2x Arc Pro B60: results, and "never rang (graph finished)" on the host-mirror path
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 35/100

Niko1221/Strata#867 · Opened Oct 5, 2026

Maintainers usually reply within 1 day
Got it working on my old 4 Maxwell Titans X, and 2016 dated Supermicro 4029TRT for Qwen 3.8 Flash Next Q8_0
Open
- Is something wrong?
Difficulty 5/5 Over a week Newbie friendliness 20/100

Niko1221/Strata#862 · 1 comment · 1 reaction · Opened Oct 5, 2026

Maintainers usually reply within 1 day
"parallel": 2 lowers total throughput on a single 48 GB card (100% expert-cache hits): keep MTP drafts in batch windows?
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 48/100

Niko1221/Strata#857 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Allow system ram to be used instead of SSD when available.
Open
- Is something wrong?
Difficulty 5/5 Over a week Newbie friendliness 25/100

Niko1221/Strata#847 · 3 comments · Opened Oct 4, 2026

Maintainers usually reply within 1 day
cache files problem and other one problem
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 25/100

Niko1221/Strata#842 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
not stable start with 3+ cards
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 48/100

Niko1221/Strata#841 · 1 comment · Opened Oct 4, 2026

Maintainers usually reply within 1 day
--calibrate on Windows + AMD (HIP prebuilt 0.1.39) measures decode ~18x slower than the same engine through server.py, so the tuning is meaningless
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 45/100

Niko1221/Strata#840 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Milestone: Add Apple Silicon Cross-Platform Support
Open
- Is something wrong?
Difficulty 5/5 Over a week Newbie friendliness 25/100

Niko1221/Strata#836 · 3 reactions · Opened Oct 4, 2026

Maintainers usually reply within 1 day
The profile's length caps the expert arena — even an explicit --expert-cache N
Open
- Is something wrong?
Difficulty 5/5 Over a week Newbie friendliness 35/100

Niko1221/Strata#831 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Let a one-shot request skip the prompt-cache work (~45 ms per call that is never reused)
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 52/100

Niko1221/Strata#830 · 1 comment · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Heap corruption (munmap_chunk: invalid pointer) at startup in Prefill::init — crashes with 1/2/4 GPUs
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 48/100

Niko1221/Strata#828 · 1 comment · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Results for --model UD-IQ4_XS
Open
- Is something wrong?
Difficulty 1/5 Under an hour Newbie friendliness 20/100

Niko1221/Strata#825 · 2 comments · Opened Oct 4, 2026

Maintainers usually reply within 1 day
ROCm on Windows ZIP
Open
- Is something wrong?
Difficulty 2/5 1-3 hours Newbie friendliness 68/100

Niko1221/Strata#821 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Assistant turn can be interrupted when generation emits a reserved ChatML boundary marker
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 35/100

Niko1221/Strata#817 · 1 comment · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Would it be possible to add support for the AMD Radeon RX 6750 GRE 12GB?
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 35/100

Niko1221/Strata#814 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Strange behavior for x2 RTX 5060 Ti (16Gb each) and UD-Q4_K_XL
Open
- Is something wrong?
Difficulty 3/5 1-2 days Newbie friendliness 65/100

Niko1221/Strata#806 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Tool call written inside `<think>` (no `</think>`) is returned as `reasoning_content`: no `tool_calls`, `finish_reason=stop`
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 45/100

Niko1221/Strata#804 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Perplexity ~7-10% above llama.cpp on the same GGUF (Qwen3.8-Flash-Next), also at 2K context, every version tested
Open
- Is something wrong?
Difficulty 5/5 Over a week Newbie friendliness 25/100

Niko1221/Strata#803 · 1 comment · 4 reactions · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Hybrid CPU detection on Linux counts only the Turbo Boost Max 3.0 "favored" cores as P-cores (Core Ultra 7 270K Plus: 2P/22E instead of 8P/16E) — affects setup's `--pool-workers` and `--pool-affinity auto|p-cores`
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 65/100

Niko1221/Strata#798 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Main engine strata.exe crashes with STATUS_ILLEGAL_INSTRUCTION (0xC000001D) on non-AVX-512 CPU - 20 WER crashes across v0.1.35/v0.1.38, fault offsets cluster in fixed code regions
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 48/100

Niko1221/Strata#795 · 1 comment · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Community benchmark: IQ3_S and community AP-Q4_K_M — single RTX 5070 Ti vs 2× RTX 5060 Ti layer split
Open
- Is something wrong?
Difficulty 5/5 Over a week Newbie friendliness 25/100

Niko1221/Strata#791 · 1 comment · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Codex got error "input items of type 'additional_tools' are not supported"
Open
- Is something wrong?
Difficulty 3/5 1-2 days Newbie friendliness 52/100

Niko1221/Strata#782 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
1M context: identical expert work per window, but the VRAM-touching stages grow 7-8x
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 45/100

Niko1221/Strata#781 · 4 comments · Opened Oct 4, 2026

Maintainers usually reply within 1 day
laptop crash with latest
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 25/100

Niko1221/Strata#779 · 1 comment · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Community result: 2.5-3.1x output at 256K context on a 16 GB card (IQ3_S) - calibration, --spec 6, learned profile
Open
- Is something wrong?
Difficulty 3/5 1-2 days Newbie friendliness 55/100

Niko1221/Strata#775 · 1 comment · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Support for Nvidia GB10.
Open
- Is something wrong?
Difficulty 5/5 Over a week Newbie friendliness 30/100

Niko1221/Strata#774 · 1 comment · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Community project: strata-router, a multi-node router for Strata / 社区项目：Strata 多节点路由入口
Open
- Is something wrong?
Difficulty 2/5 1-3 hours Newbie friendliness 65/100

Niko1221/Strata#772 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Linux expert arena (0.1.39): MADV_HUGEPAGE + defrag=madvise makes the arena's faults 20x slower (25 s start -> 432 s), and 'loaded ... at X GiB/s' does not show it
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 48/100

Niko1221/Strata#771 · 1 comment · 1 reaction · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Qwen 3.8 27B on Strata?
Open
- Is something wrong?
Difficulty 5/5 Over a week Newbie friendliness 25/100

Niko1221/Strata#770 · 2 comments · Opened Oct 4, 2026

Maintainers usually reply within 1 day
server.py: error: port 8080 is already in use
Open
- Is something wrong?
Difficulty 2/5 1-3 hours Newbie friendliness 52/100

Niko1221/Strata#769 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
--vision cpu caps images at 300 tokens; llama.cpp's mtmd asks for >=1024 for Qwen-VL grounding
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 48/100

Niko1221/Strata#767 · 2 comments · 3 reactions · Opened Oct 4, 2026

Maintainers usually reply within 1 day
524K via rope-scaling on consumer Blackwell (sm_120, no clusters): the histogram fallback works end to end — field data + two budget gotchas on 16GB cards
Open
- Is something wrong?
Difficulty 2/5 1-3 hours Newbie friendliness 54/100

Niko1221/Strata#760 · 2 comments · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Anthropic API: tool calls intermittently emitted inside `thinking` and returned as `end_turn`
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 48/100

Niko1221/Strata#754 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Regarding 128GB Memory Optimization Strategies
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 42/100

Niko1221/Strata#746 · 4 comments · Opened Oct 4, 2026

Maintainers usually reply within 1 day
[enhancement] Variance-normalized KV-cache quantization (KVarN) & KV cache precision tail
Open
- Is something wrong?
Difficulty 5/5 Over a week Newbie friendliness 20/100

Niko1221/Strata#739 · 2 reactions · Opened Oct 4, 2026

Maintainers usually reply within 1 day
Configurable system prompt in the web GUI
Open
- Is something wrong?
Difficulty 2/5 1-3 hours Newbie friendliness 85/100

Niko1221/Strata#738 · 1 comment · 1 reaction · Opened Oct 4, 2026

Maintainers usually reply within 1 day
[enhancement] #498 follow-up: UD-Q4_K_XL split gate — allow confirm/override just below 135 GB total RAM
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 48/100

Niko1221/Strata#737 · 1 comment · 1 reaction · Opened Oct 4, 2026

Maintainers usually reply within 1 day
5090 Laptop 24G + 96 GB RAM swift-iq3_xxs和qwen-iq3_s 524K 是最优档：decode 完全不掉
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 35/100

Niko1221/Strata#736 · Opened Oct 4, 2026

Maintainers usually reply within 1 day
can't load vision encoder
Open
- Is something wrong?
Difficulty 4/5 3-5 days Newbie friendliness 45/100

Niko1221/Strata#735 · Opened Oct 4, 2026

Maintainers usually reply within 1 day

Showing the newest 100

This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.

Open advanced filter

Niko1221/Strata

Is Niko1221/Strata beginner-friendly?

How to contribute to Niko1221/Strata

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Is something wrong?

Showing the newest 100

Get new issues in your inbox