Hacktoberfest 2026: the issues maintainers tagged for October, open and beginner-friendly. Browse Hacktoberfest issues

Results for --model UD-IQ4_XS

Open
  • Is something wrong?
#825 3 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
1/5
Estimated time
Under an hour
Newbie friendliness
20/100
Issue type
Documentation
Clarity
Needs clarification
Activity status
Active
Domain
performance

Research direction

The issue reports performance results for UD-IQ4_XS at 32k and 128k context sizes on the listed hardware, but does not request a change or name files or tests. First clarify with the author what they want done with these results. Until there is a defined change and a way to verify it, there is no completion criterion.

Written by the indexing model from the issue text.

Description

Just want to say thank you for a quick update here are the results for --model UD-IQ4_XS

CPU 9950X3D
RAM 64GB
GPU RTX5080 16GB.
NVME
Windows 11

32k Token Context size, everything else default

Time Status Prompt Reused Output Tok/s VRAM hit rate Duration
01:59:27 PM Done 61 0 23,947 26.6 72.7% +15.1% PCIe 902.9 s
01:58:02 PM Done 18 0 8 23.7 38.6% +27.2% PCIe 1.2 s
Since Sun 01:57 PM: 2 requests · 79 prompt tokens read at 37 tok/s (0 reused) · 23,955 written at 26.6 tok/s

128k Token Context size, everything else default

Time Status Prompt Reused Output Tok/s VRAM hit rate Duration
02:37:17 PM Done 64,723 64,507 510 27.1 61.9% +20.8% PCIe 22.0 s
02:37:04 PM Done 64,256 63,881 250 26.7 54.5% +23.7% PCIe 13.1 s
02:36:37 PM Done 63,300 63,136 579 24.0 61.0% +21.1% PCIe 26.3 s
02:36:26 PM Done 62,929 62,421 207 29.2 64.6% +19.5% PCIe 10.5 s
02:35:36 PM Done 61,570 48,115 851 30.6 67.2% +18.0% PCIe 49.6 s
02:35:23 PM Done 47,904 47,783 211 25.7 58.8% +22.1% PCIe 10.4 s
02:35:15 PM Done 47,642 47,573 141 25.4 59.5% +21.3% PCIe 7.8 s
02:35:00 PM Done 47,440 47,327 133 31.6 65.5% +19.0% PCIe 6.4 s
02:33:55 PM Done 47,204 47,177 124 25.9 60.9% +21.0% PCIe 5.7 s
02:33:43 PM Done 47,016 46,639 161 22.1 56.5% +23.0% PCIe 11.1 s
02:33:20 PM Done 46,195 46,027 444 22.9 62.1% +20.1% PCIe 22.6 s
02:33:09 PM Done 45,807 45,639 219 27.6 62.5% +20.5% PCIe 10.9 s
02:32:04 PM Done 43,748 43,663 1,890 30.2 66.6% +18.4% PCIe 64.8 s
02:31:56 PM Done 43,558 43,428 104 23.7 61.4% +21.0% PCIe 7.2 s
02:31:37 PM Done 42,866 42,773 562 33.0 71.6% +16.3% PCIe 19.0 s
02:31:28 PM Done 42,597 42,462 177 29.0 68.5% +17.1% PCIe 8.9 s
02:31:14 PM Done 42,200 42,010 263 24.9 64.4% +19.2% PCIe 13.4 s
02:31:02 PM Done 41,817 41,490 190 22.7 61.0% +20.4% PCIe 11.9 s
02:30:40 PM Done 41,356 31,505 130 25.0 57.3% +21.7% PCIe 22.1 s
02:25:51 PM Done 31,510 20,401 9,517 35.9 70.2% +17.4% PCIe 288.2 s
02:25:36 PM Done 20,270 16,858 131 32.1 64.9% +20.7% PCIe 14.4 s
02:24:55 PM Done 16,591 0 268 36.8 62.8% +21.9% PCIe 40.4 s

Dominant language
C++
Stars
11.6k
Forks
1k
Avg merge
7h 46m
Merged PRs (30d)
30

Getting set up

This project ships no dev container, Dockerfile or contributing guide, so setting up is up to you: start from its README, and see our first-contribution guide for the general steps.

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from Niko1221/Strata

All issues in Niko1221/Strata

Similar issues

More C++ issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.