Repository Issues

ggml-org/llama.cpp

LLM inference in C/C++

View on GitHub
Stars
 (124,134 stars)
Forks
 (21,764 forks)
Indexed issues
 (58 indexed issues)
open beginner issues
 (38 open beginner issues)
Latest indexed
Aug 14, 2026
Last GitHub push
Aug 16, 2026
License
MIT License
Contributing guide
Contributing guide
Code of conduct
No code of conduct
Dominant language
C++
PR merge metrics
 (Avg merge 6d 8h) (389 merged PRs in 30d)
Beginner labels
good first issuehelp wanted

Issues

58 indexed issues

Closed
Bug: Failed to run qwen2-57b-a14b-instruct-fp16.
buggood first issuehigh severity
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #9628 · Sep 24, 2024 · C++ · 124,134 stars

4 comments0 reactions0 assignees
Closed
Improve `cvector-generator`
enhancementgood first issuehelp wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #8724 · Jul 27, 2024 · C++ · 124,134 stars

34 comments1 reaction0 assignees
Open
Feature Request: Installable package via winget
enhancementhelp wanted
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #8188 · Jun 28, 2024 · C++ · 124,134 stars

22 comments7 reactions0 assignees
Closed
ggml : add WebGPU backend
help wantedresearch 🔬roadmap
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #7773 · Jun 5, 2024 · C++ · 124,134 stars

28 comments23 reactions0 assignees
Open
ggml : add DirectML backend
help wantedresearch 🔬roadmap
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #7772 · Jun 5, 2024 · C++ · 124,134 stars

20 comments39 reactions0 assignees
Closed
server: avoid full prompt eval when 'prompt >= ctx'
enhancementgood first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #6855 · Apr 23, 2024 · C++ · 124,134 stars

3 comments0 reactions0 assignees
Closed
Support for Phi-3 models
good first issuemodel
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #6849 · Apr 23, 2024 · C++ · 124,134 stars

84 comments61 reactions0 assignees
Open
ggml : add GPU support for Mamba models
Nvidia GPUenhancementhelp wantedroadmap
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #6758 · Apr 19, 2024 · C++ · 124,134 stars

39 comments32 reactions0 assignees
Open
kubernetes example
enhancementhelp wantedkubernetes
Why recommendedHas a beginner-friendly label · Repository active this month
Has a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #6546 · Apr 8, 2024 · C++ · 124,134 stars

25 comments10 reactions1 assignee
Open
Question: How to generate an MPS gputrace
help wantedhigh priority
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #6506 · Apr 5, 2024 · C++ · 124,134 stars

11 comments0 reactions0 assignees
Closed
server: support control vectors
enhancementgood first issue
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #6316 · Mar 26, 2024 · C++ · 124,134 stars

1 comment4 reactions0 assignees
Open
llama cpp server cant open to public
enhancementgood first issueserver
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #6268 · Mar 24, 2024 · C++ · 124,134 stars

6 comments0 reactions0 assignees
Open
split: allow --split-max-size option
enhancementgood first issuehelp wantedsplit
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #6259 · Mar 23, 2024 · C++ · 124,134 stars

4 comments1 reaction0 assignees
Open
server : add "token healing" support
enhancementgood first issueroadmap
Why recommendedNo assignee yet · Has a beginner-friendly label
No assignee yetHas a beginner-friendly labelRepository active this monthContributing guide available

ggml-org / llama.cpp · #5765 · Feb 28, 2024 · C++ · 124,134 stars

9 comments14 reactions0 assignees