ggml-org/llama.cpp

Feature Request: Implement missing ops from backends

Open

#14 909 ouverte le 28 juil. 2025

Voir sur GitHub
 (39 commentaires) (6 réactions) (0 assignés)C++ (18 202 forks)batch import
enhancementgood first issue

Métriques du dépôt

Stars
 (110 169 stars)
Métriques de merge PR
 (Merge moyen 5j 11h) (457 PRs mergées en 30 j)

Description

Prerequisites

  • I am running the latest code. Mention the version if possible as well.
  • I carefully followed the README.md.
  • I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
  • I reviewed the Discussions, and have a new and useful enhancement to share.

Feature Description

The list of supported operation in ggml per backend is maintained at https://github.com/ggml-org/llama.cpp/blob/master/docs/ops.md

How to contribute to make the list more complete:

  1. Pick an operation which is not implemented in a backend (pick ones marked with ❌), pick only one per PR
  2. Implement the operation
  3. Test your implementation with test-backend-ops -o <op>
  4. If it passes test for the op, create a PR.
  5. Mention performance tests in the PR if they exist (via test-backend-ops perf -o <op>)

Notes:

  1. The ops suffixed with _BACK are related to training which is WIP and does not require immediate attention
  2. Do not link this issue in your PR, which will lead to closing this issue when your PR is merged. Instead, just mention it. Example PRs will be linked below
  3. This list can be temporarily out of sync, you can check support by first running test-backend-ops -o <op> on master to confirm
  4. Please do not ask to be assigned a particular task, make the PR first if you think it will be useful

Motivation

Feature parity between backends is always desirable and it's easy to test the implementation, making it an ideal good first issue.

Possible Implementation

No response

Guide contributeur