containers/ramalama

unable to run ramalama using --runtime vllm on macOS

Offen

#801 geöffnet am 13.02.2025

 (10 Kommentare) (0 Reaktionen) (0 zugewiesene Personen)Python (357 Forks)github user discovery
good first issuestale-issue

Repository-Metriken

Stars
 (3.013 Sterne)
PR-Merge-Metriken
 (Durchschn. Merge 6T 7h) (32 gemergte PRs in 30 T)

Beschreibung

trying ramalama on macOS 15 using --runtime vllm

I got

Trying to pull quay.io/modh/vllm:rhoai-2.18-cuda...
Error: choosing an image from manifest list docker://quay.io/modh/vllm:rhoai-2.18-cuda: no image found in image index for architecture "arm64", variant "v8", OS "linux"

it seems to fetch a cuda image while I am on Apple silicon.

Contributor Guide