containers/ramalama

unable to run ramalama using --runtime vllm on macOS

Open

#801 opened on Feb 13, 2025

View on GitHubContributor guide
 (10 comments) (0 reactions) (0 assignees)Python (355 forks)github user discovery
good first issuestale-issue

Repository metrics

Stars
 (3,000 stars)
PR merge metrics
 (Avg merge 6d 7h) (32 merged PRs in 30d)

Description

trying ramalama on macOS 15 using --runtime vllm

I got

Trying to pull quay.io/modh/vllm:rhoai-2.18-cuda...
Error: choosing an image from manifest list docker://quay.io/modh/vllm:rhoai-2.18-cuda: no image found in image index for architecture "arm64", variant "v8", OS "linux"

it seems to fetch a cuda image while I am on Apple silicon.

Contributor guide

Research direction
Investigate why the image manifest for quay.io/modh/vllm:rhoai 2.18 cuda lacks an arm64 variant. Determine if a different image tag or registry can be used that supports arm64, or if the image selection logic in ramalama needs to be updated to handle architecture detection.
Tech stack
pythondocker
Domain
backendcli
Issue type
Bug
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
GitDocker
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60