containers/ramalama

unable to run ramalama using --runtime vllm on macOS

开放

#801 创建于 2025年2月13日

 (10 条评论) (0 个反应) (0 位负责人)Python (354 个派生)github user discovery
good first issuestale-issue

仓库指标

星标
 (3,003 个星标)
PR 合并指标
 (平均合并 6天 7小时) (30 天内合并 32 个 PR)

描述

trying ramalama on macOS 15 using --runtime vllm

I got

Trying to pull quay.io/modh/vllm:rhoai-2.18-cuda...
Error: choosing an image from manifest list docker://quay.io/modh/vllm:rhoai-2.18-cuda: no image found in image index for architecture "arm64", variant "v8", OS "linux"

it seems to fetch a cuda image while I am on Apple silicon.

贡献者指南