Kaggle/docker-python

Can't install vllm, llama.cpp

Open

#1,369 opened on 2024年3月9日

GitHub で見る
 (0 comments) (0 reactions) (0 assignees)Python (2,260 stars) (946 forks)batch import
bughelp wanted

説明

🐛 Bug

Recently, CUDA has updated to12. However, I'm encountering errors when attempting to install VLLM and llama.cpp using pip. Could there be an issue with my CUDA installation? For reference, the error messages are: image image

To Reproduce

Expected behavior

Additional context

コントリビューターガイド