Unable to Find libnvidia-ml.so.1 When Using "docker compose linux-gpu up"
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 30/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- docker, docker-compose
- Domain
- devops, infrastructure
Research direction
Start by reproducing docker compose --profile linux-gpu up and reviewing the linux-gpu Compose profile and .env URL guidance. Determine whether the failure is the host NVIDIA runtime missing libnvidia-ml.so.1, the container network route to llm-gpu, or both. Done means the documented GPU setup starts successfully and the model-pull service reaches Ollama.
Written by the indexing model from the issue text.
Description
Here is the result of my command. Is this error inside the container or outside? The weird part to me is:
genai-stack-pull-model-1 | pulling ollama model llama2 using http://llm-gpu:11434
The docs told me to add that URL to the .env file. However, I certainly don't have server running there.
$ docker compose --profile linux-gpu up
WARN[0000] The "LANGCHAIN_PROJECT" variable is not set. Defaulting to a blank string.
WARN[0000] The "LANGCHAIN_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_ACCESS_KEY_ID" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_SECRET_ACCESS_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_DEFAULT_REGION" variable is not set. Defaulting to a blank string.
WARN[0000] The "LANGCHAIN_PROJECT" variable is not set. Defaulting to a blank string.
WARN[0000] The "LANGCHAIN_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_ACCESS_KEY_ID" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_SECRET_ACCESS_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_DEFAULT_REGION" variable is not set. Defaulting to a blank string.
WARN[0000] The "LANGCHAIN_PROJECT" variable is not set. Defaulting to a blank string.
WARN[0000] The "LANGCHAIN_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_ACCESS_KEY_ID" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_SECRET_ACCESS_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_DEFAULT_REGION" variable is not set. Defaulting to a blank string.
WARN[0000] The "OPENAI_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "LANGCHAIN_PROJECT" variable is not set. Defaulting to a blank string.
WARN[0000] The "LANGCHAIN_API_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_ACCESS_KEY_ID" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_SECRET_ACCESS_KEY" variable is not set. Defaulting to a blank string.
WARN[0000] The "AWS_DEFAULT_REGION" variable is not set. Defaulting to a blank string.
[+] Running 4/4
✔ llm-gpu 3 layers [⣿⣿⣿] 0B/0B Pulled 1.3s
✔ aece8493d397 Already exists 0.0s
✔ 3b9196308e0f Already exists 0.0s
✔ e75cbce7870b Already exists 0.0s
[+] Building 0.0s (0/0) docker:desktop-linux
[+] Running 8/8
✔ Container genai-stack-llm-gpu-1 Created 0.0s
✔ Container genai-stack-database-1 Running 0.0s
✔ Container genai-stack-pull-model-1 Recreated 0.1s
✔ Container genai-stack-api-1 Recreated 0.1s
✔ Container genai-stack-bot-1 Recreated 0.1s
✔ Container genai-stack-pdf_bot-1 Recreated 0.1s
✔ Container genai-stack-loader-1 Recreated 0.1s
✔ Container genai-stack-front-end-1 Recreated 0.1s
Attaching to genai-stack-api-1, genai-stack-bot-1, genai-stack-database-1, genai-stack-front-end-1, genai-stack-llm-gpu-1, genai-stack-loader-1, genai-stack-pdf_bot-1, genai-stack-pull-model-1
genai-stack-pull-model-1 | pulling ollama model llama2 using http://llm-gpu:11434
genai-stack-pull-model-1 | Error: Head "http://llm-gpu:11434/": dial tcp 172.18.0.4:11434: connect: no route to host
genai-stack-pull-model-1 exited with code 1
Error response from daemon: failed to create task for container: failed to create shim task: OCI runtime create failed: runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: Auto-detected mode as 'legacy'
nvidia-container-cli: initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: no such file or directory: unknown
- Dominant language
- Python
- Stars
- 5.4k
- Forks
- 1.2k
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from docker/genai-stack
-
Difficulty 4/5 3-5 days Newbie friendliness 15/100
docker/genai-stack#207 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 25/100
docker/genai-stack#205 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
docker/genai-stack#203 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 35/100
docker/genai-stack#195 · 3 comments ·
-
Bot is unresponsive Open
Difficulty 4/5 3-5 days Newbie friendliness 35/100
docker/genai-stack#194 · 1 comment ·
All issues in docker/genai-stack
Similar issues
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
use-agent-os/agent-os#3314 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
BasedHardware/omi#15662 · 1 comment ·
-
documentation help wanted
Difficulty 2/5 1-3 hours Newbie friendliness 90/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
AiursoftWeb/AnduinOS-2#19 ·