Hacktoberfest 2026: le issue che i maintainer hanno segnato per ottobre, aperte e adatte ai principianti. Sfoglia le issue Hacktoberfest

[Feature]: AMD Strix Halo Vulkan GPU Acceleration and Ollama Engine Configuration

Aperta
  • Qualcosa non va?
#154 1 commento 0 reazioni 0 assegnatari Vedi su GitHub

I maintainer di solito rispondono entro 5 giorni

Nessuno ha ancora preso questa issue.

Valutazione

Difficoltà
4/5
Tempo stimato
3-5 giorni
Idoneità per principianti
25/100
Tipo di issue
Funzionalità
Chiarezza
Abbastanza chiara
Stato di attività
Attiva
Stack tecnologico
go, linux
Ambito
backend

Direzione di ricerca

Start with how the router launches its managed Ollama engine on port 11435 and which environment it passes to that process; the reporter says no supported setting exists for this. Check that OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1 reach the child process, then confirm with size_vram that the model loads on the Radeon 8060S. Done means a persisted, validated setting that enables Vulkan without changing cluster routing or the external API; the maintainers still need to decide the design.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Descrizione

enhancement
Area

Engine or model management

User problem

Is AMD Strix Halo (Ryzen AI Max+ 395 / Radeon 8060S) running Ubuntu Linux an intended PAIR inference platform? We have confirmed that PAIR 0.1.1 operates successfully on this system, and its bundled Ollama 0.34.1 can run Qwen 3.6 27B with Vulkan acceleration when OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1 are supplied. However, PAIR's managed Ollama starts without those settings and runs inference on the CPU. Is there a supported way to enable Vulkan for the managed engine?

Desired outcome

Provide a supported method for enabling GPU acceleration in PAIR-managed Ollama on compatible AMD hardware, including AMD Strix Halo (Ryzen AI Max+ 395 / Radeon 8060S).

Ideally, PAIR would allow users to configure the inference backend or supply engine-specific environment variables, such as OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1, through the application settings.

These settings should persist across engine restarts and application updates without requiring modifications to PAIR's internal files.

The expected result is that supported AMD GPUs can execute model inference through PAIR with GPU acceleration, while preserving existing cluster routing and model management functionality.

We would also appreciate clarification on whether AMD Strix Halo is an officially supported or planned GPU inference platform.

Alternatives considered

We successfully tested PAIR's bundled Ollama 0.34.1 independently using a temporary server on port 11436, with OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1.

The test detected the Radeon 8060S through Vulkan and successfully ran Qwen 3.6 27B with the full model allocation reported on the GPU.

In contrast, PAIR's managed Ollama instance on port 11435 runs the same model on the CPU, with size_vram reported as 0.

We examined the available PAIR configuration files, engine manager command-line options, and desktop application settings. We did not identify a supported mechanism for configuring GPU acceleration or passing environment variables to the managed Ollama engine.

We considered maintaining a separate GPU-enabled Ollama instance or modifying PAIR's startup environment, but neither approach has been validated for our existing multi-node PAIR cluster. We prefer a supported configuration method.

Compatibility and security implications

The requested functionality should preserve PAIR's existing proxy, networking, cluster pairing, authentication, and model-routing behavior.

GPU backend selection and engine environment variables should apply only to the locally managed inference engine, without changing the cluster's external API endpoints or exposing additional network services.

Existing configurations should continue to work without modification. GPU acceleration should remain optional, with current defaults preserved for systems where the requested backend is unavailable.

Any engine settings should persist across application restarts and updates. Ideally, the interface would validate supported options and avoid exposing arbitrary environment variables that could affect security-sensitive engine behavior.

No changes to model data handling, cluster identity, or authentication are requested.

Validation approach

Suggested validation on an AMD Ryzen AI Max+ 395 / Radeon 8060S system running Ubuntu Linux:

  1. Enable Vulkan acceleration for PAIR-managed Ollama through the supported configuration interface.
  2. Restart the managed engine and verify that the configuration persists.
  3. Confirm that Ollama discovers the Radeon 8060S using the Vulkan backend.
  4. Load Qwen 3.6 27B (Q4_K_M) through PAIR and execute a short inference request.
  5. Verify that Ollama reports nonzero size_vram and that AMDGPU memory usage increases during model loading.
  6. Confirm that PAIR's proxy, model discovery, cluster routing, and model ejection continue functioning normally.
  7. Restart PAIR and verify that GPU acceleration remains enabled without manual intervention.

For reference, we independently tested PAIR's bundled Ollama 0.34.1 using OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1.

The standalone test successfully detected the Radeon 8060S through Vulkan, reported approximately 94.7 GiB of GPU-addressable memory, and ran Qwen 3.6 27B with approximately 17.15 GB allocated to the GPU.

The same model running through PAIR's default managed engine reported size_vram=0.

Confirmations
  • I searched existing issues for duplicates.
  • I agree to follow the Code of Conduct.
Lingua principale
Go
Stelle
1.6k
Fork
266
Merge medio
3g 15h
PR unite (30g)
23

Preparare l'ambiente

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di NVIDIA/Personal-AI-Router

Tutte le issue di NVIDIA/Personal-AI-Router

Issue simili

Altre issue su Go

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.