Hacktoberfest 2026: die Issues, die Maintainer für den Oktober markiert haben – offen und einsteigerfreundlich. Hacktoberfest-Issues durchsuchen

[Feature]: AMD Strix Halo Vulkan GPU Acceleration and Ollama Engine Configuration

Offen
  • Stimmt etwas nicht?
#154 1 Kommentar 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen

Maintainer antworten meist innerhalb von 5 Tagen

Dieses Issue hat noch niemand übernommen.

Bewertung

Schwierigkeit
4/5
Geschätzter Aufwand
3-5 Tage
Anfängerfreundlichkeit
25/100
Issue-Typ
Feature
Klarheit
Größtenteils klar
Aktivitätsstatus
Aktiv
Tech-Stack
go, linux
Bereich
backend

Rechercherichtung

Start with how the router launches its managed Ollama engine on port 11435 and which environment it passes to that process; the reporter says no supported setting exists for this. Check that OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1 reach the child process, then confirm with size_vram that the model loads on the Radeon 8060S. Done means a persisted, validated setting that enables Vulkan without changing cluster routing or the external API; the maintainers still need to decide the design.

Vom Indexierungsmodell aus dem Issue-Text verfasst.

Beschreibung

enhancement
Area

Engine or model management

User problem

Is AMD Strix Halo (Ryzen AI Max+ 395 / Radeon 8060S) running Ubuntu Linux an intended PAIR inference platform? We have confirmed that PAIR 0.1.1 operates successfully on this system, and its bundled Ollama 0.34.1 can run Qwen 3.6 27B with Vulkan acceleration when OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1 are supplied. However, PAIR's managed Ollama starts without those settings and runs inference on the CPU. Is there a supported way to enable Vulkan for the managed engine?

Desired outcome

Provide a supported method for enabling GPU acceleration in PAIR-managed Ollama on compatible AMD hardware, including AMD Strix Halo (Ryzen AI Max+ 395 / Radeon 8060S).

Ideally, PAIR would allow users to configure the inference backend or supply engine-specific environment variables, such as OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1, through the application settings.

These settings should persist across engine restarts and application updates without requiring modifications to PAIR's internal files.

The expected result is that supported AMD GPUs can execute model inference through PAIR with GPU acceleration, while preserving existing cluster routing and model management functionality.

We would also appreciate clarification on whether AMD Strix Halo is an officially supported or planned GPU inference platform.

Alternatives considered

We successfully tested PAIR's bundled Ollama 0.34.1 independently using a temporary server on port 11436, with OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1.

The test detected the Radeon 8060S through Vulkan and successfully ran Qwen 3.6 27B with the full model allocation reported on the GPU.

In contrast, PAIR's managed Ollama instance on port 11435 runs the same model on the CPU, with size_vram reported as 0.

We examined the available PAIR configuration files, engine manager command-line options, and desktop application settings. We did not identify a supported mechanism for configuring GPU acceleration or passing environment variables to the managed Ollama engine.

We considered maintaining a separate GPU-enabled Ollama instance or modifying PAIR's startup environment, but neither approach has been validated for our existing multi-node PAIR cluster. We prefer a supported configuration method.

Compatibility and security implications

The requested functionality should preserve PAIR's existing proxy, networking, cluster pairing, authentication, and model-routing behavior.

GPU backend selection and engine environment variables should apply only to the locally managed inference engine, without changing the cluster's external API endpoints or exposing additional network services.

Existing configurations should continue to work without modification. GPU acceleration should remain optional, with current defaults preserved for systems where the requested backend is unavailable.

Any engine settings should persist across application restarts and updates. Ideally, the interface would validate supported options and avoid exposing arbitrary environment variables that could affect security-sensitive engine behavior.

No changes to model data handling, cluster identity, or authentication are requested.

Validation approach

Suggested validation on an AMD Ryzen AI Max+ 395 / Radeon 8060S system running Ubuntu Linux:

  1. Enable Vulkan acceleration for PAIR-managed Ollama through the supported configuration interface.
  2. Restart the managed engine and verify that the configuration persists.
  3. Confirm that Ollama discovers the Radeon 8060S using the Vulkan backend.
  4. Load Qwen 3.6 27B (Q4_K_M) through PAIR and execute a short inference request.
  5. Verify that Ollama reports nonzero size_vram and that AMDGPU memory usage increases during model loading.
  6. Confirm that PAIR's proxy, model discovery, cluster routing, and model ejection continue functioning normally.
  7. Restart PAIR and verify that GPU acceleration remains enabled without manual intervention.

For reference, we independently tested PAIR's bundled Ollama 0.34.1 using OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1.

The standalone test successfully detected the Radeon 8060S through Vulkan, reported approximately 94.7 GiB of GPU-addressable memory, and ran Qwen 3.6 27B with approximately 17.15 GB allocated to the GPU.

The same model running through PAIR's default managed engine reported size_vram=0.

Confirmations
  • I searched existing issues for duplicates.
  • I agree to follow the Code of Conduct.
Vorherrschende Sprache
Go
Sterne
1.6k
Forks
266
Ø Merge
3 T. 15 Std.
Gemergte PRs (30 T.)
23

Entwicklungsumgebung

Erste Schritte

  1. Lesen Sie das ganze Issue und danach den Beitragsleitfaden des Projekts.
  2. Schreiben Sie ins Issue, dass Sie es übernehmen — das erspart doppelte Arbeit.
  3. Forken Sie das Repository und arbeiten Sie in einem Branch.
  4. Öffnen Sie einen Pull Request, der die Issue-Nummer nennt.

Mehr aus NVIDIA/Personal-AI-Router

Alle Issues in NVIDIA/Personal-AI-Router

Ähnliche Issues

Weitere Issues zu Go

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.