Hacktoberfest 2026: as issues que os mantenedores marcaram para outubro, abertas e boas para iniciantes. Ver issues do Hacktoberfest

[Feature]: AMD Strix Halo Vulkan GPU Acceleration and Ollama Engine Configuration

Aberta
  • Algo errado?
#154 1 comentário 0 reações 0 responsáveis Ver no GitHub

Mantenedores costumam responder em até 5 dias

Ninguém assumiu esta issue ainda.

Avaliação

Dificuldade
4/5
Tempo estimado
3-5 dias
Facilidade para iniciantes
25/100
Tipo de issue
Funcionalidade
Clareza
Razoavelmente clara
Status de atividade
Ativa
Stack de tecnologia
go, linux
Domínio
backend

Direção de pesquisa

Start with how the router launches its managed Ollama engine on port 11435 and which environment it passes to that process; the reporter says no supported setting exists for this. Check that OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1 reach the child process, then confirm with size_vram that the model loads on the Radeon 8060S. Done means a persisted, validated setting that enables Vulkan without changing cluster routing or the external API; the maintainers still need to decide the design.

Escrita pelo modelo de indexação a partir do texto da issue.

Descrição

enhancement
Area

Engine or model management

User problem

Is AMD Strix Halo (Ryzen AI Max+ 395 / Radeon 8060S) running Ubuntu Linux an intended PAIR inference platform? We have confirmed that PAIR 0.1.1 operates successfully on this system, and its bundled Ollama 0.34.1 can run Qwen 3.6 27B with Vulkan acceleration when OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1 are supplied. However, PAIR's managed Ollama starts without those settings and runs inference on the CPU. Is there a supported way to enable Vulkan for the managed engine?

Desired outcome

Provide a supported method for enabling GPU acceleration in PAIR-managed Ollama on compatible AMD hardware, including AMD Strix Halo (Ryzen AI Max+ 395 / Radeon 8060S).

Ideally, PAIR would allow users to configure the inference backend or supply engine-specific environment variables, such as OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1, through the application settings.

These settings should persist across engine restarts and application updates without requiring modifications to PAIR's internal files.

The expected result is that supported AMD GPUs can execute model inference through PAIR with GPU acceleration, while preserving existing cluster routing and model management functionality.

We would also appreciate clarification on whether AMD Strix Halo is an officially supported or planned GPU inference platform.

Alternatives considered

We successfully tested PAIR's bundled Ollama 0.34.1 independently using a temporary server on port 11436, with OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1.

The test detected the Radeon 8060S through Vulkan and successfully ran Qwen 3.6 27B with the full model allocation reported on the GPU.

In contrast, PAIR's managed Ollama instance on port 11435 runs the same model on the CPU, with size_vram reported as 0.

We examined the available PAIR configuration files, engine manager command-line options, and desktop application settings. We did not identify a supported mechanism for configuring GPU acceleration or passing environment variables to the managed Ollama engine.

We considered maintaining a separate GPU-enabled Ollama instance or modifying PAIR's startup environment, but neither approach has been validated for our existing multi-node PAIR cluster. We prefer a supported configuration method.

Compatibility and security implications

The requested functionality should preserve PAIR's existing proxy, networking, cluster pairing, authentication, and model-routing behavior.

GPU backend selection and engine environment variables should apply only to the locally managed inference engine, without changing the cluster's external API endpoints or exposing additional network services.

Existing configurations should continue to work without modification. GPU acceleration should remain optional, with current defaults preserved for systems where the requested backend is unavailable.

Any engine settings should persist across application restarts and updates. Ideally, the interface would validate supported options and avoid exposing arbitrary environment variables that could affect security-sensitive engine behavior.

No changes to model data handling, cluster identity, or authentication are requested.

Validation approach

Suggested validation on an AMD Ryzen AI Max+ 395 / Radeon 8060S system running Ubuntu Linux:

  1. Enable Vulkan acceleration for PAIR-managed Ollama through the supported configuration interface.
  2. Restart the managed engine and verify that the configuration persists.
  3. Confirm that Ollama discovers the Radeon 8060S using the Vulkan backend.
  4. Load Qwen 3.6 27B (Q4_K_M) through PAIR and execute a short inference request.
  5. Verify that Ollama reports nonzero size_vram and that AMDGPU memory usage increases during model loading.
  6. Confirm that PAIR's proxy, model discovery, cluster routing, and model ejection continue functioning normally.
  7. Restart PAIR and verify that GPU acceleration remains enabled without manual intervention.

For reference, we independently tested PAIR's bundled Ollama 0.34.1 using OLLAMA_VULKAN=1 and OLLAMA_IGPU_ENABLE=1.

The standalone test successfully detected the Radeon 8060S through Vulkan, reported approximately 94.7 GiB of GPU-addressable memory, and ran Qwen 3.6 27B with approximately 17.15 GB allocated to the GPU.

The same model running through PAIR's default managed engine reported size_vram=0.

Confirmations
  • I searched existing issues for duplicates.
  • I agree to follow the Code of Conduct.
Linguagem predominante
Go
Estrelas
1.6k
Forks
266
Merge médio
3d 15h
PRs com merge (30d)
23

Preparar o ambiente

Primeiros passos

  1. Leia a issue inteira e depois o guia de contribuição do projeto.
  2. Comente na issue dizendo que vai assumir — evita que duas pessoas façam o mesmo trabalho.
  3. Faça um fork do repositório e trabalhe em uma branch.
  4. Abra um pull request que referencie o número da issue.

Mais de NVIDIA/Personal-AI-Router

Todas as issues de NVIDIA/Personal-AI-Router

Issues semelhantes

Mais issues de Go

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.