kernels benchmark does not support XPU

Aperta
  • Qualcosa non va?
#669 2 commenti 0 reazioni 1 assegnatario Vedi su GitHub

I maintainer di solito rispondono entro 1 giorno

@drbh ci sta già lavorando.

Dal 1/7/2026.

  • #727 di @AdityaKulshrestha — aperta

Valutazione

Questa issue non è ancora stata valutata.

Descrizione

bug
Description

Expected the XPU to be discovered and used for benchmarking for kernels that have XPU versions.

Steps to reproduce
# Will open PR to add kernels[xpu] soon
uv pip install --index  https://download.pytorch.org/whl/xpu "torch==2.12+xpu"

uv pip install "kernels[benchmark]"

source .venv/bin/activate

kernels benchmark kernels-community/flash-attn2 --version 1

Traceback (most recent call last):
  File "/dan/projects/kernels/.venv/bin/kernels", line 10, in <module>
    sys.exit(main())
             ^^^^^^
  File "/dan/projects/kernels/.venv/lib/python3.12/site-packages/kernels/cli/__init__.py", line 87, in main
    args.func(args)
  File "/dan/projects/kernels/.venv/lib/python3.12/site-packages/kernels/cli/__init__.py", line 165, in run_benchmark
    benchmark.run_benchmark(
  File "/dan/projects/kernels/.venv/lib/python3.12/site-packages/kernels/cli/benchmark.py", line 751, in run_benchmark
    results, kernel_sha = run_benchmark_script(
                          ^^^^^^^^^^^^^^^^^^^^^
  File "/dan/projects/kernels/.venv/lib/python3.12/site-packages/kernels/cli/benchmark.py", line 650, in run_benchmark_script
    results, kernel_sha = run_benchmark_class(
                          ^^^^^^^^^^^^^^^^^^^^
  File "/dan/projects/kernels/.venv/lib/python3.12/site-packages/kernels/cli/benchmark.py", line 501, in run_benchmark_class
    setup_fn()
  File "/dan/projects/kernels/.venv/lib/python3.12/site-packages/kernels/benchmarks/attention.py", line 75, in setup_large
    self.q = torch.randn(B, S, H, D, device="cuda", dtype=torch.float16)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/dan/projects/kernels/.venv/lib/python3.12/site-packages/torch/cuda/__init__.py", line 484, in _lazy_init
    raise AssertionError("Torch not compiled with CUDA enabled")
Expected behavior

Measure performance.

Environment
  • kernels 0.15.2
  • python 3.12.13
  • torch 2.12.0+xpu
  • triton-xpu 3.7.1
  • Linux
Additional context

No response

Lingua principale
Python
Stelle
783
Fork
143
Merge medio
1g 10h
PR unite (30g)
57

Preparare l'ambiente

Come iniziare

  1. Leggi tutta la issue e poi la guida ai contributi del progetto.
  2. Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
  3. Fai un fork del repository e lavora su un branch.
  4. Apri una pull request che faccia riferimento al numero della issue.

Altre issue di huggingface/kernels

Tutte le issue di huggingface/kernels

Issue simili

Altre issue su Python

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.