Running into issue with LocalLLM

Maintainers usually reply within 1 day

Assessment

Research direction

Description

Hi,
I am running into this issue when setting up onnxruntime-genai. Can anyone let me know how to resolve this?

Thanks in advance.

Getting set up

First steps

1. Read the whole issue, then the project's contributing guide.
2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
3. Fork the repository and make your change on a branch.
4. Open a pull request that references the issue number.

More from microsoft/onnxruntime-inference-examples

• Replace deprecated light-server with lite-server for onnxruntime-web

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 68/100

  microsoft/onnxruntime-inference-examples#359 · Opened Dec 27, 2023

  Maintainers usually reply within 1 day

• Minor: typo

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 1/5 Under an hour Newbie friendliness 72/100

  microsoft/onnxruntime-inference-examples#124 · 1 reaction · Opened Jul 11, 2022

  Maintainers usually reply within 1 day

• candy.onnx missing in c_cxx/ort_tutorial/20_devicetensors-datatransfer

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 38/100

  microsoft/onnxruntime-inference-examples#559 · Opened Feb 12, 2026

  Maintainers usually reply within 1 day

• Package "onnxruntime-react-native" does not contain a valid config plugin

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 3/5 1-2 days Newbie friendliness 42/100

  microsoft/onnxruntime-inference-examples#548 · Opened Dec 14, 2025

  Maintainers usually reply within 1 day

• mobile/examples/Qwen_QA/Android

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 3/5 1-2 days Newbie friendliness 45/100

  microsoft/onnxruntime-inference-examples#547 · Opened Dec 3, 2025

  Maintainers usually reply within 1 day

All issues in microsoft/onnxruntime-inference-examples

Similar issues

• [YSQL] pg_stat_monitor duplicates PG's unpack_sql_state symbol, so sqlcode can be empty (import pg_stat_monitor 9da007a83e0b)

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  area/ysql kind/bug priority/medium

  Difficulty 2/5 1-3 hours Newbie friendliness 75/100

  yugabyte/yugabyte-db#34552 · Opened Oct 2, 2026

  Maintainers usually reply within 1 day

• [BUG] Process Actions buttons are a fixed 180px wide and ignore Font Size

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  Difficulty 2/5 1-3 hours Newbie friendliness 86/100

  mgradwohl/tasksmack#949 · Opened Oct 2, 2026

  Maintainers usually reply within 1 day

• tests/functional/gc-closure.sh can fail with SIGPIPE (exit 141) at `printf | head -n1`

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  Difficulty 1/5 Under an hour Newbie friendliness 94/100

  NixOS/nix#16546 · Opened Oct 2, 2026

  Maintainers usually reply within 1 day

• [BUG] cuVS Bench Faiss CAGRA b_ratio reads the wrong JSON key

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  bug

  Difficulty 2/5 1-3 hours Newbie friendliness 84/100

  NVIDIA/cuvs#2718 · Opened Oct 1, 2026

  Maintainers usually reply within 1 day

• ARM visibleWidth 1.18-1.57x slower on non-ASCII text after #122049

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  ai_p2

  Difficulty 2/5 1-3 hours Newbie friendliness 76/100

  ClickHouse/ClickHouse#123351 · Opened Oct 1, 2026

  Maintainers usually reply within 1 day

More C++ issues