Chat with onnxruntime-web fails when i deployed on my machine
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Newbie friendliness
- 25/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- javascript, wasm
- Domain
- machine-learning, web-dev
Research direction
Start by comparing the deployed example with the live demo, then inspect llm.js at lines 152 and 210 and main.js at lines 140, 141, 167, and 233. Reproduce the local deployment and determine why logits become infinite; done means the chat example runs locally without the reported error.
Written by the indexing model from the issue text.
Description
Chat with onnxruntime-web example deployed with
"onnxruntime-web": "1.19.0-dev.20240509-69cfcba38a"
and associated wasm files from https://cdn.jsdelivr.net/npm/[email protected]/dist/
live demo https://guschmue.github.io/ort-webgpu/chat/index.html works just fine.
When i run locally, i receive the below error
Error: found infinitive in logits at LLM.argmax (llm.js:152:1) at LLM.generate (llm.js:210:1) at async Query (main.js:233:1) | (anonymous) | @ | main.js:141 -- | -- | -- | -- | Promise.catch (async) | | | submitRequest | @ | main.js:140 | (anonymous) | @ | main.js:167- Dominant language
- C++
- Stars
- 1.7k
- Forks
- 414
- Avg merge
- 15h 1m
- Merged PRs (30d)
- 7
Getting set up
We have not checked this project's setup files yet. Start from its README, and see our first-contribution guide for the general steps.
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from microsoft/onnxruntime-inference-examples
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
microsoft/onnxruntime-inference-examples#359 ·
Maintainers usually reply within 1 day
-
Minor: typoOpen
Difficulty 1/5 Under an hour Newbie friendliness 72/100
microsoft/onnxruntime-inference-examples#124 · 1 reaction ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 38/100
microsoft/onnxruntime-inference-examples#559 ·
Maintainers usually reply within 1 day
-
Difficulty 3/5 1-2 days Newbie friendliness 42/100
microsoft/onnxruntime-inference-examples#548 ·
Maintainers usually reply within 1 day
-
Difficulty 3/5 1-2 days Newbie friendliness 45/100
microsoft/onnxruntime-inference-examples#547 ·
Maintainers usually reply within 1 day
All issues in microsoft/onnxruntime-inference-examples
Similar issues
-
area/ysql kind/bug priority/medium
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
yugabyte/yugabyte-db#34552 ·
Maintainers usually reply within 1 day
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 86/100
Maintainers usually reply within 1 day
-
bug
Difficulty 1/5 Under an hour Newbie friendliness 94/100
Maintainers usually reply within 1 day
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
Maintainers usually reply within 1 day
-
ai_p2
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
ClickHouse/ClickHouse#123351 ·
Maintainers usually reply within 1 day