feat: add auto into --runtime or alike to auto select best suitable runtime
Nobody has claimed this yet.
Assessment
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Newbie friendliness
- 45/100
Research direction
Start by reading the runtime-selection work in PR #1015 and the existing --runtime handling. Define the auto-selection behavior for an .ort file versus a folder containing genai_config.json, including transformer-style inference that still uses ort; done means these cases select the suitable runtime.
Written by the indexing model from the issue text.
Description
It is easy to tell from ort (an onnx file) and ort-genai (a folder with genai_config.json)
As a follow up of https://github.com/microsoft/winml-cli/pull/1015
Folder itself is not enough if we support transformer style inference, it is still using ort not ort-genai
- Dominant language
- Python
- Stars
- 40
- Forks
- 11
- Avg merge
- 1d 2h
- Merged PRs (30d)
- 59
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from microsoft/winml-cli
-
bug P1
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
-
bug P1 triaged
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
P2 refactor triaged
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
-
bug P1
Difficulty 4/5 3-5 days Newbie friendliness 45/100
-
bug P1
Difficulty 3/5 1-2 days Newbie friendliness 65/100
All issues in microsoft/winml-cli
Similar issues
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
stephrobert/dsoxlab#238 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
sublimehq/package_control#1780 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
nwg-piotr/nwg-displays#145 ·