Feature: Local Ollama / llama.cpp endpoint connector for Desktop JVM
Maintainers usually reply within 2 days
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 55/100
Research direction
Start by locating LlmInferenceEngine and the Desktop JVM Settings implementation, then read how existing simulated and on-device providers are configured. Add a configurable local endpoint and model, handle an offline service, and write unit tests for serialization and mock response parsing. Done means both Ollama and llama-server endpoints can be configured and the tests cover the requested behavior.
Written by the indexing model from the issue text.
Description
Summary
Currently, YAAN supports simulated and on-device SLM interfaces. For the Desktop JVM target, we should provide a configurable local inference connector allowing users to route prompts to a locally running Ollama instance (http://localhost:11434/api/generate) or llama-server without sending data over the internet.
Requirements
- Add an
OllamaClient/LocalLlmProviderimplementingLlmInferenceEngine. - Allow configuring endpoint URL and model name (e.g.
llama3.2:3b,qwen2.5:3b) in Settings. - Graceful error handling when local service is offline.
- Unit tests verifying serialization and mock response parsing.
- Dominant language
- Kotlin
- Stars
- 1
- Forks
- 0
- Avg merge
- 25m
- Merged PRs (30d)
- 2
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from developmentwithyash/yaan
-
documentation good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
developmentwithyash/yaan#14 ·
Maintainers usually reply within 2 days
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 35/100
developmentwithyash/yaan#13 ·
Maintainers usually reply within 2 days
-
enhancement help wanted
Difficulty 4/5 3-5 days Newbie friendliness 48/100
developmentwithyash/yaan#12 ·
Maintainers usually reply within 2 days
All issues in developmentwithyash/yaan
Similar issues
-
[Submission] 招商银行Opensubmit-adaption submit-adaption-pre
Difficulty 1/5 Under an hour Newbie friendliness 72/100
BetterAndroid/android-notification-icon-project#848 · 1 comment ·
Maintainers usually reply within 1 day
-
"Tick" is confusingOpenbug
Difficulty 1/5 1-3 hours Newbie friendliness 70/100
orgzly-revived/orgzly-android-revived#1132 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
commons-app/apps-android-commons#7275 ·
Maintainers usually reply within 1 day
-
Bug
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
keiyoushi/extensions-source#20856 ·
Maintainers usually reply within 1 day
-
Update READMEOpendocumentation
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
JoseAngelManeiro/BusSantiago#126 ·