Question: Feasibility of using more modern small language models
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 25/100
- Issue type
- Feature
- Clarity
- Needs clarification
- Activity status
- Active
- Tech stack
- python
- Domain
- ai, machine-learning
Research direction
The issue names no files, tests, or entry points. Start by reviewing the repository's compilation and runtime entry points, then determine whether model selection, Cactus runtime support, server-side compilation, or RAG integration is in scope and what concrete outcome would define completion.
Written by the indexing model from the issue text.
Description
Hi I saw the reddit blog post on claudish and thought this is a very interesting thing. I was thinking if using a newer model like LFM2.5-230M or LFM2.5-350M might help to drastically improve the model's capabilities? I understand that changing models would require recompilation of the .paw file. I also saw some things about Cactus' runtime being made for edge and browser use, not sure if its is a promising alternative to what is used now. Also I would like to know more about the compilation process on the server as I dont think the source is published? It would help with experimentation greatly. Im also thinking about the possibility to use this as part of a RAG? What do you think? Thank you, just wanted to share some thoughts I had on this.
- Dominant language
- Python
- Stars
- 332
- Forks
- 31
- Avg merge
- 2d 3h
- Merged PRs (30d)
- 1
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from programasweights/programasweights-python
-
Difficulty 4/5 3-5 days Newbie friendliness 45/100
programasweights/programasweights-python#5 · 1 comment ·
All issues in programasweights/programasweights-python
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
syfoud/Simulated_Scepter#172 ·
-
A cancelled tests run makes the coverage comment workflow fail and reports it as a red check on main Openarea: ci bug perceived difficulty: 3
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
Nitjsefnie-Harness-Commons/daedalus#921 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 86/100
EleutherAI/lm-evaluation-harness#4207 ·
-
Difficulty 1/5 Under an hour Newbie friendliness 92/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
ClickHouse/clickhouse-connect#1057 ·