Question: Feasibility of using more modern small language models

Open
#4 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
25/100
Issue type
Feature
Clarity
Needs clarification
Activity status
Active
Tech stack
python

Research direction

The issue names no files, tests, or entry points. Start by reviewing the repository's compilation and runtime entry points, then determine whether model selection, Cactus runtime support, server-side compilation, or RAG integration is in scope and what concrete outcome would define completion.

Written by the indexing model from the issue text.

Description

Hi I saw the reddit blog post on claudish and thought this is a very interesting thing. I was thinking if using a newer model like LFM2.5-230M or LFM2.5-350M might help to drastically improve the model's capabilities? I understand that changing models would require recompilation of the .paw file. I also saw some things about Cactus' runtime being made for edge and browser use, not sure if its is a promising alternative to what is used now. Also I would like to know more about the compilation process on the server as I dont think the source is published? It would help with experimentation greatly. Im also thinking about the possibility to use this as part of a RAG? What do you think? Thank you, just wanted to share some thoughts I had on this.

Dominant language
Python
Stars
332
Forks
31
Avg merge
2d 3h
Merged PRs (30d)
1

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from programasweights/programasweights-python

All issues in programasweights/programasweights-python

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.