reworkd/AgentGPT

馃 Investigate utilizing local models

Open

#19 opened on Apr 11, 2023

View on GitHub
聽(3 comments)聽(0 reactions)聽(0 assignees)TypeScript聽(34,594 stars)聽(9,446 forks)batch import
help wanted

Description

This is a big undertaking. As a user, I'd like to be able to use my own local models to not be crippled by limitations of OpenAI models. The opensource model scene is getting huge and we want to support this as best as possible. The issue is, given we are a product first and foremost, connection to local models must work in both prod and dev and must be as simple as possible to setup.

One option is WindowAI: https://twitter.com/xanderatallah/status/1643356106670981122. This is an extension that will allow a site to connect to a model locally.

Before implementing anything, we should first investigate possibilities and report back in this issue.

Contributor guide

Tech stack
typescript
Domain
ai
Issue type
research
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
needs investigation
Prerequisites
Basic knowledge of local AI modelsUnderstanding of browser extensions
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
30
Research direction
Investigate options for integrating local models, starting with WindowAI (browser extension). Evaluate ease of setup for both development and production environments. Report findings with recommendations for implementation path.