abi/screenshot-to-code

Investigate open source models

Open

#17 opened on Nov 17, 2023

View on GitHub
 (13 comments) (9 reactions) (0 assignees)TypeScript (72,582 stars) (8,943 forks)batch import
good first issuemodel

Description

This project looks amazing!! Unfortunately I cannot self host it without paying for OpenAI models - is there a possibility that you could look into alternative open-source models utilizing ggml and/or llama.cpp? So far I have found LLaVa but I'm not sure if it'd work for this project.

Contributor guide

Tech stack
typescriptreactvuetailwindcss
Domain
machine learningai
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
3-5 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
needs investigation
Prerequisites
Understanding of LLM inferenceFamiliarity with ggml/llama.cpp
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
20
Research direction
Explore the current integration of AI models in the project (likely via OpenAI API). Investigate alternatives using ggml/llama.cpp with open source models like LLaVa. Review the comments for any pointers from maintainers. Assess technical feasibility and provide recommendations.