ggml-org/ggml

ggml : implement a spellcheck model (xfspell, t5-spellchecker, etc)

Open

#233 opened on Jun 6, 2023

View on GitHub
 (12 comments) (10 reactions) (0 assignees)C++ (14,741 stars) (1,646 forks)auto 404
good first issuehelp wantedmodelroadmap

Description

Apple had recently announced a new transformer-based keyboard auto-correct and prediction.

xfspell seems to be an existing model that tried doing it, so why not investigate if it can be ported to GGML. If anyone know other models for predictive keyboard or auto correct, please drop your suggestions here.

Perhaps this may even be a good test case for on-device QLoRA fine-tuning.

High quality predictive keyboards and auto-correct in pure C++ can be a useful thing for open-source mobile operating systems like Ubuntu Touch and privacy-focused Android ROMs, because traditionally, such proposals got rejected because of excessive dependencies for ML inference.

Contributor guide

Tech stack
cpp
Domain
machine learning
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
active
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
GitC++Machine Learning basics
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
40
Research direction
Study the xfspell model (https://github.com/mhagiwara/xfspell) and its transformer architecture. Identify key components and map them to GGML operations. Consider implementing a prototype for auto correct functionality.