ggml-org/llama.cpp

llama : add CLI assistant

クローズ

#10,688 opened on 2024/12/06

 (5 件のコメント) (4 件のリアクション) (0 人の担当者)C++ (21,786 件のフォーク)batch import
enhancementgood first issueroadmap

Repository metrics

Stars
 (124,222 個のスター)
PR merge metrics
 (平均マージ 6d 8h) (30d で 389 merged PRs)

説明

The https://github.com/AnswerDotAI/shell_sage project seems quite fun and useful. GitHub Copilot CLI was also a rather useful utility.

We should build a fully-local alternative leveraging llama-server's advanced context reuse techniques in the same spirit as llama.vim. Speculative decoding should be very effective in this scenario as well. Likely the Qwen 2.5 family would be ideal for this use case.

コントリビューターガイド