ggml-org/llama.cpp

Refactor: Existing examples refactoring opportunities

Open

#7,559 创建于 2024年5月27日

在 GitHub 查看
 (0 评论) (2 反应) (0 负责人)C++ (18,202 fork)batch import
help wantedrefactoring

仓库指标

Star
 (110,169 star)
PR 合并指标
 (平均合并 6天 8小时) (30 天内合并 389 个 PR)

描述

GG in this PR was suggesting a refactoring of examples and provided an example of what he would like to refactor. This is a ticket to inform others about opportunities to improve examples

I think a bigger advantage would be to do some refactoring in the existing examples and "hide" some of the state for sampling and KV cache management that we expose behind the common API

If there is any other aspect of the example which is currently a pain point for developer grokking, feel free to also suggest some so it can be added here.

贡献者指南