5 评论 (5 评论)7 反应 (7 反应)0 负责人 (0 负责人)Python38,959 star (38,959 star)4,736 fork (4,736 fork)batch import
good first issue
- 议题类型
- feature
- 研究方向
- The issue requests support for loading GGUF and GGML model formats. Investigate the current model loading code in FastChat, particularly within the `fastchat/model` directory and any existing model adapter classes. Check the issue comments for any additional context or suggested approaches. Consider looking at how other projects like llama.cpp or transformers handle these formats to guide the implementation.