5 comments (5 comments)7 reactions (7 reactions)0 assignees (0 assignees)Python38,959 stars (38,959 stars)4,736 forks (4,736 forks)batch import
good first issue
- Issue 種別
- feature
- 調査方針
- The issue requests support for loading GGUF and GGML model formats. Investigate the current model loading code in FastChat, particularly within the `fastchat/model` directory and any existing model adapter classes. Check the issue comments for any additional context or suggested approaches. Consider looking at how other projects like llama.cpp or transformers handle these formats to guide the implementation.