good first issue
Repository metrics
- Stars
- (38,959 個のスター)
- PR merge metrics
- (PR metrics pending)
説明
CPU model working fine python -m fastchat.serve.cli --model-path /path/to/fastchat-t5-3b-v1.0 --device cpu
GPU models both got errors python -m fastchat.serve.cli --model-path /path/to/fastchat-t5-3b-v1.0 --device mps --load-8bit python -m fastchat.serve.cli --model-path /path/to/fastchat-t5-3b-v1.0 --device mps
So, does fastchat-t5-3b-v1.0 can running on Mac --device mps?