feature requesthelp wanted
倉庫指標
- 星標
- (80,034 顆星)
- PR 合併指標
- (PR 指標待抓取)
描述
🚀 The feature, motivation and pitch
DCP is great Fp8 kv cache is great We should support both at the same time:
(EngineCore_DP0 pid=2734260) ERROR 01-08 23:29:29 [core.py:900] RuntimeError: Worker failed with error 'DCP not support fp8 kvcache now.', please check the stack trace above for the root cause
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.