vllm-project/compressed-tensors

A safetensors extension to efficiently store sparse quantized tensors on disk