Repositories
liguodongiot repositories
Code Repository of Evaluating Quantized Large Language Models
R study
The Scala programming language
Databricks Scala Coding Style Guide
SGLang is a fast serving framework for large language models and vision language models.
[ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
The Triton TensorRT-LLM Backend
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
unify-easy-llm(ULM)旨在打造一个简易的一键式大模型训练工具,支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。
A high-throughput and memory-efficient inference and serving engine for LLMs