sgl-project/ome

OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)