Lightning-AI/LitServe

Build custom inference engines for models, agents, multi-modal systems, RAG, pipelines and more.