JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
(451 stars) (67 forks) (0 issues indexées) (0 good first issues ouvertes)
Dépôts
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
A simple, performant, and scalable Jax LLM!