Ecosystem integrations

Some projects it will be nice to get integrations

• MPI operator https://github.com/kubeflow/mpi-operator
  • https://github.com/google/dranet/blob/main/site/content/docs/user/mpi-operator.md
• Slurm on Kube https://github.com/slinkyproject
  • Expose affinity mask Numa
  • Expose fabric topology https://slurm.schedmd.com/topology.html?
• Kube Ray https://github.com/ray-project/kuberay
  • reference https://github.com/ray-project/ray/issues/30094
  • "Ray Job Yaml Deployment Example" with only a few GPUs and NICs and running in parallel
  • https://github.com/google/dranet/pull/162
• Jobset https://github.com/kubernetes-sigs/jobset
• Kueue https://github.com/kubernetes-sigs/kueue
• GKE https://cloud.google.com/ai-hypercomputer/docs/create/gke-ai-hypercompute-custom
• Flux operator https://github.com/flux-framework/flux-operator @vsoch
• XPK https://github.com/AI-Hypercomputer/xpk/issues/482
• NVidia GPU driver https://github.com/NVIDIA/k8s-dra-driver-gpu
  • https://github.com/google/dranet/pull/127
• VLLM https://github.com/vllm-project/vllm
• pytorch example https://docs.pytorch.org/docs/stable/distributed.html
• GKE TPUs Trillium
• Kubeflow