[Feature]: Support gds.enabled=true with precompiled drivers when nvidia_fs is pre-built into the driver image

未关闭
#3,165 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看

维护者通常 1 天内回复

还没有人认领这个 Issue。

评估

难度
4/5
预计耗时
3-5 天
新手友好度
35/100
Issue 类型
功能
描述清晰度
基本清楚
活跃度
活跃
技术栈
go, kubernetes

调研方向

Start in transformGDSContainer(), where the pre-compiled-driver error is raised, and check how UsePrecompiledDrivers() is used there. The issue proposes a load-only path that skips nvidia-gds-driver install and only verifies the module, writes cufile.json, and sets device permissions. It does not say how a pre-built nvidia_fs is detected, so settle that with maintainers first. Done means the combination no longer returns an error and the setup steps run.

由索引模型根据 Issue 内容生成。

描述

feature lifecycle/frozen needs-triage

When using precompiled NVIDIA drivers, gds.enabled=true is currently hard-rejected in
transformGDSContainer() with the error:

GPUDirect Storage driver (nvidia-fs) is not supported along with pre-compiled NVIDIA drivers

The reason is that the nvidia-fs-ctr sidecar waits for /run/nvidia/driver/usr/src to be
populated, then runs nvidia-gds-driver install which builds nvidia_fs.ko from those sources.
With precompiled drivers there are no sources at that path, so the install would fail.

This assumption breaks down when nvidia_fs.ko is pre-built into the precompiled driver image.
In that case the module is already loaded by the time nvidia-fs-ctr starts, making the build
step in nvidia-gds-driver install unnecessary.

The request is to support a load-only mode in transformGDSContainer() for this case: when
UsePrecompiledDrivers() is true and nvidia_fs is pre-built into the image, skip the
nvidia-gds-driver install step and only run the GDS toolkit setup (verify module is loaded,
write cufile.json, configure device permissions) rather than returning an error.

主要语言
Go
星标
3k
派生
592
平均合并
3 天 16 小时
30 天内合并 PR
68

环境准备

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

NVIDIA/gpu-operator 的其他 Issue

查看 NVIDIA/gpu-operator 的全部 Issue

相似的 Issue

更多 Go Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。