kubeflow/sdk
Refactor Spark options API to clearly distinguish SparkApplication and SparkConnect options
开放
#720 创建于 2026年8月4日
area/sparkgood first issuehelp wantedkind/feature
仓库指标
- 星标
- (124 个星标)
- PR 合并指标
- (PR 指标待抓取)
描述
Summary
The current Spark options API exposes options through a common entry point even though some options are only applicable to SparkConnect (for example PodTemplateOverride). This can make it difficult for users to determine which options are supported by submit_job() versus connect().
Refactor the options API and documentation to provide a clearer, more consistent experience while preserving existing functionality.
Ref - https://github.com/kubeflow/sdk/pull/685#pullrequestreview-4859037596