kubeflow/sdk
Refactor Spark options API to clearly distinguish SparkApplication and SparkConnect options
開放
#720 建立於 2026年8月4日
area/sparkgood first issuehelp wantedkind/feature
倉庫指標
- 星標
- (124 顆星)
- PR 合併指標
- (PR 指標待抓取)
描述
Summary
The current Spark options API exposes options through a common entry point even though some options are only applicable to SparkConnect (for example PodTemplateOverride). This can make it difficult for users to determine which options are supported by submit_job() versus connect().
Refactor the options API and documentation to provide a clearer, more consistent experience while preserving existing functionality.
Ref - https://github.com/kubeflow/sdk/pull/685#pullrequestreview-4859037596