kubeflow/sdk
Refactor Spark options API to clearly distinguish SparkApplication and SparkConnect options
オープン
#720 opened on 2026/08/04
area/sparkgood first issuehelp wantedkind/feature
Repository metrics
- Stars
- (124 個のスター)
- PR merge metrics
- (PR metrics pending)
説明
Summary
The current Spark options API exposes options through a common entry point even though some options are only applicable to SparkConnect (for example PodTemplateOverride). This can make it difficult for users to determine which options are supported by submit_job() versus connect().
Refactor the options API and documentation to provide a clearer, more consistent experience while preserving existing functionality.
Ref - https://github.com/kubeflow/sdk/pull/685#pullrequestreview-4859037596