kubeflow/sdk

Simplify SparkConnectState to align with Spark Operator state model

Open

#572 geöffnet am 8. Juli 2026

Auf GitHub ansehen
 (5 Kommentare) (1 Reaktion) (1 zugewiesene Person)Python (196 Forks)auto 404
area/sparkgood first issuehelp wantedkind/feature

Repository-Metriken

Stars
 (124 Stars)
PR-Merge-Metriken
 (PR-Metriken ausstehend)

Beschreibung

Summary

Review and simplify the SDK SparkConnectState model to better align with the Spark Operator's SparkConnectState enum.

Background

During the review of PR #521, it was noted that:

  • RUNNING is not an operator state and may be redundant with READY.
  • PROVISIONING is currently unused by the SparkConnect controller.
  • The operator exposes a NEW ("") state that is not currently represented in the SDK.

Proposed work

  • Review the SDK SparkConnectState model against the current Spark Operator CRD.
  • Determine whether RUNNING should be removed or consolidated with READY.
  • Evaluate whether PROVISIONING should remain in the SDK.
  • Add support for any missing operator states where appropriate.
  • Update unit tests and documentation as needed.

Reference

Contributor Guide