area/sparkgood first issuehelp wantedkind/bug
倉庫指標
- 星標
- (124 顆星)
- PR 合併指標
- (平均合併 12天 14小時) (30 天內合併 31 個 PR)
描述
Summary
While working on port-forward cleanup in the SDK #460 , it surfaced that there may be a broader gap in how SparkConnect resources are handled on failure.
Observations
- SparkConnect CR does not appear to clean up resources when connection/setup fails
- This can leave resources running if failure happens mid-connection
There is a related issue in the Spark Operator: kubeflow/spark-operator#2927
Additional Observation
There also appears to be a mismatch in state mapping:
- The SDK exposes a "Running" state
- SparkConnect CR does not expose a corresponding state