kubeflow/sdk

SparkConnect CR cleanup behavior on failure and SDK state mismatch

开放

#476 创建于 2026年4月30日

 (6 条评论) (1 个反应) (1 位负责人)Python (196 个派生)auto 404
area/sparkgood first issuehelp wantedkind/bug

仓库指标

星标
 (124 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Summary

While working on port-forward cleanup in the SDK #460 , it surfaced that there may be a broader gap in how SparkConnect resources are handled on failure.

Observations

  • SparkConnect CR does not appear to clean up resources when connection/setup fails
  • This can leave resources running if failure happens mid-connection

There is a related issue in the Spark Operator: kubeflow/spark-operator#2927

Additional Observation

There also appears to be a mismatch in state mapping:

  • The SDK exposes a "Running" state
  • SparkConnect CR does not expose a corresponding state

贡献者指南