apache/airflow

Tasks that are running when a DAG run reaches its timeout should optionally support `on_killed`

开放

#41,036 创建于 2024年7月26日

 (9 条评论) (1 个反应) (0 位负责人)Python (16,781 个派生)batch import
area:Schedulergood first issuekind:feature

仓库指标

星标
 (44,809 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Description

The current functionality for task instances that are in the running state when a DAG run reaches its timeout is controversial (see #30264). It'd be great if users could optionally allow tasks' on_kill method to be called at this time.

Use case/motivation

Some users would like for externally running workloads (e.g. snowflake, emr, bigquery, etc etc) to stop executing when a DAG run times out.

Related issues

#30264

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

贡献者指南