apache/airflow

Support for Kubernetes Executor side task attempt logging for failed tasks in case of task pods doesn't reach running state

オープン

#37,435 opened on 2024/02/15

 (2 件のコメント) (4 件のリアクション) (1 人の担当者)Python (16,781 件のフォーク)batch import
area:providersgood first issuekind:featureprovider:cncf-kubernetes

Repository metrics

Stars
 (44,809 個のスター)
PR merge metrics
 (平均マージ 7d 18h) (30d で 834 merged PRs)

説明

Description

Right now, when the tasks fail due to pod launch failures or the pod is stuck in the pending phase, then the task logs from the UI are empty. It is very inconvenient for airflow consumers to debug it. They might not have access to the scheduler logs. I believe we can push these failure reasons from the Kubernetes executor to task attempt logs (remote). So, that airflow consumers can able to see task failure reasons from the UI.

Use case/motivation

Right now, when the tasks fail due to pod launch failures or the pod is stuck in the pending phase, then the task logs from the UI are empty. It is very inconvenient for airflow consumers to debug it.

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

コントリビューターガイド