apache/airflow

Databricks: sensor for jobs

オープン

#21,379 opened on 2022/02/07

 (3 件のコメント) (0 件のリアクション) (1 人の担当者)Python (16,781 件のフォーク)batch import
area:providersgood first issuekind:featureprovider:databricks

Repository metrics

Stars
 (44,809 個のスター)
PR merge metrics
 (PR metrics pending)

説明

Description

A sensor which allows waiting for completion of a Databricks job or task.

Use case/motivation

We would like to make it easy to wait for a Databricks job, similar to how ExternalTaskSensor allows waiting for other Airflow tasks. Specifically, we’d like to support waiting for:

  • A specific job run to complete
  • A specific task of a job run to complete

The state of job runs can be queried via the JobRunsGet API.

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

コントリビューターガイド