apache/airflow

Databricks: sensor for jobs

Open

#21,379 opened on 2022年2月7日

GitHub で見る
 (3 comments) (0 reactions) (1 assignee)Python (16,781 forks)batch import
area:providersgood first issuekind:featureprovider:databricks

Repository metrics

Stars
 (44,809 stars)
PR merge metrics
 (平均マージ 7d 18h) (30d で 834 merged PRs)

説明

Description

A sensor which allows waiting for completion of a Databricks job or task.

Use case/motivation

We would like to make it easy to wait for a Databricks job, similar to how ExternalTaskSensor allows waiting for other Airflow tasks. Specifically, we’d like to support waiting for:

  • A specific job run to complete
  • A specific task of a job run to complete

The state of job runs can be queried via the JobRunsGet API.

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

コントリビューターガイド