apache/airflow

Databricks: sensor for jobs

开放

#21,379 创建于 2022年2月7日

 (3 条评论) (0 个反应) (1 位负责人)Python (16,781 个派生)batch import
area:providersgood first issuekind:featureprovider:databricks

仓库指标

星标
 (44,809 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Description

A sensor which allows waiting for completion of a Databricks job or task.

Use case/motivation

We would like to make it easy to wait for a Databricks job, similar to how ExternalTaskSensor allows waiting for other Airflow tasks. Specifically, we’d like to support waiting for:

  • A specific job run to complete
  • A specific task of a job run to complete

The state of job runs can be queried via the JobRunsGet API.

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

贡献者指南