apache/airflow

Improve Databricks operators with query tags

Chiusa

#66.839 aperta il 13 mag 2026

Vedi su GitHubGuida contributor
 (5 commenti) (0 reazioni) (0 assegnatari)Python (16.781 fork)batch import
good first issuekind:featureprovider:databricks

Metriche repository

Star
 (44.809 stelle)
Metriche merge PR
 (Merge medio 7g 18h) (834 PR mergiate in 30 g)

Descrizione

Description

Databricks supports query tags which allows us to track where the source of a query is on Databricks UI. Reference: https://docs.databricks.com/aws/en/sql/user/queries/query-tags

Currently when a query is sent to Databricks, on Databricks UI, the only info we can see is the query is from Airflow, but there is no other metadata like airflow dag id, task id, run id and etc.

Use case/motivation

With query tags instrumented, it will be easy for organizations to track and do Databricks cost contribution across different Airflow DAGs.

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Guida contributor

Direzione di ricerca
Examine the existing Databricks operators in the Airflow providers package (e.g., airflow/providers/databricks/operators/). Understand the query tag documentation from Databricks to see how tags are passed. Consider adding a parameter to the operators for query tags and ensure they are attached to each query execution. Check for any existing PRs or discussions on the issue for implementation details.
Tech stack
python
Dominio
backenddata
Tipo issue
Funzionalità
DifficoltàQuanto dovrebbe essere impegnativa per un nuovo contributor.
3
Tempo stimatoTempo stimato per completare e verificare uno scope piccolo.
1-2 giorni
Stato attivitàQuanto è probabile che la issue sia ancora attiva e reviewable.
Attiva
ChiarezzaQuanto chiaramente la issue descrive problema, scope e risultato atteso.
Chiara
Prerequisiti
Basic understanding of Apache Airflow operatorsFamiliarity with Databricks SQLPython programming
Adatta ai principiantiQuanto la issue è adatta a contributor alla prima esperienza.
50