apache/airflow

Support connection with Proxy in Databricks provider

已關閉

#32,576 建立於 2023年7月13日

 (8 則留言) (0 個反應) (0 位負責人)Python (16,781 個分叉)batch import
area:providersgood first issuekind:featureprovider:databricks

倉庫指標

星標
 (44,809 顆星)
PR 合併指標
 (平均合併 7天 18小時) (30 天內合併 834 個 PR)

描述

Apache Airflow version

2.6.3

What happened

Databricks connection is unable to query login.microsoftonline.com if using a proxy as there is no provision in databricks.py file to include proxy as part of requests.post command to include proxy in it.

What you think should happen instead

there is no provision in databricks.py file to include proxy as part of requests.post command to include proxy in it.

How to reproduce

Try reaching login.microsoftonline.com endpoint via proxy. Tried providing proxy as part of extra in databricks connection { "azure_tenant_id": "xxxx", "proxies": { "http": "http://xxxx:443", "https": "http://xxxx:443" } } Error: {databricks_base.py:434} INFO - Using AAD Token for SPN. {databricks_base.py:223} INFO - Existing AAD token is expired, or going to expire soon. Refreshing... {connectionpool.py:1003} DEBUG - Starting new HTTPS connection (1): login.microsoftonline.com:443 {databricks_base.py:469} ERROR - Attempt 1 API Request to Databricks failed with reason: <Future at 0x7f1954c4e280 state=finished raised ConnectTimeout>

Noticed that line 251 where the requests.post happens doesn't have this enabled.

Operating System

Linux

Versions of Apache Airflow Providers

No response

Deployment

Other

Deployment details

No response

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

貢獻者指南