apache/airflow

Add deferrable mode to SFTPOperator

Open

#65,475 建立於 2026年4月19日

在 GitHub 查看
 (1 留言) (0 反應) (0 負責人)Python (44,809 star) (16,781 fork)batch import
area:providersgood first issuekind:featureneeds-triageprovider:sftp

描述

Description

The SFTPOperator currently runs in synchronous mode only, blocking a worker slot for the entire duration of every file transfer. For large file transfers, this wastes worker resources unnecessarily.

Proposed Solution Add deferrable=True parameter to SFTPOperator following the same pattern used in other Airflow providers. When deferrable=True, the operator will defer execution to a trigger, freeing the worker slot immediately and allowing the Triggerer to poll for completion.

Implementation Plan

  • Add SFTPOperatorTrigger class in triggers/sftp.py
  • Add deferrable param to SFTPOperator.init()
  • Add defer() call in execute() when deferrable=True
  • Add execute_complete() callback method
  • Add unit tests

Related Similar to deferrable mode already implemented in SFTPSensor.

I am willing to submit a PR for this.

Use case/motivation

No response

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

貢獻者指南

技術棧
python
領域
backend
議題類型
feature
難度面向新貢獻者的預計實作難度，1 表示很小改動，5 表示專家級工作。
3
預計時間有經驗貢獻者完成調查、實作、測試並準備 pull request 的粗略時間範圍。
half day
活動狀態議題目前的可參與程度：新鮮、活躍、陳舊、阻塞或等待維護者輸入。
fresh
清晰度議題是否清楚說明預期改動、驗收標準和下一步。
clear
前置要求
PythonAirflow operatorsDeferrable patternTesting
新手友善度1-100 的估計分數，表示該議題對首次貢獻者的友善程度。
60
研究方向
Review the existing SFTPSensor deferrable implementation in `triggers/sftp.py` and `operators/sftp.py` for reference. Examine similar deferrable operators in other Airflow providers (e.g., `SimpleHttpOperator`, `S3KeySensor`) to understand the pattern. Focus on the `SFTPOperator` class in `airflow/providers/sftp/operators/sftp.py` and plan to add a new trigger class in `airflow/providers/sftp/triggers/sftp.py`. The issue provides a clear implementation plan: add `deferrable` parameter, implement `defer()` and `execute complete()` methods, and write unit tests. There is an existing PR for SFTPSensor that can guide the approach.