apache/airflow

Add deferrable mode to SFTPOperator

Open

#65475 opened on Apr 19, 2026

View on GitHub
 (1 comment) (0 reactions) (0 assignees)Python (44,809 stars) (16,781 forks)batch import
area:providersgood first issuekind:featureneeds-triageprovider:sftp

Description

Description

The SFTPOperator currently runs in synchronous mode only, blocking a worker slot for the entire duration of every file transfer. For large file transfers, this wastes worker resources unnecessarily.

Proposed Solution Add deferrable=True parameter to SFTPOperator following the same pattern used in other Airflow providers. When deferrable=True, the operator will defer execution to a trigger, freeing the worker slot immediately and allowing the Triggerer to poll for completion.

Implementation Plan

  • Add SFTPOperatorTrigger class in triggers/sftp.py
  • Add deferrable param to SFTPOperator.init()
  • Add defer() call in execute() when deferrable=True
  • Add execute_complete() callback method
  • Add unit tests

Related Similar to deferrable mode already implemented in SFTPSensor.

I am willing to submit a PR for this.

Use case/motivation

No response

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Contributor guide

Tech stack
python
Domain
backend
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
PythonAirflow operatorsDeferrable patternTesting
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60
Research direction
Review the existing SFTPSensor deferrable implementation in `triggers/sftp.py` and `operators/sftp.py` for reference. Examine similar deferrable operators in other Airflow providers (e.g., `SimpleHttpOperator`, `S3KeySensor`) to understand the pattern. Focus on the `SFTPOperator` class in `airflow/providers/sftp/operators/sftp.py` and plan to add a new trigger class in `airflow/providers/sftp/triggers/sftp.py`. The issue provides a clear implementation plan: add `deferrable` parameter, implement `defer()` and `execute complete()` methods, and write unit tests. There is an existing PR for SFTPSensor that can guide the approach.