apache/airflow

AIP-82: Add common messaging system providers

开放

#52,712 创建于 2025年7月2日

 (25 条评论) (2 个反应) (0 位负责人)Python (16,781 个派生)batch import
AIP-82good first issuekind:featurekind:metaprovider:amazonprovider:googleprovider:microsoft-azureprovider:redis

仓库指标

星标
 (44,809 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Body

related: #49938

Why

Several users have pointed out that the Event-Driven Scheduling feature introduced in Airflow 3 currently supports only Amazon SQS.

So I add Kafka common message queue provider in #49938, but there are still quite a few common providers that should be useful for airflow users to implement Event-Driven workflows.

What

Here are some common messaging systems:

reference for implementation: https://github.com/apache/airflow/pull/49938/files

Committer

  • I acknowledge that I am a maintainer/committer of the Apache Airflow project.

贡献者指南