apache/airflow

`StackdriverTaskHandler` rework for the structlog era

Open

#65191 opened on Apr 14, 2026

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Python (44,809 stars) (16,781 forks)batch import
area:loggingarea:providersgood first issuekind:metaprovider:google

Description

Body

Following https://github.com/apache/airflow/pull/48491

Reference: https://github.com/apache/airflow/pull/48788

In Airflow 3, the task execution path was rearchitected: task workers now use structlog and communicate with a RemoteLogIO (set as REMOTE_TASK_LOGin the logging config module) rather than through a Python stdlib logging. Handler registered inDEFAULT_LOGGING_CONFIG`.

All major remote log backends have been migrated to this new pattern — S3, GCS, CloudWatch, WASB, OSS, HDFS (recently in #48788), and Elasticsearch. Similar effort is needed for StackDriver

Committer

  • I acknowledge that I am a maintainer/committer of the Apache Airflow project.

Contributor guide

Tech stack
pythongcp
Domain
backendinfrastructureobservabilitycloud
Issue type
refactor
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-2 days
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
clear
Prerequisites
Familiarity with Airflow loggingUnderstanding of structlogKnowledge of StackDriver
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
50
Research direction
Examine the referenced PRs (#48491, #48788) to understand the pattern used for migrating remote log backends to structlog. Implement the same changes for the StackDriverTaskHandler, likely located in airflow/providers/google/cloud/logging/stackdriver task handler.py. Ensure the handler uses the RemoteLogIO interface and structlog instead of the stdlib logging handler. Follow the structure of similar migrated handlers such as S3 or GCS.