apache/airflow

skip_archive should actually skip archive in db clean command

Open

#42.003 geöffnet am 4. Sept. 2024

Auf GitHub ansehen
 (8 Kommentare) (1 Reaktion) (0 zugewiesene Personen)Python (16.781 Forks)batch import
area:db-migrationsgood first issuekind:featurekind:meta

Repository-Metriken

Stars
 (44.809 Stars)
PR-Merge-Metriken
 (Durchschn. Merge 7T 18h) (834 gemergte PRs in 30 T)

Beschreibung

Body

Currently the delete process uses the archive table in the process of deletion. But we should refactor this so it doesn't need this and actually not create the archive table at all when user specifies this option.

The issue is when you are deleting a lot of rows, particularly if you have a low statement timeout, you may hit errors.

Committer

  • I acknowledge that I am a maintainer/committer of the Apache Airflow project.

Contributor Guide