Hacktoberfest 2026:维护者为十月标记出来的 issue,仍然开放、适合新手。 浏览 Hacktoberfest issue

Composer_dags.py script (pause & unpause dags) is taking hours to finish

未关闭
#10,805 3 条评论 0 个 reaction 已指派 1 人 在 GitHub 查看

还没有人认领这个 Issue。

评估

这个 Issue 还没有评估数据。

描述

api: composer priority: p2 samples type: bug

In which file did you encounter the issue?

composer/tools/composer_dags.py

Did you change the file? If so, how?

No change

Describe the issue

I run the script for the environment of 500 dags. It is extremely slow, it takes more than 1-2min to do this for each dag. I has taken almost entire day and not yet finished. Is there a better way to batch those requests and pause multiple dags at once?
This has to be done before the snapshot can be created.

Example logs:
2023-10-25 15:49:30,718 - Executing shell command: CLOUDSDK_API_ENDPOINT_OVERRIDES_COMPOSER=https://composer.googleapis.com/ gcloud composer environments run composer-dev --project=whejna-dataops --location=europe-west3 dags pause -- export_task_reschedule_v1_0
Executing the command: [ airflow dags pause export_task_reschedule_v1_0 ]...
Command has been started. execution_id=3fa888b4-7cf4-4c0e-ab07-c54cccda24ac
Use ctrl-c to interrupt the command
2023-10-25 15:51:07,371 - Dag: export_task_reschedule_v1_0, paused: True

Thanks

主要语言
Jupyter Notebook
星标
8.1k
派生
6.7k
平均合并
4 天 4 小时
30 天内合并 PR
8

贡献指南

打开贡献指南

从这里开始

  1. 先读完整个 Issue,再读项目的贡献指南。
  2. 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
  3. Fork 仓库,在一个分支上完成修改。
  4. 提交 Pull Request,并在描述里引用这个 Issue 编号。

GoogleCloudPlatform/python-docs-samples 的其他 Issue

查看 GoogleCloudPlatform/python-docs-samples 的全部 Issue

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。