apache/beam

Python DirectRunner _PubSubReadEvaluator creates new client per bundle

Open

#19,712 建立於 2022年6月4日

在 GitHub 查看
 (0 留言) (0 反應) (0 負責人)Java (4,097 fork)batch import
P3bugcoregood first issuepython

倉庫指標

Star
 (7,313 star)
PR 合併指標
 (平均合併 6天) (30 天內合併 243 個 PR)

描述

Lots of credential fetches. Similar to https://issues.apache.org/jira/browse/BEAM-2264 but in this case the DirectRunner implementation seems to be creating a new client for each bundle: https://github.com/apache/beam/blob/d5d7a7b7d0408d8435031e7bfce1abe2227115f5/sdks/python/apache_beam/runners/direct/transform_evaluator.py#L474

From: https://stackoverflow.com/questions/57010426/dataflow-access-to-pubsub-access-tokens

Imported from Jira BEAM-7763. Original Jira may contain additional context. Reported by: udim.

貢獻者指南