apache/beam

Python DirectRunner _PubSubReadEvaluator creates new client per bundle

開放

#19,712 建立於 2022年6月4日

 (0 則留言) (0 個反應) (0 位負責人)Java (4,097 個分叉)batch import
P3bugcoregood first issuepython

倉庫指標

星標
 (7,313 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

Lots of credential fetches. Similar to https://issues.apache.org/jira/browse/BEAM-2264 but in this case the DirectRunner implementation seems to be creating a new client for each bundle: https://github.com/apache/beam/blob/d5d7a7b7d0408d8435031e7bfce1abe2227115f5/sdks/python/apache_beam/runners/direct/transform_evaluator.py#L474

From: https://stackoverflow.com/questions/57010426/dataflow-access-to-pubsub-access-tokens

Imported from Jira BEAM-7763. Original Jira may contain additional context. Reported by: udim.

貢獻者指南