apache/beam

Python SDK should stage only up-to-date versions of pipeline dependencies defined by requirements file.

開放

#19,968 建立於 2022年6月4日

 (0 則留言) (0 個反應) (0 位負責人)Java (4,097 個分叉)batch import
P3bugcoregood first issuepython

倉庫指標

星標
 (7,313 顆星)
PR 合併指標
 (PR 指標待抓取)

描述

When staging pipeline dependencies specified in requirements.txt file and transitive deps, we stage entire content of requirements-cache directory on user's machine, which may include dependencies that were cached a while ago and are no longer needed. See [1] for discussion and some ideas how we can avoid staging packages we don't need.

[1] https://lists.apache.org/thread.html/f99820489026a46160505ea9a4c8c4a0eabe8649143c1ee22b7088aa%40%3Cdev.beam.apache.org%3E

Imported from Jira BEAM-8900. Original Jira may contain additional context. Reported by: tvalentyn.

貢獻者指南