apache/beam

Python SDK should stage only up-to-date versions of pipeline dependencies defined by requirements file.

Open

#19,968 建立於 2022年6月4日

在 GitHub 查看
 (0 留言) (0 反應) (0 負責人)Java (4,097 fork)batch import
P3bugcoregood first issuepython

倉庫指標

Star
 (7,313 star)
PR 合併指標
 (平均合併 6天) (30 天內合併 243 個 PR)

描述

When staging pipeline dependencies specified in requirements.txt file and transitive deps, we stage entire content of requirements-cache directory on user's machine, which may include dependencies that were cached a while ago and are no longer needed. See [1] for discussion and some ideas how we can avoid staging packages we don't need.

[1] https://lists.apache.org/thread.html/f99820489026a46160505ea9a4c8c4a0eabe8649143c1ee22b7088aa%40%3Cdev.beam.apache.org%3E

Imported from Jira BEAM-8900. Original Jira may contain additional context. Reported by: tvalentyn.

貢獻者指南