apache/beam
在 GitHub 查看Python SDK should stage only up-to-date versions of pipeline dependencies defined by requirements file.
Open
#19,968 建立於 2022年6月4日
P3bugcoregood first issuepython
倉庫指標
- Star
- (7,313 star)
- PR 合併指標
- (平均合併 6天) (30 天內合併 243 個 PR)
描述
When staging pipeline dependencies specified in requirements.txt file and transitive deps, we stage entire content of requirements-cache directory on user's machine, which may include dependencies that were cached a while ago and are no longer needed. See [1] for discussion and some ideas how we can avoid staging packages we don't need.
Imported from Jira BEAM-8900. Original Jira may contain additional context. Reported by: tvalentyn.