apache/beam
在 GitHub 查看DataflowRunner should canonicalize gcpTempLocation/stagingLocation/etc formats.
Open
#18,199 创建于 2022年6月3日
P3dataflowgood first issuerunnerstests
仓库指标
- Star
- (7,313 star)
- PR 合并指标
- (平均合并 6天) (30 天内合并 243 个 PR)
描述
Cloud Dataflow has a minor history of small bugs related to various code paths expecting there to be or not be a trailing forward-slash in these location fields. The way that Beam's integration tests are set up, we are likely to only have one of these two cases tested (there is a single set of integration test pipeline options).
We should add a dedicated DataflowRunner integration test to handle this case.
Actually, we should probably canonicalize the URLs so that we only ever produce one version.
Imported from Jira BEAM-1194. Original Jira may contain additional context. Reported by: dhalperi.