apache/beam
DataflowRunner should canonicalize gcpTempLocation/stagingLocation/etc formats.
开放
#18,199 创建于 2022年6月3日
P3dataflowgood first issuerunnerstests
仓库指标
- 星标
- (7,313 个星标)
- PR 合并指标
- (PR 指标待抓取)
描述
Cloud Dataflow has a minor history of small bugs related to various code paths expecting there to be or not be a trailing forward-slash in these location fields. The way that Beam's integration tests are set up, we are likely to only have one of these two cases tested (there is a single set of integration test pipeline options).
We should add a dedicated DataflowRunner integration test to handle this case.
Actually, we should probably canonicalize the URLs so that we only ever produce one version.
Imported from Jira BEAM-1194. Original Jira may contain additional context. Reported by: dhalperi.