apache/beam
GitHub で見るDataflowRunner should canonicalize gcpTempLocation/stagingLocation/etc formats.
Open
#18,199 opened on 2022年6月3日
P3dataflowgood first issuerunnerstests
Repository metrics
- Stars
- (7,313 stars)
- PR merge metrics
- (平均マージ 6d) (30d で 243 merged PRs)
説明
Cloud Dataflow has a minor history of small bugs related to various code paths expecting there to be or not be a trailing forward-slash in these location fields. The way that Beam's integration tests are set up, we are likely to only have one of these two cases tested (there is a single set of integration test pipeline options).
We should add a dedicated DataflowRunner integration test to handle this case.
Actually, we should probably canonicalize the URLs so that we only ever produce one version.
Imported from Jira BEAM-1194. Original Jira may contain additional context. Reported by: dhalperi.