apache/beam
DataflowRunner should canonicalize gcpTempLocation/stagingLocation/etc formats.
開放
#18,199 建立於 2022年6月3日
P3dataflowgood first issuerunnerstests
倉庫指標
- 星標
- (7,313 顆星)
- PR 合併指標
- (PR 指標待抓取)
描述
Cloud Dataflow has a minor history of small bugs related to various code paths expecting there to be or not be a trailing forward-slash in these location fields. The way that Beam's integration tests are set up, we are likely to only have one of these two cases tested (there is a single set of integration test pipeline options).
We should add a dedicated DataflowRunner integration test to handle this case.
Actually, we should probably canonicalize the URLs so that we only ever produce one version.
Imported from Jira BEAM-1194. Original Jira may contain additional context. Reported by: dhalperi.