apache/beam
DataflowRunner should canonicalize gcpTempLocation/stagingLocation/etc formats.
オープン
#18,199 opened on 2022/06/03
P3dataflowgood first issuerunnerstests
Repository metrics
- Stars
- (7,313 個のスター)
- PR merge metrics
- (PR metrics pending)
説明
Cloud Dataflow has a minor history of small bugs related to various code paths expecting there to be or not be a trailing forward-slash in these location fields. The way that Beam's integration tests are set up, we are likely to only have one of these two cases tested (there is a single set of integration test pipeline options).
We should add a dedicated DataflowRunner integration test to handle this case.
Actually, we should probably canonicalize the URLs so that we only ever produce one version.
Imported from Jira BEAM-1194. Original Jira may contain additional context. Reported by: dhalperi.