apache/beam

DataflowRunner should canonicalize gcpTempLocation/stagingLocation/etc formats.

Open

#18,199 创建于 2022年6月3日

在 GitHub 查看
 (0 评论) (0 反应) (0 负责人)Java (4,097 fork)batch import
P3dataflowgood first issuerunnerstests

仓库指标

Star
 (7,313 star)
PR 合并指标
 (平均合并 6天) (30 天内合并 243 个 PR)

描述

Cloud Dataflow has a minor history of small bugs related to various code paths expecting there to be or not be a trailing forward-slash in these location fields. The way that Beam's integration tests are set up, we are likely to only have one of these two cases tested (there is a single set of integration test pipeline options).

We should add a dedicated DataflowRunner integration test to handle this case.

Actually, we should probably canonicalize the URLs so that we only ever produce one version.

Imported from Jira BEAM-1194. Original Jira may contain additional context. Reported by: dhalperi.

贡献者指南