apache/beam

JsonToRow can catch errors in downstream transforms

クローズ

#20,935 opened on 2022/06/04

 (2 件のコメント) (0 件のリアクション) (1 人の担当者)Java (4,097 件のフォーク)batch import
P3bugcoregood first issuejava

Repository metrics

Stars
 (7,313 個のスター)
PR merge metrics
 (平均マージ 6d) (30d で 243 merged PRs)

説明

JsonToRow :

  |try {| | | | | |output.get(PARSED_LINE).output(jsonToRow(objectMapper(), element));| | | | | |} catch (Exception ex) {|

Can catch errors thrown downstream with runners that have fusion. This can be confusing as it can appear that the issue happens in the parse operation , when its really happening in a transform further down the DAG. This is made worse as different runners can show different behaviour in this situation.

 

Replace with try{i = parse}catch{}  if i not null output

Imported from Jira BEAM-11940. Original Jira may contain additional context. Reported by: rarokni@gmail.com.

コントリビューターガイド