apache/beam

[Bug][Go]: Metrics incremented in Setup methods are not recalled.

Open

#27,038 建立於 2023年6月6日

在 GitHub 查看
 (2 留言) (0 反應) (0 負責人)Java (4,097 fork)batch import
P3buggogood first issue

倉庫指標

Star
 (7,313 star)
PR 合併指標
 (平均合併 6天) (30 天內合併 243 個 PR)

描述

What happened?

Because the ParDo Setup context is uncached metrics initialized in Setup are lost, which is unexpected. Work done in setup, while logically outside of a bundle, will be under the context of the first bundle to execute that transform.

So there needs to be a way to transfer/extract the metrics from the Setup context so they are recorded back to the runner.

Issue Priority

Priority: 3 (minor)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner

貢獻者指南