apache/beam

python typehints: reduce the number of runtime-type-check wrappers

Open

#20,226 opened on 2022年6月4日

GitHub で見る
 (4 comments) (0 reactions) (0 assignees)Java (4,097 forks)batch import
P3bugcoregood first issuepythontypes

Repository metrics

Stars
 (7,313 stars)
PR merge metrics
 (平均マージ 6d) (30d で 243 merged PRs)

説明

The --runtime_type_check flag is considered to be a performance penalty. One of the possible slowdowns is the wrapper around DoFn.process(), which adds an extra call to the wrapped process() method. Currently, there are 2 wrappers applied: OutputCheckWrapperDoFn and TypeCheckWrapperDoFn. These could be merged into one to possibly save on overhead.

Imported from Jira BEAM-9489. Original Jira may contain additional context. Reported by: udim.

コントリビューターガイド