apache/beam

python typehints: reduce the number of runtime-type-check wrappers

Open

#20 226 ouverte le 4 juin 2022

Voir sur GitHub
 (4 commentaires) (0 réactions) (0 assignés)Java (4 097 forks)batch import
P3bugcoregood first issuepythontypes

Métriques du dépôt

Stars
 (7 313 stars)
Métriques de merge PR
 (Merge moyen 6j) (243 PRs mergées en 30 j)

Description

The --runtime_type_check flag is considered to be a performance penalty. One of the possible slowdowns is the wrapper around DoFn.process(), which adds an extra call to the wrapped process() method. Currently, there are 2 wrappers applied: OutputCheckWrapperDoFn and TypeCheckWrapperDoFn. These could be merged into one to possibly save on overhead.

Imported from Jira BEAM-9489. Original Jira may contain additional context. Reported by: udim.

Guide contributeur