apache/beam

No python equivalent of org.apache.beam.sdk.transforms.Sample.any(100)?

クローズ

#18,552 opened on 2022/06/03

 (0 件のコメント) (0 件のリアクション) (0 人の担当者)Java (4,097 件のフォーク)batch import
P3coregood first issueimprovementpython

Repository metrics

Stars
 (7,313 個のスター)
PR merge metrics
 (PR metrics pending)

説明

Java's org.apache.beam.sdk.transforms.Sample.any will return a PCollection with bounded size (filtering strategy). The closest python eqiuvalent is beam.Sample.FixedSizeGlobally(n) whover, this version uses a combiner strategy, returning a list with n elements; which does not scale if n is "bigger than what fits in memory".

Imported from Jira BEAM-3000. Original Jira may contain additional context. Reported by: rodrigob.

コントリビューターガイド