apache/beam
No python equivalent of org.apache.beam.sdk.transforms.Sample.any(100)?
已關閉
#18,552 建立於 2022年6月3日
P3coregood first issueimprovementpython
倉庫指標
- 星標
- (7,313 顆星)
- PR 合併指標
- (PR 指標待抓取)
描述
Java's org.apache.beam.sdk.transforms.Sample.any will return a PCollection with bounded size (filtering strategy). The closest python eqiuvalent is beam.Sample.FixedSizeGlobally(n) whover, this version uses a combiner strategy, returning a list with n elements; which does not scale if n is "bigger than what fits in memory".
Imported from Jira BEAM-3000. Original Jira may contain additional context. Reported by: rodrigob.