spotify/scio

Reservoir sampling into a side output?

开放

#1,321 创建于 2018年8月23日

 (6 条评论) (0 个反应) (0 位负责人)Scala (529 个派生)auto 404
enhancementgood first issue

仓库指标

星标
 (2,626 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

Right now we have SCollection#sample which uses a Beam transform and is implemented as a global combine operation. It'll be nice to have a sample into side output variation that passes main input through while randomly reservoir sample them into a side input. We should also benchmark this approach against the Beam implementation.

贡献者指南