mit-pdos/noria

Allow trading off consistency for performance

Open

#92 创建于 2018年9月19日

在 GitHub 查看
 (0 评论) (0 反应) (0 负责人)Rust (229 fork)batch import
enhancementhelp wantedm-consistencyperf

仓库指标

Star
 (4,576 star)
PR 合并指标
 (30 天内没有已合并 PR)

描述

Currently, we "swap" the Reader after every batch we process. This ensures that views are always as fresh as we can make them (subject to write propagation delays), but also means we incur the cost of waiting for readers to exit the current map for every batch. Users would likely see significant speedups if we amortized the cost of swaps by doing them less often, though this would come at the cost of an increase in the delay before writes become visible.

This should probably be an option that is exposed to users, with sufficient warning labels about "eventualness". Care must also be taken to ensure that we eventually swap the maps, even if there are no more writes, so that reads don't remain eternally stale.

贡献者指南