Zannick/logic-graph

Better capacity/eviction policy for the segmented queue

开放

#97 创建于 2023年7月13日

 (1 条评论) (0 个反应) (0 位负责人)Rust (0 个派生)auto 404
help wanted

仓库指标

星标
 (4 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

With no fixed capacity and after removing the shrink_to_fit calls, we generate reports of the total capacity of each segment, and find that with our current AV2 test, the entire queue keeps a capacity of roughly 2-3x the capacity we asked for.

It may be beneficial to have a per-segment cap, such that we can better control the allocated capacity for each segment, especially since DoublePriorityQueue's underlying store does not support shrink_to_fit on the inner map, only on the lists of indexes. One idea is for the heap to perform a segment eviction if attempting to push or extend past a segment's capacity limit, which we'd set to maybe 1.5-2x the average we'd have with a full queue on all segments.

贡献者指南