ipfs/kubo

Tune batch add parallelism constant

Open

#4,299 创建于 2017年10月11日

在 GitHub 查看
 (0 评论) (0 反应) (0 负责人)Go (13,906 star) (2,725 fork)batch import
help wantedstatus/deferredtopic/perf

描述

Specifically, tune the ParallelBatchCommits constant added in #4296. Right now, we just use NumCPU*2 but we could probably do something fancier (learn it? does the datastore matter? does the storage medium matter? how about the filesystem?).

We may never get to this but hey, if anyone wants to spend some time experimenting they're free to take a crack at it.

贡献者指南

技术栈
go
领域
performance
议题类型
performance
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
over 1 week
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
stale
清晰度议题是否清楚说明期望改动、验收标准和下一步。
unclear
前置要求
GoIPFS conceptsperformance profilingunderstanding of batch commit
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
20
研究方向
Investigate the `ParallelBatchCommits` constant added in #4296. Experiment with different values and measure performance across various datastores, storage media, and filesystems. Consider implementing adaptive tuning based on runtime metrics. Refer to the codebase for how the constant is used in batch add operations.