sharkdp/fd

scatter search targets of threads to optimize search across multiple devices

Open

#559 创建于 2020年4月6日

在 GitHub 查看
 (9 评论) (0 反应) (0 负责人)Rust (42,984 star) (1,059 fork)batch import
feature-requesthelp wantedperformance

描述

when searching across multiple devices, cpu utilization is rarely the bottleneck but rather io is.

an option to scatter the search targets of threads would speed up search massively when searching in /media/ for example across multiple external harddrives.

they may share a data link but its their latency and responsiveness that is the bottleneck. and can be exercised in parallel.

贡献者指南

技术栈
rust
领域
cliperformance
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
1-2 days
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
stale
清晰度议题是否清楚说明期望改动、验收标准和下一步。
needs investigation
前置要求
Rustasync I/O
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
30
研究方向
The issue proposes scattering search targets across threads to improve I/O parallelism when searching multiple drives. To implement, investigate the current threading model in the fd codebase, likely in src/worker.rs or similar. Consider using async I/O or a thread pool for I/O bound tasks. The discussion in the issue may provide additional context; look for comments suggesting design alternatives.