tikv/tikv

Enable rate-bytes-per-sec option by default

开放

#6,484 创建于 2020年1月17日

 (0 条评论) (0 个反应) (0 位负责人)Rust (2,189 个派生)batch import
component/rocksdbcomponent/titandifficulty/mediumhelp wantedsig/engine

仓库指标

星标
 (15,922 个星标)
PR 合并指标
 (平均合并 28天 9小时) (30 天内合并 68 个 PR)

描述

Enabling rate-bytes-per-sec would keep rocksdb background compaction steadily runs, smoothing both IO and CPU usage. However few of our users are using the option. Since ansible runs fio test by default, we can use the result to set an initial default value for rate-bytes-per-sec, if user didn't set it.

To be more specific, we can run fio write only with threads = default max-background-jobs, and use the throughput as upper bound. Then we can maybe set rate-bytes-per-sec to 90% of the upper bound. Other suggestions are welcome.

Currently only kvdb respect rate-bytes-per-sec. We should also make raftdb respect it too.

Task breakdown:

  • Make raftdb respect rate-bytes-per-sec
  • Update ansible to set default value for rate-bytes-per-sec
  • benchmark to show what would be a good default rate-bytes-per-sec

贡献者指南