ninja-build/ninja

Add a performance test script / "performance regression tests"

Open

#1,733 创建于 2020年2月6日

在 GitHub 查看
 (4 评论) (0 反应) (0 负责人)C++ (10,194 star) (1,544 fork)batch import
help wanted

描述

Currently this is done manually by building Chromium before and after a commit. I think it would be good to have a script, which you can pass two commit hashes and a path to a Chromium source, which will then compare the -d stats result.

Maybe add the functionality to misc/measure.py?

See https://github.com/ninja-build/ninja/pull/1577#issuecomment-517797439

贡献者指南

技术栈
cpppython
领域
testingperformancebuild system
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
half day
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
stale
清晰度议题是否清楚说明期望改动、验收标准和下一步。
clear
前置要求
PythonNinja build system conceptsBasic understanding of performance testing
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
60
研究方向
Extend the existing misc/measure.py script to accept two commit hashes and a Chromium source path. The script should build with ninja for each commit and compare the ` d stats` output. Reference the discussion in PR #1577 (comment) for context on the desired comparison logic. The deliverable is a script that automates the manual performance regression check.