swiftlang/swift

[SR-1691] Run longer tests first

Open

#44,300 创建于 2016年6月6日

在 GitHub 查看
 (6 评论) (0 反应) (0 负责人)Swift (69,989 star) (10,719 fork)batch import
good first issuepythontest suite

描述
Previous ID SR-1691
Radar None
Original Reporter @gribozavr
Type New Feature
Votes 0
Component/s Project Infrastructure
Labels New Feature, Python, StarterBug
Assignee None
Priority Medium

md5: d2501feeca870b45e5e159e000fd4619

Issue Description:

In the Swift testsuite there many short tests and a few long tests. Sometimes the longer tests happen to be scheduled last, creating a "long tail" and keeping just a few cores busy. It would be better to start the longer tests first, and then run the short tests. This can shave off 1..2 minutes from testing time.

The suggested solution is to add a new feature to lit, that would allow to attach arbitrary labels to tests. lit could embed definition of special label type, or test suite could have extra code to take specific label names and then attach more semantic attributes to test.

// RUN: some-long-test
// LABEL: run_first

We could also migrate the limit_to_features feature to use labels, it would be a much better fit.

贡献者指南

技术栈
pythonswift
领域
testingperformance
议题类型
feature
难度面向新贡献者的预计实现难度，1 表示很小改动，5 表示专家级工作。
3
预计时间有经验贡献者完成调查、实现、测试并准备 pull request 的粗略时间范围。
half day
活动状态议题当前的可参与程度：新鲜、活跃、陈旧、阻塞或等待维护者输入。
stale
清晰度议题是否清楚说明期望改动、验收标准和下一步。
clear
前置要求
Pythonlit test frameworktest infrastructure concepts
新手友好度1-100 的估计分数，表示该议题对首次贡献者的友好程度。
55
研究方向
The issue suggests adding a label mechanism to lit to prioritize longer tests. Start by familiarizing with the lit test framework used in the Swift project. Look at the existing test suite organization and scheduling logic. Explore how tests are currently defined and run. Consider implementing a simple prototype that adds a `LABEL` directive to lit test files, allowing tests to be tagged with priority. Check the lit source code for any existing prioritization features. Since the issue is from 2016, verify if any similar changes have been made or if the approach is still relevant.