`MutableSuiteTest` is flaky
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 52/100
Research direction
Start with the sleeping test in modules/framework-cats/shared/src/test/scala/MutableSuiteTest.scala and inspect how it is exercised by modules/framework-cats/shared/src/test/scala/DogFoodTests.scala. Reproduce the GitHub Actions failure if possible and verify that the sleeping test and DogFoodTests remain reliable across repeated runs.
Written by the indexing model from the issue text.
Description
The MutableSuiteTest for sleeping is flaky:
test("sleeping") {
for {
before <- CatsUnsafeRun.realTimeMillis
_ <- CatsUnsafeRun.sleep(1.seconds)
after <- CatsUnsafeRun.realTimeMillis
} yield expect(after - before >= 1000)
}
The test suite is run by DogFoodTests. This failed in Github Actions:
https://github.com/typelevel/weaver-test/actions/runs/17489340107/job/49675350638#step:10:135
[info] *************FAILURES**************
[info] weaver.framework.test.DogFoodTests
[info] - test suite reports successes events 3s
[info] weaver.framework.test.Meta$MutableSuiteTest:TestSelector(sleeping) failed with Failure (modules/framework-cats/shared/src/test/scala/DogFoodTests.scala:22)
[info]
[info] modules/framework-cats/shared/src/test/scala/DogFoodTests.scala:22
[info] case (_, events) => forEach(events)(isSuccess)
[info] ^
- Dominant language
- Scala
- Stars
- 85
- Forks
- 15
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from typelevel/weaver-test
-
Difficulty 3/5 1-2 days Newbie friendliness 65/100
typelevel/weaver-test#302 · 3 comments ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
typelevel/weaver-test#262 · 2 comments ·
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
typelevel/weaver-test#233 · 3 comments · 2 reactions ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
typelevel/weaver-test#180 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 30/100
typelevel/weaver-test#110 ·
All issues in typelevel/weaver-test
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
ergoplatform/ergodocs#614 ·
-
area:ci enhancement requires-triage
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
apache/datafusion-comet#6078 ·
-
Difficulty 1/5 Under an hour Newbie friendliness 90/100
-
[VL] madvise(WILLNEED) call fails in MmapFileStream because of wrong calculation of fetching length Openbug triage
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
chipsalliance/rocket-chip#3831 ·