temporalio/cli

[Bug] Dev Server concurrent execution test is incorrect and flaky

オープン

#581 opened on 2024/06/04

 (0 件のコメント) (1 件のリアクション) (0 人の担当者)Go (96 件のフォーク)auto 404
buggood first issuetests

Repository metrics

Stars
 (370 個のスター)
PR merge metrics
 (PR metrics pending)

説明

Describe the bug

We recently added an integration test that starts a total of 80 dev server, with a maximum of 8 instances running concurrently. This is used to assert, among other things, the reliability of the "get ephemeral port number" logic.

However, that test is incorrect, because it calls FailNow and similar from goroutines, which is not allowed. The test is also flaky. Incorrect usage of test APIs is like not the cause of the flakiness, but may be masking the actual errors, making the issue harder to diagnose.

Given that the CLI's test harness internally use FailNow, fixing this will likely require developing a substitute for the existing test harness.

コントリビューターガイド