temporalio/cli

[Bug] Dev Server concurrent execution test is incorrect and flaky

Aberta

#581 aberto em 4 de jun. de 2024

 (0 comentário) (1 reação) (0 responsável)Go (96 forks)auto 404
buggood first issuetests

Métricas do repositório

Stars
 (370 estrelas)
Métricas de merge de PR
 (Métricas PR pendentes)

Description

Describe the bug

We recently added an integration test that starts a total of 80 dev server, with a maximum of 8 instances running concurrently. This is used to assert, among other things, the reliability of the "get ephemeral port number" logic.

However, that test is incorrect, because it calls FailNow and similar from goroutines, which is not allowed. The test is also flaky. Incorrect usage of test APIs is like not the cause of the flakiness, but may be masking the actual errors, making the issue harder to diagnose.

Given that the CLI's test harness internally use FailNow, fixing this will likely require developing a substitute for the existing test harness.

Guia do colaborador