spike: audit the test suites for duplication, usefulness and structure

Abierto
  • ¿Algo no está bien?
#435 0 comentarios 0 reacciones 0 asignados Ver en GitHub

Los mantenedores suelen responder en 1 día

Nadie ha tomado este issue todavía.

Evaluación

Dificultad
5/5
Tiempo estimado
Más de una semana
Aptitud para principiantes
35/100
Tipo de issue
Nueva funcionalidad
Claridad
Bien especificado
Estado de actividad
Activo
Stack tecnológico
csharp, javascript
Área
testing-qa

Línea de trabajo

Start by confirming the listed test locations and file sizes: TaskFlow.Api.Tests, TaskFlow.Web/src, and assistant/tests; inspect TestSupport.cs and the API Helpers/ folder for repeated setup. Run Stryker.NET and StrykerJS on one representative slice per area, recording setup cost, runtime, mutation results, and full test runtimes with the slowest files. Post the requested area tables, recommend grouping and a size limit, update the agent wording once agreed, and record whether to create a test-curator with follow-up issues if needed.

Escrito por el modelo de indexación a partir del texto del issue.

Descripción

tech-debt

Found while reviewing the test-verifier agent for #400 (piece 8). The test suites have grown large, and part of the growth comes from our own instructions ("extend the existing test file rather than creating a parallel one"). This spike measures the problem and decides what to do about it before anyone builds a tool.

What I found

Area Test code Tests Notes
API (TaskFlow.Api.Tests) about 19,400 lines 946 Five files cover TaskItemsController (about 4,300 lines together) and overlap in topic: TaskItemsControllerV1Tests, ...ParentCompletedTests, ...PatchTests, ...JournalDateMockedTests, and others.
Web (TaskFlow.Web/src) about 21,300 lines 1,650 in 99 files Several files of 600 to 1,000 lines; four CSS-contract style tests.
Assistant (assistant/tests) about 5,100 lines 348 in 3 files TaskToolsTests.cs is 2,973 lines.
  • The API tests have no shared builder or fixture folder that I could find (their Helpers/ folder tests production helpers). The assistant has TestSupport.cs (234 lines) and the web has src/test/. This needs confirming.
  • Line coverage (75% API, 80% web) says a line ran, not that a test is useful. Deleting tests risks the gates, so the gates cannot be the only measure.

Scope

  1. Structure. For each area, find overlapping test files, files over a size threshold, setup repeated across files, and helpers that should be shared. Propose a grouping rule (by behavior, a size limit) to replace "extend the existing file".
  2. Usefulness. Find tests that only assert a mock was called, restate what a lower or higher layer already proves, or have no meaningful assertion. Use mutation testing (Stryker.NET for the API and assistant, StrykerJS for the web) on one representative slice per area: tests that kill no mutant that another test does not also kill are candidates to remove. Record the run time and setup cost of each tool.
  3. Cost. Record the current full test run time per area and what the slowest files are.
  4. Decide what to do. Compare: a series of ordinary cleanup PRs, or a test-curator agent and skill run by hand on one area at a time to produce behavior-preserving refactor PRs. Recommend one, with an estimate.
  5. If an agent is recommended, state the proof it must give with each PR: coverage gates unchanged and mutation score no lower.

Acceptance criteria

  1. A table is posted on this issue for each area: files over the proposed size limit, overlapping files, repeated setup, and candidate shared helpers.
  2. Mutation results for one slice per area are posted, with the tool setup and run time, or the issue says why a tool was dropped.
  3. A recommended file grouping and size rule is posted, and the "extend the existing test file" wording in the agents is replaced with it once agreed.
  4. A recommendation is recorded on whether to build a test-curator, with follow-up issues opened if so.

Out of scope

  • Doing the refactor. This issue produces a decision and follow-up issues.
  • Changing the coverage gates.
  • The test-verifier's probing and usefulness bar. #400 decided those and carries them.
Lenguaje dominante
C#
Estrellas
1
Forks
0
Merge medio
2 h 2 min
PR fusionados (30 d)
98

Preparar el entorno

Primeros pasos

  1. Lee el issue completo y luego la guía de contribución del proyecto.
  2. Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
  3. Haz un fork del repositorio y trabaja en una rama.
  4. Abre un pull request que haga referencia al número del issue.

Más de nevridge/TaskFlow

Todos los issues de nevridge/TaskFlow

Issues similares

Más issues de C#

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.