spike: audit the test suites for duplication, usefulness and structure

Đang mở
  • Có gì không ổn?
#435 0 bình luận 0 reaction 0 người được giao Xem trên GitHub

Maintainer thường phản hồi trong vòng 1 ngày

Chưa có ai nhận issue này.

Đánh giá

Độ khó
5/5
Thời gian dự kiến
Hơn một tuần
Mức phù hợp với người mới
35/100
Loại issue
Tính năng
Độ rõ ràng
Đặc tả rõ ràng
Mức độ hoạt động
Sôi nổi
Công nghệ
csharp, javascript
Lĩnh vực
testing-qa

Hướng nghiên cứu

Start by confirming the listed test locations and file sizes: TaskFlow.Api.Tests, TaskFlow.Web/src, and assistant/tests; inspect TestSupport.cs and the API Helpers/ folder for repeated setup. Run Stryker.NET and StrykerJS on one representative slice per area, recording setup cost, runtime, mutation results, and full test runtimes with the slowest files. Post the requested area tables, recommend grouping and a size limit, update the agent wording once agreed, and record whether to create a test-curator with follow-up issues if needed.

Do mô hình lập chỉ mục viết ra từ nội dung của issue.

Mô tả

tech-debt

Found while reviewing the test-verifier agent for #400 (piece 8). The test suites have grown large, and part of the growth comes from our own instructions ("extend the existing test file rather than creating a parallel one"). This spike measures the problem and decides what to do about it before anyone builds a tool.

What I found

Area Test code Tests Notes
API (TaskFlow.Api.Tests) about 19,400 lines 946 Five files cover TaskItemsController (about 4,300 lines together) and overlap in topic: TaskItemsControllerV1Tests, ...ParentCompletedTests, ...PatchTests, ...JournalDateMockedTests, and others.
Web (TaskFlow.Web/src) about 21,300 lines 1,650 in 99 files Several files of 600 to 1,000 lines; four CSS-contract style tests.
Assistant (assistant/tests) about 5,100 lines 348 in 3 files TaskToolsTests.cs is 2,973 lines.
  • The API tests have no shared builder or fixture folder that I could find (their Helpers/ folder tests production helpers). The assistant has TestSupport.cs (234 lines) and the web has src/test/. This needs confirming.
  • Line coverage (75% API, 80% web) says a line ran, not that a test is useful. Deleting tests risks the gates, so the gates cannot be the only measure.

Scope

  1. Structure. For each area, find overlapping test files, files over a size threshold, setup repeated across files, and helpers that should be shared. Propose a grouping rule (by behavior, a size limit) to replace "extend the existing file".
  2. Usefulness. Find tests that only assert a mock was called, restate what a lower or higher layer already proves, or have no meaningful assertion. Use mutation testing (Stryker.NET for the API and assistant, StrykerJS for the web) on one representative slice per area: tests that kill no mutant that another test does not also kill are candidates to remove. Record the run time and setup cost of each tool.
  3. Cost. Record the current full test run time per area and what the slowest files are.
  4. Decide what to do. Compare: a series of ordinary cleanup PRs, or a test-curator agent and skill run by hand on one area at a time to produce behavior-preserving refactor PRs. Recommend one, with an estimate.
  5. If an agent is recommended, state the proof it must give with each PR: coverage gates unchanged and mutation score no lower.

Acceptance criteria

  1. A table is posted on this issue for each area: files over the proposed size limit, overlapping files, repeated setup, and candidate shared helpers.
  2. Mutation results for one slice per area are posted, with the tool setup and run time, or the issue says why a tool was dropped.
  3. A recommended file grouping and size rule is posted, and the "extend the existing test file" wording in the agents is replaced with it once agreed.
  4. A recommendation is recorded on whether to build a test-curator, with follow-up issues opened if so.

Out of scope

  • Doing the refactor. This issue produces a decision and follow-up issues.
  • Changing the coverage gates.
  • The test-verifier's probing and usefulness bar. #400 decided those and carries them.
Ngôn ngữ chính
C#
Star
1
Fork
0
Merge trung bình
2 giờ 2 phút
Pull request đã merge (30 ngày)
98

Chuẩn bị môi trường

Bắt đầu từ đâu

  1. Đọc hết issue, rồi đọc hướng dẫn đóng góp của dự án.
  2. Bình luận trên issue rằng bạn sẽ nhận — tránh hai người làm cùng một việc.
  3. Fork repository và làm thay đổi trên một nhánh.
  4. Mở pull request có tham chiếu số hiệu của issue.

Issue khác của nevridge/TaskFlow

Tất cả issue của nevridge/TaskFlow

Issue tương tự

Thêm issue về C#

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.