Print raw trial samples from the CSPA performance gate

Open Beginner friendly
#1,914 0 comments 0 reactions 0 assignees View on GitHub

Maintainers usually reply within 1 day

Nobody has claimed this yet.

Assessment

Difficulty
2/5
Estimated time
1-3 hours
Newbie friendliness
86/100
Issue type
Feature
Clarity
Clearly specified
Activity status
Active
Tech stack
c

Research direction

Start in tests/test_cspa_perf_gate.c and compare its timed loop and output with tests/test_crdt_perf_gate.c. Emit the nine recorded trial values after measurement in sample order using a stable, parseable format, then add focused validation that confirms ordering and placement while preserving the existing summaries, sentinels, skip behavior, and exit status.

Written by the indexing model from the issue text.

Description

p2-medium

Discovery context

While diagnosing the required CRDT and CSPA performance regressions for #1913, review found that tests/test_cspa_perf_gate.c records nine ordered trial times but prints only summary statistics. The analogous tests/test_crdt_perf_gate.c prints every raw sample. Existing CSPA CI logs therefore cannot show whether a median/variance shift comes from an outlier or a consistent change.

Architect and Critic reviewed this gap and agreed it is useful general gate observability, but not required to complete #1913: paired invocation medians plus the current gate summaries and correctness/iteration sentinels suffice for that diagnosis.

Scope

Print all nine existing CSPA trial values after the timed loop in a stable, parseable order and format. Keep the diagnostic outside the measured interval and retain the current summaries and gate behavior.

Acceptance criteria

  • All nine trial values are emitted in sample order on both passing and stable target-failure runs.
  • The output format is stable and parseable.
  • Correctness and iteration sentinels, target, CoV skip behavior, exit status, and mean/stdev/median calculations remain unchanged.
  • A focused test or source-level validation confirms the values are emitted after measurement and in order.

Related: #1913, #1369.

Dominant language
C
Stars
18
Forks
2
Avg merge
9h 28m
Merged PRs (30d)
148

Getting set up

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from semantic-reasoning/wirelog

All issues in semantic-reasoning/wirelog

Similar issues

More C issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.