Census mock trial: take the 40 census programs from 8 whole to 40 of 40 accounted, measured by the tool only

Đang mở
  • Có gì không ổn?
#7,709 22 bình luận 0 reaction 0 người được giao Xem trên GitHub

Maintainer thường phản hồi trong vòng 1 ngày

Chưa có ai nhận issue này.

Đánh giá

Độ khó
5/5
Thời gian dự kiến
Hơn một tuần
Mức phù hợp với người mới
25/100
Loại issue
Tính năng
Độ rõ ràng
Khá rõ ràng
Mức độ hoạt động
Sôi nổi
Công nghệ
python
Lĩnh vực
devtools, testing-qa

Hướng nghiên cứu

Read the census protocol and ledger in this issue, then follow #5649 and the T0 instructions for cics_census.py survey and gap_prevalence.py. The work spans multiple translator gap classes and depends on fixes merging before each measurement. Done means all 40 programs are either translated whole or recorded as named source or clone problems, with aggregate ledger results published within the 14-day time box.

Do mô hình lập chỉ mục viết ra từ nội dung của issue.

Mô tả

claim:melek scope:core

Owner request 2026-11-04: treat the 40 census programs (9 public repos excluded from the blind study, never burned, counted by tools only under opaque labels) as a mock trial of the engine. Write-up: https://claude.ai/artifact/9CJkXtuprzxzRne4bty3dy

Baseline (last real survey 2026-10-24, 6758295f2 / #6361)

8 of 40 translate whole (20%). Of the 32 blocked: 13 only by source / clone problems (missing estate copybooks 9, undeclared items #7647, ISPF screens #7645), 17 only by translator gaps, 2 by both. On the 25 programs with no source or clone problem: 8 of 25 (32%).

Predictions (frozen before the first fix)

  • Translator work alone takes the census to 25 whole (62%); the other 15 end as named source / clone problems: 40 of 40 accounted.
  • The tool's coverage-if-closed (upper bounds; they count the missing-copybook gap as closable): top 1 -> 17, top 3 -> 20, top 5 -> 29, top 10 -> 32.
  • Cost: 9 translator gap classes x ~4-5 PRs per class (calibrated on #6876: 17 programs, 8 classes, 35 PRs, 6 days) = 35-45 PRs, 6-9 days at two workers.

Protocol

  1. First (owner 2026-11-04): #5649 -- the translator consumes the engine's record layouts (routed to nyx). The T0 re-survey waits until #5649 has merged; T0 then measures main with #5649 in, and the ledger notes it.
  2. T0: re-survey the census at current main with no census-targeted change (cics_census.py survey over the census repos, then gap_prevalence.py --census-survey ... --census-corpora ... --write); post the rate here. The 10-24 -> T0 delta is what the burned-estate work did for unseen code.
  3. Nobody reads census source. A fix gets the gap label, the IBM manual page and the owning issue, and proves itself on our own test (a cics-crucible program or a fixture), never a census excerpt.
  4. Measure with the tool only (aggregates, opaque labels), after each fix merges; append one ledger row below.
  5. A gap that is the source's fault becomes a named source defect with its reason.
  6. L1 only (translates whole); no claim about L2+.
  7. Finish: 40 of 40 accounted (whole or named), time box 14 days from T0; publish the ledger as it stands at the time box.

Gap classes (owners)

  • Bare LayoutError, 9 programs (#7644; some may be source defects) (#7714)
  • No such item, 3 programs (no owner yet) (#7730)
  • Bytes overlap COMP-1/2/5, 3 programs (#7646 slice 5): flip translate() to default zos_comp5=True (owner ruling B, 2026-11-04; the v2.12.1 hold was lifted by the owner 2026-11-05, no release pending). Regenerate the affected goldens and re-prove the 5 burned COMP-5 programs (CardDemo PAUDBLOD / PAUDBUNL / DBUNLDGS, async ASYNCPNT / SEQPNT), then re-survey.
  • STRING numeric sender with P or a decimal place, 2 programs (#7523). Re-opened 2026-11-05: #7738 named the wide literal a hole, but T3 still shows this gap. (#7752) Re-opened again 2026-11-05 evening: no PR since T3 closed this gap.
  • EXEC CICS map: no such field, 2 programs (#4270)
  • JSON GENERATE / PARSE, 2 programs (#7524)
  • Code-page literals (MOVE, STRING, UNSTRING / INSPECT beyond the single-byte code page), consolidated in #7526. T3: MOVE 2 programs, STRING 1. #7738 names the wide-literal hole.
  • EXEC CICS WEB CONVERSE / RECEIVE / HTTPHEADER, 1 program (#7525)
  • EXEC SQL ROLLBACK in CICS, 1 program (#7527) (#7727; the row is gone at T3)
  • Tool: gap_prevalence names closed #4767 as the owner of the census EXEC CICS WEB rows. Point them at #7525 (one-line owner-map fix). (#7754)
  • Tool: cics_census.py blockers --unmask prints census repository and program names in its per-program rows. Scrub them as gap_prevalence's census half does (protocol rule 2). (#7755)

Ledger (one row per re-survey)

date main whole / 40 gap closed (PRs) predicted vs actual new gaps exposed cost (PRs, worker-h, $) named, not fixed
2026-10-24 6758295f2 8 baseline - - - -

Related: #6064 (no current non-burned translation rate), #5865 (coverage-if-closed never validated against a run), #3803 (the real blind trial this rehearses).

Ngôn ngữ chính
Python
Star
57
Fork
11
Merge trung bình
1 giờ 32 phút
Pull request đã merge (30 ngày)
974

Chuẩn bị môi trường

Bắt đầu từ đâu

  1. Đọc hết issue, rồi đọc hướng dẫn đóng góp của dự án.
  2. Bình luận trên issue rằng bạn sẽ nhận — tránh hai người làm cùng một việc.
  3. Fork repository và làm thay đổi trên một nhánh.
  4. Mở pull request có tham chiếu số hiệu của issue.

Issue khác của squid-protocol/gitgalaxy

Tất cả issue của squid-protocol/gitgalaxy

Issue tương tự

Thêm issue về Python

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.