[rig-sampler] Daily Rig sample report — 2026-10-23

Start by reading the Daily Rig Sample Report workflow and its sample-coordinator and sample-runner entry points, then inspect the named failing tests: scripts/run-sample.test.ts, src/rig.test.ts, scripts/haiku.integration.test.ts, src/launcher-default-engine.test.ts, and src/skill-bootstrap.test.ts. The report records 497 test failures across five files alongside successful sample runs, but does not identify a specific change to make. Done means the reported test failures are understood and resolved, with the relevant tests passing.

Ran the sample-coordinator program once. It randomly selected 5 samples. All 5 succeeded.

{
  "score": 13,
  "grade": "F",
  "missingRequired": [
    "version",
    "description",
    "main"
  ],
  "missingRecommended": [
    "license",
    "author",
    "repository",
    "keywords",
    "bugs",
    "homepage"
  ],
  "details": {
    "name": {
      "present": true,
      "score": 100,
      "note": "Field 'name' is present"
    },
    "version": {
      "present": false,
      "score": 0,
      "note": "Missing required field"
    },
    "description": {
      "present": false,
      "score": 0,
      "note": "Missing required field"
    },
    "main": {
      "present": false,
      "score": 0,
      "note": "Missing required field"
    },
    "license": {
      "present": false,
      "score": 0,
      "note": "Missing recommended field"
    },
    "author": {
      "present": false,
      "score": 0,
      "note": "Missing recommended field"
    },
    "repository": {
      "present": false,
      "score": 0,
      "note": "Missing recommended field"
    },
    "keywords": {
      "present": false,
      "score": 0,
      "note": "Missing recommended field"
    },
    "bugs": {
      "present": false,
      "score": 0,
      "note": "Missing recommended field"
    },
    "homepage": {
      "present": false,
      "score": 0,
      "note": "Missing recommended field"
    },
    "engines": {
      "present": false,
      "score": 0,
      "note": "Missing optional field"
    },
    "files": {
      "present": false,
      "score": 0,
      "note": "Missing optional field"
    },
    "exports": {
      "present": true,
      "score": 60,
      "note": "Field 'exports' is present"
    }
  }
}

{
  "kind": "review-finding",
  "finding": "No finding was provided: the input was an empty string, so there is nothing to convert into a review record.",
  "severity": "info"
}

{
  "classes": {},
  "totalClasses": 0,
  "totalAbstractMethods": 0
}

{
  "decision": "blocked",
  "reason": "Lint passed with no issues, but tests failed: 497 failures across 5 test files, including 484 in scripts/run-sample.test.ts, 5 in src/rig.test.ts (createSession toHaveBeenCalledWith at line 801), 3 each in scripts/haiku.integration.test.ts and src/launcher-default-engine.test.ts, and 2 in src/skill-bootstrap.test.ts."
}

{
  "byExtension": {
    "ts": {
      "fileCount": 1412,
      "lineCount": 68637
    },
    "md": {
      "fileCount": 1345,
      "lineCount": 65134
    },
    "js": {
      "fileCount": 27,
      "lineCount": 3779
    },
    "yml": {
      "fileCount": 22,
      "lineCount": 30827
    },
    "json": {
      "fileCount": 16,
      "lineCount": 13855
    }
  },
  "totalLines": 68637,
  "largestExtension": "ts",
  "complexityRating": "large"
}

Rig Runtime Logs

Captured from the child runs (per-sample logs). Top-level coordinator and runner rig.agent:invoke lines are included under "Coordinator".

Coordinator

{"type":"rig.agent:invoke","data":{"agent":"sample-coordinator","input":"","model":"small","maxTurns":4},"created_at":1792772682387,"timestamp":197.492086}
{"type":"rig.agent:invoke","data":{"agent":"sample-runner","input":{"path":"skills/rig/samples/229-package-json-scorer.md"},"model":"small","maxTurns":4},"created_at":1792772683697,"timestamp":1506.542234}
{"type":"rig.agent:invoke","data":{"agent":"sample-runner","input":{"path":"skills/rig/samples/39-unknown-raw-output.md"},"model":"small","maxTurns":4},"created_at":1792772701473,"timestamp":19282.849152}
{"type":"rig.agent:invoke","data":{"agent":"sample-runner","input":{"path":"skills/rig/samples/486-ts-abstract-class-finder.md"},"model":"small","maxTurns":4},"created_at":1792772707188,"timestamp":24997.435169}
{"type":"rig.agent:invoke","data":{"agent":"sample-runner","input":{"path":"skills/rig/samples/525-lint-test-gate-workflow.md"},"model":"small","maxTurns":4},"created_at":1792772718750,"timestamp":36560.084018}
{"type":"rig.agent:invoke","data":{"agent":"sample-runner","input":{"path":"skills/rig/samples/121-loc-stats-gatherer.md"},"model":"small","maxTurns":4},"created_at":1792772877745,"timestamp":195554.671757}

229-package-json-scorer.md

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"small","maxTurns":4},"created_at":1792772685249,"timestamp":204.850743}
{"type":"rig.engine:copilot:create","data":{"model":"small","transport":"stdio"},"created_at":1792772685251,"timestamp":205.741707}
{"type":"rig.agent:close","data":{"agent":"agent"},"created_at":1792772696406,"timestamp":11360.292226}
{"type":"rig.engine:copilot:close","created_at":1792772696406,"timestamp":11360.437357}

39-unknown-raw-output.md

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"mini","maxTurns":4},"created_at":1792772703119,"timestamp":206.105425}
{"type":"rig.engine:copilot:create","data":{"model":"mini","transport":"stdio"},"created_at":1792772703120,"timestamp":206.833395}
{"type":"rig.agent:close","data":{"agent":"agent"},"created_at":1792772704517,"timestamp":1603.440596}
{"type":"rig.engine:copilot:close","created_at":1792772704517,"timestamp":1603.570488}

486-ts-abstract-class-finder.md

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"","model":"small","maxTurns":8},"created_at":1792772708918,"timestamp":206.39877}
{"type":"rig.engine:copilot:create","data":{"model":"small","transport":"stdio"},"created_at":1792772708920,"timestamp":207.330873}
{"type":"rig.agent:close","data":{"agent":"agent"},"created_at":1792772716098,"timestamp":7385.233375}
{"type":"rig.engine:copilot:close","created_at":1792772716098,"timestamp":7385.359821}

525-lint-test-gate-workflow.md

{"type":"rig.agent:invoke","data":{"agent":"agent","input":"run lint check","model":"small","maxTurns":4},"created_at":1792772720577,"timestamp":202.581335}
{"type":"rig.engine:copilot:create","data":{"model":"small","transport":"stdio"},"created_at":1792772720579,"timestamp":203.490875}
{"type":"rig.agent:close","data":{"agent":"agent"},"created_at":1792772731689,"timestamp":11313.610221}
{"type":"rig.engine:copilot:close","created_at":1792772731689,"timestamp":11313.768407}
{"type":"rig.agent:invoke","data":{"agent":"agent","input":"run test check","model":"small","maxTurns":4},"created_at":1792772731723,"timestamp":11347.83896}
{"type":"rig.engine:copilot:create","data":{"model":"small","transport":"stdio"},"created_at":1792772731723,"timestamp":11347.957351}
{"type":"rig.agent:close","data":{"agent":"agent"},"created_at":1792772868456,"timestamp":148080.458572}
{"type":"rig.engine:copilot:close","created_at":1792772868456,"timestamp":148080.54887}
{"type":"rig.agent:invoke","data":{"agent":"agent","input":{"lint":{"passed":true,"issues":[]},"test":{"passed":false,"failures":["scripts/run-sample.test.ts: 484 tests failed","scripts/haiku.integration.test.ts: 3 tests failed","src/launcher-default-engine.test.ts: 3 tests failed","src/rig.test.ts: 5 tests failed (e.g. createSession toHaveBeenCalledWith at line 801)","src/skill-bootstrap.test.ts: 2 tests failed (typechecks with host-provided compiler; reports missing compiler)","Total: 497 failed, 921 passed, 1 skipped (5 of 29 test files failed)"]}},"model":"small","maxTurns":4},"created_at":1792772868499,"timestamp":148123.712605}
{"type":"rig.engine:copilot:create","data":{"model":"small","transport":"stdio"},"created_at":1792772868499,"timestamp":148123.946522}
{"type":"rig.agent:close","data":{"agent":"agent"},"created_at":1792772870574,"timestamp":150198.556415}
{"type":"rig.engine:copilot:close","created_at":1792772870574,"timestamp":150198.621145}

121-loc-stats-gatherer.md

{"type":"rig.agent:invoke","data":{"agent":"locStatsGatherer","input":"","model":"small","maxTurns":4},"created_at":1792772879580,"timestamp":217.797851}
{"type":"rig.engine:copilot:create","data":{"model":"small","transport":"stdio"},"created_at":1792772879582,"timestamp":218.746584}
{"type":"rig.agent:close","data":{"agent":"locStatsGatherer"},"created_at":1792772888526,"timestamp":9163.104816}
{"type":"rig.engine:copilot:close","created_at":1792772  879582}

Note: the last line above is reproduced exactly as captured (it contains a malformed created_at and no timestamp). The coordinator lines came from the launcher's RIG_DEBUG=agent:invoke stderr; the per-sample lines are the child logs returned in each run result.

Generated by Daily Rig Sample Report · copilot · auto · ~116 AIC · ⌖ ~1 AIC · ⊞ 4K · ◷

• expires on Oct 30, 2026, 4:31 PM UTC