[Safe Outputs Conformance] MCE-001: add_comment tool description wording does not match conformance checker 50-link disclosure pattern
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 68/100
Research direction
The add_comment description and its body field description live in pkg/workflow/js/safe_outputs_tools.json, and the failing regex is in check_mce_constraint_disclosure in scripts/check-safe-outputs-conformance.sh. Start by comparing the current max-links wording with the 50 link pattern the checker greps for, then decide whether to reword the JSON or widen the regex, which maintainers should confirm. Done means the checker reports MCE-001 as passing when run.
Written by the indexing model from the issue text.
Description
Conformance Check Failure
Check ID: MCE-001
Severity: MEDIUM
Category: Implementation (MCP Constraint Enforcement, Section 8.3 MCE2)
Problem Description
scripts/check-safe-outputs-conformance.sh (check check_mce_constraint_disclosure) requires the add_comment tool description in pkg/workflow/js/safe_outputs_tools.json to contain the literal substring 50 link (case-insensitive) as proof that the 50-URL constraint is disclosed to the agent per spec Section 8.3 MCE2.
The description does disclose the limit, but with different wording:
"...the configured max-links URL occurrences in agent content (default: 50; generated footer and metadata links excluded)..."
Because the digit 50 and the word link/links never appear adjacent, the checker's grep -iE "50 link" does not match, and the check fails with a MEDIUM-severity false-positive-style result even though the underlying requirement (informing the agent of the link limit before it calls the tool) is satisfied.
This will keep re-triggering on every scheduled run of this conformance workflow until either the description wording or the checker pattern is adjusted, generating recurring noise.
Affected Components
- Files:
pkg/workflow/js/safe_outputs_tools.json(canonical source, embedded viago:embedinpkg/workflow/safe_outputs_tools.go) —add_commenttooldescription(~line 525) andbodyfielddescription(~line 533)scripts/check-safe-outputs-conformance.sh—check_mce_constraint_disclosure(around line 684)
🔍 Current vs Expected Behavior
Current Behavior
The add_comment description states the link limit as "...(default: 50; generated footer and metadata links excluded)" — correct in substance, but it does not contain a string matching 50 link so the automated checker flags it as missing disclosure.
Expected Behavior
Either:
- The tool description text explicitly includes a phrase like "maximum 50 links" / "50 link limit" so the disclosure is unambiguous to both the agent and the automated conformance check, OR
- The checker's regex is broadened to also accept the existing "max-links ... default: 50" phrasing (and similar equivalent wording) so it does not flag substantively-conformant descriptions.
Remediation Steps
This task can be assigned to a Copilot coding agent with the following steps:
- Open
pkg/workflow/js/safe_outputs_tools.jsonand locate theadd_commenttooldescriptionand itsbodyfielddescription(two occurrences of the max-links wording). - Reword the link-limit clause to literally include "50 links" (or "50 link limit"), e.g. change "...the configured max-links URL occurrences in agent content (default: 50; generated footer and metadata links excluded)..." to "...a maximum of 50 links (configurable via max-links; generated footer and metadata links excluded)...", keeping the meaning unchanged.
- Regenerate/sync
actions/setup/js/safe_outputs_tools.jsonfrom the canonical source if it is a generated copy (checkpkg/workflow/safe_outputs_tools_generation.go/generate_safe_outputs_tools.cjsfor the regeneration step), and runmake fmt. - Re-run the conformance checker to confirm MCE-001 passes.
- If, instead, the maintainers prefer to keep the current wording, update the checker regex in
scripts/check-safe-outputs-conformance.sh(check_mce_constraint_disclosure) to accept the existing "max-links...default: 50" phrasing instead of requiring the literal "50 link" substring.
Verification
After remediation, verify the fix by running:
bash scripts/check-safe-outputs-conformance.sh
The check MCE-001 should pass without errors.
References
- Safe Outputs Specification: docs/src/content/docs/specs/safe-outputs-specification.md (Section 8.3 MCE2)
- Conformance Checker: scripts/check-safe-outputs-conformance.sh
- Run ID: §38688391715
- Date: 2026-10-15
Generated by ✅ Daily Safe Outputs Conformance Checker · claude · agent · 83.3 AIC · ⊞ 5.3K · ◷
- expires on Oct 15, 2026, 9:49 PM UTC-08:00
- Dominant language
- Go
- Stars
- 5.4k
- Forks
- 584
- Avg merge
- 3h 56m
- Merged PRs (30d)
- 810
Getting set up
Starts the project's dev container in your browser, under your own GitHub account.
- Ships a Dockerfile or Docker Compose file
- No pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from github/gh-aw
-
ai-inspected
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
Maintainers usually reply within 1 day
-
automation cookie
Difficulty 1/5 Under an hour Newbie friendliness 68/100
github/gh-aw#68990 · 2 comments ·
Maintainers usually reply within 1 day
-
goroutineresourceleak (81st linter): paren_unwrap_gap across lock/cancel/channel detection, day oneOpencookie sergo
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
github/gh-aw#68591 · 1 comment ·
Maintainers usually reply within 1 day
-
agentic-workflows cascade-suspected
Difficulty 4/5 3-5 days Newbie friendliness 22/100
Maintainers usually reply within 1 day
-
agentic-workflows cascade-suspected
Difficulty 4/5 1-2 days Newbie friendliness 15/100
Maintainers usually reply within 1 day
Similar issues
-
documentation hacktoberfest priority: low skill: good first issue status: ready for dev
Difficulty 2/5 Half a day Newbie friendliness 85/100
hyperledger-labs/fabric-smart-client#2142 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
numberly/vault-db-injector#107 ·
Maintainers usually reply within 1 day
-
area/import kind/bug
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
Maintainers usually reply within 1 day
-
[DOC] Wrong sg_egress_ports range in the Terraform Databricks Guide for AWS Hub & Spoke with Network FirewallPossibly taken @akhil9tiet claimed this today. Opendocs
Difficulty 1/5 Under an hour Newbie friendliness 72/100
databricks/terraform-provider-databricks#6080 · 1 comment ·
Maintainers usually reply within 3 days
-
kind/documentation
Difficulty 2/5 1-3 hours Newbie friendliness 80/100
kubernetes-sigs/dra-driver-nvidia-gpu#1569 ·
Maintainers usually reply within 1 day