Agent Persona Exploration - 2026-10-22
I maintainer di solito rispondono entro 1 giorno
Nessuno ha ancora preso questa issue.
Valutazione
- Difficoltà
- 2/5
- Tempo stimato
- 1-3 ore
- Idoneità per principianti
- 72/100
- Tipo di issue
- Documentazione
- Chiarezza
- Specificata chiaramente
- Stato di attività
- Attiva
- Stack tecnologico
- github-actions
- Ambito
- documentation
Direzione di ricerca
Leggi .github/aw/safe-outputs.md e .github/aw/report.md, indicati dall’issue come obiettivi della documentazione. Aggiungi indicazioni per la revisione umana dei workflow di conformità e una convenzione per la chiave di deduplicazione close-older-issues; verifica che entrambe le raccomandazioni siano formulate chiaramente nelle sezioni pertinenti.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Descrizione
Persona Overview
- Agent: agentic-workflows (persona-evaluator)
- Personas This Run: Program Manager, Designer, Legal / Compliance
- Scenarios Tested: 4 (PM-1, DS-1, LC-1, LC-2)
- Average Quality Score: 4.8/5.0
Key Findings
- All 4 invocations succeeded; this was the strongest-scoring batch recorded so far (previous batch averaged 4.7/5.0).
- The agent consistently separates read-only agent-job permissions from writes, routing all mutations through safe-outputs (
create-issue,add-comment,add-labels). - For the compliance scenario (LC-1), the agent chose a flag-for-human-review pattern (comment + label) rather than auto-approving or auto-blocking PRs — an appropriate human-in-the-loop design for a legal domain.
- The agent proactively justified security choices unprompted: using
pull_requestinstead ofpull_request_targetfor untrusted diffs (DS-1), and keepingnetwork_accessempty to avoid being steered into fetching untrusted external "policy" text (LC-1, LC-2). - Dedup strategy differs by scenario shape: stable
close-older-issueskeys for recurring digests/audits (PM-1, LC-2) vs. no dedup needed for per-PR comments (DS-1, LC-1).
Top Patterns
- Triggers:
schedule+workflow_dispatchfor digests/audits;pull_request(opened/synchronize/reopened) scoped withpaths:filters for PR automation — no scenario triggered on overly broad events. - Tools:
githubingh-proxymode with thedefaulttoolset is the near-universal recommendation; no unnecessary tool grants (nobash/web-fetchsuggested where file/API reads sufficed). - Security practices: agent job permissions held to
contents: read(+issues: readorpull-requests: read) in every case;network_access: []whenever no external fetch was truly required; writes exclusively via safe-outputs. - Noop discipline: every scenario included an explicit
noopbranch (nothing stale / nothing missing / no mismatches) to avoid empty-result issue spam.
View High Quality Responses (Top 2-3)
- PM-1 (5.0/5 avg): Designed a stable per-week dedup key, explicitly turned off
mentionsandallowed-github-referencesto prevent unwanted owner pings/backlinks on an automated digest — a subtle but correct safety default. - LC-1 (4.8/5 avg): Resisted the temptation to make the workflow a gate; instead it flags uncertain DPA coverage for a human, matching the task's "flag uncertain... for human review" requirement precisely.
- LC-2 (4.8/5 avg): Called out avoiding any live SPDX/license lookup over the network, reasoning that fetching remote "policy" text for comparison would introduce an injection/trust risk — a non-obvious catch.
View Areas for Improvement (Top 2-3)
- Tool selection scored 4/5 (not 5/5) in 3 of 4 scenarios only because the summaries didn't explicitly address how file-content diffs (CSS/token files, license text, DPA table rows) would be read — relying implicitly on repo checkout access rather than naming a specific read path.
- No scenario surfaced genuinely insecure configurations in this batch, which is a positive signal but also means this run didn't stress-test failure modes (e.g., ambiguous trigger scenarios, scenarios needing
pull_request_target, or multi-repo scope). - Compliance- and design-token-adjacent scenarios reliably produced strong human-in-the-loop defaults, but this pattern is not yet written down anywhere — it currently depends on the model inferring it per scenario.
Recommendations
- Document the "flag-for-human-review, never auto-block/auto-approve" pattern explicitly in
.github/aw/safe-outputs.mdfor compliance- and policy-adjacent workflows, so it's a stated convention rather than an emergent one. - Add a canonical
close-older-issuesdedup-key naming convention (e.g.,<workflow-slug>-<cadence>) to.github/aw/report.md, since the agent currently invents a reasonable but ad hoc key per scenario (dependency-risk-digest:<window-id>vs.license-policy-audit). - Next run should include at least one scenario with an intentionally ambiguous trigger (e.g., a task that could plausibly need
pull_request_targetor cross-repo access) to test whether the agent's security reasoning holds up under harder cases, not just straightforward ones.
Generated by 🎭 Agent Persona Explorer · claude · agent · 140.2 AIC · ⌖ 0.751 AIC · ⊞ 6.7K · ◷
- Lingua principale
- Go
- Stelle
- 5.4k
- Fork
- 596
- Merge medio
- 3h 51m
- PR unite (30g)
- 831
Preparare l'ambiente
Avvia il container di sviluppo del progetto nel browser, con il tuo account GitHub.
- Include un Dockerfile o un file Docker Compose
- Nessun modello di pull request
- Leggi la guida per i contributori
Come iniziare
- Leggi tutta la issue e poi la guida ai contributi del progetto.
- Commenta sulla issue per dire che te ne occupi tu — evita che due persone facciano lo stesso lavoro.
- Fai un fork del repository e lavora su un branch.
- Apri una pull request che faccia riferimento al numero della issue.
Altre issue di github/gh-aw
-
automated-analysis bug cookie safe-outputs tool-improvement workflow-issue
Difficoltà 2/5 1-3 ore Idoneità per principianti 75/100
github/gh-aw#71952 · 3 commenti ·
I maintainer di solito rispondono entro 1 giorno
-
agent-research
Difficoltà 2/5 1-3 ore Idoneità per principianti 68/100
I maintainer di solito rispondono entro 1 giorno
-
wgdonenotdeferred: parenthesized Done() statement escapes non-deferred detection (paren_unwrap_gap)Apertacookie sergo
Difficoltà 2/5 1-3 ore Idoneità per principianti 76/100
I maintainer di solito rispondono entro 1 giorno
-
cookie eslint
Difficoltà 2/5 1-3 ore Idoneità per principianti 75/100
I maintainer di solito rispondono entro 1 giorno
-
automation
Difficoltà 1/5 Meno di un'ora Idoneità per principianti 1/100
I maintainer di solito rispondono entro 1 giorno
Tutte le issue di github/gh-aw
Issue simili
-
Difficoltà 1/5 Meno di un'ora Idoneità per principianti 76/100
I maintainer di solito rispondono entro 1 giorno
-
[flaky test] TestValidatorCommitterDropsEmptyStatusBatch: submits to the mock VC before its stream is registeredForse già presa @liran-funaro l’ha presa oggi. Apertacoordinator flaky-test race-condition testing
Difficoltà 2/5 1-3 ore Idoneità per principianti 83/100
hyperledger/fabric-x-committer#876 ·
I maintainer di solito rispondono entro 1 giorno
-
enhancement
Difficoltà 2/5 1-3 ore Idoneità per principianti 65/100
garethgeorge/backrest#1426 ·
I maintainer di solito rispondono entro 1 giorno
-
enhancement nav-pilot
Difficoltà 2/5 Mezza giornata Idoneità per principianti 62/100
I maintainer di solito rispondono entro 1 giorno
-
Difficoltà 2/5 1-3 ore Idoneità per principianti 68/100
valkey-io/valkey-operator#549 · 1 commento ·
I maintainer di solito rispondono entro 3 giorni