[aw] Contract test: verify context separation failed

Closed
#271 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
1-2 days
Newbie friendliness
55/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Active
Tech stack
github-actions
Domain
ci-cd

Research direction

Start with .github/workflows/issue-triage.md and inspect its workflow frontmatter, then read .github/skills/agentic-workflows/SKILL.md and the linked debug.md guidance. Re-run the failed issue-triage workflow after checking the configured Copilot model and integration settings; done means the contract test completes without the unsupported-model or engine failure.

Written by the indexing model from the issue text.

Description

agentic-workflows
Workflow Failure

Workflow: Contract test: verify context separation
Branch: main
Run: https://github.com/Azure/apiops-cli/actions/runs/34220055160

[!WARNING]
Invalid or Unsupported Model: The agent failed because the configured model name is invalid, unknown, or unavailable for this engine/account.

This is a configuration issue, not a transient error — retrying will not help.

How to fix this

Specify a valid model for the selected engine in the workflow frontmatter:

---
engine: copilot
model: gpt-5-mini
---

To find valid models, check your engine/provider documentation (for Copilot see supported models).

[!WARNING]
Engine Failure: The copilot engine terminated unexpectedly.

Last agent output:

Duration   0s
400 The requested model is not available for integrator "agentic-workflows". Available models: [gpt-4.1 claude-fable-5.1 claude-fable-5 claude-opus-4.6 claude-opus-4.7 claude-opus-4.8-fast claude-opus-4.8 claude-opus-5 claude-sonnet-5 copilot-search-a copilot-search-b copilot-search-c exec-agent-a exec-agent-b exec-agent-c gpt-5.3-codex gpt-5.4-mini gpt-5.4 gpt-5.5 gpt-5.6-luna gpt-5.6-sol-fast gpt-5.6-sol gpt-5.6-terra gpt-6-astra grok-4.5 grok-4.6 kimi-k2.7-code kimi-k3 mai-code-1.1-flash mai-code-1-flash-picker trajectory-compaction gpt-5-mini gpt-3.5-turbo gpt-3.5-turbo-0613 gpt-4o-mini gpt-4o-mini-2024-07-18 copilot-preview-4o-mini-a1cfd608 gpt-4 gpt-4-0613 copilot-preview-gpt4-centralus gpt-4o gpt-4o-2024-11-20 gpt-4o-2024-05-13 gpt-4-o-preview gpt-4o-japanwest copilot-preview-gpt4o-centralus gpt-4o-2024-08-06 claude-sonnet-4.5 claude-opus-4.5 claude-haiku-4.5 gpt-4.1-2025-04-14 goldeneye-secondary gpt-5.2]. Verify the correct Copilot-Integration-Id header is being sent.
Changes    +0 -0
Duration   7s
400 The requested model is not available for integrator "agentic-workflows". Available models: [gpt-4.1 claude-fable-5.1 claude-fable-5 claude-opus-4.6 claude-opus-4.7 claude-opus-4.8-fast claude-opus-4.8 claude-opus-5 claude-sonnet-5 copilot-search-a copilot-search-b copilot-search-c exec-agent-a exec-agent-b exec-agent-c gpt-5.3-codex gpt-5.4-mini gpt-5.4 gpt-5.5 gpt-5.6-luna gpt-5.6-sol-fast gpt-5.6-sol gpt-5.6-terra gpt-6-astra grok-4.5 grok-4.6 kimi-k2.7-code kimi-k3 mai-code-1.1-flash mai-code-1-flash-picker trajectory-compaction gpt-5-mini gpt-3.5-turbo gpt-3.5-turbo-0613 gpt-4o-mini gpt-4o-mini-2024-07-18 copilot-preview-4o-mini-a1cfd608 gpt-4 gpt-4-0613 copilot-preview-gpt4-centralus gpt-4o gpt-4o-2024-11-20 gpt-4o-2024-05-13 gpt-4-o-preview gpt-4o-japanwest copilot-preview-gpt4o-centralus gpt-4o-2024-08-06 claude-sonnet-4.5 claude-opus-4.5 claude-haiku-4.5 gpt-4.1-2025-04-14 goldeneye-secondary gpt-5.2]. Verify the correct Copilot-Integration-Id header is being sent.
Changes    +0 -0
Duration   19s
400 The requested model is not available for integrator "agentic-workflows". Available models: [gpt-4.1 claude-fable-5.1 claude-fable-5 claude-opus-4.6 claude-opus-4.7 claude-opus-4.8-fast claude-opus-4.8 claude-opus-5 claude-sonnet-5 copilot-search-a copilot-search-b copilot-search-c exec-agent-a exec-agent-b exec-agent-c gpt-5.3-codex gpt-5.4-mini gpt-5.4 gpt-5.5 gpt-5.6-luna gpt-5.6-sol-fast gpt-5.6-sol gpt-5.6-terra gpt-6-astra grok-4.5 grok-4.6 kimi-k2.7-code kimi-k3 mai-code-1.1-flash mai-code-1-flash-picker trajectory-compaction gpt-5-mini gpt-3.5-turbo gpt-3.5-turbo-0613 gpt-4o-mini gpt-4o-mini-2024-07-18 copilot-preview-4o-mini-a1cfd608 gpt-4 gpt-4-0613 copilot-preview-gpt4-centralus gpt-4o gpt-4o-2024-11-20 gpt-4o-2024-05-13 gpt-4-o-preview gpt-4o-japanwest copilot-preview-gpt4o-centralus gpt-4o-2024-08-06 claude-sonnet-4.5 claude-opus-4.5 claude-haiku-4.5 gpt-4.1-2025-04-14 goldeneye-secondary gpt-5.2]. Verify the correct Copilot-Integration-Id header is being sent.
Changes    +0 -0
Duration   40s
Action Required

Assign this issue to an agent to debug and fix the issue.

Debug with any coding agent

Use this prompt with any coding agent (GitHub Copilot, Claude, Gemini, etc.):

Debug the agentic workflow failure using https://raw.githubusercontent.com/github/gh-aw/main/debug.md

The failed workflow run is at https://github.com/Azure/apiops-cli/actions/runs/34220055160
Manually invoke the agent

Debug this workflow failure using your favorite Agent CLI and the agentic-workflows prompt.

[!TIP]

Stop reporting this workflow as a failure

To stop a workflow from creating failure issues, set report-failure-as-issue: false in its frontmatter:

safe-outputs:
  report-failure-as-issue: false

Generated from Contract test: verify context separation ·

  • expires on Sep 15, 2026, 11:25 AM UTC
Dominant language
TypeScript
Stars
29
Forks
10
Avg merge
1d 13h
Merged PRs (30d)
23

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from Azure/apiops-cli

All issues in Azure/apiops-cli

Similar issues

More TypeScript issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.