microsoft/vscode-chat-customizations-evaluation

A repository to evaluate the chat customizations

Stars: 139
Forks: 49
Open beginner issues: 0
Indexed issues: 19
Avg merge: 3d 13h
Merged PRs (30d): 3

Dominant language: TypeScript
License: No license data
Last GitHub push: Sep 15, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

19 open issues indexed

this.traceOutputChannel.onDidChangeLogLevel is not a function Open

bug

microsoft/vscode-chat-customizations-evaluation#284 · 2 comments · 1 assignee · Opened Aug 18, 2026
Review and improve Waza User Guide documentation Open

bug

microsoft/vscode-chat-customizations-evaluation#269 · 1 comment · 1 assignee · Opened Jul 15, 2026
LLM Analysis Failed Open

bug

microsoft/vscode-chat-customizations-evaluation#268 · 1 comment · 1 assignee · Opened Jul 15, 2026
Support custom model provider / BYOK for users without Copilot subscription Open

bug

microsoft/vscode-chat-customizations-evaluation#267 · 1 comment · 1 assignee · Opened Jul 10, 2026
Wrong/Missing error handling when model returns no result Open

bug

microsoft/vscode-chat-customizations-evaluation#266 · 1 assignee · Opened Jul 1, 2026
Real-world scenario for large plan implementation and multiple acceptance criteria Open

bug

microsoft/vscode-chat-customizations-evaluation#261 · 1 assignee · Opened Jun 23, 2026
Analyze button is only showing up for skills and not for instructions.md/agents.md Open

bug info-needed

microsoft/vscode-chat-customizations-evaluation#260 · 3 comments · 1 assignee · Opened Jun 22, 2026
chatCustomizationsEvaluations.wazaRunEval fails all tests due to token budget issues Open

bug under-discussion

microsoft/vscode-chat-customizations-evaluation#259 · 2 comments · 1 assignee · Opened Jun 22, 2026
Implement suggestions sometimes reuses an existing session Open

bug not-reproducible

microsoft/vscode-chat-customizations-evaluation#254 · 1 comment · 1 assignee · Opened Jun 22, 2026
Analyze button only shows in source file view, not when file is opened as preview Open

under-discussion

microsoft/vscode-chat-customizations-evaluation#253 · 1 comment · 1 assignee · Opened Jun 22, 2026
Expect button to change to `Evaluate` after analyzing and implementing suggestions Open

feature-request under-discussion

microsoft/vscode-chat-customizations-evaluation#199 · 1 comment · 1 assignee · Opened Jun 15, 2026
Would like UI option to just implement some suggestions from Waza eval Open

under-discussion

microsoft/vscode-chat-customizations-evaluation#194 · 2 comments · 1 assignee · Opened Jun 15, 2026
Running waza evaluations I got this error notifcation Open

bug info-needed

microsoft/vscode-chat-customizations-evaluation#188 · 4 comments · 1 assignee · Opened Jun 15, 2026
Can we select model when run "analyze prompts"? Open

feature-request

microsoft/vscode-chat-customizations-evaluation#171 · 11 comments · 1 assignee · Opened Jun 9, 2026
It would be even better if we could customize the supported file types. Open

feature-request under-discussion

microsoft/vscode-chat-customizations-evaluation#156 · 3 comments · 1 assignee · Opened Jun 3, 2026
Unsure what `Create Waza Eval Scaffold` should do Open

bug not-reproducible

microsoft/vscode-chat-customizations-evaluation#146 · 18 comments · 1 assignee · Opened Jun 1, 2026
1.0.4 does not sanitize problem context before tossing it into the JSON report, causing parse errors Open

bug not-reproducible

microsoft/vscode-chat-customizations-evaluation#118 · 16 comments · 1 assignee · Opened May 29, 2026
Let this extension be a VScode and github copilot agent functionality, as agents should review periodically and optimize the prompts, not humans file after file Open

feature-request under-discussion

microsoft/vscode-chat-customizations-evaluation#48 · 1 comment · 1 assignee · Opened May 6, 2026
Show warnings or nudges to improve customization files Open

feature-request under-discussion

microsoft/vscode-chat-customizations-evaluation#46 · 1 assignee · Opened Apr 29, 2026

A short digest of beginner-friendly GitHub issues.