Better "expected results" in ADA
还没有人认领这个 Issue。
评估
这个 Issue 还没有评估数据。
描述
A common failure in ADA is the result of poor result formatting. In my experience we can significantly improve on this by having the generation use a regular expression for validation rather than the similarity. This is because the system will often use truncated results (which is good from a readability perspective). For example:
{
"agentPoolProfiles": [
{
"name": "nodepool1",
"count": 1,
"vmSize": "Standard_DS2_v2",
"maxPods": 110,
"osType": "Linux"
}
],
"dnsPrefix": "AKSClusterxxx-dns",
"provisioningState": "Succeeded",
"resourceGroup": "AKSLabResourceGroupxxx",
"name": "AKSClusterxxx",
"type": "Microsoft.ContainerService/ManagedClusters",
...
}
However, this is not valid JSON and thus the validation step fails.
In this case, and in many like it, what we are actually looking for is "provisioningState": "Succeeded". Therefore for responses like this one we can use:
<!-- expected_similarity=.*Succeeded -->
On a similar note, it seems the tool gives a default similarity value of 0.3 which, for the most part, is too low to be reliable.
- 主要语言
- Python
- 星标
- 13
- 派生
- 26
- PR 合并指标
- 30 天内没有已合并 PR
贡献指南
这个仓库没有索引到贡献指南
从这里开始
- 先读完整个 Issue,再读项目的贡献指南。
- 在 Issue 下留言说明你要接手 —— 这能避免两个人做同样的事。
- Fork 仓库,在一个分支上完成修改。
- 提交 Pull Request,并在描述里引用这个 Issue 编号。
MicrosoftDocs/executable-docs 的其他 Issue
-
MicrosoftDocs/executable-docs#675 · 已指派 1 人 ·
-
MicrosoftDocs/executable-docs#674 · 已指派 1 人 ·
-
MicrosoftDocs/executable-docs#673 · 已指派 1 人 ·
-
MicrosoftDocs/executable-docs#672 · 已指派 1 人 ·
-
MicrosoftDocs/executable-docs#671 · 已指派 1 人 ·
查看 MicrosoftDocs/executable-docs 的全部 Issue
相似的 Issue
-
难度 2/5 1-3 小时 新手友好度 75/100
anthropics/skills#1811 · 1 条评论 ·
-
难度 2/5 1-3 小时 新手友好度 75/100
speaches-ai/speaches#678 ·
-
bug
难度 2/5 1-3 小时 新手友好度 75/100
datalayer/mcp-compose#42 ·
-
难度 2/5 1-3 小时 新手友好度 75/100
conda-forge/spacy-feedstock#177 ·
-
难度 2/5 1-3 小时 新手友好度 70/100
UKGovernmentBEIS/inspect_evals#2523 ·