GoogleCloudPlatform/kubectl-ai
evals: we should ensure resources in eval tasks must not contain hints to help with the eval tasks
开放
#298 创建于 2025年6月2日
enhancementhelp wanted
仓库指标
- 星标
- (7,532 个星标)
- PR 合并指标
- (PR 指标待抓取)
描述
We want to ensure the eval tasks represent realistic scenario and we have observed that name/namespaces of the k8s resources used in the task contains hint to make AI Models aware that these are part of evals or some sort of test. I think this affects the model's performance on the task, so we need to fix it for all the existing tasks.