GoogleCloudPlatform/kubectl-ai

Help needed: We need more evals

开放

#145 创建于 2025年5月6日

 (5 条评论) (4 个反应) (0 位负责人)Go (708 个派生)auto 404
good first issuehelp wanted

仓库指标

星标
 (7,532 个星标)
PR 合并指标
 (PR 指标待抓取)

描述

kubectl-ai has 10 eval tasks today covering different areas. We want to improve the evals coverage. The goal is to get the eval coverage closer to realistic scenario that users run into.

This is an area where we need input from the community. Share the scenarios that you or your team run into very regularly.

Adding an eval task to k8s-bench is very simple, you can see existing tasks.

Ask:

  • Share a scenario that we can add eval for
  • Better, send a PR with the eval task following an example under k8s-bench directory.

/cc @selimacerbas @rxinui @cwrau @hakman @mattn @DoctorLai @mschneider82 @tuannvm

贡献者指南