GoogleCloudPlatform/kubectl-ai

Help needed: We need more evals

Aberta

#145 aberto em 6 de mai. de 2025

 (5 comentários) (4 reações) (0 responsável)Go (708 forks)auto 404
good first issuehelp wanted

Métricas do repositório

Stars
 (7.532 estrelas)
Métricas de merge de PR
 (Nenhuma PRs mesclada em 30d)

Description

kubectl-ai has 10 eval tasks today covering different areas. We want to improve the evals coverage. The goal is to get the eval coverage closer to realistic scenario that users run into.

This is an area where we need input from the community. Share the scenarios that you or your team run into very regularly.

Adding an eval task to k8s-bench is very simple, you can see existing tasks.

Ask:

  • Share a scenario that we can add eval for
  • Better, send a PR with the eval task following an example under k8s-bench directory.

/cc @selimacerbas @rxinui @cwrau @hakman @mattn @DoctorLai @mschneider82 @tuannvm

Guia do colaborador