GoogleCloudPlatform/kubectl-ai

Help needed: We need more evals

Aperta

#145 aperta il 6 mag 2025

 (5 commenti) (4 reazioni) (0 assegnatari)Go (708 fork)auto 404
good first issuehelp wanted

Metriche repository

Star
 (7532 stelle)
Metriche merge PR
 (Metriche PR in attesa)

Descrizione

kubectl-ai has 10 eval tasks today covering different areas. We want to improve the evals coverage. The goal is to get the eval coverage closer to realistic scenario that users run into.

This is an area where we need input from the community. Share the scenarios that you or your team run into very regularly.

Adding an eval task to k8s-bench is very simple, you can see existing tasks.

Ask:

  • Share a scenario that we can add eval for
  • Better, send a PR with the eval task following an example under k8s-bench directory.

/cc @selimacerbas @rxinui @cwrau @hakman @mattn @DoctorLai @mschneider82 @tuannvm

Guida contributor