GoogleCloudPlatform/kubectl-ai

Add github action to run lightweight evals as presubmit job

Offen

#119 geöffnet am 28.04.2025

 (5 Kommentare) (0 Reaktionen) (1 zugewiesene Person)Go (708 Forks)auto 404
good first issue

Repository-Metriken

Stars
 (7.532 Sterne)
PR-Merge-Metriken
 (Keine gemergten PRs in 30 T)

Beschreibung

We want to run a few eval tasks (may be difficulty level easy) as pre-submit tasks to ensure that new PRs are getting some basic e2e tests.

Details:

  • The pre-submit job should bring up a kind cluster
  • The pre-submit job should also bring up ollama or llamacpp server
  • Run evals with the difficulty level easy or to begin with --task-pattern=scale
  • Add contributing section in the README.md to use this job as e2e test

Contributor Guide