GoogleCloudPlatform/kubectl-ai
Add github action to run lightweight evals as presubmit job
Offen
#119 geöffnet am 28.04.2025
good first issue
Repository-Metriken
- Stars
- (7.532 Sterne)
- PR-Merge-Metriken
- (Keine gemergten PRs in 30 T)
Beschreibung
We want to run a few eval tasks (may be difficulty level easy) as pre-submit tasks to ensure that new PRs are getting some basic e2e tests.
Details:
- The pre-submit job should bring up a kind cluster
- The pre-submit job should also bring up ollama or llamacpp server
- Run evals with the difficulty level
easyor to begin with--task-pattern=scale - Add contributing section in the README.md to use this job as e2e test