GoogleCloudPlatform/kubectl-ai
Add github action to run lightweight evals as presubmit job
オープン
#119 opened on 2025/04/28
good first issue
Repository metrics
- Stars
- (7,532 個のスター)
- PR merge metrics
- (PR metrics pending)
説明
We want to run a few eval tasks (may be difficulty level easy) as pre-submit tasks to ensure that new PRs are getting some basic e2e tests.
Details:
- The pre-submit job should bring up a kind cluster
- The pre-submit job should also bring up ollama or llamacpp server
- Run evals with the difficulty level
easyor to begin with--task-pattern=scale - Add contributing section in the README.md to use this job as e2e test