Add unit tests for the basic functionality

Open
#2 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
35/100
Issue type
Feature
Clarity
Mostly clear
Activity status
Stale
Tech stack
python
Domain
testing

Research direction

The issue names pytest fixtures, VCR API snapshots, and tests for types, config, RAG metrics, statistics, comparisons, the inference client, and evaluators. Start by locating those core components and any existing test entry points, then establish the pytest and mocked-API setup. Done means the listed core and client behaviors have unit coverage with reusable fixtures and API snapshots.

Written by the indexing model from the issue text.

Description

Add Unit Tests for Core Components

Add pytest-based unit tests for elastic-evals core logic including types, config, RAG metrics, statistics, and client components with VCR for API snapshots.

Scope
  • Test infrastructure with pytest fixtures and VCR setup
  • Core logic tests: types, config, RAG metrics, statistics, comparisons
  • Client tests: inference client and evaluators with mocked APIs
Dominant language
Python
Stars
2
Forks
0
Avg merge
1d 5h
Merged PRs (30d)
17

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from elastic/elastic-evals-sdk-python

All issues in elastic/elastic-evals-sdk-python

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.