mlcommons/algorithmic-efficiency

Clean up train diff tests

Open

#808 opened on Oct 31, 2024

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Python (76 forks)auto 404
Good First Issue

Repository metrics

Stars
 (422 stars)
PR merge metrics
 (PR metrics pending)

Description

The train diff tests are difficult to run at the moment.

  • Add documentation on how to run them
  • Eliminate IO errors related to writing temporary results to files

Train diff test: https://github.com/mlcommons/algorithmic-efficiency/blob/main/tests/test_traindiffs.py

Contributor guide

Research direction
Inspect the train diff test file at tests/test traindiffs.py and the project's testing documentation. Understand how the tests are run and investigate the IO errors related to writing temporary results to files.
Tech stack
python
Domain
testing
Issue type
Test
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
GitPython
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
75