Add random seed tests to all applicable models
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 35/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Stale
- Tech stack
- machine-learning, python
- Domain
- machine-learning, testing
Research direction
Start by identifying the models that expose random seed fixation, then read their existing tests and run the relevant test suites. Add coverage for each applicable model showing that the same fixed seed reproduces results and different fixed seeds produce different results; done means both behaviors are checked across all applicable models.
Written by the indexing model from the issue text.
Description
Feature Description
Check which models have random seed fixation and write tests for all of them:
- models with fixed seed produce same results
- models with different fixed seeds produce different results
Why this feature?
Avoid problems with seed fixation
Additional context
No response
- Dominant language
- Python
- Stars
- 457
- Forks
- 55
- PR merge metrics
- No merged PRs in 30d
Getting set up
- No Dockerfile or Docker Compose file
- Has a pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from MTSWebServices/RecTools
-
good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
MTSWebServices/RecTools#330 ·
-
Is it not possible to `load` transformer model on cpu onlyPossibly taken @maxteneff claimed this 22 days ago. Openbug good first issue
Difficulty 3/5 1-2 days Newbie friendliness 35/100
MTSWebServices/RecTools#286 · 3 comments ·
-
bug good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 35/100
MTSWebServices/RecTools#269 · 4 comments ·
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 25/100
MTSWebServices/RecTools#249 ·
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 25/100
MTSWebServices/RecTools#243 ·
All issues in MTSWebServices/RecTools
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 83/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 87/100
Maintainers usually reply within 7 days
-
area: web priority: P1 story
Difficulty 2/5 1-3 hours Newbie friendliness 76/100
nfiasco/Quant-Time-Machine#151 ·
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
autowarefoundation/autoware_carla_scenario#2019 ·
Maintainers usually reply within 1 day
-
docs pydanty:is-working
Difficulty 1/5 1-3 hours Newbie friendliness 85/100
pydantic/pydantic-ai#12892 ·
Maintainers usually reply within 1 day