Model A vs Model B comparison table
Nobody has claimed this yet.
Assessment
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Newbie friendliness
- 35/100
Research direction
Start in scripts/evaluate_custom.py and find where saved per-model results are loaded, since the table must be built only from those, not by retraining. Issues #33, #17, #26 and #27 must be merged first, so check whether their outputs exist before starting. Done when results/compare_AB.csv and results/compare_AB.tex are both generated from saved results and contain all seven listed columns.
Written by the indexing model from the issue text.
Description
Table required by the brief.
Files: scripts/evaluate_custom.py
Tasks
- Columns: trainable params, MACs, size on disk (KB), int8 KB, training time/epoch, latency, test accuracy
- Export to
results/compare_AB.csvand a LaTeX tableresults/compare_AB.tex
Done when
CSV and .tex are generated from saved results only.
Depends on
#33 #17 #26 #27
Close with a commit or PR message containing Closes #<this issue>.
- Dominant language
- Jupyter Notebook
- Stars
- 0
- Forks
- 0
- Avg merge
- 5h 32m
- Merged PRs (30d)
- 5
Getting set up
This project ships no dev container, Dockerfile or contributing guide, so setting up is up to you: start from its README, and see our first-contribution guide for the general steps.
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from VisionForgeCSE/CNN-For-Image-Classification
-
evaluation
Difficulty 2/5 1-3 hours Newbie friendliness 66/100
-
evaluation good first issue
Difficulty 2/5 1-3 hours Newbie friendliness 62/100
-
evaluation
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
-
training
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
-
Optimizer factoryOpentraining
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
All issues in VisionForgeCSE/CNN-For-Image-Classification
Similar issues
-
bug difficulty:2
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
MakazhanAlpamys/Soup#1856 ·
Maintainers usually reply within 1 day
-
Add: MS NOWOpencheck:passed streams:add
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 63/100
google-research/weatherbenchX#310 ·
Maintainers usually reply within 3 days
-
request-theme
Difficulty 1/5 Under an hour Newbie friendliness 65/100
LizardByte/ThemerrDB#8924 · 1 comment ·
Maintainers usually reply within 1 day
-
automation missing-model model-sync provider:aimlapi
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
anomalyco/models.dev#9734 ·
Maintainers usually reply within 1 day