Review performance metrics in README.md
Maintainers usually reply within 1 day
Nobody has claimed this yet.
Assessment
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Newbie friendliness
- 55/100
- Issue type
- Documentation
- Clarity
- Mostly clear
- Activity status
- Active
- Tech stack
- cpp
- Domain
- documentation, performance
Research direction
Review the benchmark section in the main README.md and identify which results refer to older NMT models. Find benchmark results for newer models that are relevant to CTranslate2, then update the README with the revised metrics and their sources. Done when the README presents current, clearly sourced performance benchmarks in place of or alongside the outdated results.
Written by the indexing model from the issue text.
Description
Also I think you may take this opportunity to revisit the main README and include some perf bench mark from newer models instead of these old stuff from NMT.
- Dominant language
- C++
- Stars
- 4.8k
- Forks
- 557
- Avg merge
- 1d 6h
- Merged PRs (30d)
- 24
Getting set up
- No Dockerfile or Docker Compose file
- No pull request template
- Read the contributing guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from OpenNMT/CTranslate2
-
MPS: GPT-2 produces NaN logits and invalid token IDsPossibly taken @TBO22 claimed this today. Open
Difficulty 2/5 1-3 hours Newbie friendliness 70/100
OpenNMT/CTranslate2#2154 · 1 comment ·
Maintainers usually reply within 1 day
-
Allow no-timestamp Whisper decoding beyond 224 tokensPossibly taken @Emre-Akgul claimed this 127 days ago. Open
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
OpenNMT/CTranslate2#2074 ·
Maintainers usually reply within 1 day
-
T5Gemma fails on MPS: incorrect beam expansion with padded batchesPossibly taken @TBO22 claimed this today. Open
Difficulty 4/5 3-5 days Newbie friendliness 30/100
OpenNMT/CTranslate2#2153 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 5/5 Over a week Newbie friendliness 8/100
OpenNMT/CTranslate2#2152 · 1 comment ·
Maintainers usually reply within 1 day
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
OpenNMT/CTranslate2#2105 ·
Maintainers usually reply within 1 day
All issues in OpenNMT/CTranslate2
Similar issues
-
Documentation: Fix parameter markup, legacy branch link, and phrasing in Detachable Joints and Model Command tutorialsPossibly taken @patelshivani2283-lab claimed this today. Open
Difficulty 1/5 1-3 hours Newbie friendliness 88/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
Maintainers usually reply within 1 day
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
Niko1221/Strata#6071 · 2 comments ·
Maintainers usually reply within 4 days
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
KhronosGroup/Vulkan-Tutorial#551 ·
Maintainers usually reply within 1 day