explosion/curated-transformers

View on GitHub

🤖 A PyTorch library of curated Transformer models and their composable components

Stars: 890
Forks: 36
Open beginner issues: 0
Indexed issues: 17

Dominant language: Python
License: MIT
Last GitHub push: Apr 17, 2024
Latest indexed: Sep 15, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Beginner friendly Everything

Open All

17 open issues indexed

📋 Documentation Enhancement Suggestion Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

explosion/curated-transformers#379 · Opened May 14, 2026
Truncation of sequences that are beyond the model's maximum length Open

feat/tokenization type/bug type/feature

Difficulty 4/5 3-5 days Newbie friendliness 35/100

explosion/curated-transformers#359 · 2 comments · 1 reaction · Opened Jan 14, 2024
Add suggested PyTorch LLM optimizations Open

feat/generation feat/model

Difficulty 4/5 3-5 days Newbie friendliness 25/100

explosion/curated-transformers#356 · 2 reactions · Opened Dec 1, 2023
Move the old Falcon architecuture to the extras/addons pacakage Open

type/maintenance

Difficulty 4/5 3-5 days Newbie friendliness 38/100

explosion/curated-transformers#355 · Opened Oct 19, 2023
Add support for attention sinks Open

feat/layers feat/model type/feature

Difficulty 5/5 Over a week Newbie friendliness 20/100

explosion/curated-transformers#350 · Opened Oct 4, 2023
Support DeBERTa v2/3 Open

feat/model type/feature

Difficulty 4/5 3-5 days Newbie friendliness 15/100

explosion/curated-transformers#348 · 1 comment · Opened Oct 3, 2023
Add a an extras/contrib package Open

type/maintenance

Difficulty 5/5 Over a week Newbie friendliness 25/100

explosion/curated-transformers#347 · Opened Oct 3, 2023
Expose more outputs through the `Generator` interface Open

feat/generation type/feature

Difficulty 4/5 3-5 days Newbie friendliness 35/100

explosion/curated-transformers#345 · Opened Oct 3, 2023
Make `QkvMode` ADT-like Open

feat/layers type/maintenance

Difficulty 5/5 Over a week Newbie friendliness 25/100

explosion/curated-transformers#344 · Opened Oct 3, 2023
Convert QKV projection splitting methods into Torch modules Open

feat/layers type/maintenance

Difficulty 4/5 3-5 days Newbie friendliness 20/100

explosion/curated-transformers#343 · Opened Oct 3, 2023
Option to only return the last hidden layer output from models Open

feat/model type/feature

Difficulty 4/5 3-5 days Newbie friendliness 42/100

explosion/curated-transformers#342 · Opened Oct 3, 2023
Add support for Mistral Open

feat/model type/feature

Difficulty 4/5 3-5 days Newbie friendliness 25/100

explosion/curated-transformers#341 · Opened Oct 3, 2023
Support for Encoder-Decoder-style architectures Open

feat/model type/feature

Difficulty 5/5 Over a week Newbie friendliness 35/100

explosion/curated-transformers#340 · 2 comments · 3 reactions · Opened Oct 2, 2023
Optimal Qlora settings Open

feat/training type/feature

Difficulty 5/5 Over a week Newbie friendliness 25/100

explosion/curated-transformers#316 · 1 comment · 1 reaction · Opened Sep 2, 2023
Add Low-Rank Adapters injection into base models Open

feat/training type/feature

Difficulty 5/5 Over a week Newbie friendliness 25/100

explosion/curated-transformers#312 · 3 comments · 1 reaction · Opened Aug 28, 2023
Output logits for generation Open

feat/generation type/feature

Difficulty 5/5 Over a week Newbie friendliness 25/100

explosion/curated-transformers#311 · 1 comment · Opened Aug 24, 2023
Thoughts on jaxtyping Open

feat/misc type/feature

Difficulty 5/5 Over a week Newbie friendliness 20/100

explosion/curated-transformers#246 · 1 comment · 2 reactions · Opened Jul 14, 2023

explosion/curated-transformers

Get new issues in your inbox