huggingface/accelerate
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
Is huggingface/accelerate beginner-friendly?
In the last 30 days, huggingface/accelerate merged 4 of 87 pull requests from outside contributors, and its maintainers usually reply within 1 day. 3 beginner-friendly issues are open now.
- Stars
- 9.9k
- Forks
- 1.6k
- Open beginner issues
- 3
- Indexed issues
- 109
- Avg merge
- 2d 13h
- Merged PRs (30d)
- 13
- Dominant language
- Python
- License
- Apache-2.0
- Last GitHub push
- Nov 2, 2026
- Latest indexed
- Sep 17, 2026
- Contributing guide
- Contributing guide
- Code of conduct
- Code of conduct
- Beginner labels
- good first issue
How to contribute to huggingface/accelerate
- Read the contributing guide first: it says how the maintainers want changes proposed, tested and reviewed.
- The project ships a dev container: open it in Codespaces to get a working environment in your browser.
- Read its code of conduct: it covers issues and pull requests as well as chat.
- Pick one of the 3 open beginner-friendly issues below and comment that you want to work on it before you start.
Issues somebody may already be working on are listed last. List everything by date
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
huggingface/accelerate#4511 ·
Maintainers usually reply within 1 day
-
Difficulty 4/5 3-5 days Newbie friendliness 42/100
huggingface/accelerate#4510 ·
Maintainers usually reply within 1 day
-
Difficulty 3/5 Half a day Newbie friendliness 35/100
huggingface/accelerate#4488 ·
Maintainers usually reply within 1 day
-
Difficulty 5/5 Over a week Newbie friendliness 35/100
huggingface/accelerate#4476 ·
Maintainers usually reply within 1 day
-
Difficulty 1/5 Under an hour Newbie friendliness 8/100
huggingface/accelerate#4411 ·
Maintainers usually reply within 1 day
-
test2Open
Difficulty 5/5 Over a week Newbie friendliness 5/100
huggingface/accelerate#4409 ·
Maintainers usually reply within 1 day
-
Warn when DeepSpeed ZeRO silently changes custom optimizer semanticsMay be free again A pull request for this issue was closed without being merged. Open
Difficulty 4/5 3-5 days Newbie friendliness 48/100
huggingface/accelerate#4392 · 2 comments ·
Maintainers usually reply within 1 day
-
Resuming with load_state + skip_first_batches (checkpointing example) does not restore the shuffle orderMay be free again @mohdfaour03 claimed this 35 days ago, and no pull request is open. Open
Difficulty 4/5 3-5 days Newbie friendliness 45/100
huggingface/accelerate#4330 · 5 comments ·
Maintainers usually reply within 1 day
-
`use_stateful_dataloader` + `num_workers>0` draws epoch-0 permutation during `prepare()` before cross-rank RNG sync — corrupts DDP data partitionMay be free again @JohnnyWilson16 claimed this 21 days ago, and no pull request is open. Open
Difficulty 4/5 3-5 days Newbie friendliness 52/100
huggingface/accelerate#4204 · 5 comments ·
Maintainers usually reply within 1 day
-
feature request
Difficulty 5/5 Over a week Newbie friendliness 25/100
huggingface/accelerate#3267 · 1 comment · 1 reaction ·
Maintainers usually reply within 1 day
-
accelerator.prepareOpen
Difficulty 4/5 3-5 days Newbie friendliness 30/100
huggingface/accelerate#3265 · 60 comments ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 5/5 Over a week Newbie friendliness 45/100
huggingface/accelerate#2951 · 19 comments · 13 reactions ·
Maintainers usually reply within 1 day
-
Plan to support FSDP2?May be free again @muellerzr claimed this 833 days ago, and no pull request is open. Openenhancement feature request
huggingface/accelerate#2873 · 12 comments · 1 assignee ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 4/5 3-5 days Newbie friendliness 35/100
huggingface/accelerate#2865 · 4 comments · 2 reactions ·
Maintainers usually reply within 1 day
-
gather objects in TPU is not supportedMay be free again A pull request for this issue was closed without being merged. Openfeature request TPU
Difficulty 5/5 Over a week Newbie friendliness 20/100
huggingface/accelerate#2858 · 4 comments ·
Maintainers usually reply within 1 day
-
`torch.compile` not working with `device_map` and multiple GPUsMay be free again A pull request for this issue was closed without being merged. Openbig model inference wip
Difficulty 4/5 3-5 days Newbie friendliness 35/100
huggingface/accelerate#2592 · 2 comments ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 5/5 Over a week Newbie friendliness 30/100
huggingface/accelerate#2585 · 6 comments ·
Maintainers usually reply within 1 day
-
wip
Difficulty 4/5 3-5 days Newbie friendliness 35/100
huggingface/accelerate#2390 · 19 comments ·
Maintainers usually reply within 1 day
-
feature request
Difficulty 5/5 Over a week Newbie friendliness 25/100
huggingface/accelerate#2306 · 2 comments ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 4/5 3-5 days Newbie friendliness 25/100
huggingface/accelerate#2154 · 4 comments ·
Maintainers usually reply within 1 day
-
WebLoader SupportOpenenhancement feature request
Difficulty 4/5 3-5 days Newbie friendliness 35/100
huggingface/accelerate#2083 · 9 comments ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 4/5 3-5 days Newbie friendliness 35/100
huggingface/accelerate#2038 · 5 comments ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 4/5 3-5 days Newbie friendliness 35/100
huggingface/accelerate#2028 · 8 comments ·
Maintainers usually reply within 1 day
-
Feature request: ability to truncate datasets on split rather than padMay be free again A pull request for this issue was closed without being merged. Openenhancement feature request
Difficulty 4/5 3-5 days Newbie friendliness 35/100
huggingface/accelerate#2019 · 3 comments ·
Maintainers usually reply within 1 day
-
Feature request: support for multi-node, multi-GPU distributed inferenceMay be free again A pull request for this issue was closed without being merged. Openenhancement feature request
Difficulty 5/5 Over a week Newbie friendliness 25/100
huggingface/accelerate#1890 · 8 comments · 20 reactions ·
Maintainers usually reply within 1 day
-
Title: Support for non-tensor based datasets in AccelerateMay be free again A pull request for this issue was closed without being merged. Openenhancement feature request
Difficulty 5/5 Over a week Newbie friendliness 35/100
huggingface/accelerate#1878 · 3 comments ·
Maintainers usually reply within 1 day
-
[Feature Request] support to pass custom slice function in accelerate data loader (useful for models like Flamingo)May be free again @muellerzr claimed this 1190 days ago, and no pull request is open. Openenhancement feature request
huggingface/accelerate#1816 · 1 assignee ·
Maintainers usually reply within 1 day
-
Feature request: Slurm env detectionMay be free again @muellerzr claimed this 1193 days ago, and no pull request is open. Openenhancement feature request
huggingface/accelerate#1811 · 1 assignee ·
Maintainers usually reply within 1 day
-
Can accelerate train a single model on multiple TPU VMs (not a TPU Pod)?May be free again @muellerzr claimed this 1256 days ago, and no pull request is open. Openfeature request TPU
huggingface/accelerate#1509 · 7 comments · 1 assignee ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 5/5 Over a week Newbie friendliness 20/100
huggingface/accelerate#1487 · 1 comment ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 4/5 3-5 days Newbie friendliness 35/100
huggingface/accelerate#1485 · 1 comment ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 5/5 Over a week Newbie friendliness 20/100
huggingface/accelerate#1459 · 1 comment · 2 reactions ·
Maintainers usually reply within 1 day
-
feature request
Difficulty 5/5 Over a week Newbie friendliness 20/100
huggingface/accelerate#1421 · 8 comments ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 4/5 3-5 days Newbie friendliness 25/100
huggingface/accelerate#1414 · 3 comments ·
Maintainers usually reply within 1 day
-
feature request
Difficulty 4/5 3-5 days Newbie friendliness 35/100
huggingface/accelerate#1396 · 9 comments · 1 reaction ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 5/5 Over a week Newbie friendliness 25/100
huggingface/accelerate#1384 · 5 comments · 3 reactions ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 4/5 3-5 days Newbie friendliness 35/100
huggingface/accelerate#1368 · 18 comments · 3 reactions ·
Maintainers usually reply within 1 day
-
[Feature Request] Publish `accelerate` conda package on the `huggingface` channelMay be free again @muellerzr claimed this 1293 days ago, and no pull request is open. Openwip
huggingface/accelerate#1357 · 1 comment · 1 reaction · 1 assignee ·
Maintainers usually reply within 1 day
-
Feature request - SLURM supportMay be free again @LeonxLJX claimed this 69 days ago, and no pull request is open. Opendocumentation enhancement feature request
Difficulty 5/5 Over a week Newbie friendliness 35/100
huggingface/accelerate#1239 · 23 comments · 39 reactions ·
Maintainers usually reply within 1 day
-
feature request
Difficulty 5/5 Over a week Newbie friendliness 20/100
huggingface/accelerate#1157 · 10 reactions ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 3/5 1-2 days Newbie friendliness 48/100
huggingface/accelerate#1105 · 3 comments ·
Maintainers usually reply within 1 day
-
webdataset compatibility / exampleMay be free again @muellerzr claimed this 1361 days ago, and no pull request is open. Opendocumentation wip
huggingface/accelerate#1092 · 1 comment · 2 reactions · 1 assignee ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 3/5 1-2 days Newbie friendliness 48/100
huggingface/accelerate#1089 · 25 comments ·
Maintainers usually reply within 1 day
-
[feature request] implement `set_verbosity`May be free again @muellerzr claimed this 1364 days ago, and no pull request is open. Openenhancement feature request
huggingface/accelerate#1066 · 1 comment · 1 assignee ·
Maintainers usually reply within 1 day
-
Different accelerate lauch behavior via ssh commandMay be free again @muellerzr claimed this 1390 days ago, and no pull request is open. Openbug TPU wip
huggingface/accelerate#987 · 1 comment · 1 assignee ·
Maintainers usually reply within 1 day
-
Be able to use `notebook_launcher` with TPUs on cloud TPU instancesMay be free again @muellerzr claimed this 1397 days ago, and no pull request is open. Openenhancement TPU wip
huggingface/accelerate#967 · 1 comment · 1 assignee ·
Maintainers usually reply within 1 day
-
accelerator.end_training() is generating exception when wandb is being used as trackerMay be free again @muellerzr claimed this 1406 days ago, and no pull request is open. Openbug wip
huggingface/accelerate#944 · 15 comments · 5 reactions · 1 assignee ·
Maintainers usually reply within 1 day
-
`Accelerate test` failing on an 8-GPU docker instanceMay be free again @muellerzr claimed this 1406 days ago, and no pull request is open. Openbug wip
huggingface/accelerate#934 · 6 comments · 1 assignee ·
Maintainers usually reply within 1 day
-
enhancement feature request
Difficulty 4/5 3-5 days Newbie friendliness 35/100
huggingface/accelerate#925 ·
Maintainers usually reply within 1 day
-
Need to do distributed training using 2 separate machinesMay be free again @muellerzr claimed this 1419 days ago, and no pull request is open. Openenhancement feature request
huggingface/accelerate#924 · 2 comments · 1 reaction · 1 assignee ·
Maintainers usually reply within 1 day