webdataset compatibility / example

Maintainers usually reply within 1 day

Assessment

This issue has not been assessed yet.

Description

Getting set up

First steps

1. Read the whole issue, then the project's contributing guide.
2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
3. Fork the repository and make your change on a branch.
4. Open a pull request that references the issue number.

More from huggingface/accelerate

• FSDP2: prepare() keeps the whole unsharded model alive during sharding when cpu_ram_efficient_loading=False

  Possibly taken A pull request linked to this issue is open or already merged. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 78/100

  huggingface/accelerate#4511 · Opened Nov 8, 2026

  Maintainers usually reply within 1 day

• BatchSamplerShard padding mutates retained sampler batches and changes original loader samples

  Possibly taken @davrens101 claimed this 4 days ago. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 75/100

  huggingface/accelerate#4505 · Opened Nov 6, 2026

  Maintainers usually reply within 1 day

• accelerator.reduce(tensor, "mean") fails on integer tensors when more than one process is used

  Possibly taken @MaiAditya claimed this 13 days ago. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 78/100

  huggingface/accelerate#4469 · Opened Oct 29, 2026

  Maintainers usually reply within 1 day

• merge_fsdp_weights with remove_checkpoint_dir=True deletes the merged model when output_path is inside checkpoint_dir

  Possibly taken @assass1nlike claimed this 2 days ago. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 25/100

  huggingface/accelerate#4514 · Opened Nov 9, 2026

  Maintainers usually reply within 1 day

• FSDP2 QLoRA: with `bnb_4bit_quant_storage=bf16` (the storage the #3987 warning recommends), the all-gather alters packed 4-bit weights at world size ≥ 2

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 4/5 3-5 days Newbie friendliness 42/100

  huggingface/accelerate#4510 · Opened Nov 8, 2026

  Maintainers usually reply within 1 day

All issues in huggingface/accelerate

Similar issues

• [Bug]: Literal fallbacks containing "No", "Yes", "On" or "Off" are silently dropped

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 84/100

  FAIRmat-NFDI/pynxtools#861 · Opened Nov 11, 2026

• Keyword arguments are silently ignored when a decorated function is called without positional arguments

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 76/100

  NVIDIA/nsight-python#88 · Opened Nov 11, 2026

  Maintainers usually reply within 1 day

• Criteria can pass when the deliverable is missing

  Possibly taken @clementtisseau claimed this today. Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 68/100

  harveyai/harvey-labs#217 · Opened Nov 11, 2026

  Maintainers usually reply within 2 days

• SQL queries not using prepared statements

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel

  Difficulty 2/5 1-3 hours Newbie friendliness 62/100

  haiwen/seahub#9744 · Opened Nov 11, 2026

  Maintainers usually reply within 1 day

• [Bug] Tags panel clears assigned tag values on save

  Open

  ⋯Report a problem with this issue

  • Is something wrong?

  • Already taken
  • Not beginner-friendly
  • Stale or invalid
  • Something else…
  • Send Cancel
  priority/medium roadmap/v1.1.1 stakeholder/rapr type/bug

  Difficulty 2/5 1-3 hours Newbie friendliness 83/100

  databrickslabs/ontos#1420 · Opened Nov 11, 2026

  Maintainers usually reply within 3 days

More Python issues