Be able to use `notebook_launcher` with TPUs on cloud TPU instances

Open
#967 1 comment 0 reactions 1 assignee View on GitHub

Maintainers usually reply within 1 day

@muellerzr is already working on this.

Since Jan 12, 2023.

Assessment

This issue has not been assessed yet.

Description

enhancement TPU wip

Currently, the notebook_launchersupport TPUs only on Kaggle or Google Colab. I would like to be able to use notebook_launcher on a cloud TPU instance.

We could introduce a the distributed_type as a parameter of the notebook_launcher and refactor in_colab and in_kaggle to use_tpu with addition if distributed_type is set.

Dominant language
Python
Stars
9.9k
Forks
1.6k
Avg merge
20h 23m
Merged PRs (30d)
12

Getting set up

Open in Codespaces

Starts the project's dev container in your browser, under your own GitHub account.

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from huggingface/accelerate

All issues in huggingface/accelerate

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.