[DOC]: Update the documentation of ShardConfig for 1D, 2D, 2.5D, 3D tensor parallelism

Open Beginner friendly
#6,197 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
2/5
Estimated time
1-3 hours
Newbie friendliness
76/100
Issue type
Documentation
Clarity
Mostly clear
Activity status
Active
Tech stack
python

Research direction

Start with colossalai/shardformer/README.md and compare its ShardConfig documentation with the tensor_parallel_mode definition mentioned in the issue. Update the documentation to cover 1D, 2D, 2.5D, and 3D tensor parallelism, then verify that the documented options match ShardConfig.

Written by the indexing model from the issue text.

Description

documentation
📚 The doc issue

Hi @FrankLeeeee , @ver217 please update the https://github.com/hpcaitech/ColossalAI/blob/main/colossalai/shardformer/README.md file

# tensor_parallel_mode: Literal['1d', '2d', '2.5d', '3d'] this line is commented in ShardConfig but documentation is not updated Its hard to use 2D,2.5D, 3D tensor parallelism
Dominant language
Python
Stars
41.4k
Forks
4.5k
PR merge metrics
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from hpcaitech/ColossalAI

All issues in hpcaitech/ColossalAI

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.