[DOC]: Update the documentation of ShardConfig for 1D, 2D, 2.5D, 3D tensor parallelism
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 76/100
- Issue type
- Documentation
- Clarity
- Mostly clear
- Activity status
- Active
- Tech stack
- python
- Domain
- distributed-systems, documentation
Research direction
Start with colossalai/shardformer/README.md and compare its ShardConfig documentation with the tensor_parallel_mode definition mentioned in the issue. Update the documentation to cover 1D, 2D, 2.5D, and 3D tensor parallelism, then verify that the documented options match ShardConfig.
Written by the indexing model from the issue text.
Description
📚 The doc issue
Hi @FrankLeeeee , @ver217 please update the https://github.com/hpcaitech/ColossalAI/blob/main/colossalai/shardformer/README.md file
# tensor_parallel_mode: Literal['1d', '2d', '2.5d', '3d'] this line is commented in ShardConfig but documentation is not updated Its hard to use 2D,2.5D, 3D tensor parallelism
- Dominant language
- Python
- Stars
- 41.4k
- Forks
- 4.5k
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from hpcaitech/ColossalAI
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
hpcaitech/ColossalAI#6437 ·
-
bug
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
hpcaitech/ColossalAI#6428 ·
-
documentation
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
hpcaitech/ColossalAI#5293 · 3 comments ·
-
bug
Difficulty 4/5 3-5 days Newbie friendliness 35/100
hpcaitech/ColossalAI#6413 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
hpcaitech/ColossalAI#6403 ·
All issues in hpcaitech/ColossalAI
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100