aiob参数

Open
#256 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
1-2 days
Newbie friendliness
35/100
Issue type
Documentation
Clarity
Needs clarification
Activity status
Quiet
Tech stack
python, shell
Domain
cli, documentation, machine-learning

Research direction

Start by reading aicb/workload/aiob_inputs/Example.txt and tracing scripts/megatron_workload_with_aiob.sh. Document the source GPU model and data, explain train_iter, identify whether model size can be changed, and show how workload iteration count is controlled. Done means these command and input-file questions are answered with concrete references.

Written by the indexing model from the issue text.

Description

请问aicb/workload/aiob_inputs/Example.txt中example中的数据是什么GPU型号的，怎么得来的，上面train_iter:10是什么意思，此外我使用
sh ./scripts/megatron_workload_with_aiob.sh -m 7
--world_size 4096 --tensor_model_parallel_size 2 --pipeline_model_parallel 1
--frame Megatron --global_batch 8192
--micro_batch 1 --seq_length 4096 --swiglu
--use_flash_attn --aiob_enable
--comp_filepath workload/aiob_inputs/Example.txt
命令生成训练工作负载，其中模型参数大小可以随意修改吗比如我想run个15B的，迭代次数如何控制，目前命令看不到这是迭代多少次的工作负载

Dominant language
Python
Stars
1.2k
Forks
184
Avg merge
6h 47m
Merged PRs (30d)
2

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from aliyun/SimAI

All issues in aliyun/SimAI

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.