How to get train-splits.txt and valid-splits.txt before training tr11-176B-ml

Open
#66 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
3/5
Estimated time
1-2 days
Newbie friendliness
28/100
Issue type
Documentation
Clarity
Mostly clear
Activity status
Stale
Tech stack
python, shell

Research direction

Start with line 39 of train/tr11-176B-ml/tr11-176B-ml.slurm and trace how TRAIN_DATA_PATH and VALID_DATA_PATH are consumed. Review the repository's documented training and data setup for the source or generation process for train-splits.txt and valid-splits.txt. Done means the steps clearly explain how to obtain both files before running tr11-176B-ml.

Written by the indexing model from the issue text.

Description

  • Big Science version: latest
  • Python version: 3.8.8
  • Operating System: Ubuntu 20.04.5 LTS
Description

How to get train-splits.txt and valid-splits.txt at Line39 in train/tr11-176B-ml/tr11-176B-ml.slurm. Thx.
TRAIN_DATA_PATH=$MEGATRON_DEEPSPEED_REPO/data/train-splits.txt
VALID_DATA_PATH=$MEGATRON_DEEPSPEED_REPO/data/valid-splits.txt

Dominant language
Shell
Stars
1k
Forks
102
PR merge metrics
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from bigscience-workshop/bigscience

All issues in bigscience-workshop/bigscience

Similar issues

More Shell/Bash issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.