good first issue
Repository metrics
- Stars
- (30,145 stars)
- PR merge metrics
- (PR metrics pending)
説明
Follow the GPT-2 reference .py file and initialize the weights in C from scratch in the exact same way.
Allow init from scratch instead of init from checkpoint when building the GPT-2.
Add argparse flag to configure which way to go.
Ok to only change the mainline development file train_gpt2.cu.