Is the 13B - unmodified Megatron gpt2 - baseline available? ( tr1-13B-base)

Open
#21 1 comment 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
2/5
Estimated time
1-3 hours
Newbie friendliness
25/100
Issue type
Documentation
Clarity
Needs clarification
Activity status
Stale
Tech stack
huggingface

Research direction

Start by checking train/tr1-13B-base/chronicles.md and the referenced Hugging Face Hub location. Verify whether the tr1-13B-base checkpoints are publicly available and identify the correct model link or clarify their absence. Done means the issue has an accurate, discoverable answer.

Written by the indexing model from the issue text.

Description

I was super excited to hear about this project! I was wondering if the model is available anywhere?

In the chronicles of tr1-13B-base it says at the end: "All checkpoints converted to HF format and uploaded to HUB.", which I thought meant that it is available on Huggingface, but I can't seem to find it.

Is it available and I'm just not able to find it, or did I misunderstand and it's not available?

Dominant language
Shell
Stars
1k
Forks
102
PR merge metrics
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from bigscience-workshop/bigscience

All issues in bigscience-workshop/bigscience

Similar issues

More Shell/Bash issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.