codertimo/BERT-pytorch

Pretrained model transfer to pytorch

Open

#34 opened on Oct 24, 2018

View on GitHub
 (8 comments) (11 reactions) (1 assignee)Python (5,757 stars) (1,252 forks)batch import
enhancementhelp wanted

Description

Well all of you guys know, it's nearly impossible to train from the scratch, because of lack of computation power. So I'm going to implement the transfer code for making pretrained model can be supported on pytorch too.

This implementation will be started when the Google release their official BERT code and pretrained model. If anyone interested to join this work, please leave the comment underside.

Thank you everyone who carefully watching this project👍 By Junseong Kim

Contributor guide

Tech stack
pythonpytorch
Domain
machine learningai
Issue type
feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
5
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
over 1 week
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
stale
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
unclear
Prerequisites
BERT model understandingPyTorchpretrained model loading
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
10
Research direction
The issue awaits Google's official BERT code release. The assignee should clarify the current status and whether the transfer is still needed. Check the repository's existing code for model loading. Engage with the assignee and maintainer to define specific steps.