Generators used for pre-training

Open
#13 3 comments 6 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
20/100
Issue type
Documentation
Clarity
Needs clarification
Activity status
Stale
Tech stack
python
Domain
machine-learning

Research direction

Start by inspecting the relogic and pretrainkit code mentioned in the issue to identify the expected training data and available entry points. Determine whether the SQL-to-Text and Table-to-Text models can be trained with custom datasets, then document the required data format and commands needed to run training.

Written by the indexing model from the issue text.

Description

The paper mentions the use of a SQL-to-Text and Table-to-Text model to generate synthetic samples for pre-training. I would like to use these models to try generate synthetic training examples for my own custom datasets. It doesn’t seem like the weights for these models were made public, is there any way I can train these models myself? I saw some code under relogic and pretrainkit which seems relevant for this but couldn’t figure out what data it uses and how to run it. Thanks!

Dominant language
Python
Stars
109
Forks
25
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from awslabs/gap-text2sql

All issues in awslabs/gap-text2sql

Similar issues

More Python issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.