unslothai/unsloth

Kaggle - GPT OSS Data set

Open

#3400 opened on Oct 2, 2025

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Python (64,271 stars) (5,658 forks)batch import
help wanted

Description

Hi I am trying ot run the kaggle version but I have a list of .md files which I wan to feed the model to train and then export the model. but is .md file enough to feed model I can see you have this ,

from datasets import Dataset
dataset = Dataset.from_list([{"prompt" : [{"role": "user", "content": prompt.strip()}], "answer" : 0, "reasoning_effort": "low"}]*1000)
maximum_length = len(tokenizer(prompt.strip())["input_ids"])
print(maximum_length)
dataset[0]

given that I wan this plus all my md files , how best to merge these any tips

Contributor guide

Tech stack
pythonpytorch
Domain
machine learningai
Issue type
research
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
3
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
under 1 hour
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
unclear
Prerequisites
basic familiarity with unslothunderstanding of dataset formatting
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
30
Research direction
The issue asks about using .md files for training. Review the unsloth documentation on custom dataset preparation, particularly how to format prompts and answers. Look at existing examples in the repository's 'notebooks' folder. The user's provided code snippet shows a basic dataset format; they need to parse .md files into similar structures. Suggest checking the 'unsloth/dataset.py' or related files for how to load markdown. If no clear answer, ask for more details on the exact training goal.