Release PlayEval dataset on Hugging Face
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 38/100
Research direction
Start with benchmark_metadata.json and clone_repos.sh to understand how PlayEval is assembled from other repositories. Read the linked Hugging Face dataset-loading and dataset-viewer guidance before choosing a loadable structure. Done means the dataset is uploaded to Hugging Face, can be loaded with load_dataset, and is linked to the paper page.
Written by the indexing model from the issue text.
Description
Hi @itaowei 🤗
I'm Niels and work as part of the open-source team at Hugging Face. I discovered your work through Hugging Face's daily papers as yours got featured: https://huggingface.co/papers/2604.19742.
The paper page lets people discuss about your paper and lets them find artifacts about it (your dataset for instance),
you can also claim the paper as yours which will show up on your public profile at HF, add Github and project page URLs.
Would you like to host the PlayEval dataset you've released on https://huggingface.co/datasets?
I see your GitHub repository https://github.com/Tencent/PlayCoder defines this new benchmark, including benchmark_metadata.json and scripts like clone_repos.sh to assemble it from various other repositories. Hosting PlayEval on Hugging Face will give you more visibility/enable better discoverability, and will also allow people to do:
from datasets import load_dataset
dataset = load_dataset("your-hf-org-or-username/playeval")
If you're down, leaving a guide here: https://huggingface.co/docs/datasets/loading.
We can also help with structuring the dataset so it's easily loadable via load_dataset. Besides that, there's the dataset viewer which allows people to quickly explore the first few rows of the data in the browser.
After uploaded, we can also link the datasets to the paper page (read here) so people can discover your work.
Let me know if you're interested/need any guidance.
Kind regards,
Niels
- Dominant language
- Python
- Stars
- 46
- Forks
- 3
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100