add pervasive label errors tutorial as an examples notebook
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 35/100
- Issue type
- Feature
- Clarity
- Mostly clear
- Activity status
- Stale
- Tech stack
- jupyter-notebook
- Domain
- machine-learning
Research direction
Start with examples/Tutorial - How To Find Label Errors With CleanLab.ipynb and compare it with the existing examples/ notebooks. Update the notebook and its dataset-loading code for the latest cleanlab version, decide whether a similar example should be replaced, and add the requested link in the original notebook.
Written by the indexing model from the issue text.
Description
Make examples notebook out of this:
https://github.com/cleanlab/label-errors/blob/main/examples/Tutorial%20-%20How%20To%20Find%20Label%20Errors%20With%20CleanLab.ipynb
The code needs to be updated to use the latest version of cleanlab. Dataset files can stay where they are, but code to load them needs to be updated too.
Consider replacing one of the existing examples/ notebooks with this one if they are quite similar.
- Also update the original notebook with link to the examples/ notebook stating:
Here's how to find label issues in these datasets using the latest version of cleanlab:
- Dominant language
- Jupyter Notebook
- Stars
- 136
- Forks
- 28
- PR merge metrics
- No merged PRs in 30d
Getting set up
This project ships no dev container, Dockerfile or contributing guide, so setting up is up to you: start from its README, and see our first-contribution guide for the general steps.
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from cleanlab/examples
-
help wanted
Difficulty 5/5 Over a week Newbie friendliness 35/100
-
help wanted
Difficulty 3/5 1-2 days Newbie friendliness 42/100
-
help wanted
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
good first issue help wanted
Difficulty 5/5 Over a week Newbie friendliness 30/100
All issues in cleanlab/examples
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
huggingface/trl#8296 ·
Maintainers usually reply within 2 days
-
bot-triaged module: correctness (silent) module: inductor oncall: pt2 release triage triage review
Difficulty 2/5 1-3 hours Newbie friendliness 65/100
Maintainers usually reply within 1 day
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
apple/coreai-models#523 ·
Maintainers usually reply within 1 day
-
bug low
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
anubhavaanand/project-cyan-phishNet#150 ·
Maintainers usually reply within 1 day