thomasthaddeus/Tokenizer
View on GitHubA web-based Text Truncator and Cleaner that allows users to upload text files, set token limits, and apply various cleaning options like removing special characters, numbers, punctuation, emojis, and converting text to lowercase. Ideal for quick text processing and cleanup tasks.
- Stars
- 1
- Forks
- 0
- Open beginner issues
- 0
- Indexed issues
- 3
- Dominant language
- JavaScript
- License
- MIT
- Last GitHub push
- May 9, 2026
- Latest indexed
- Sep 21, 2026
- Contributing guide
- Contributing guide
- Code of conduct
- Code of conduct
- Beginner labels
- No beginner labels indexed
- PR merge metrics
- No merged PRs in 30d
3 open issues indexed
Loading issues
-
[Bug]: Help Page Openbug
thomasthaddeus/Tokenizer#3 · 1 assignee ·
-
[UX]: Truncated Text Open
thomasthaddeus/Tokenizer#2 · 1 assignee ·
-
bug
thomasthaddeus/Tokenizer#1 · 1 assignee ·