microsoft/Tokenizer
View on GitHubTypescript and .NET implementation of BPE tokenizer for OpenAI LLMs.
- Stars
- 213
- Forks
- 37
- Open beginner issues
- 0
- Indexed issues
- 4
- Avg merge
- 5d 1h
- Merged PRs (30d)
- 5
- Dominant language
- C#
- License
- MIT
- Last GitHub push
- Sep 10, 2026
- Latest indexed
- Sep 19, 2026
- Contributing guide
- Contributing guide
- Code of conduct
- Code of conduct
- Beginner labels
- No beginner labels indexed
Loading issues
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
deepseek support? Open
Difficulty 5/5 Over a week Newbie friendliness 15/100
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100