Repository Issues

huggingface/tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

View on GitHub
Stars
 (5,605 stars)
Forks
 (473 forks)
Indexed issues
 (0 indexed issues)
open beginner issues
 (0 open beginner issues)
Latest indexed
Jul 5, 2026
Last GitHub push
May 10, 2022
License
Apache License 2.0
Contributing guide
Contributing guide
Code of conduct
No code of conduct
Dominant language
Rust
PR merge metrics
 (Avg merge 3d 7h) (14 merged PRs in 30d)
Beginner labels
No beginner labels indexed

Issues

0 open indexed issues

RSSAtom

No open indexed issues found for this repository.