Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Apps
llama.cpp
LM Studio
Jan
Draw Things
DiffusionBee
Jellybox
JoyFusion
LocalAI
vLLM
Ollama
MLX LM
Docker Model Runner
Lemonade
SGLang
Pi
Inference Providers
Select all
Groq
Novita
Cerebras
SambaNova
Nscale
fal
Hyperbolic
Together AI
Fireworks
Featherless AI
Zai
Replicate
Cohere
Scaleway
Public AI
OVHcloud AI Endpoints
HF Inference API
WaveSpeed
Misc
Reset Misc
tokenizer
Inference Endpoints
text-generation-inference
Eval Results (legacy)
text-embeddings-inference
4-bit precision
Merge
custom_code
8-bit precision
Mixture of Experts
Carbon Emissions
Eval Results
Apply filters
Models
853
Full-text search
Inference Available
Edit filters
Sort: Trending
Active filters:
tokenizer
Clear all
ibm-research/DAC.speech.v1.0
Updated
Sep 19, 2024
•
30
•
15
pszemraj/sail-slimpajama-6B-32768-BPE-tokenizer
Updated
Dec 29, 2025
gpwr/bark-it-tokenizer
Updated
Nov 9, 2024
charanhu/kannada-tokenizer
Text Generation
•
Updated
Nov 12, 2024
•
2
GlowCheese/minBERT
Text Classification
•
Updated
Dec 4, 2024
•
1
AhmetSemih/tr_tokenizer
Updated
Dec 26, 2024
aliarda/turkish_tokenizer
Updated
Dec 3, 2024
•
1
aliarda/turkish_tokenizer_256k
Updated
Dec 4, 2024
•
1
tejagowda/t5-hebrew-translation
Text Classification
•
0.2B
•
Updated
Dec 7, 2024
•
1
aloobun/IN-Llama-3-Tokenizer
Updated
Mar 7, 2025
Saiteja/telugu-bpe
Updated
Jan 5, 2025
•
4
aayushraina/hindi-bpe-tokenizer
Text Generation
•
Updated
Jan 11, 2025
aayushraina/bpe-hindi
Text Generation
•
Updated
Jan 11, 2025
physical-intelligence/fast
Robotics
•
Updated
Jan 16, 2025
•
166
InterwebAlchemy/PGNTokenizer
Updated
Feb 11, 2025
•
1
sachin6624/sachin-gpt2-tokenizer
Updated
Feb 3, 2025
•
1
nilsleh/eo-vae
Image-to-Image
•
Updated
30 days ago
•
1
Ornaments/72k-Bilingual-BBPE-TK-SPM-Identity
Updated
Feb 18, 2025
Ornaments/72k-TK-BBPE-HF
Updated
Feb 18, 2025
savath/laonlp-enhanced
Updated
Feb 21, 2025
mishmish66/throwing_fast
Robotics
•
Updated
Feb 28, 2025
•
1
Adiii143/code-search-net-tokenizer
Updated
Mar 12, 2025
TuKoResearch/WavCochV8192
Feature Extraction
•
11.1M
•
Updated
Jan 12
•
18
mishmish66/trying-fast
Robotics
•
Updated
Apr 22, 2025
•
1
deshanksuman/romanized-sinhala-tokenizer
Updated
Sep 14, 2025
Namuun123/mn_sentencepiece_tokenizer
Updated
Apr 25, 2025
luispintoc/MoleBERT-Tokenizer-NbTMC_scratch_150k_20ep
2.17M
•
Updated
May 9, 2025
luispintoc/MoleBERT-Tokenizer-NbTMC_scratch_400k_30ep
2.17M
•
Updated
May 9, 2025
•
2
ArabovMK/tajik-tokenizers-v1
Updated
May 10, 2025
neghny/segmo
Updated
May 15, 2025
Previous
1
2
3
4
...
29
Next