Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
jonasaise
/
oellm_tokenizer_262k_v2
like
0
42 languages
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
main
oellm_tokenizer_262k_v2
File size: 41 Bytes
7a1ee6a
1
2
3
4
5
{
"<bos>"
:
262144
,
"<eos>"
:
262145
}