Shaping capabilities with token-level data filtering
Paper โข 2601.21571 โข Published โข 27
AI & ML interests
This organization is maintained by the transformers team at Hugging Face and contains the historical (pre-"Hub") ALBERT checkpoints.
Recent Activity
View all activity
julien-cย
submitted a
paper to Daily Papers about 2 months ago
Post
8247
We're kick-starting the process of Transformers v5, with @ArthurZ and @cyrilvallez !
v5 should be significant: we're using it as a milestone for performance optimizations, saner defaults, and a much cleaner code base worthy of 2025.
Fun fact: v4.0.0-rc-1 came out on Nov 19, 2020, nearly five years ago!
v5 should be significant: we're using it as a milestone for performance optimizations, saner defaults, and a much cleaner code base worthy of 2025.
Fun fact: v4.0.0-rc-1 came out on Nov 19, 2020, nearly five years ago!
- 6 replies
Post
10023
BOOOOM: Today I'm dropping TINY AGENTS
the 50 lines of code Agent in Javascript ๐ฅ
I spent the last few weeks working on this, so I hope you will like it.
I've been diving into MCP (Model Context Protocol) to understand what the hype was all about.
It is fairly simple, but still quite powerful: MCP is a standard API to expose sets of Tools that can be hooked to LLMs.
But while doing that, came my second realization:
Once you have a MCP Client, an Agent is literally just a while loop on top of it. ๐คฏ
โก๏ธ read it exclusively on the official HF blog: https://huggingface.co/blog/tiny-agents
the 50 lines of code Agent in Javascript ๐ฅ
I spent the last few weeks working on this, so I hope you will like it.
I've been diving into MCP (Model Context Protocol) to understand what the hype was all about.
It is fairly simple, but still quite powerful: MCP is a standard API to expose sets of Tools that can be hooked to LLMs.
But while doing that, came my second realization:
Once you have a MCP Client, an Agent is literally just a while loop on top of it. ๐คฏ
โก๏ธ read it exclusively on the official HF blog: https://huggingface.co/blog/tiny-agents
- 1 reply
Post
4432
Important notice ๐จ
For Inference Providers who have built support for our Billing API (currently: Fal, Novita, HF-Inference โ with more coming soon), we've started enabling Pay as you go (=PAYG)
What this means is that you can use those Inference Providers beyond the free included credits, and they're charged to your HF account.
You can see it on this view: any provider that does not have a "Billing disabled" badge, is PAYG-compatible.
For Inference Providers who have built support for our Billing API (currently: Fal, Novita, HF-Inference โ with more coming soon), we've started enabling Pay as you go (=PAYG)
What this means is that you can use those Inference Providers beyond the free included credits, and they're charged to your HF account.
You can see it on this view: any provider that does not have a "Billing disabled" badge, is PAYG-compatible.
- 9 replies
Post
8388
SmolVLM-2 and SigLIP-2 are now part of
They're added on top of the v4.49.0 release, and can be installed from the following tags:
This marks a new beginning for the release process of transformers. For the past five years, we've been doing monthly releases featuring many models (v4.49.0, the latest release, features 9 new architectures).
Starting with SmolVLM-2 & SigLIP2, we'll now additionally release tags supporting new models on a stable branch. These models are therefore directly available for use by installing from the tag itself. These tags will continue to be updated with fixes applied to these models.
Going forward, continue expecting software releases following semantic versioning: v4.50.0 will have ~10 new architectures compared to v4.49.0, as well as a myriad of new features, improvements and bug fixes. Accompanying these software releases, we'll release tags offering brand new models as fast as possible, to make them accessible to all immediately.
transformers in dedicated releases!They're added on top of the v4.49.0 release, and can be installed from the following tags:
v4.49.0-SmolVLM-2 and v4.49.0-SigLIP-2.This marks a new beginning for the release process of transformers. For the past five years, we've been doing monthly releases featuring many models (v4.49.0, the latest release, features 9 new architectures).
Starting with SmolVLM-2 & SigLIP2, we'll now additionally release tags supporting new models on a stable branch. These models are therefore directly available for use by installing from the tag itself. These tags will continue to be updated with fixes applied to these models.
Going forward, continue expecting software releases following semantic versioning: v4.50.0 will have ~10 new architectures compared to v4.49.0, as well as a myriad of new features, improvements and bug fixes. Accompanying these software releases, we'll release tags offering brand new models as fast as possible, to make them accessible to all immediately.
- 1 reply
Post
11448
After some heated discussion ๐ฅ, we clarify our intent re. storage limits on the Hub
TL;DR:
- public storage is free, and (unless blatant abuse) unlimited. We do ask that you consider upgrading to PRO and/or Enterprise Hub if possible
- private storage is paid above a significant free tier (1TB if you have a paid account, 100GB otherwise)
docs: https://huggingface.co/docs/hub/storage-limits
We optimize our infrastructure continuously to scale our storage for the coming years of growth in Machine learning, to the benefit of the community ๐ฅ
cc: @reach-vb @pierric @victor and the HF team
TL;DR:
- public storage is free, and (unless blatant abuse) unlimited. We do ask that you consider upgrading to PRO and/or Enterprise Hub if possible
- private storage is paid above a significant free tier (1TB if you have a paid account, 100GB otherwise)
docs: https://huggingface.co/docs/hub/storage-limits
We optimize our infrastructure continuously to scale our storage for the coming years of growth in Machine learning, to the benefit of the community ๐ฅ
cc: @reach-vb @pierric @victor and the HF team
- 29 replies
Post
3291
wow ๐ฎ
INTELLECT-1 is the first collaboratively trained 10 billion parameter language model trained from scratch on 1 trillion tokens of English text and code.
PrimeIntellect/INTELLECT-1-Instruct
INTELLECT-1 is the first collaboratively trained 10 billion parameter language model trained from scratch on 1 trillion tokens of English text and code.
PrimeIntellect/INTELLECT-1-Instruct
Post
5289
Hey it was good meeting you yesterday @MaziyarPanahi ๐ฅ
thanks @mishig for setting this up
Let's make the Hub as useful as possible for the community โค๏ธ
thanks @mishig for setting this up
Let's make the Hub as useful as possible for the community โค๏ธ
- 1 reply
Post
6978
text-generation-inference (TGI) is now fully open-source again!
Along with text-embeddings-inference.
We just switched both of those repos' license back to Apache 2. ๐ฅ
Along with text-embeddings-inference.
We just switched both of those repos' license back to Apache 2. ๐ฅ
Post
3239
Very glad to welcome @josefprusa , pioneer of 3D printing and open source hardware, founder of https://www.prusa3d.com/, to the HF Hub ๐
AI applied to 3D printing could be big.
AI applied to 3D printing could be big.
- 1 reply
Post
671 authors ๐คฏ
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context (2403.05530) Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context (2403.05530) Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
- 2 replies
Post
What if you could casually access your remote GPU in HF Spaces from the comfort of your local VSCode ๐คฏ
- 8 replies
lysandreย
updated 7
models about 2 years ago
albert/albert-xxlarge-v2
Fill-Mask โข 0.2B โข Updated โข 2.92k โข โข 21
albert/albert-xxlarge-v1
Fill-Mask โข Updated โข 712 โข 5
albert/albert-xlarge-v1
Fill-Mask โข 59M โข Updated โข 548 โข 4
albert/albert-large-v2
Fill-Mask โข 17.9M โข Updated โข 3.24k โข โข 21
albert/albert-large-v1
Fill-Mask โข Updated โข 570 โข 3
albert/albert-base-v2
Fill-Mask โข 11.8M โข Updated โข 554k โข โข 140
albert/albert-base-v1
Fill-Mask โข 11.8M โข Updated โข 131k โข โข 12
Post
๐ฃ NEW on HF
the Dataset Viewer is now available on *private datasets* too
You need to be a PRO or a Enterprise Hub user. ๐ฅ
Great work from our Datasets team ๐ฅฐ: @lhoestq @severo @polinaeterna @asoria @albertvillanova and the whole team ๐ฅฐ
the Dataset Viewer is now available on *private datasets* too
You need to be a PRO or a Enterprise Hub user. ๐ฅ
Great work from our Datasets team ๐ฅฐ: @lhoestq @severo @polinaeterna @asoria @albertvillanova and the whole team ๐ฅฐ
- 1 reply