Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,244

Full-text search

Active filters: 4-bit

mlx-community/Qwen3.5-27B-4bit

Image-Text-to-Text • 5B • Updated 4 days ago • 7.87k • 8

QuantTrio/Qwen3.5-122B-A10B-AWQ

Image-Text-to-Text • 125B • Updated 2 days ago • 7.94k • 8

QuantTrio/Qwen3.5-35B-A3B-AWQ

Image-Text-to-Text • 36B • Updated 2 days ago • 10.9k • 5

Intel/Qwen3.5-397B-A17B-int4-AutoRound

Updated about 3 hours ago • 321 • 5

LiquidAI/LFM2-24B-A2B-MLX-4bit

Text Generation • 24B • Updated 4 days ago • 117 • 4

EricRollei/HunyuanImage-3.0-Instruct-Distil-NF4-v2

Text-to-Image • 83B • Updated 6 days ago • 139 • 4

RepublicOfKorokke/Qwen3.5-35B-A3B-mlx-lm-mxfp4

Text Generation • 35B • Updated 4 days ago • 5.12k • 4

QuantTrio/Qwen3.5-397B-A17B-AWQ

Image-Text-to-Text • Updated about 7 hours ago • 2.46k • 4

QuantTrio/Qwen3.5-27B-AWQ

Image-Text-to-Text • 28B • Updated 2 days ago • 11.2k • 4

Intel/Qwen3.5-122B-A10B-int4-AutoRound

20B • Updated about 3 hours ago • 1.15k • 4

Intel/Qwen3-Coder-Next-int4-AutoRound

Text Generation • 12B • Updated 18 days ago • 8k • 11

andrevp/MiniCPM-o-4_5-MLX-4bit

Image-Text-to-Text • 2B • Updated 14 days ago • 365 • 4

Intel/MiniMax-M2.5-int4-AutoRound

Text Generation • 32B • Updated 3 days ago • 506 • 7

baa-ai/Qwen3.5-397B-A17B-SWAN-4bit

Text Generation • 396B • Updated 6 days ago • 1.21k • 3

mlx-community/Qwen3.5-35B-A3B-4bit

Image-Text-to-Text • 6B • Updated 4 days ago • 5.37k • 3

mlx-community/Qwen3.5-122B-A10B-4bit

Image-Text-to-Text • 20B • Updated 4 days ago • 2.87k • 3

nightmedia/Qwen3.5-122B-A10B-Text-mxfp4-mlx

Text Generation • 122B • Updated 2 days ago • 2.05k • 3

Intel/Qwen3.5-35B-A3B-int4-AutoRound

6B • Updated about 3 hours ago • 305 • 3

unsloth/Qwen3-8B-unsloth-bnb-4bit

Updated May 13, 2025 • 96.3k • 17

Qwen/Qwen3-30B-A3B-GPTQ-Int4

Text Generation • 31B • Updated May 21, 2025 • 289k • 47

ethanolivertroy/HackIDLE-NIST-Coder-MLX-4bit

Text Generation • 1B • Updated Oct 14, 2025 • 17 • 2

mlx-community/Qwen3-VL-2B-Instruct-4bit

Image-Text-to-Text • Updated Oct 21, 2025 • 4.53k • 2

mlx-community/GLM-4.6V-Flash-mxfp4

Image-Text-to-Text • 3B • Updated 7 days ago • 271 • 2

mlx-community/Qwen3-TTS-12Hz-0.6B-Base-4bit

Text-to-Speech • 0.4B • Updated Jan 25 • 1.3k • 6

mlx-community/Qwen3-Coder-Next-4bit

Text Generation • Updated 20 days ago • 4.68k • 9

mrdbourke/sunny-medgemma-1.5-4b-finetune-mlx-4bit

Image-Text-to-Text • 1B • Updated 9 days ago • 364 • 2

QuantTrio/MiniMax-M2.5-AWQ

Text Generation • 229B • Updated 12 days ago • 43.7k • 10

brianmatzelle/personaplex-7b-v1-bnb-4bit

Updated 5 days ago • 7

Madras1/JadeBr72b

Text Generation • 73B • Updated 7 days ago • 54 • 2

Bob-the-Koala/LocalCodeViber

Text Generation • 8B • Updated 4 days ago • 24 • 2