Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

19,481

Full-text search

Active filters: gguf-my-repo

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 608 • 145

ggml-org/Qwen2.5-Coder-1.5B-Q8_0-GGUF

Text Generation • 2B • Updated Oct 28, 2024 • 5.19k • 17

itlwas/Qwen2.5-Coder-7B-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 20, 2024 • 5.87k • 2

Anoxiom/Sujet-Finance-8B-v0.1-Q6_K-GGUF

Text Generation • 8B • Updated Apr 23, 2024 • 10 • 2

joshnader/Phi-3-mini-4k-instruct-Q8_0-GGUF

Text Generation • 4B • Updated Jul 3, 2024 • 42 • 1

Ransss/Pantheon-RP-1.5-12b-Nemo-Q8_0-GGUF

12B • Updated Aug 4, 2024 • 4 • 1

ggml-org/Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation • 8B • Updated Sep 2, 2024 • 1.47k • 14

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Sep 25, 2024 • 27.6k • 27

WSDW/Qwen2.5-7B-Instruct-Uncensored-Q4_K_M-GGUF

Text Generation • 8B • Updated Oct 6, 2024 • 7.56k • 2

noxinc/bitnet_b1_58-large-Q5_K_M-GGUF

0.7B • Updated Oct 20, 2024 • 12 • 1

yemiao2745/Qwen2.5-14B-Instruct-Uncensored-Q4_K_M-GGUF

15B • Updated Nov 23, 2024 • 774 • 5

matrixportalx/Llama-3.2-3B-Instruct-uncensored-Q3_K_M-GGUF

4B • Updated Dec 3, 2024 • 98 • 1

Hack337/WavGPT-2-Q8_0-GGUF

Text Generation • 8B • Updated Feb 18, 2025 • 12 • 3

huydt/japanese-bge-reranker-v2-m3-v1-Q8_0-GGUF

Text Ranking • 0.6B • Updated Apr 28, 2025 • 17 • 1

NikolayKozloff/Phi-4-reasoning-Q5_K_S-GGUF

Text Generation • 15B • Updated May 1, 2025 • 2 • 2

NikolayKozloff/Phi-4-reasoning-plus-Q5_K_S-GGUF

Text Generation • 15B • Updated May 1, 2025 • 4 • 2

AliCat2/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-Q5_K_M-GGUF

24B • Updated Jun 30, 2025 • 16 • 2

Trendyol/Qwen3-14B-BaronLLM-v2-Q8

15B • Updated Aug 20, 2025 • 64 • 6

Ygz-08123/Qwen3-7B-Instruct-Q4_K_M-GGUF

8B • Updated Oct 13, 2025 • 1.41k • 1

infil00p/shieldgemma-2-4b-it-GGUF

Image Classification • 4B • Updated Nov 15, 2025 • 149 • 1

echos-keeper/Qwen3-30B-A3B-Thinking-2507-Claude-4.5-Sonnet-High-Reasoning-Distill-Q5_K_M-GGUF

Text Generation • 31B • Updated Nov 17, 2025 • 111 • 2

ldostadi/Huihui-Ministral-3-3B-Reasoning-2512-abliterated-Q4_K_M-GGUF

3B • Updated Dec 6, 2025 • 34 • 1

matrixportalx/gemma-2-9b-it-abliterated-Q4_0-GGUF

9B • Updated Dec 25, 2025 • 48 • 1

matrixportalx/Huihui-gemma-3n-E4B-it-abliterated-Q6_K-GGUF

Image-Text-to-Text • 7B • Updated Dec 27, 2025 • 14 • 1

Edge-Quant/Nanbeige4.1-3B-Q4_K_M-GGUF

Text Generation • 4B • Updated about 1 month ago • 11.8k • 37

NeshVerse/Uncensored_Nanbeige-4.1-3B-Q8_0-GGUF

4B • Updated 25 days ago • 220 • 2

TitleOS/Qwen3-VL-Embedding-2B-GGUF

Feature Extraction • 0.4B • Updated 22 days ago • 278 • 1

cs2764/Huihui-Qwen3.5-35B-A3B-abliterated-Q8_0-GGUF

Image-Text-to-Text • 35B • Updated 14 days ago • 4.7k • 2

lainlives/Qwen3.5-9B-Claude-4.6-HighIQ-INSTRUCT-HERETIC-UNCENSORED-GGUF

Image-Text-to-Text • 9B • Updated 5 days ago • 958 • 1

welyjesch/hiligaynon_llama_3.1_finetuned_8b_gguf

8B • Updated 2 days ago • 490 • 1