Edit Models filters

Model Tree

ibm-granite/granite-3.1-8b-instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

35

Full-text search

Active filters: ibm-granite/granite-3.1-8b-instruct

bartowski/granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Dec 23, 2024 • 535 • 12

lmstudio-community/granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Dec 23, 2024 • 1.47k • 16

NikolayKozloff/granite-3.1-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Dec 18, 2024 • 8 • 1

DevQuasar-5/ibm-granite.granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Feb 1, 2025 • 35 • 4

mradermacher/granite-3.1-8b-instruct-GGUF

8B • Updated Dec 20, 2024 • 105 • 1

mradermacher/granite-3.1-8b-instruct-i1-GGUF

8B • Updated Feb 13, 2025 • 208 • 2

jakiAJK/granite-3.1-8b-instruct_GPTQ-int4

Text Generation • 8B • Updated Jan 21, 2025 • 3 • 1

jakiAJK/granite-3.1-8b-instruct_AWQ

Text Generation • 8B • Updated Jan 21, 2025 • 3

itlwas/granite-3.1-8b-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 23, 2024 • 4

SandLogicTechnologies/Granite-3.1-8b-instruct-GGUF

8B • Updated Dec 23, 2024 • 15

Triangle104/granite-3.1-8b-instruct-Q4_K_S-GGUF

Text Generation • 8B • Updated Dec 25, 2024 • 3

Triangle104/granite-3.1-8b-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 25, 2024 • 3

Triangle104/granite-3.1-8b-instruct-Q5_K_S-GGUF

Text Generation • 8B • Updated Dec 25, 2024 • 3

Triangle104/granite-3.1-8b-instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Dec 25, 2024 • 9

Triangle104/granite-3.1-8b-instruct-Q6_K-GGUF

Text Generation • 8B • Updated Dec 25, 2024

Triangle104/granite-3.1-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Dec 25, 2024 • 5

tensorblock/granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated 29 days ago • 43

mindw96/code-granite-8b-text-to-sql-ver0.1

Text Generation • 9B • Updated Jan 2, 2025 • 3

Alcoft/granite-3.1-8b-instruct-GGUF

Text Generation • 8B • Updated Jan 6, 2025 • 38

RedHatAI/granite-3.1-8b-instruct-FP8-dynamic

Text Generation • 8B • Updated Sep 22, 2025 • 28 • 1

RedHatAI/granite-3.1-8b-instruct-quantized.w4a16

Text Generation • 1B • Updated Sep 22, 2025 • 658 • 1

RedHatAI/granite-3.1-8b-instruct-quantized.w8a8

Text Generation • 8B • Updated Sep 25, 2025 • 109 • 2

cgus/granite-3.1-8b-instruct-exl2

Text Generation • Updated Jan 22, 2025 • 5

TheMelonGod/granite-3.1-8b-instruct-exl2

Text Generation • Updated Feb 5, 2025 • 3

msyukorai/granite-3.1-8b-instruct-Q4_0-GGUF

Text Generation • 8B • Updated Feb 9, 2025

ruslanmv/granite-3.1-8b-Reasoning-GGUF

Text Generation • 8B • Updated Feb 12, 2025 • 30

EasierAI/Granite-3.1-8B

Text Generation • 8B • Updated Feb 12, 2025 • 431

Lucy-in-the-Sky/granite-3.1-8b-instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Feb 17, 2025 • 5

Lucy-in-the-Sky/granite-3.1-8b-instruct-Q6_K-GGUF

Text Generation • 8B • Updated Feb 17, 2025 • 4

Lucy-in-the-Sky/granite-3.1-8b-instruct-Q8_0-GGUF

Text Generation • 8B • Updated Feb 17, 2025 • 6