roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 6
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 8
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 20
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 24
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 3
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 2
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 90 • 2
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_0-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 1
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S-GGUF Text Generation • 71B • Updated Jan 19, 2025
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 57
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 18
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0-GGUF Text Generation • 71B • Updated Jan 19, 2025 • 1