Quantized Models (GGUF, IQ, Imatrix)
Collection
Various GGUF quantizations of small models. Models with a "checkmark" are personal favorites. An "orange arrow" means it's being uploaded. • 97 items • Updated
• 69
A newer version of this model is available:
Lewdiculous/CaptainErisNebula-12B-Chimera-v1.1-GGUF-IQ-Imatrix
Archive notice:
Please use the updated version instead! Lewdiculous/CaptainErisNebula-12B-Chimera-v1.1-GGUF-IQ-Imatrix
GGUF quants for testing at the moment. Thank you, "mad scientist" Nitral-AI!
This model has potential! Not chaotic, and at the ideal size for most people.
Doesn't show excessive alignment – note that my initial testing had a relatively permissive prompt and focused on NSFW scenarios, so you should also try to guide it to your needs – so it should be good for any scenarios/writing situations.
- Downloads last month
- 294
Hardware compatibility
Log In to add your hardware
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support