Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
sh0ck0r
/
Anubis-Pro-105B-v1-FP8-Dynamic
like
0
Text Generation
Transformers
Safetensors
llama
fp8
vllm
compressed-tensors
quantized
llmcompressor
conversational
text-generation-inference
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Deploy
Use this model
refs/pr/1
Anubis-Pro-105B-v1-FP8-Dynamic
/
recipe.yaml
sh0ck0r
Upload folder using huggingface_hub
de024ad
verified
3 months ago
raw
Copy download link
history
blame
Safe
136 Bytes
default_stage:
default_modifiers:
QuantizationModifier:
targets:
[
Linear
]
ignore:
[
lm_head
]
scheme:
FP8_DYNAMIC