hugging-quants
/

Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Resources

View closed (9)

Update README.md

#18 opened 30 days ago by

add AIBOM

#17 opened 8 months ago by

Interview request: genAI evaluation & documentation

#16 opened over 1 year ago by

add base_model

#15 opened over 1 year ago by

add base_model metadata

#14 opened over 1 year ago by

Issues to set the seed

#13 opened over 1 year ago by

could not run this in lmdeploy

#12 opened over 1 year ago by

How to use INT4 with vLLM?

#8 opened over 1 year ago by

Fixed tokenizer

#6 opened over 1 year ago by