arxiv:2411.02355
Eldar Kurtić
ekurtic
AI & ML interests
Efficient inference
Recent Activity
updated
a model
about 9 hours ago
nm-testing/TinyLlama-1.1B-compressed-tensors-kv-cache-scheme
updated
a collection
about 9 hours ago
Models in CI
updated
a collection
about 9 hours ago
Models in CI
Organizations
models
7
ekurtic/qwen3-8b-int4-asym
2B
•
Updated
•
4
ekurtic/qwen3-8b-int4-sym
2B
•
Updated
•
7
ekurtic/llama-3.1-8b-instruct-int4-asym
2B
•
Updated
•
4
ekurtic/llama-3.1-8b-instruct-int4-sym
2B
•
Updated
•
3
ekurtic/Qwen2.5-VL-7B-Instruct-weight-only-INT4-fake-quant
8B
•
Updated
•
5
ekurtic/Qwen2.5-VL-7B-Instruct-weight-only-INT8-fake-quant
8B
•
Updated
•
14
ekurtic/Qwen2.5-VL-7B-Instruct-weight-only-FP8-fake-quant
8B
•
Updated
•
7
datasets
0
None public yet