smol-IQ2_KS on a barely sufficient system
5
#11 opened 4 months ago
by
Hansi2024
when qwen_next (i just tested both model did well)
π 1
4
#10 opened 5 months ago
by
gopi87
IQ5_K on EPYC with a single GPU
π₯ 1
1
#9 opened 5 months ago
by
sousekd
128K context does not work (possibly because YaRN meta information is missing?)
β 1
2
#8 opened 5 months ago
by
Lissanro
testing smol-IQ4-KSS
π π 3
5
#7 opened 5 months ago
by
shewin
IQ2_K Ling 1T Discussion
π₯ 2
3
#6 opened 5 months ago
by
Hunterx
Feedback on smol-IQ1_KT
π₯ 1
#5 opened 5 months ago
by
wunderschnitzel
mainline llama.cpp?
2
#4 opened 5 months ago
by
gghfez
(IQ2_XSS) Initial Performance Results Inside γ96GB VRAM / 256GB DDR5 γ
π π₯ 2
3
#3 opened 5 months ago
by
phakio
Great Work!
β€οΈ 1
7
#2 opened 5 months ago
by
anikifoss
403 Error
6
#1 opened 5 months ago
by
ubergarm