Any recommended settings?
#4
by
juanml82
- opened
temperature, top_P all that? It can get too verbose with whatever default settings I'm using, which is kind of amusing in a good way, but not quite the answers you'd expect
My ST settings give good results;
response tokens = 600
temp = 1
top k = 0
top p = 0.97
min p = 0.025
rep pen = 1.05
freq pen = 0.05
mirostat mode =2
tau = 5
eta = 0.1
dynamic temp is on (0.5-1.5) but it doesn't do much, logs show it's always '1'
sampler order:
- rep/freq/pres penalties
- dry
- top n-sigma
- top k
- typical p
- top p
- exclude top choices
- temp
context/instruct templates: mistral tekken-v7-tekken xml. my system prompt is custom but simple