Recommended Parameters?

#4
by ghostwithahat - opened

Do you have recommendations for temperature, top-k, top-p, ...?

Orion LLM Labs org

temperature = 0.6
top_p = 0.9
top_k = 50
repetition_penalty = 1.2

DedeProGames changed discussion status to closed

Sign up or log in to comment