The “Chat settings“ menu is where you can configure the performance of your bot. Customize it to your needs to reach the best results. Open the the “Chat settings“ menu by clicking the menu icon:
“Parameters” tab
“Parameters” tab allows you to set the “Temperature“ and “Maximum tokens“ configuration.
Temperature - used to control the degree of randomness or creativity in the generated text. A high temperature value will lead to more deep and diverse responses, while a low temperature value will lead to more predictable and conservative responses. Another way to think of it is that a high temperature value allows more exploration of the model's knowledge. In contrast, a low temperature value encourages exploitation of what the model already knows.
Maximum tokens - limits the maximum amount of tokens bot can use for its response. Token is a resource AI bot consume to generate the response, which means that the size and completeness of the bot response will be depending on the “maximum tokens“ value set in the “Parameters“.