Groq Cloud

The Groq Cloud API interface is very similar to the OpenAI interface, with a limited parameter list.

Parameters

The exact parameter name must be used, followed by the equals sign ( = ), then the value:

max_tokens          = 1024

Whitespace such as tabs and spaces are ignored.

top_p = 0.5
temperature                =            1.0

Comments have a hash ( # ) at the beginning of the line and are ignored:

#not_used          = null

Definitions

The official Groq documentation has details about the parameters themselves.

https://console.groq.com/docs/text-chat

Unused

• Some parameters (such as model and messages) are handled by the Synthonnel software.

Supported

Parameter	Data Type	Range
temperature	float	0 to 2
max_tokens	integer	1 to model dependant
top_p	float	0 to 1