LM Studio
The LM Studio API interface is completely compliant with the OpenAI interface.
Parameters
The exact parameter name must be used, followed by the equals sign ( = ), then the value:
max_tokens = 1024
Whitespace such as tabs and spaces are ignored.
frequency_penalty = 0.5
temperature = 1.0
Comments have a hash ( # ) at the beginning of the line and are ignored:
#not_used = null
Definitions
The official LM Studio documentation refers the user to the officail OpenAI documentation.
https://lmstudio.ai/docs/local-server#supported-payload-parameters
https://platform.openai.com/docs/api-reference/chat/create
Unused
- Some parameters (such as
modelandmessages) are handled by the Synthonnel software. - Some parameters (such as
logit_bias) are complex datatypes and not used by Synthonnel at this time. - Some parameters (such as
nandresponse_format) do not make sense in Synthonnel usage so are not included.
Supported
| Parameter | Data Type | Range |
|---|---|---|
| frequency_penalty | float | -2.0 to 2.0 |
| logprobs | boolean | true or false |
| top_logprobs | integer | 0 to 20 |
| max_tokens | integer | 1 to model dependant |
| presence_penalty | float | -2.0 to 2.0 |
| seed | integer | integer max value |
| stop | string or array | valid string or array |
| temperature | float | 0 to 2 |
| top_p | float | 0 to 1 |