IBM WatsonX

IBM WatsonX uses it's own API interface that is different from OpenAI.

1. project_id or space_id must be specified in the parameters section of the configuration.
   • https://developer.ibm.com/tutorials/integrate-your-watson-assistant-chatbot-with-watsonxai-for-generative-ai/
   • See 'Step 4. Getting your watsonx.ai project ID'

Parameters

The exact parameter name must be used, followed by the equals sign ( = ), then the value:

MAX_NEW_TOKENS          = 1024

Whitespace such as tabs and spaces are ignored.

TOP_P = 0.5
TEMPERATURE                =            1.0

Comments have a hash ( # ) at the beginning of the line and are ignored:

#not_used          = null

Definitions

The official WatsonX documentation has details about the parameters themselves.

https://ibm.github.io/watsonx-ai-python-sdk/fm_model.html#metanames.GenTextParamsMetaNames

Unused

• Some parameters (such as RETURN_OPTIONS) do not make sense in Synthonnel usage so are not included.

Supported

Parameter	Data Type	Range
TEMPERATURE	float	0.0 to 2.0
TOP_P	float	0.0 to 1.0
TOP_K	int	1 to 100
RANDOM_SEED	int	1 to 4,294,967,295
REPETITION_PENALTY	float	1.0 to 2.0
MIN_NEW_TOKENS	int	0 to model dependent
MAX_NEW_TOKENS	int	0 to model dependent
STOP_SEQUENCES	list	0 to 6 strings
TIME_LIMIT	int	In milliseconds.
TRUNCATE_INPUT_TOKENS	int	Zero means don’t truncate.