Skip to main content

Hugging Face Free

Bad API Key.​

Error Message Looks Like This​

Authorization header is correct, but the token seems invalid

Reason​

Old, expired, or otherwise invalid API Key. Copy-pasted the API Key from the wrong Provider?

Solution​

Fix the API Key.

Bad Model Name​

Error Message Looks Like This​

Model mistralai/Mixtral-8x7B-Instruct-v0.1XXX does not exist

Reason​

The model name must be exactly as published by the Inference Provider. You will need the maker and the model name. They are separated by a slash.

Solution​

Fix the model name.

Bad Parameter​

Error Message Looks Like This​

Exception: Expecting value: line 1 column 1 (char 0)

Reason​

The model name must be exactly as published by the Inference Provider.

Solution​

Examine the parameter list. Not all providers use the same parameters, and not all models have the same parameters available.

Bad ProviderUrl​

Error Message Looks Like This​

Model ZZZmistralai/Mixtral-8x7B-Instruct-v0.1 does not exist

Reason​

The model name must be exactly as published by the Inference Provider. You will need the maker and the model name. They are separated by a slash.

Solution​

Review all settings. Delete and recreate the model.

Corrupted API Template.​

Error Message Looks Like This​

Inference Failure. provider: 'Hugging Face FreeXXX' not found. Most likely due to corrupted API template.

Reason​

This should not happen if the model was configured through the UI. Were you messing with the configuration JSON file directly?

Solution​

Delete and recreate the model. Or revert to the backup of the JSON configuration that you made before messing with it.