Anthropic Messages [BETA]
Create a messages response. This endpoint is compatible with the Anthropic API.
Request message for /v1/messages
The provider preference for handling the request.
The providers that are allowed to be used for the completion.
["mistral","scaleway"]Whether to consider only providers based and regulated withing the EU. Even when false, all our endpoints are GDPR compliant.
falseWhether to allow quantized endpoints.
trueWhether to use only ZDR providers.
Whether to allow model fallback when a model is currently unavailable.
The maximum number of tokens to generate before stopping. The model may stop before the max_tokens when it reaches the stop sequence.
Model name for the model to use.
latest(Not supported by reasoning models) Up to 4 sequences where the API will stop generating further tokens.
If set, partial message deltas will be sent. Tokens will be sent as data-only server-sent events as they become available, with the stream terminated by a data: [DONE] message.
Text content of system prompt.
What sampling temperature to use, between 0 and 2. Higher values like 0.8 will make the output more random, while lower values like 0.2 will make it more focused and deterministic. It may not work well with reasoning models.
1(Unsupported) When generating next tokens, randomly selecting the next token from the k most likely options.
An alternative to sampling with temperature, called nucleus sampling, where the model considers the results of the tokens with top_p probability mass. So 0.1 means only the tokens comprising the top 10% probability mass are considered. It is generally recommended to alter this or temperature but not both.
1Success
Bad request. The request is invalid or an invalid API key is provided.
Unprocessable Entity. There are missing fields in the request body.
Last updated