Page cover
For the complete documentation index, see llms.txt. This page is also available as Markdown.

Chat Completion

Create a chat completion

post
Authorizations
AuthorizationstringRequired
Bearer authentication header of the form Bearer <token>.
Body
modelstringRequired
timeoutany ofOptionalDefault: null
numberOptional
or
integerOptional
or
nullOptional
temperatureany ofOptionalDefault: null
numberOptional
or
nullOptional
top_pany ofOptionalDefault: null
numberOptional
or
nullOptional
nany ofOptionalDefault: null
integerOptional
or
nullOptional
streamany ofOptionalDefault: null
booleanOptional
or
nullOptional
stopany ofOptionalDefault: null
objectOptional
or
nullOptional
max_tokensany ofOptionalDefault: null
integerOptional
or
nullOptional
presence_penaltyany ofOptionalDefault: null
numberOptional
or
nullOptional
frequency_penaltyany ofOptionalDefault: null
numberOptional
or
nullOptional
logit_biasany ofOptionalDefault: null
objectOptional
or
nullOptional
userany ofOptionalDefault: null
stringOptional
or
nullOptional
seedany ofOptionalDefault: null
integerOptional
or
nullOptional
tool_choicestring · enumOptional

Controls whether the model calls a tool. auto lets the model decide, none disables tool calls, required forces the model to call a tool.

Possible values:
logprobsany ofOptionalDefault: null
booleanOptional
or
nullOptional
top_logprobsany ofOptionalDefault: null
integerOptional
or
nullOptional
functionsany ofOptionalDefault: null
string[]Optional
or
nullOptional
function_callany ofOptionalDefault: null
stringOptional
or
nullOptional
Responses
200

Chat completion result. When stream: true, the response is returned as text/event-stream instead of JSON, with OpenAI-style data: {chunk}\n\n framing terminated by data: [DONE]\n\n.

application/json
objectOptional

OpenAI-compatible chat completion response. Standard fields (id, object, created, model, choices, usage) are returned; provider-specific extras are stripped before responding.

post
/v1/chat/completions

Last updated