Inference API
Chat Completions
The Chat Completions API is the stateless, OpenAI-compatible predecessor of the Responses API. New integrations should use Responses; see Migrating from Chat Completions.
Chat completions
/v1/chat/completions
Create a chat response from text/image chat prompts. This is the endpoint for making requests to chat and image understanding models.
Request Body
Response Body
choices
array
A list of response choices from the model. The length corresponds to the n in request body (default to 1).
created
integer
The chat completion creation time in Unix timestamp.
id
string
A unique ID for the chat response.
model
string
Model ID used to create chat completion.
object
string
The object type, which is always "chat.completion".
service_tier
"default" | "priority"
Processing tier for a request. Determines scheduling priority and billing.
Get deferred chat completions
/v1/chat/deferred-completion/{request_id}
Tries to fetch a result for a previously-started deferred completion. Returns 200 Success with the response body, if the request has been completed. Returns 202 Accepted when the request is pending processing.
Path parameters
request_id
string
required
The deferred request id returned by a previous deferred chat request.
Response Body
choices
array
A list of response choices from the model. The length corresponds to the n in request body (default to 1).
created
integer
The chat completion creation time in Unix timestamp.
id
string
A unique ID for the chat response.
model
string
Model ID used to create chat completion.
object
string
The object type, which is always "chat.completion".
service_tier
"default" | "priority"
Processing tier for a request. Determines scheduling priority and billing.
Last updated: September 2, 2026