Inference API

Chat Completions

The Chat Completions API is the stateless, OpenAI-compatible predecessor of the Responses API. New integrations should use Responses; see Migrating from Chat Completions.


Chat completions

/v1/chat/completions

Create a chat response from text/image chat prompts. This is the endpoint for making requests to chat and image understanding models.

Request Body

Response Body

choices

array

A list of response choices from the model. The length corresponds to the n in request body (default to 1).

created

integer

The chat completion creation time in Unix timestamp.

id

string

A unique ID for the chat response.

model

string

Model ID used to create chat completion.

object

string

The object type, which is always "chat.completion".

service_tier

"default" | "priority"

Processing tier for a request. Determines scheduling priority and billing.


Get deferred chat completions

/v1/chat/deferred-completion/{request_id}

Tries to fetch a result for a previously-started deferred completion. Returns 200 Success with the response body, if the request has been completed. Returns 202 Accepted when the request is pending processing.

Path parameters

request_id

string

required

The deferred request id returned by a previous deferred chat request.

Response Body

choices

array

A list of response choices from the model. The length corresponds to the n in request body (default to 1).

created

integer

The chat completion creation time in Unix timestamp.

id

string

A unique ID for the chat response.

model

string

Model ID used to create chat completion.

object

string

The object type, which is always "chat.completion".

service_tier

"default" | "priority"

Processing tier for a request. Determines scheduling priority and billing.


Last updated: September 2, 2026