Inference API

Batches

View as Markdown

List batches

/v1/batches


Get batch

/v1/batches/{batch_id}


List batch requests in a batch

/v1/batches/{batch_id}/requests


Add batch requests to a batch

/v1/batches/{batch_id}/requests


Get processing results of a batch

/v1/batches/{batch_id}/results


Cancel processing on a batch

/v1/batches/{batch_id}:cancel


Did you find this page helpful?