batchwatch

batchwatch › Questions › How long does the OpenAI batch API take?

How long does the OpenAI batch API take?

Between 50s and 61s, depending on the model.

The answer

We have measured this. Across the 3 OpenAI models we have enough completions for, the median wait ranges from 50s (gpt-5-nano) to 61s (gpt-5.6-luna). Nine in ten gpt-5-nano jobs finished within 29 min. Every figure carries n and a confidence grade on its own page.

OpenAI promises only "within 24 hours" - a ceiling, not a typical wait. The measured medians above are what jobs actually get, and they are why batching is worth the wait for most workloads.

Every model we have measured

Every OpenAI model we have enough completions to publish a percentile for. Most predictable first - spread is p90 over p50.

ModelMedian (p50) p90Spreadn
OpenAI gpt-5.6-sol 51s 57s 1.1x 1728
OpenAI gpt-5.6-luna 61s 4 min 3.7x 3332
OpenAI gpt-5-nano 50s 29 min 34.2x 3891

Each row is measured over the last 30 days, and links to that model's own page with its full distribution and confidence grade. A model we have not yet measured enough of to stand behind a percentile is left out entirely - never filled in with an estimate.

How predictable is it?

1.1x spread - p90 over p50

How much longer the slow tail runs than the typical job. Nearer 1× is more predictable.

Half of gpt-5.6-sol jobs finished within 51s, and nine in ten within 57s - a spread of 1.1x. The tail sits close to the middle, so what you measure once is close to what you get again, and sizing a deadline against the tail costs almost nothing. It is the tightest distribution we measure across every model on the site - the most predictable batch queue we have found.

Spread is p90 divided by p50, both measured here over the last 30 days. No provider publishes it; it is the number that tells you whether a median is safe to plan on.

The full numbers, per model

Questions this answers

How long does the OpenAI batch API actually take?
It depends on the model. The median ranges from 50s (gpt-5-nano) to 61s (gpt-5.6-luna) across the 3 models we have measured, over the last 30 days.
Is that faster than OpenAI's 24-hour window?
Far faster for the typical job. OpenAI guarantees completion within 24 hours; the measured medians above are minutes, not hours. The 24-hour window is the contract, not the experience.
Which OpenAI model is fastest for batch?
Measured over the last 30 days: gpt-5-nano at a median of 50s (p90 29 min, spread 34.2x); gpt-5.6-sol at a median of 51s (p90 57s, spread 1.1x); gpt-5.6-luna at a median of 61s (p90 4 min, spread 3.7x). Each model has its own page with the full distribution.

See it live

Every number here is measured, and it is all public.

The live dashboard shows every model with its distribution, n and confidence grade. /v1/coverage is the same data as JSON, no key required. Send five measurements in seven days and the delay is gone: you read every figure live, and the decision endpoints open (/v1/should-i-batch, /v1/estimate-batchtime).

More questions we have measured the answer to