What a million-document LLM batch job costs in API fees
Cheapest listed price for this workload
$87.00 a month
DeepSeek V4 Flash (0731) at DeepInfra. $0.09 per 1,000 requests.
You're running a model over a large pile of documents: classifying, extracting or summarising. At our example volume, the cheapest open model we track costs $87.00 a month in API fees, from the API prices we checked on 2026-11-02. Your bill scales with your volume, so the cost per 1,000 requests is the number to carry over.
Every model we track, cheapest first
Monthly API cost at the example volume, USD. Sorted by price only: we don't rank quality, so test the cheap ones on your own prompts.
| Model | Cheapest at | Monthly | Per 1,000 requests | Priciest listing | Providers |
|---|---|---|---|---|---|
| DeepSeek V4 Flash (0731) | DeepInfra | $87.00 | $0.09 | $169.00 | 2 |
| gpt-oss-20b | Groq | $120.00 | $0.12 | $120.00 | 1 |
| Llama 3.3 70B | DeepInfra | $148.00 | $0.15 | $1,196.00 | 2 |
| Qwen3 235B A22B Instruct 2507 | DeepInfra | $172.50 | $0.17 | $290.00 | 2 |
| gpt-oss-120b | Baseten | $175.00 | $0.18 | $240.00 | 4 |
| GLM-5.3 Flash | Baseten | $225.00 | $0.23 | $225.00 | 3 |
| DeepSeek V4.1 Flash | Baseten | $480.00 | $0.48 | $480.00 | 2 |
| Nemotron 3 Ultra | DeepInfra | $830.00 | $0.83 | $960.00 | 3 |
| GLM-5.3 | Baseten | $2,060.00 | $2.06 | $2,060.00 | 3 |
| Kimi K3 | DeepInfra | $4,987.50 | $4.99 | $5,250.00 | 4 |
The example volume: 1,000,000 documents a month, each sending about 1,000 input tokens and getting about 150 output tokens back. These are standard per-token list prices; a provider's batch tier, if it has one, isn't included. That is 1,000 M input and 150 M output tokens a month. Each model links to its page with every provider's input and output price and a link to that provider's own pricing page.
Self-hosting starts with $2,109.70 a month of rent
The cheapest NVIDIA H100 cloud VM we list is $2.89 per hour at RunPod, or $2,109.70 for 730 hours. The rent alone is about 24 times the cheapest API bill, so at this volume the API is cheaper; your traffic would have to grow by that much before one GPU's rent matched the API bill. That's rent only: it leaves out engineering time and idle hours, and whether one GPU can serve your traffic depends on the model, its size and your serving engine. Bigger models need several GPUs. Put your own throughput into the break-even calculator before you decide.