Planning AI API capacity without the guesswork
TPM vs RPM — what is the difference?
TPM (tokens per minute) budgets the total tokens — input and output — your account can process each minute. RPM (requests per minute) budgets how many separate calls you can make, regardless of their size. Providers enforce both simultaneously, so your true ceiling is whichever empties first. Large requests hit the TPM wall; a flood of tiny requests hits the RPM wall.
How many concurrent users can a tier hold?
Take the binding requests-per-minute ceiling and divide by how many requests each active user makes per minute. If TPM allows 150 req/min and RPM allows 500 req/min, TPM binds at 150 — and at one request per user per minute that is 150 concurrent users. Halve the per-user rate and you double the users; double the tokens per request and you roughly halve them.
Why do 429 errors appear below my request limit?
A 429 Too Many Requests fires when you cross either limit. You can sit well under RPM and still get throttled because your requests are large and you exhausted the TPM budget instead. Long completions are the usual culprit — output tokens count toward TPM. The table above shows exactly which limit you are hitting at your workload.
Is my data sent anywhere?
No. This calculator runs entirely in your browser. Nothing you enter is uploaded, logged, or stored.