Cohere API Rate Limits Explained: 429 Errors, Tiers, and Fixes

When Cohere requests start failing, the first question every team asks is whether the service is down. Usually it is not. A 429 Too Many Requests response is Cohere enforcing your quota, and it affects only your API key — everyone else is running fine.

That distinction matters because the fixes are completely different. An outage means failover. A rate limit means backoff, batching, or a tier upgrade. This guide covers how Cohere meters usage, how to read the limits off every response, and what to change when you keep hitting the ceiling.

How Cohere Meters Your Usage

Cohere enforces limits across calls per minute, applied separately to each endpoint family (chat, embed, rerank, classify). You are throttled the moment any single one of those dimensions is exhausted, which is why an app that sends very few requests can still get 429s if each request is enormous.

The quirk that catches most teams: Cohere applies separate limits per endpoint family. A RAG pipeline can be throttled on Embed while Chat is still completely healthy, which looks like a partial outage but is really two independent quotas. Instrument each endpoint separately.

Read the Rate-Limit Headers

Every Cohere response carries headers describing your remaining budget. Log them and you can see a 429 coming minutes before it lands, instead of discovering it in production.

Dump them for a single call with a verbose cURL:

curl -i https://api.cohere.com/v2/chat \
  -H "Authorization: Bearer $COHERE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"command-a-03-2025","messages":[{"role":"user","content":"ping"}]}' \
  | grep -i "ratelimit\|retry-after"

Exact numeric ceilings change as Cohere adjusts capacity and pricing, so treat the headers on your own traffic as the source of truth rather than any number copied from a blog post — including this one.

Cohere Rate Limit Tiers

Limits scale with account tier. The jump from the free or trial tier to a paid one is almost always the largest single increase available to you.

Current per-tier numbers live in the Cohere dashboard (dashboard.cohere.com). Check there before assuming you need an enterprise contract — plenty of teams are throttled purely because billing was never enabled on the key.

Handling 429s Properly: Backoff with Jitter

A naive retry loop makes rate limiting worse: every throttled client retries at the same instant and the next window is exhausted immediately. Exponential backoff with jitter spreads the retries out.

async function callCohere(body, attempt = 0) {
  const res = await fetch('https://api.cohere.com/v2/chat', {
    method: 'POST',
    headers: { 'Authorization': `Bearer ${process.env.COHERE_API_KEY}`, 'Content-Type': 'application/json' },
    body: JSON.stringify(body),
  });

  if (res.status === 429) {
    if (attempt >= 5) throw new Error('Cohere rate limit: retries exhausted');
    // Respect retry-after when present, otherwise back off exponentially with jitter
    const retryAfter = Number(res.headers.get('retry-after')) || 0;
    const backoff = retryAfter * 1000 || (2 ** attempt) * 500 + Math.random() * 500;
    await new Promise((r) => setTimeout(r, backoff));
    return callCohere(body, attempt + 1);
  }

  if (res.status >= 500) throw new Error('Cohere outage - fail over to a backup provider');
  return res.json();
}

Two details matter more than the loop itself. First, cap your retries — infinite retry against a daily quota just burns your own compute for hours. Second, treat 5xx differently from 429: a 429 should wait, a 500 should fail over.

Five Ways to Stop Hitting the Ceiling

Fallback Providers for Cohere Overflow

Each provider maintains an independent quota pool, so overflow routing genuinely doubles your effective ceiling — unlike retries, which just re-queue against the same exhausted budget.

Rate Limit or Real Outage? A 60-Second Check

1. Read the status code. 429 is quota. 401 is a key problem. 5xx and timeouts are Cohere.
2. Check the headers. If remaining requests or tokens are at zero, you have your answer.
3. Try a second key. If a different key on a different account works, the problem is your quota, not the service.
4. Check status.cohere.com and live Cohere monitoring for a confirmed incident.
5. Try a smaller model. Limits are frequently per model, so a working sibling model points squarely at quota rather than infrastructure.

For the full outage-side playbook, see our Is Cohere Down? Outage Checking Guide.

Frequently Asked Questions

Related Cohere Guides

• Is Cohere Down? Outage Checking Guide
• Cohere API Monitoring Guide
• Mistral vs Cohere
• API Rate Limiting: The Complete Guide
• LLM Inference API Uptime Comparison