Groq API Rate Limits Explained: 429 Errors, Tiers, and Fixes

When Groq requests start failing, the first question every team asks is whether the service is down. Usually it is not. A 429 Too Many Requests response is Groq enforcing your quota, and it affects only your API key — everyone else is running fine.

That distinction matters because the fixes are completely different. An outage means failover. A rate limit means backoff, batching, or a tier upgrade. This guide covers how Groq meters usage, how to read the limits off every response, and what to change when you keep hitting the ceiling.

How Groq Meters Your Usage

Groq enforces limits across requests per minute (RPM), requests per day (RPD), tokens per minute (TPM) and tokens per day (TPD). You are throttled the moment any single one of those dimensions is exhausted, which is why an app that sends very few requests can still get 429s if each request is enormous.

The quirk that catches most teams: Groq applies limits per model, not per account. Hitting the ceiling on llama-3.3-70b-versatile does not block llama-3.1-8b-instant, which makes model-level failover the cheapest fix for bursty traffic.

Read the Rate-Limit Headers

Every Groq response carries headers describing your remaining budget. Log them and you can see a 429 coming minutes before it lands, instead of discovering it in production.

Dump them for a single call with a verbose cURL:

curl -i https://api.groq.com/openai/v1/chat/completions \
  -H "Authorization: Bearer $GROQ_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model":"llama-3.3-70b-versatile","messages":[{"role":"user","content":"ping"}]}' \
  | grep -i "ratelimit\|retry-after"

Exact numeric ceilings change as Groq adjusts capacity and pricing, so treat the headers on your own traffic as the source of truth rather than any number copied from a blog post — including this one.

Groq Rate Limit Tiers

Limits scale with account tier. The jump from the free or trial tier to a paid one is almost always the largest single increase available to you.

Current per-tier numbers live in the Groq Console (console.groq.com). Check there before assuming you need an enterprise contract — plenty of teams are throttled purely because billing was never enabled on the key.

Handling 429s Properly: Backoff with Jitter

A naive retry loop makes rate limiting worse: every throttled client retries at the same instant and the next window is exhausted immediately. Exponential backoff with jitter spreads the retries out.

async function callGroq(body, attempt = 0) {
  const res = await fetch('https://api.groq.com/openai/v1/chat/completions', {
    method: 'POST',
    headers: { 'Authorization': `Bearer ${process.env.GROQ_API_KEY}`, 'Content-Type': 'application/json' },
    body: JSON.stringify(body),
  });

  if (res.status === 429) {
    if (attempt >= 5) throw new Error('Groq rate limit: retries exhausted');
    // Respect retry-after when present, otherwise back off exponentially with jitter
    const retryAfter = Number(res.headers.get('retry-after')) || 0;
    const backoff = retryAfter * 1000 || (2 ** attempt) * 500 + Math.random() * 500;
    await new Promise((r) => setTimeout(r, backoff));
    return callGroq(body, attempt + 1);
  }

  if (res.status >= 500) throw new Error('Groq outage - fail over to a backup provider');
  return res.json();
}

Two details matter more than the loop itself. First, cap your retries — infinite retry against a daily quota just burns your own compute for hours. Second, treat 5xx differently from 429: a 429 should wait, a 500 should fail over.

Five Ways to Stop Hitting the Ceiling

Fallback Providers for Groq Overflow

Each provider maintains an independent quota pool, so overflow routing genuinely doubles your effective ceiling — unlike retries, which just re-queue against the same exhausted budget.

Rate Limit or Real Outage? A 60-Second Check

1. Read the status code. 429 is quota. 401 is a key problem. 5xx and timeouts are Groq.
2. Check the headers. If remaining requests or tokens are at zero, you have your answer.
3. Try a second key. If a different key on a different account works, the problem is your quota, not the service.
4. Check groqstatus.com and live Groq monitoring for a confirmed incident.
5. Try a smaller model. Limits are frequently per model, so a working sibling model points squarely at quota rather than infrastructure.

For the full outage-side playbook, see our Is Groq Down? Outage Checking Guide.

Frequently Asked Questions

Related Groq Guides

• Is Groq Down? Outage Checking Guide
• Groq API Monitoring Guide
• Groq vs Together AI
• API Rate Limiting: The Complete Guide
• LLM Inference API Uptime Comparison