groq-rate-limits

Featured

Implement Groq rate limit handling with backoff, queuing, and header parsing. Use when handling rate limit errors, implementing retry logic, or optimizing API request throughput for Groq. Trigger with phrases like "groq rate limit", "groq throttling", "groq 429", "groq retry", "groq backoff".

AI & Automation 2,266 stars 315 forks Updated today MIT

Install

View on GitHub

Quality Score: 99/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Groq Rate Limits ## Overview Handle Groq rate limits using the `retry-after` header, exponential backoff, and request queuing. Groq enforces limits at the organization level with both RPM (requests/minute) and TPM (tokens/minute) constraints -- hitting either one triggers a `429`. ## Rate Limit Structure Groq rate limits vary by plan and model. Limits are applied simultaneously -- you must stay under both RPM and TPM. | Constraint | Description | |-----------|-------------| | RPM | Requests per minute | | RPD | Requests per day | | TPM | Tokens per minute | | TPD | Tokens per day | Free tier limits are significantly lower than paid tier. Check your current limits at [console.groq.com/settings/limits](https://console.groq.com/settings/limits). ## Rate Limit Response Headers When Groq responds (even on success), it includes these headers: | Header | Description | |--------|-------------| | `x-ratelimit-limit-requests` | Max requests in current window | | `x-ratelimit-limit-tokens` | Max tokens in current window | | `x-ratelimit-remaining-requests` | Requests remaining before limit | | `x-ratelimit-remaining-tokens` | Tokens remaining before limit | | `x-ratelimit-reset-requests` | Time until request limit resets | | `x-ratelimit-reset-tokens` | Time until token limit resets | | `retry-after` | Seconds to wait (only on 429 responses) | ## Instructions ### Step 1: Parse Rate Limit Headers ```typescript import Groq from "groq-sdk"; interface RateLimitInfo { limitReque...

Details

Author
jeremylongshore
Repository
jeremylongshore/claude-code-plugins-plus-skills
Created
7 months ago
Last Updated
today
Language
Python
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Featured

groq-observability

Set up observability for Groq integrations: latency histograms, token throughput, rate limit gauges, cost tracking, and Prometheus alerts. Trigger with phrases like "groq monitoring", "groq metrics", "groq observability", "monitor groq", "groq alerts", "groq dashboard".

2,266 Updated today
jeremylongshore
AI & Automation Featured

apollo-rate-limits

Implement Apollo.io rate limiting and backoff. Use when handling rate limits, implementing retry logic, or optimizing API request throughput. Trigger with phrases like "apollo rate limit", "apollo 429", "apollo throttling", "apollo backoff", "apollo request limits".

2,266 Updated today
jeremylongshore
AI & Automation Featured

groq-common-errors

Diagnose and fix Groq API errors with real error codes and solutions. Use when encountering Groq errors, debugging failed requests, or troubleshooting integration issues. Trigger with phrases like "groq error", "fix groq", "groq not working", "debug groq", "groq 429".

2,266 Updated today
jeremylongshore
AI & Automation Featured

gamma-rate-limits

Understand and manage Gamma API rate limits effectively. Use when hitting rate limits, optimizing API usage, or implementing request queuing systems. Trigger with phrases like "gamma rate limit", "gamma quota", "gamma 429", "gamma throttle", "gamma request limits".

2,266 Updated today
jeremylongshore
AI & Automation Featured

apify-rate-limits

Handle Apify API rate limits with proper backoff and request queuing. Use when hitting 429 errors, optimizing API request throughput, or implementing rate-aware client wrappers. Trigger: "apify rate limit", "apify throttling", "apify 429", "apify retry", "apify backoff", "too many requests apify".

2,266 Updated today
jeremylongshore