cohere-rate-limits

# Cohere Rate Limits ## Overview Handle Cohere rate limits with exponential backoff, request queuing, and proactive throttling. Real rate limits from Cohere's documentation. ## Prerequisites - `cohere-ai` SDK installed - Understanding of async/await patterns ## Actual Cohere Rate Limits | Key Type | Endpoint | Rate Limit | Monthly Limit | |----------|----------|-----------|---------------| | **Trial** | Chat | 20 calls/min | 1,000 total | | **Trial** | Embed | 5 calls/min | 1,000 total | | **Trial** | Rerank | 5 calls/min | 1,000 total | | **Trial** | Classify | 5 calls/min | 1,000 total | | **Production** | All endpoints | 1,000 calls/min | Unlimited | Trial keys are free. Production keys require billing at [dashboard.cohere.com](https://dashboard.cohere.com). ## Instructions ### Step 1: Exponential Backoff with Jitter ```typescript import { CohereError, CohereTimeoutError } from 'cohere-ai'; interface RetryConfig { maxRetries: number; baseDelayMs: number; maxDelayMs: number; } const DEFAULT_RETRY: RetryConfig = { maxRetries: 5, baseDelayMs: 1000, maxDelayMs: 60_000, }; async function withBackoff<T>( operation: () => Promise<T>, config = DEFAULT_RETRY ): Promise<T> { for (let attempt = 0; attempt <= config.maxRetries; attempt++) { try { return await operation(); } catch (err) { if (attempt === config.maxRetries) throw err; // Only retry on rate limits (429) and server errors (5xx) let shouldRetry = false; le...