clade-load-scale

# Anthropic Load & Scale ## Overview Scale Claude usage for high-throughput applications. Covers four strategies: Message Batches (10K requests, 50% off, no rate limits), request queues with concurrency control via p-limit, tier upgrades (Tier 1-4 + Scale), and model selection for throughput (Haiku is 3-4x faster than Sonnet). ## Scaling Strategies ## Instructions ### Step 1: Message Batches (Best for Bulk) ```typescript // 10K requests per batch, 50% cheaper, no rate limits const batch = await client.messages.batches.create({ requests: items.map((item, i) => ({ custom_id: `${i}`, params: { model: 'claude-sonnet-4-20250514', max_tokens: 1024, messages: [{ role: 'user', content: item }] }, })), }); // Process up to 100 concurrent batches ``` ### Step 2: Request Queue with Concurrency Control ```typescript import pLimit from 'p-limit'; // Match your rate limit tier const limit = pLimit(10); // 10 concurrent requests const results = await Promise.all( inputs.map(input => limit(() => client.messages.create({ model: 'claude-sonnet-4-20250514', max_tokens: 1024, messages: [{ role: 'user', content: input }], })) ) ); ``` ### Step 3: Tier Upgrades Increase your spending to unlock higher tiers: | Tier | RPM | Input TPM | How to Qualify | |------|-----|-----------|----------------| | 1 | 50 | 40K | Free | | 2 | 1,000 | 80K | $40+ total spend | | 3 | 2,000 | 160K | $200+ total spend | | 4 | 4,000 | 400K | $400+ total spend | | Scale | ...