anth-load-scale

# Anthropic Load & Scale ## Overview Capacity planning and load testing for Claude API integrations. Key constraint: your rate limits (RPM/ITPM/OTPM) are the ceiling, not your infrastructure. ## Capacity Planning ```python # Calculate required tier based on traffic def plan_capacity( requests_per_minute: int, avg_input_tokens: int, avg_output_tokens: int, model: str = "claude-sonnet-4-20250514" ) -> dict: itpm = requests_per_minute * avg_input_tokens otpm = requests_per_minute * avg_output_tokens # Estimate monthly cost pricing = { "claude-haiku-4-20250514": (0.80, 4.00), "claude-sonnet-4-20250514": (3.00, 15.00), "claude-opus-4-20250514": (15.00, 75.00), } rates = pricing[model] cost_per_request = (avg_input_tokens * rates[0] + avg_output_tokens * rates[1]) / 1_000_000 monthly_cost = cost_per_request * requests_per_minute * 60 * 24 * 30 return { "rpm_needed": requests_per_minute, "itpm_needed": itpm, "otpm_needed": otpm, "cost_per_request": f"${cost_per_request:.4f}", "monthly_estimate": f"${monthly_cost:,.0f}", "recommendation": "Contact Anthropic sales for Scale tier" if requests_per_minute > 500 else "Self-serve tiers sufficient", } print(plan_capacity(100, 500, 200)) ``` ## Load Testing Script ```python import anthropic import asyncio import time from dataclasses import dataclass @dataclass class LoadTestResult: total_requests: int...