clay-load-scale

# Clay Load & Scale ## Overview Strategies for processing 10K-100K+ leads through Clay monthly. Clay is a hosted platform -- you can't add servers. Scaling focuses on: table partitioning, webhook management, batch submission pacing, credit budgeting at scale, and multi-table architectures. ## Prerequisites - Clay Growth or Enterprise plan - Understanding of Clay's credit model (Data Credits + Actions) - Queue infrastructure for batch processing (Redis, SQS, or BullMQ) - Monitoring for credit consumption ## Instructions ### Step 1: Capacity Planning ```typescript // src/clay/capacity-planner.ts interface CapacityPlan { monthlyLeads: number; creditsPerLead: number; totalCreditsNeeded: number; planRequired: string; estimatedMonthlyCost: number; webhooksNeeded: number; // Each webhook has 50K lifetime limit tablesRecommended: number; } function planCapacity(monthlyLeads: number, creditsPerLead = 6): CapacityPlan { const totalCredits = monthlyLeads * creditsPerLead; // Determine plan let plan: string, cost: number; if (totalCredits <= 2500) { plan = 'Launch ($185/mo)'; cost = 185; } else if (totalCredits <= 6000) { plan = 'Growth ($495/mo)'; cost = 495; } else { plan = `Enterprise (custom pricing for ${totalCredits} credits/mo)`; cost = 495 + Math.ceil((totalCredits - 6000) / 1000) * 50; // Rough estimate } // With own API keys: 0 data credits, only actions consumed console.log(`TIP: With own API keys, you ne...