clay-reliability-patterns

# Clay Reliability Patterns ## Overview Production reliability patterns for Clay data enrichment pipelines. Clay's async enrichment model, credit-based billing, and dependency on 150+ external data providers require specific resilience strategies: credit budget circuit breakers, webhook delivery tracking, dead letter queues for failed batches, and graceful degradation when Clay is unavailable. ## Prerequisites - Clay integration in production or pre-production - Redis or similar for state tracking - Understanding of Clay's async enrichment model - Monitoring infrastructure (see `clay-observability`) ## Instructions ### Step 1: Credit Budget Circuit Breaker Stop processing when credit burn exceeds budget to prevent runaway costs: ```typescript // src/clay/circuit-breaker.ts class CreditCircuitBreaker { private state: 'closed' | 'open' | 'half-open' = 'closed'; private dailyCreditsUsed = 0; private failureCount = 0; private lastFailureAt: Date | null = null; private readonly cooldownMs: number; constructor( private dailyLimit: number, private failureThreshold: number = 5, cooldownMinutes: number = 15, ) { this.cooldownMs = cooldownMinutes * 60 * 1000; } canProcess(estimatedCredits: number): { allowed: boolean; reason?: string } { // Check circuit state if (this.state === 'open') { // Check if cooldown has elapsed if (this.lastFailureAt && Date.now() - this.lastFailureAt.getTime() > this.cooldownMs) { this.s...