perplexity-data-handling

# Perplexity Data Handling ## Overview Manage data flowing through Perplexity Sonar API. Critical concern: queries are sent to Perplexity for web search, so any PII in queries is exposed to external infrastructure. Responses contain citations (third-party URLs) that must be validated before displaying to users. ## Data Flow ``` User Input → Query Sanitization → Perplexity API → Response Parsing │ ┌─────────────┼──────────────┐ │ │ │ Answer Text Citations Search Results │ │ │ Format & Validate & Store for Display Deduplicate Analytics ``` ## Prerequisites - Perplexity API key configured - Understanding of PII regulations (GDPR/CCPA) - Cache storage (Redis or in-memory) ## Instructions ### Step 1: Query Sanitization ```typescript function sanitizeQuery(query: string): { clean: string; redacted: boolean } { let clean = query; let redacted = false; const patterns: Array<[RegExp, string]> = [ [/\b[\w.+-]+@[\w-]+\.[\w.]+\b/g, "[email]"], [/\b\d{3}[-.]?\d{3}[-.]?\d{4}\b/g, "[phone]"], [/\b\d{3}-\d{2}-\d{4}\b/g, "[ssn]"], [/\b\d{4}[\s-]?\d{4}[\s-]?\d{4}[\s-]?\d{4}\b/g, "[card]"], [/\b(p...