perplexity-incident-runbook

# Perplexity Incident Runbook ## Overview Rapid incident response for Perplexity Sonar API issues. Perplexity-specific: the API depends on live web search, so outages can be partial (search degraded but API responding), model-specific (sonar-pro down but sonar working), or citation-related (answers returned but no sources). ## Severity Levels | Level | Definition | Response Time | Example | |-------|-----------|--------------|---------| | P1 | Complete API failure | < 15 min | All requests returning 500/503 | | P2 | Degraded service | < 1 hour | High latency, 429 rate limits, no citations | | P3 | Minor impact | < 4 hours | Single model unavailable, sporadic errors | | P4 | No user impact | Next business day | Monitoring gap, stale cache | ## Quick Triage (Run Immediately) ```bash set -euo pipefail echo "=== Perplexity Triage ===" # 1. Test sonar model echo -n "sonar: " curl -s -w "HTTP %{http_code} in %{time_total}s" -o /dev/null \ -H "Authorization: Bearer $PERPLEXITY_API_KEY" \ -H "Content-Type: application/json" \ -d '{"model":"sonar","messages":[{"role":"user","content":"test"}],"max_tokens":5}' \ https://api.perplexity.ai/chat/completions echo "" # 2. Test sonar-pro model echo -n "sonar-pro: " curl -s -w "HTTP %{http_code} in %{time_total}s" -o /dev/null \ -H "Authorization: Bearer $PERPLEXITY_API_KEY" \ -H "Content-Type: application/json" \ -d '{"model":"sonar-pro","messages":[{"role":"user","content":"test"}],"max_tokens":5}' \ https://api.perpl...