openevidence-observability

# OpenEvidence Observability ## Overview OpenEvidence delivers clinical evidence queries where response accuracy and freshness have direct patient safety implications. Monitor query response times to ensure clinicians get timely answers, track evidence freshness to catch stale citations, and audit every query for compliance. Observability must also verify citation accuracy and maintain complete audit logs for regulatory requirements (HIPAA, clinical decision support standards). ## Key Metrics | Metric | Type | Target | Alert Threshold | |--------|------|--------|-----------------| | Query response time p95 | Histogram | < 3s | > 8s | | Evidence freshness | Gauge | < 7 days median | > 30 days | | Citation accuracy rate | Gauge | > 95% | < 90% | | API error rate | Gauge | < 0.5% | > 2% | | Audit log completeness | Gauge | 100% | < 99.9% | | Daily query volume | Counter | Within quota | > 90% quota | ## Instrumentation ```typescript async function trackClinicalQuery(queryType: string, fn: () => Promise<any>) { const start = Date.now(); const traceId = crypto.randomUUID(); try { const result = await fn(); metrics.histogram('openevidence.query.latency', Date.now() - start, { queryType }); metrics.increment('openevidence.query.total', { queryType }); auditLog.record({ traceId, queryType, status: 'ok', latency: Date.now() - start }); return result; } catch (err) { metrics.increment('openevidence.query.errors', { queryType, error: err.code }); ...