qa-observability

Solid

Implement OpenTelemetry logs/metrics/traces, SLI/SLO gates, burn-rate alerts, and APM integrations. Use when adding or validating observability.

AI & Automation 80 stars 17 forks Updated 1 weeks ago MIT

Install

View on GitHub

Quality Score: 83/100

Stars 20%
64
Recency 20%
90
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# QA Observability and Performance Engineering Use telemetry (logs, metrics, traces, profiles) as a QA signal and a debugging substrate. Core references (see `data/sources.json`): OpenTelemetry, W3C Trace Context, and SLO practices (Google SRE). ## Quick Start (Default) If key context is missing, ask for: critical user journeys, service/dependency inventory, environments (local/staging/prod), current telemetry stack, and current SLO/SLA commitments (if any). 1. Establish the minimum bar: correlation IDs + structured logs + traces + golden metrics (latency, traffic, errors, saturation). 2. Verify propagation: confirm `traceparent` (and your request ID) flow across boundaries end-to-end. 3. Make failures diagnosable: every test failure captures a trace link (or trace ID) plus the correlated logs. 4. Define SLIs/SLOs and error budget policy; wire burn-rate alerts (prefer multi-window burn rates). 5. Produce artifacts: a readiness checklist plus an SLO definition and alert rules (use `assets/checklists/template-observability-readiness-checklist.md` and `assets/monitoring/slo/*`). ## Default QA stance - Treat telemetry as part of acceptance criteria (especially for integration/E2E tests). - Require correlation: request_id + trace_id (traceparent) across boundaries. - Prefer SLO-based release gating and burn-rate alerting over raw infra thresholds. - Budget overhead: sampling, cardinality, retention, and cost are quality constraints. - Redact PII/secrets by default (logs and...

Details

Author
vasilyu1983
Repository
vasilyu1983/AI-Agents-public
Created
9 months ago
Last Updated
1 weeks ago
Language
Python
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

observability

Use for observability, logs, metrics, traces, health checks, dashboards, alerts, SLOs.

1 Updated today
kreek
AI & Automation Listed

sota-observability

State-of-the-art observability and reliability engineering (2026). Use when instrumenting code (structured logging, metrics, distributed tracing with OpenTelemetry, SLOs, alerting, health endpoints) or auditing an existing codebase's observability posture (can on-call answer "why is this request slow?" and "what broke at 3am?"). Not for security detections, SIEM, or threat hunting — use sota-detection-engineering. Triggers: logging, metrics, tracing, monitoring, alerting, SLO, SLI, error budget, OpenTelemetry, OTel, Prometheus, Grafana, debugging production, incident, on-call, telemetry, instrumentation, health check, runbook, Sentry, crash reporting, profiling.

15 Updated today
martinholovsky
AI & Automation Listed

observability

Production observability done right — structured logs, distributed traces, metrics, alerting, SLO/SLI. Use when adding logging to a new service, designing dashboards, choosing between OpenTelemetry / Datadog / Grafana stack, defining SLOs for a feature, writing alert rules, or untangling a noisy alert channel. Stack-agnostic; recipes target OpenTelemetry as the canonical instrumentation, Prometheus + Grafana / Datadog as the canonical backends. Pairs with performance (perf budgets), security-web (audit logs), and incident-response (alert → runbook).

5 Updated today
kouroshez