dt-obs-genai
FeaturedAnalyzes observability signals from customer GenAI applications with DQL. Reads OpenTelemetry GenAI spans and LLM evaluation bizevents. Use for: golden signals (traffic, errors, latency, saturation); LLM signals (model, provider, tokens); cost/token analytics, usage attribution, and prompt caching; agent signals (tool calls, steps, failures, loop detection, Smartscape topology); conversation/session analytics; guardrails (blocked/truncated responses); and evaluation signals (quality, pass/fail). Trigger: "LLM latency", "token usage by model", "cost by model and provider", "cost per conversation", "who is driving token spend", "do I have prompt caching", "failing agent tool calls", "find runaway agents", "responses truncated or blocked", "failed evaluations", "am I hitting rate limits", "token throughput / TPM", "provider throttling or 429s". Do NOT use for: Davis CoPilot/MCP telemetry (dt-platform), generic service metrics (dt-obs-services), logs (dt-obs-logs), or non-GenAI tracing (dt-obs-tracing).
Install
Quality Score: 89/100
Skill Content
Details
- Author
- Dynatrace
- Repository
- Dynatrace/dynatrace-for-ai
- Created
- 5 months ago
- Last Updated
- 2 days ago
- Language
- JavaScript
- License
- Apache-2.0
Bundled in these plugins
Similar Skills
Semantically similar based on skill content — not just same category
agent-observability
Instrument AI agents with tracing, token metrics, latency, and cost visibility. Use for reliability and debugging.
instrument-llm-observability
Use this when adding tracing/observability to an LLM or AI-agent application - capturing prompts, tool calls, token usage, latency, and cost per step. Trigger whenever someone wants to "add tracing", "instrument", "monitor", "see what my agent is doing", or debug an LLM app in production. Prefer vendor-neutral OpenTelemetry unless a specific platform is already in use.
grafana-llmops-forge
Runs end-to-end AI/LLM observability on any Grafana (OSS, Cloud, Enterprise) with a single prerequisite, a reachable Grafana. Auto-discovers the instance and which LLM telemetry dialects exist (OpenTelemetry GenAI gen_ai.*, LiteLLM, vLLM, TGI, GPU/DCGM, eval scores), then generates and deploys dashboards (FinOps and cost by provider origin across US/EU/Asia, gateway SLOs, agent and RAG tracing, adoption, quality evaluations, self-hosted inference, and governance evidence read against the EU AI Act, ISO/IEC 42001 and NIST AI RMF). Also emits burn-rate SLO alerts, cost recording rules for Prometheus or the Prometheus Operator, English or French labels, and a visual verification pass. Use it whenever the user mentions Grafana, dashboards, AI or LLM monitoring, token costs, AI FinOps, LLMOps, agents or RAG, model adoption, AI Act, ISO 42001 or NIST AI RMF evidence, or Prometheus/Loki/Tempo applied to AI, even without the word dashboard, or to audit a stack emitting nothing yet.