coderabbit-observability

# CodeRabbit Observability ## Overview Monitor CodeRabbit AI code review effectiveness, review latency, and team adoption. Key metrics include time-to-first-review (how fast CodeRabbit posts after PR creation), comment acceptance rate (comments resolved vs dismissed), review coverage (percentage of PRs reviewed), and per-repository review volume. ## Prerequisites - CodeRabbit installed on GitHub/GitLab organization - GitHub CLI (`gh`) authenticated with org access - Access to CodeRabbit dashboard at app.coderabbit.ai ## Key Metrics | Metric | Target | Why It Matters | |--------|--------|----------------| | Review coverage | > 90% | PRs without review = blind spots | | Time-to-review | < 5 min | Fast feedback keeps developers in flow | | Comment acceptance | > 40% | Low acceptance = noisy reviews | | Comments per PR | 3-8 | Too many = fatigue, too few = not useful | | Review state: APPROVED | > 60% | High approval = clean code culture | ## Instructions ### Step 1: Measure Review Coverage ```bash #!/bin/bash # coderabbit-coverage.sh - Review coverage for a repo set -euo pipefail ORG="${1:?Usage: $0 <org> <repo> [days]}" REPO="${2:?Usage: $0 <org> <repo> [days]}" DAYS="${3:-30}" echo "=== CodeRabbit Review Coverage ===" echo "Repository: $ORG/$REPO" echo "Period: Last $DAYS days" echo "" TOTAL=0 REVIEWED=0 APPROVED=0 CHANGES_REQUESTED=0 SINCE=$(date -d "$DAYS days ago" +%Y-%m-%dT%H:%M:%SZ 2>/dev/null || date -v-${DAYS}d +%Y-%m-%dT%H:%M:%SZ) for PR_NUM in $(gh api "rep...