databricks-debug-bundle

# Databricks Debug Bundle ## Current State !`databricks --version 2>/dev/null || echo 'CLI not installed'` !`python3 -c "import databricks.sdk; print(f'SDK {databricks.sdk.__version__}')" 2>/dev/null || echo 'SDK not installed'` ## Overview Collect all diagnostic information needed for Databricks support tickets: environment info, cluster state, cluster events, job run details, Spark driver logs, and Delta table history. Produces a redacted tar.gz bundle safe to share with support. ## Prerequisites - Databricks CLI installed and configured - Access to cluster logs (admin or cluster owner) - Permission to access job run details ## Instructions ### Step 1: Create Debug Collection Script ```bash #!/bin/bash set -euo pipefail # databricks-debug-bundle.sh [cluster_id] [run_id] [table_name] BUNDLE_DIR="databricks-debug-$(date +%Y%m%d-%H%M%S)" mkdir -p "$BUNDLE_DIR" CLUSTER_ID="${1:-}" RUN_ID="${2:-}" TABLE_NAME="${3:-}" echo "=== Databricks Debug Bundle ===" | tee "$BUNDLE_DIR/summary.txt" echo "Generated: $(date -u +%Y-%m-%dT%H:%M:%SZ)" >> "$BUNDLE_DIR/summary.txt" echo "Workspace: ${DATABRICKS_HOST:-unset}" >> "$BUNDLE_DIR/summary.txt" ``` ### Step 2: Collect Environment Info ```bash { echo "" echo "--- Environment ---" echo "CLI: $(databricks --version 2>&1)" echo "SDK: $(pip show databricks-sdk 2>/dev/null | grep Version || echo 'not installed')" echo "Python: $(python3 --version 2>&1)" echo "OS: $(uname -srm)" echo "" echo "--- Current ...