databricks-prod-checklist

# Databricks Production Checklist ## Overview Complete checklist for deploying Databricks jobs and pipelines to production. Covers security hardening, infrastructure validation, code quality gates, job configuration, deployment commands, monitoring setup, and rollback procedures. ## Prerequisites - Staging environment tested and verified - Production workspace access with service principal - Unity Catalog configured with prod catalogs - Monitoring and alerting ready (see `databricks-observability`) ## Instructions ### Step 1: Pre-Deployment Security - [ ] Service principal configured for automated runs (not personal PAT) - [ ] Secrets in Databricks Secret Scopes (not env vars or hardcoded) - [ ] Token expiration set (max 90 days) - [ ] Unity Catalog grants follow least privilege - [ ] Cluster policies enforced for cost/security guardrails - [ ] IP access lists configured in Admin Console - [ ] Audit logging verified via `system.access.audit` ### Step 2: Infrastructure Validation - [ ] Instance pool created for fast cluster startup - [ ] Node types validated for workload (compute-optimized for streaming, memory-optimized for ML) - [ ] Autoscaling configured with sensible min/max workers - [ ] Spot instances enabled for worker nodes (on-demand for driver) - [ ] Auto-termination disabled for job clusters (they terminate on completion) ```bash # Verify infrastructure databricks clusters list-node-types --output json | jq '.[0:5] | .[].node_type_id' databricks instance-pools...