snowflake-ci-integration

# Snowflake CI Integration ## Overview Set up CI/CD for Snowflake using SchemaChange for migrations, GitHub Actions for automation, and Terraform for infrastructure. ## Prerequisites - GitHub repository with Actions enabled - Snowflake service account with key pair auth - SchemaChange or Terraform installed ## Instructions ### Step 1: SchemaChange for Database Migrations ```bash # Install SchemaChange pip install schemachange # Directory structure migrations/ ├── V1.0.0__initial_schema.sql # Versioned (run once, in order) ├── V1.1.0__add_orders_table.sql ├── V1.2.0__add_customer_segments.sql ├── R__views.sql # Repeatable (re-run on every change) ├── R__stored_procedures.sql └── A__cleanup_temp_tables.sql # Always run ``` ```sql -- V1.0.0__initial_schema.sql CREATE DATABASE IF NOT EXISTS {{database}}; CREATE SCHEMA IF NOT EXISTS {{database}}.{{schema}}; CREATE TABLE IF NOT EXISTS {{database}}.{{schema}}.users ( id INTEGER AUTOINCREMENT, name VARCHAR(100) NOT NULL, email VARCHAR(255) UNIQUE, created_at TIMESTAMP_NTZ DEFAULT CURRENT_TIMESTAMP() ); -- V1.1.0__add_orders_table.sql CREATE TABLE IF NOT EXISTS {{database}}.{{schema}}.orders ( order_id INTEGER AUTOINCREMENT, user_id INTEGER REFERENCES {{database}}.{{schema}}.users(id), amount DECIMAL(12,2), order_date TIMESTAMP_NTZ DEFAULT CURRENT_TIMESTAMP() ); ``` ```bash # Run migrations locally schemachange deploy \ --root-folder migrations \ ...