vastai-local-dev-loop

# Vast.ai Local Dev Loop ## Overview Set up a fast, reproducible local development workflow for Vast.ai GPU workloads. Test Docker images locally, mock API responses for CI, and minimize cloud GPU costs during development. ## Prerequisites - Completed `vastai-install-auth` setup - Docker installed locally - Python 3.8+ with pytest ## Instructions ### Step 1: Project Structure ``` vastai-project/ src/ vastai_client.py # API client wrapper job_runner.py # Job orchestration logic instance_manager.py # Instance lifecycle management docker/ Dockerfile # GPU workload image requirements.txt # Python dependencies for GPU job tests/ test_client.py # Unit tests with mocked API test_job_runner.py # Integration tests conftest.py # Shared fixtures and mocks scripts/ test-connection.sh # Quick API verification benchmark-gpu.py # GPU benchmark script .env.development # Dev API key (low spending limit) .env.production # Prod API key (gitignored) ``` ### Step 2: Mock the Vast.ai API for Testing ```python # tests/conftest.py import pytest from unittest.mock import MagicMock @pytest.fixture def mock_vast_client(): client = MagicMock() client.search_offers.return_value = { "offers": [ {"id": 12345, "gpu_name": "RTX_4090", "gpu_ram": 24, "dph_total": 0.22, "reliability2": 0.99, "inet_down": 500, "ssh_host": "te...