coreweave-hello-world

# CoreWeave Hello World ## Overview Deploy your first GPU workload on CoreWeave: a simple inference service using vLLM or a batch CUDA job. CoreWeave runs Kubernetes on bare-metal GPU nodes with A100, H100, and L40 GPUs. ## Prerequisites - Completed `coreweave-install-auth` setup - kubectl configured with CoreWeave kubeconfig - Namespace with GPU quota ## Instructions ### Step 1: Deploy a vLLM Inference Server ```yaml # vllm-inference.yaml apiVersion: apps/v1 kind: Deployment metadata: name: vllm-server spec: replicas: 1 selector: matchLabels: app: vllm-server template: metadata: labels: app: vllm-server spec: containers: - name: vllm image: vllm/vllm-openai:latest args: - "--model" - "meta-llama/Llama-3.1-8B-Instruct" - "--port" - "8000" ports: - containerPort: 8000 resources: limits: nvidia.com/gpu: 1 memory: 48Gi cpu: "8" requests: nvidia.com/gpu: 1 memory: 32Gi cpu: "4" env: - name: HUGGING_FACE_HUB_TOKEN valueFrom: secretKeyRef: name: hf-token key: token affinity: nodeAffinity: requiredDuringSchedulingIgnoredDuringExecution: nodeSelectorTerms: - matchExpressions: ...