groq-migration-deep-dive

# Groq Migration Deep Dive ## Current State !`npm list groq-sdk openai @anthropic-ai/sdk 2>/dev/null | grep -E "groq|openai|anthropic" || echo 'No LLM SDKs found'` ## Overview Migrate to Groq from OpenAI, Anthropic, or other LLM providers. Groq's OpenAI-compatible API makes migration straightforward -- the primary changes are: different SDK import, different model IDs, and different response metadata. The reward is 10-50x faster inference. ## Migration Complexity | Source | Complexity | Key Changes | |--------|-----------|-------------| | OpenAI | Low | Import, model IDs, base URL -- API shape is identical | | Anthropic | Medium | Different API shape, message format, streaming protocol | | Local LLMs | Medium | Remove infra, add API calls | | Other cloud (Bedrock, Vertex) | Medium | Remove cloud SDK, add groq-sdk | ## Instructions ### Step 1: OpenAI to Groq Migration ```typescript // BEFORE: OpenAI import OpenAI from "openai"; const openai = new OpenAI({ apiKey: process.env.OPENAI_API_KEY }); const result = await openai.chat.completions.create({ model: "gpt-4o-mini", messages: [{ role: "user", content: "Hello" }], }); // AFTER: Groq (minimal changes) import Groq from "groq-sdk"; const groq = new Groq({ apiKey: process.env.GROQ_API_KEY }); const result = await groq.chat.completions.create({ model: "llama-3.3-70b-versatile", // or "llama-3.1-8b-instant" messages: [{ role: "user", content: "Hello" }], }); // Same response shape: result.choices[0].message.content...