together-local-dev-loop

# Together AI Local Dev Loop ## Overview Local development workflow for Together AI inference API integration. Provides a fast feedback loop with mock chat completions, embeddings, and model listing endpoints so you can build AI-powered applications without consuming live API credits. Together AI is OpenAI-compatible, so the same client libraries work with both. Toggle between mock mode for rapid iteration and live mode for model evaluation. ## Environment Setup ```bash cp .env.example .env # Set your credentials: # TOGETHER_API_KEY=tog_xxxxxxxxxxxx # TOGETHER_BASE_URL=https://api.together.xyz/v1 # MOCK_MODE=true npm install express axios dotenv tsx typescript @types/node npm install -D vitest supertest @types/express # Or for Python: pip install together openai httpx pytest ``` ## Dev Server ```typescript // src/dev/server.ts import express from "express"; import { createProxyMiddleware } from "http-proxy-middleware"; const app = express(); app.use(express.json()); const MOCK = process.env.MOCK_MODE === "true"; if (!MOCK) { app.use("/v1", createProxyMiddleware({ target: process.env.TOGETHER_BASE_URL, changeOrigin: true, headers: { Authorization: `Bearer ${process.env.TOGETHER_API_KEY}` }, })); } else { const { mountMockRoutes } = require("./mocks"); mountMockRoutes(app); } app.listen(3009, () => console.log(`Together dev server on :3009 [mock=${MOCK}]`)); ``` ## Mock Mode ```typescript // src/dev/mocks.ts — OpenAI-compatible mock responses for inferen...