groq-deploy-integration

Featured

Deploy Groq integrations to Vercel, Cloud Run, and containerized platforms. Use when deploying Groq-powered applications to production, configuring platform-specific secrets, or setting up deployment pipelines. Trigger with phrases like "deploy groq", "groq Vercel", "groq production deploy", "groq Cloud Run", "groq Docker".

DevOps & Infrastructure 2,926 stars 433 forks Updated yesterday MIT

Install

View on GitHub

Quality Score: 99/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Groq Deploy Integration ## Overview Deploy applications using Groq's inference API to Vercel Edge, Cloud Run, Docker, and other platforms. Groq's sub-200ms latency makes it ideal for edge deployments and real-time applications. ## Prerequisites - Groq API key stored in `GROQ_API_KEY` - Application using `groq-sdk` package - Platform CLI installed (vercel, docker, or gcloud) ## Instructions ### Step 1: Vercel Edge Function ```typescript // app/api/chat/route.ts (Next.js App Router) import Groq from "groq-sdk"; export const runtime = "edge"; export async function POST(req: Request) { const groq = new Groq({ apiKey: process.env.GROQ_API_KEY! }); const { messages, stream: useStream } = await req.json(); if (useStream) { const stream = await groq.chat.completions.create({ model: "llama-3.3-70b-versatile", messages, stream: true, max_tokens: 2048, }); const encoder = new TextEncoder(); const readable = new ReadableStream({ async start(controller) { for await (const chunk of stream) { const content = chunk.choices[0]?.delta?.content; if (content) { controller.enqueue( encoder.encode(`data: ${JSON.stringify({ content })}\n\n`) ); } } controller.enqueue(encoder.encode("data: [DONE]\n\n")); controller.close(); }, }); return new Response(readable, { headers: { "Content-Type": "text/event-stream", ...

Details

Author
jeremylongshore
Repository
jeremylongshore/claude-code-plugins-plus-skills
Created
1 years ago
Last Updated
yesterday
Language
Python
License
MIT

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category