groq-reference-architecture

Featured

Implement Groq reference architecture with model routing, streaming pipelines, and fallbacks. Use when designing new Groq integrations, reviewing project structure, or establishing architecture standards for Groq applications. Trigger with phrases like "groq architecture", "groq best practices", "groq project structure", "how to organize groq", "groq design".

AI & Automation 2,359 stars 334 forks Updated today MIT

Install

View on GitHub

Quality Score: 99/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Groq Reference Architecture ## Overview Production architecture for applications built on Groq's LPU inference API. Covers model routing by latency requirements, streaming pipelines, multi-provider fallback, and the middleware layer that ties it together. ## Architecture Diagram ``` ┌──────────────────────────────────────────────────────────────┐ │ Application Layer │ │ Chat UI │ API Backend │ Batch Processor │ Agent │ └─────┬─────┴──────┬────────┴────────┬──────────┴──────┬───────┘ │ │ │ │ ▼ ▼ ▼ ▼ ┌──────────────────────────────────────────────────────────────┐ │ Groq Service Layer │ │ ┌─────────────┐ ┌────────────┐ ┌─────────────────────┐ │ │ │ Model Router │ │ Middleware │ │ Fallback Chain │ │ │ │ │ │ │ │ │ │ │ │ speed → │ │ Cache │ │ Groq (primary) │ │ │ │ 8b-instant│ │ Rate Guard │ │ ↓ 429/5xx │ │ │ │ quality → │ │ Metrics │ │ Groq (fallback model)│ │ │ │ 70b-versa.│ │ Logging │ │ ↓ still failing │ │ │ │ vision → │ │ Retry │ │ OpenAI (backup) │ │ │ │ llama-4 │ │ │ │ ↓ also failing │ │ │ │ audio → │ │ │ │ Graceful degrade │ │ │ │ whisper │ │ │ │ │ ...

Details

Author
jeremylongshore
Repository
jeremylongshore/claude-code-plugins-plus-skills
Created
8 months ago
Last Updated
today
Language
Python
License
MIT

Integrates with

OpenAI · AI Anthropic · AI

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Featured

groq-migration-deep-dive

Migrate from OpenAI/Anthropic/other LLM providers to Groq, or migrate between Groq model generations with zero-downtime traffic shifting. Trigger with phrases like "migrate to groq", "switch to groq", "groq migration", "openai to groq", "groq replatform".

2,359 Updated today
jeremylongshore
AI & Automation Featured

granola-reference-architecture

Enterprise reference architecture for meeting management with Granola. Use when designing org-wide meeting workflows, planning integration topology, or architecting meeting-to-action pipelines across departments. Trigger: "granola architecture", "granola enterprise design", "granola system design", "meeting system architecture".

2,359 Updated today
jeremylongshore
AI & Automation Featured

groq-core-workflow-a

Execute Groq primary workflow: chat completions with tool use and JSON mode. Use when implementing chat interfaces, function calling, structured output, or building AI features with Groq's fast inference. Trigger with phrases like "groq chat completion", "groq tool use", "groq function calling", "groq JSON mode".

2,359 Updated today
jeremylongshore