ai-llm-orchestration

Solid

AI system and LLM Council management for {{PROJECT_NAME}}. Covers the 3-model council architecture (Claude + Gemini + GPT), snapshot construction and minimization, prompt engineering for market analysis, usage throttling (100K tokens/day budget), input injection prevention, proprietary data protection, signal quality assessment, confidence thresholds, fallback chains, and cost optimization. Use when working on any code in src/ai/, reviewing AI prompts, implementing new AI features, debugging AI signal quality, managing LLM costs, or reviewing AI security (injection attacks, data leakage). 18 files, ~9.3K lines. Also use when the user mentions "AI council", "LLM", "market analysis AI", "AI signals", or "prediction confidence".

AI & Automation 3 stars 0 forks Updated today MIT

Install

View on GitHub

Quality Score: 82/100

Stars 20%
20
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# AI & LLM Orchestration ## Fail-Fast Rule If an AI response cannot be parsed, validated, or is below confidence threshold, **discard it entirely**. Never use an AI signal you cannot validate. Never expose raw LLM output to users without sanitization. Never send proprietary market data to LLMs without minimization. ## Architecture ``` Market Snapshot (engine state) → Snapshot Minimizer (reduce to essential data) → AI Council (3 models in parallel) ├── Claude (Anthropic) ├── Gemini (Google) └── GPT (OpenAI) → Response Aggregator (voting, confidence) → Signal (BUY/SELL/HOLD with confidence) → Usage Limiter (daily budget check) ``` ### Key modules (archetype — adapt filenames to your stack) Every project adopting the AI Council pattern should own these responsibilities, usually one module per responsibility: - **AI orchestration service** — main entry point; receives a task, decides which model(s) to call, applies rate limits, returns the aggregated response. - **AI council** — multi-model voting and aggregation logic; decides how to combine outputs from 2+ models (majority vote, confidence-weighted, quorum). - **AI client adapters** — one per provider (Anthropic, OpenAI, Google, etc.). Wraps the SDK, handles retries, normalizes errors. - **Snapshot builder** — constructs the minimized context payload the LLM will see. Strips PII, aggregates raw data, caps size. - **Minimizer** — strategy layer on top of the snapshot builder. Impl...

Details

Author
Canhada-Labs
Repository
Canhada-Labs/ceo-orchestration
Created
4 weeks ago
Last Updated
today
Language
Python
License
MIT

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

llm-council

Provider-agnostic multi-LLM deliberation. Three phases — independent responses, cross-model anonymized ranking, chairman synthesis. Provider config from env (OPENAI/ANTHROPIC/FIREWORKS/OPENROUTER/custom OpenAI-compatible base URL). Persists transcript to a wiki page when --wiki <slug> is passed. Use when the user wants multiple AI perspectives, consensus-building, or the "LLM Council" approach for high-stakes reviews, plan critique, or contested learning rules.

2,653 Updated today
rohitg00
AI & Automation Listed

llm-council

Run any question, idea, or decision through a council of 5 AI advisors who independently analyze it, peer-review each other anonymously, and synthesize a final verdict. Based on Karpathy's LLM Council methodology. MANDATORY TRIGGERS: 'council this', 'run the council', 'war room this', 'pressure-test this', 'stress-test this', 'debate this'. STRONG TRIGGERS (use when combined with a real decision or tradeoff): 'should I X or Y', 'which option', 'what would you do', 'is this the right move', 'validate this', 'get multiple perspectives', 'I can't decide', 'I'm torn between'. Do NOT trigger on simple yes/no questions, factual lookups, or casual 'should I' without a meaningful tradeoff (e.g. 'should I use markdown' is not a council question). DO trigger when the user presents a genuine decision with stakes, multiple options, and context that suggests they want it pressure-tested from multiple angles.

0 Updated 1 weeks ago
kochellenk-afk
AI & Automation Listed

llm-council

Pressure-test a real decision with independent perspectives, anonymous peer review, and a final verdict when the user wants to compare options or choose a direction.

0 Updated 4 days ago
nahiddotai