evaluate
FeaturedEvaluate execution with three-stage verification pipeline
AI & Automation 5,596 stars
559 forks Updated today MIT
Install
Quality Score: 96/100
Stars 20%
Recency 20%
Frontmatter 20%
Documentation 15%
Issue Health 10%
License 10%
Description 5%
Skill Content
# /ouroboros:evaluate
Evaluate an execution session using the three-stage verification pipeline.
## Usage
```
/ouroboros:evaluate <session_id> [artifact]
```
**Trigger keywords:** "evaluate this", "3-stage check"
## How It Works
The evaluation pipeline runs three progressive stages:
1. **Stage 1: Mechanical Verification** ($0 cost)
- Lint checks, build validation, test execution
- Static analysis, coverage measurement
- Fails fast if mechanical checks don't pass
2. **Stage 2: Semantic Evaluation** (Standard tier)
- AC compliance assessment
- Goal alignment scoring
- Drift measurement
- Reasoning explanation
3. **Stage 3: Multi-Model Consensus** (Frontier tier, optional)
- Multiple models vote on approval
- Only triggered by uncertainty or manual request
- Majority ratio determines outcome
## Instructions
When the user invokes this skill:
### Load MCP Tools (Required first)
The Ouroboros MCP tools are often registered as **deferred tools** that must be explicitly loaded before use. **You MUST perform this step before proceeding.**
1. Use the active runtime's tool-discovery capability to find and load the evaluate MCP tools:
```
tool discovery query: "+ouroboros evaluate"
```
2. The tool will typically be named `mcp__plugin_ouroboros_ouroboros__ouroboros_start_evaluate` (with a plugin prefix). After runtime tool discovery returns, the tool becomes callable.
3. If the tool is callable — already exposed, or loaded by discovery ...
Details
- Author
- Q00
- Repository
- Q00/ouroboros
- Created
- 7 months ago
- Last Updated
- today
- Language
- Python
- License
- MIT
Integrates with
Bundled in these plugins
Similar Skills
Semantically similar based on skill content — not just same category
AI & Automation Solid
mkevaluate
Experimental behavioral evaluator. Drives a running artifact via browser/curl/CLI and records rubric evidence; the runner is not yet a fully implemented automated evaluation system.
14 Updated 3 weeks ago
ngocsangyem AI & Automation Listed
evaluate-plugin
How to verify the Cognitive OS is functioning correctly.
0 Updated today
attac-t AI & Automation Listed
forge-eval
Run Stage 7 of the Forge pipeline — evaluation and quality assurance. Use when the user says /forge:eval, wants to verify the implementation, check test coverage, or validate against requirements. Requires Stage 1–6. Invokes the evaluator.
1 Updated 1 weeks ago
tonmoy007