evaluation-methodology
FeaturedPluginEval quality methodology — dimensions, rubrics, statistical methods, and scoring formulas. Use this skill when understanding how plugin quality is measured, when interpreting a low score on a specific dimension, when deciding how to improve a skill's triggering accuracy or orchestration fitness, when calibrating scoring thresholds for your marketplace, or when explaining quality badges to external partners like Neon.
Install
Quality Score: 93/100
Skill Content
Details
- Author
- wshobson
- Repository
- wshobson/agents
- Created
- 1 years ago
- Last Updated
- today
- Language
- Python
- License
- MIT
Integrates with
Similar Skills
Semantically similar based on skill content — not just same category
evaluate-plugin
Evaluate plugin quality. Use when user says "evaluate plugin", "review plugin quality", "score my plugin", "check plugin", "rate plugin".
three-layer-eval
Three-layer skill quality evaluation (Static → LLM Judge → Monte Carlo). Layer 1: deterministic checks (frontmatter, triggers, size, links) in <2s. Layer 2: semantic eval across 4 dimensions using Haiku+Sonnet. Layer 3: 50-100 simulated runs for statistical reliability.
evaluate
Comprehensive quality grading. Checks prompt compliance, code quality, security, test coverage, architecture fitness. Produces a percentage score. Not lenient. Keywords: evaluate, grade, check, verify, validate, scorecard, quality, percentage, score, how good