define-rubric

Solid

Builds measurable validation criteria when no existing standards apply. Invoked by team agents during review.

AI & Automation 82 stars 7 forks Updated 4 days ago MIT

Install

View on GitHub

Quality Score: 86/100

Stars 20%
64
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
40
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

The team can't find existing standards. Help them build a rubric. Ask: what does the output look like when it's right? Get specific, measurable answers. File sizes, response times, value ranges, visual correctness, behavioral expectations. If the user or team can't quantify it, ask what they'd check manually. If they don't know the values yet, the rubric item becomes an experiment: produce a sample, measure the property, decide if it's acceptable. The rubric is a short list of pass/fail criteria the team agrees on before execution starts. Keep it concrete. The team will review output against these criteria in a loop — refining until confidence reaches 9/10+. Write criteria that guide improvement, not just pass/fail. When no test suite exists, this rubric is the testing framework.

Details

Author
DheerG
Repository
DheerG/swarms
Created
3 months ago
Last Updated
4 days ago
Language
Shell
License
MIT

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

eval-rubric-generator

Use this skill when a product spec, feature requirement, PRD, or user story needs to be converted into a concrete evaluation rubric. Triggers on phrases like "write an eval for this", "create a rubric", "how do I test this AI feature", "define good output", "what should I measure", or when a user pastes a spec and asks what success looks like. Produces a binary pass/fail checklist — not vague metrics, not suggestions — a rubric you can run against model outputs today. This is the skill AI PMs need before anything ships to production.

2 Updated 6 days ago
Abhillashjadhav
AI & Automation Listed

eval-rubric-generator

Use this skill when a product spec, feature requirement, PRD, or user story needs to be converted into a concrete evaluation rubric. Triggers on phrases like "write an eval for this", "create a rubric", "how do I test this AI feature", "define good output", "what should I measure", or when a user pastes a spec and asks what success looks like. Produces a binary pass/fail checklist — not vague metrics, not suggestions — a rubric you can run against model outputs today. This is the skill AI PMs need before anything ships to production. Do NOT use to execute an evaluation or invent requirements absent from the supplied specification.

1 Updated 6 days ago
Abhillashjadhav
AI & Automation Listed

verification-rubric

Use when judging a task_gates entry whose verification_type is semantic or self_review -- reading the gate's evidence_shape as an explicit rubric, assessing the produced work against each stated criterion, and emitting a justified pass/fail verdict. Loaded by the verifier role for judgment-based gates.

3 Updated today
metraton