define-rubric

Solid

Builds measurable validation criteria when no existing standards apply. Invoked by team agents during review.

AI & Automation 85 stars 7 forks Updated 1 months ago MIT

Install

View on GitHub

Quality Score: 82/100

Stars 20%
64
Recency 20%
75
Frontmatter 20%
70
Documentation 15%
40
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

The team can't find existing standards. Help them build a rubric. Ask: what does the output look like when it's right? Get specific, measurable answers. File sizes, response times, value ranges, visual correctness, behavioral expectations. If the user or team can't quantify it, ask what they'd check manually. If they don't know the values yet, the rubric item becomes an experiment: produce a sample, measure the property, decide if it's acceptable. The rubric is a short list of pass/fail criteria the team agrees on before execution starts. Keep it concrete. The team will review output against these criteria in a loop — refining until confidence reaches 9/10+. Write criteria that guide improvement, not just pass/fail. When no test suite exists, this rubric is the testing framework.

Details

Author
DheerG
Repository
DheerG/swarms
Created
5 months ago
Last Updated
1 months ago
Language
Shell
License
MIT

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

eval-rubric-generator

Use this skill when a product spec, feature requirement, PRD, or user story needs to be converted into a concrete evaluation rubric. Triggers on phrases like "write an eval for this", "create a rubric", "how do I test this AI feature", "define good output", "what should I measure", or when a user pastes a spec and asks what success looks like. Produces a binary pass/fail checklist — not vague metrics, not suggestions — a rubric you can run against model outputs today. This is the skill AI PMs need before anything ships to production.

2 Updated 1 months ago
Abhillashjadhav
AI & Automation Listed

eval-rubric-generator

Use this skill when a product spec, feature requirement, PRD, or user story needs to be converted into a concrete evaluation rubric. Triggers on phrases like "write an eval for this", "create a rubric", "how do I test this AI feature", "define good output", "what should I measure", or when a user pastes a spec and asks what success looks like. Produces a binary pass/fail checklist — not vague metrics, not suggestions — a rubric you can run against model outputs today. This is the skill AI PMs need before anything ships to production. Do NOT use to execute an evaluation or invent requirements absent from the supplied specification.

1 Updated 1 months ago
Abhillashjadhav
Testing & QA Listed

unit-testing-rubric

Standards for writing, reviewing, and evaluating unit tests. Use whenever writing new tests, reviewing existing tests, deciding what to test, assigning a test to a fast vs. full feedback loop, or diagnosing flaky, slow, or low-value tests. Covers structural fidelity, the FIRST properties, behavioral invariants, and coverage-as-diagnostic.

20 Updated 1 weeks ago
Accelerated-Innovation