skill-quality-evallisted

# Skill Quality Evaluator Validates `.claude/commands/*.md` files for quality, triggering accuracy, and best practices from Phil Schmid's (Google DeepMind) eval harness methodology. ## What it checks 1. **YAML frontmatter** — every command must start with `---` block containing `description:` 2. **Description length** — minimum 40 characters (short descriptions don't trigger well) 3. **Jargon detection** — flags internal terms that confuse users (dogfood, --dangerously, etc.) 4. **Directive language** — descriptions must contain action verbs (Run, Fix, Scan, Extract, etc.) because passive descriptions don't trigger Claude's skill routing 5. **Duplicate detection** — similar commands must have distinct descriptions (first 30 chars normalized) ## How to run Execute the bundled script — it requires **zero dependencies** (pure Node.js): ```bash node .claude/skills/skill-quality-eval/scripts/run-eval.js [commands-dir] ``` - Default `commands-dir`: `.claude/commands` (relative to cwd) - Pass an absolute path to scan a different directory The script outputs a structured report with PASS/FAIL per file, summary stats, and specific fix suggestions. ## When a check fails | Check | How to fix | |-------|-----------| | Missing frontmatter | Add `---\ndescription: "..."\n---` at top of file | | Description too short | Expand to 40+ chars — explain WHEN to use and WHAT it does | | Jargon detected | Replace internal terms with user-facing language | | No directive verb | Add action