calibrate

Solid

Calibrate skills/role cards for leaks/gaps with recall, precision, and confidence-accuracy checks.

AI & Automation 25 stars 4 forks Updated today Apache-2.0

Install

View on GitHub

Quality Score: 81/100

Stars 20%
47
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# Calibrate Run calibration for Codex workflow integrity and behavioral scoring. ## Input Schema ```json { "scope": "skills|agents|routing|all", "pace": "fast|full", "mode": "ab-test|apply", "require_live_routes": false, "skip_gate": false, "done_when": "recall and bias scores emitted; proposals written if mode=apply; gate skipped if skip_gate=true" } ``` ## Workflow Installed plugin runs use `--layout plugin --root <consuming-project>`. The runner discovers package assets from its own file location under `runtime/calibration`, `skills`, `roles`, and `shared`; `--root` controls only report output, Git context, and read-only classification work. It must not fall back to a source checkout or project `.codex`. Repository maintainers may use `--layout source --root <source-project>` to validate the source `.codex` layout. Do not mix source agents, sync manifests, or project registration checks into an installed-plugin result. ### 01: Load calibration task set from `../../runtime/calibration/tasks.json` ### 02: Load behavioral cases from `../../runtime/calibration/behavioral-cases.json` ### 03: Load behavioral observations from `../../runtime/calibration/behavioral-observations.jsonl` - Require `source`, `run_id`, `observed_at`. `source=live-*` also needs route; campaign/pair IDs; pair/registered role; actual model/effort; recomputable prompt/task-contract SHA-256; task type/scope; input/cached/output tokens; latency; outcome; tool/check failures; normalized ...

Details

Author
Borda
Repository
Borda/AI-Rig
Created
5 months ago
Last Updated
today
Language
Python
License
Apache-2.0

Similar Skills

Semantically similar based on skill content — not just same category