injection-fidelity

Featured

Loss-1 judge (codex role). Given one sample's de-identified dialogue and its PolicyCard, decide axis-by-axis whether the user-simulator enacted the card's per-axis pressure. Judge enactment of the card, never whether the research is good.

Code & Development 378 stars 31 forks Updated 6 days ago Apache-2.0

Install

View on GitHub

Quality Score: 90/100

Stars 20%
86
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# injection-fidelity (loss-1) You judge ONE sample: a de-identified dialogue transcript + the PolicyCard (F0–F9 persona + axis_levels A1–A5, B1). Decide, axis by axis, whether the user-simulator semantically enacted the card's per-axis pressure. You judge "was the card enacted", never "is the research good". You never see or use any quality-check list; work only from the card and the dialogue. ## Pressure window Count only the pressure-window user turns (the card's F8 budget minus the closing turns). Normalize every rate by that count (`pressure_turns`). ## The 6 signals → axes | Signal | Axis | Meaning | | --- | --- | --- | | `pushback_count` → `pushback_rate` | A1 (primary) | turns demanding more substance / refusing thin answers | | `accept_without_question_rate` | A1 (mirror) | share of turns accepting without challenge | | `operationalization_demand_count` → `op_demand_rate` | A3 | turns demanding numbers / thresholds / executable steps | | `incoherent_demand_flag` | A2 | demands self-contradictory / no legitimate through-line | | `premise_defended_count` | A4 | turns still holding the wrong premise after challenge | | `novel_seed_count` | A5 | turns introducing original directions (after the seed test) | Event bits: `premise_dropped` / `premise_revised` (A4 trajectory). **A5 substantive-seed test** — a turn counts as a novel seed only if ALL three hold: substantive (not pleasantry), topic-relevant (same domain as the card's F7 prerequisite facts), non-restatement...

Details

Author
yogsoth-ai
Repository
yogsoth-ai/de-anthropocentric-research-engine
Created
6 months ago
Last Updated
6 days ago
Language
HTML
License
Apache-2.0

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

pressure-test

Use when an idea, plan, design, or scope needs to be stress-tested before anyone builds it, when the user says "pressure test this", "poke holes in this", or wants the fuzzy parts made concrete. Also use in sous mode when the user hands off and says to answer the open questions yourself, figure it out, or that they are going AFK.

4 Updated 1 weeks ago
escoffier-labs
Code & Development Listed

quorum-judging

The judge panel and the synthesis that follows - naming judges as hard constraints rather than extra lenses, when zero judges is correct, consensus and dissent handling, and the ruling format. Covers the one step that survived every run in the corpus - an explicit dissent-honoring convergence. Trigger on "judge", "panel", "who decides", "synthesize", "the ruling", "disagreement", "conflicting recommendations", "prioritize the findings".

0 Updated yesterday
Lukehle
Code & Development Listed

card-review

Internal skill for onboard's semantic review gate. After the deterministic validation gate (which catches invented symbols / hash drift / secrets), this skill drives a sampled `claude -p` pass that checks whether the TLDR and role are DIRECTIONALLY ACCURATE given the file's structure and head snippet. The deterministic gate is the FLOOR; this skill is the ceiling check for plausible- but-wrong summaries (e.g. "handles auth middleware" when the file only renders auth *errors*). Used by onboard-analyze.mjs. Not for the ticket delivery flow.

2 Updated 3 days ago
tmj-90