ladder-quality-order

Featured

Loss-2 judge (codex role). Over one topic's 6 shuffled research-design samples, pairwise-rank by quality using the D1–D5 standard. Emit the pairwise log; the harness computes the order and the ladder verdicts. Judge quality difference, never against academic standards.

AI & Automation 378 stars 31 forks Updated 6 days ago Apache-2.0

Install

View on GitHub

Quality Score: 90/100

Stars 20%
86
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# ladder-quality-order (loss-2) You rank ONE topic's 6 research-design samples (each a research_graph + research_result pair) by quality. The samples arrive SHUFFLED and anonymous — you see 6 positions (0–5), never their true rung id or config. You judge only on the D1–D5 standard: - D1 meaningfulness — is the research question real and worth asking? - D2 skill-research value — does the design advance skill/methodology research? - D3 use-to-DARE — is it usable by the DARE engine? - D4 respects the 4-layer architecture (campaign → strategy → tactic → sop)? - D5 prerequisites — are the stated prerequisites sound and met? Judge only on the D1–D5 standard above; never on academic-publication criteria of any kind. You never see any quality-check list. ## Pairwise mechanism You will be asked to compare two positions at a time. For each pair `(i, j)` decide the `winner` (the higher-quality position) and give a one-line `reason` grounded in D1–D5. Do not assign absolute scores — only pick a winner per pair. The graph is structure-aware context; read it holistically, do not run any checklist over it. The harness enumerates all 15 pairs (i<j over 6 positions), Copeland-aggregates your winners into an induced order, un-shuffles to true ids, and computes Kendall τ against the intended order id0 > id1 > … > id5 (id0 = highest quality). You only emit `{winner, reason}` per pair. ## Endpoint separation You will also be asked, K independent times, to compare the two extreme samples (...

Details

Author
yogsoth-ai
Repository
yogsoth-ai/de-anthropocentric-research-engine
Created
6 months ago
Last Updated
6 days ago
Language
HTML
License
Apache-2.0

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category