night-market-model-and-harness-updates

Featured

Sweep plugins, skills, agents, commands, and hooks after a model release or Claude Code version bump. Use when upstream ships. Do not use for routine edits; use night-market-change-control.

AI & Automation 330 stars 33 forks Updated today MIT

Install

View on GitHub

Quality Score: 90/100

Stars 20%
84
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Night Market Model and Harness Updates When Anthropic ships a model or Claude Code ships a version, the pins scattered through this repo rot silently. This skill runs the sweep that finds the rot, researches what actually changed, applies the updates, and records where upstream stood so the next run reports only the new delta. The watermark is the point. Without it every audit restarts from zero and re-derives the same answer by hand. `.claude/upstream-baseline.json` holds the last recorded upstream state, and each run diffs against it. ## When to run | Trigger | Signal | |---------|--------| | Model release | A tier or model ID ships that the ledger does not record | | Harness release | `claude --version` differs from the ledger | | Scheduled check | Monthly, to catch a release nobody noticed | ## The five steps Run them in order. Each one gates the next. ```bash # 1. Detect. Deterministic, no model in the loop. python3 scripts/check_upstream_drift.py # 2. Research what changed (only when step 1 reports drift). # Release notes and model cards are mandatory sources. # 3. Map findings onto asset classes. # 4. Sweep the implicated classes. # 5. Prove, then record the new watermark. python3 scripts/check_upstream_drift.py && \ python3 scripts/check_agent_model_matrix.py ``` Step 5 runs before the ledger is written, never after. Recording a migration that has not passed its proof is the failure the ledger exists to prevent. ## What the detector proves and what i...

Details

Author
athola
Repository
athola/claude-night-market
Created
9 months ago
Last Updated
today
Language
Python
License
MIT

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

unhobble

Empirical bare-baseline experiment on a repo's standing instructions: reversibly strip project CLAUDE.md/rules/behavioral hooks/skills on a dedicated branch, work normally against the bare model logging observed stumbles to a ledger, then re-add ONLY instructions with repeated same-cause evidence, each restore citing its ledger rows. Measures the model where sibling audit-instructions judges the text. Use when: 'unhobble', 'run the bare experiment', 'delete my CLAUDE.md and see', 'does the model still need these instructions', 'new model dropped, re-baseline', 'instruction ablation experiment'. Human-gated mutations; resumable state.

11 Updated today
melodic-software
AI & Automation Featured

night-market-diagnostics-toolkit

Run and interpret repo diagnostic scripts (ratchets, validators, token stats). Use when measuring health. Do not use to run tests; use night-market-operations.

330 Updated today
athola
Code & Development Listed

harness-health-audit

Audit the health of an AI-coding harness — the CLAUDE.md / AGENTS.md files, rules, skills, agents, hooks, and commands that steer an agent in a repository — across four questions a linter cannot answer: is it TRUE (does it match the real code?), is it USED (do skills actually trigger and does the loop actually verify?), is it AFFORDABLE (is it inside the budget where instructions are still followed?), and is it SAFE (is a live, accurate instruction still a good idea — permission bypasses, unpinned remote scripts, untrusted content flowing in as instructions? — safety findings are flagged for the user's decision, never auto-removed). Then surgically correct or remove only what is proven wrong or dead. Use whenever the steering layer may have rotted or may not be working: "하네스 점검해줘", "하네스 드리프트 감사", "CLAUDE.md가 실제랑 맞는지 봐줘", "룰/스킬이 최신인지 확인해줘", "스킬이 제대로 활용되는지 봐줘", "루프 엔지니어링 잘 되고 있는지 검토해줘", "죽은 훅/커맨드 정리해줘", "하네스 안전한지 점검해줘", "audit my harness", "check the rules still match the real stack", "are my skills actually be

3 Updated 2 days ago
uzysjung