← ClaudeAtlas

agent-testabilitylisted

Audit whether a codebase gives a coding agent a reliable way to verify its own work, and propose fixes. Use whenever an agent reports success but the change is broken, when tests exist but don't catch regressions, when the feedback loop is too slow or too noisy for an agent to use, when test failures don't say what broke, or when someone asks how to make a repo safe for autonomous or unattended agent runs. Also use for requests like "why does it keep saying it's done when it isn't", "review our test setup for agents", "what should agents run before opening a PR", or planning a testing strategy where the consumer is an agent rather than a human.
arndvs/ctrlshft · ★ 0 · AI & Automation · score 64
Install: claude install-skill arndvs/ctrlshft
# Agent testability audit An agent that cannot check its own work will report success anyway. Not from dishonesty — it finished the edit, nothing contradicted it, so it says done. Every unverified change is a coin flip that gets discovered later by a human, which is exactly the cost autonomy was supposed to remove. The question throughout: **can an agent tell, without a human, whether the change it just made is correct?** That is narrower than "is this well tested." A repo with excellent coverage can still fail this if the suite takes forty minutes, or if failures print nothing useful, or if nobody can tell which command to run. And a modest suite can pass it if it's fast, obvious, and specific. Related skills: `logging-audit` covers whether runtime output is legible; `agent-navigability` covers whether the code is. This one covers whether the loop closes. --- ## Step 1: Close the loop yourself Don't read the test directory and form opinions. **Make a small change and try to verify it the way an agent would.** Add a field, change a function's behaviour, or deliberately break something small — then find out whether the repo tells you. Record, concretely: - What command you ran, and how you worked out it was the right one - How long it took before you had a verdict - Whether the failure named the thing that broke, or just reported that something did - Whether a passing run actually meant anything, or the change wasn't covered Then the harder test: **break something on