factcheck-guard

Solid

Use this skill when making any factual claim about the codebase — existence, absence, or behavior. Converts the claim-verification rule into a systematic action protocol that prevents false assertions from grep-only results.

AI & Automation 495 stars 41 forks Updated 1 months ago MIT

Install

View on GitHub

Quality Score: 86/100

Stars 20%
90
Recency 20%
75
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# FactCheck Guard — Runtime Claim Verification Prevents false claims about the codebase. Grep results are hypotheses, not proof. Every assertion about "what the code does" must be verified by reading the actual code. ## Why This Exists An 80% false claim rate was observed when agents trusted grep results without reading files. The pattern repeats: grep finds a string, agent asserts behavior, behavior is wrong. This skill converts the claim-verification guidelines into an actionable protocol. ## Confidence Markers (MANDATORY) Every factual claim about the codebase MUST carry one of these markers: | Marker | Meaning | Requirements | |--------|---------|-------------| | [VERIFIED] | Read the file, traced the logic | Must cite file:line | | [INFERRED] | Based on grep or file name | Must verify before asserting to others | | [UNCERTAIN] | Not yet checked | Must investigate before making the claim | Never promote an [INFERRED] claim to a statement of fact. Never let [UNCERTAIN] appear in a response to the user — investigate first. --- ## Verification Protocol ### Level 1: Existence Claims When asserting "X exists in the codebase": **Step 1 — Search (produces [INFERRED])** ``` Grep/Glob for the pattern. Result: "X appears at path/to/file.ts:42" [INFERRED] ``` **Step 2 — Read the file (required to reach [VERIFIED])** ``` Read path/to/file.ts, locate line 42. Confirm the match is actual code, not a comment or string literal. ``` **Step 3 — Check context** ``` Is the code...

Details

Author
vibeeval
Repository
vibeeval/vibecosystem
Created
2 months ago
Last Updated
1 months ago
Language
C#
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

fact-check

Enforces evidence-based reasoning for any task that involves making factual claims about a codebase — debugging, bug fixing, code investigation, code modification, AND explaining what code does, answering "where is X" / "what does Y do" / "is this safe", or summarizing behavior. Use this skill whenever the user asks to fix a bug, investigate an issue, modify existing code, trace a problem, debug behavior, refactor, change, update code, or explain/locate/audit any part of the codebase. This skill ensures Claude gathers real evidence from source code, docs, git history, and runtime behavior before making any claim — never guessing, never paraphrasing comments as fact, never relying on training memory. Even if the task seems straightforward, use this skill to guarantee that every claim and recommendation is grounded in verified facts.

0 Updated yesterday
Stoica-Mihai
AI & Automation Listed

code-verifier

Use BEFORE claiming any code/test/script runs successfully. Detects FAKE-RUN patterns (hardcoded results, assert True, mocks-only tests, swallowed exceptions, fabricated numbers, dead-code short-circuits). Apply automatically whenever about to claim "test passes", "code works", "results show X", "training converges", or commit/push. Complements superpowers:verification-before-completion (which enforces real-run discipline) by auditing whether the run itself is genuine.

0 Updated 4 days ago
jajupmochi
AI & Automation Solid

fp-check

Systematic false positive verification for security findings. Provides structured methodology to confirm or dismiss scanner results, manual audit findings, and automated alerts. Adapted from Trail of Bits. Use when triaging security scan results or verifying audit findings.

495 Updated 1 months ago
vibeeval
AI & Automation Listed

verify-before-claim

Iron rule — no completion claims without fresh verification evidence. Use whenever about to claim work is done, fixed, working, or passing. Run verification commands and show output before making any success statement.

107 Updated 3 days ago
Mark393295827
AI & Automation Solid

fact-check-workflow

Structured workflow for fact-checking claims in journalism. Use when verifying statements for publication, rating claims for fact-check articles, or building pre-publication verification processes. Includes claim extraction, evidence gathering, rating scales, and correction protocols.

233 Updated today
jamditis