web-presence-auditlisted

# Web Presence Audit The public surface is where the product meets people who do not yet trust it. Every gap here costs traffic, conversion or credibility — and unlike most engineering debt, the cost is continuous and silent. This skill covers four layers. Run them in order; each depends on the one above. ``` 1. CRAWLABLE Can a machine find, fetch and index this at all? 2. LEGIBLE Does each page declare what it is, uniquely and correctly? 3. STRUCTURED Can a machine understand the entities and answer questions with it? 4. TRUSTED Would a stranger believe this is a real business and act? ``` Verify against the **live rendered page**, not the source. Server-side headers, proxies, CDNs and client-side rendering all change what a crawler actually sees. Run `scripts/web-check.sh <url>` for the automated first pass. --- ## Layer 1 — Crawlable | Check | Requirement | Severity if missing | |---|---|---| | `robots.txt` | Exists at the root, does not accidentally block the site, references the sitemap | P1 | | `sitemap.xml` | Generated (never hand-maintained), only canonical indexable URLs, submitted to Search Console | P2 | | **Custom 404** | Returns a **real 404 status**, offers navigation and search, does not dead-end | P2 | | Custom 500 | Branded, leaks no stack trace | P2 | | Canonical URL | One per page, self-referencing by default | P2 | | HTTPS | Enforced, HTTP redirected once, no mixed content | P1 | | One hostname | `www` and apex resolve to one canonical ho