webclawlisted

# webclaw Web extraction for AI agents, powered by a local Rust engine. It turns any URL into clean Markdown, text, or JSON through the webclaw MCP server, and it works with no API key. ## Install ``` npx create-webclaw ``` This writes the `npx @webclaw/mcp` MCP config into your agent (Claude Code, Cursor, Windsurf, Codex, Antigravity, and more) — nothing to install; the server is fetched and cached on first launch. Restart the agent to load the tools below. - **No key needed.** Extraction runs on your machine: free, private, and unlimited for the common case. Static sites, docs, blogs, server-rendered pages, and product pages all work locally. - **Optional upgrade.** Set `WEBCLAW_API_KEY` (from https://webclaw.io) and webclaw escalates to the hosted engine for the pages local extraction can't finish: bot-protected sites and JavaScript-rendered SPAs. Without a key, those pages return a clear message that tells you how to unlock them. ## When to use this skill - You need reliable web content with clean, structured output. - `web_fetch` returns empty, truncated, or blocked content. - You need structured data (pricing tables, product specs, contact info) as JSON. - You need to crawl a whole site or discover every URL. - You need LLM-optimized content, cleaner than raw markdown. - You need a site-specific extractor (GitHub, Reddit, YouTube, npm, PyPI, Amazon). - You need to summarize, diff, or search the web. - You need to enrich a company URL — or a list of them — into ou