← ClaudeAtlas

web-fetchlisted

Fetches web content with intelligent content extraction, converting HTML to clean markdown. Use for documentation, articles, and reference pages http/https URLs.
aiskillstore/marketplace · ★ 329 · Data & Documents · score 79
Install: claude install-skill aiskillstore/marketplace
# Web Content Fetching Fetch web content using `curl | html2markdown` with CSS selectors for clean, complete markdown output. ## Quick Usage (Known Sites) Use site-specific selectors for best results: ```bash # Anthropic docs curl -s "<url>" | html2markdown --include-selector "#content-container" # MDN Web Docs curl -s "<url>" | html2markdown --include-selector "article" # GitHub docs curl -s "<url>" | html2markdown --include-selector "article" --exclude-selector "nav,.sidebar" # Generic article pages curl -s "<url>" | html2markdown --include-selector "article,main,[role=main]" --exclude-selector "nav,header,footer" ``` ## Site Patterns | Site | Include Selector | Exclude Selector | |------|------------------|------------------| | platform.claude.com | `#content-container` | - | | docs.anthropic.com | `#content-container` | - | | developer.mozilla.org | `article` | - | | github.com (docs) | `article` | `nav,.sidebar` | | Generic | `article,main` | `nav,header,footer,script,style` | ## Universal Fallback (Unknown Sites) For sites without known patterns, use the Bun script which auto-detects content: ```bash bun ~/.claude/skills/web-fetch/fetch.ts "<url>" ``` ### Setup (one-time) ```bash cd ~/.claude/skills/web-fetch && bun install ``` ## Finding the Right Selector When a site isn't in the patterns list: ```bash # Check what content containers exist curl -s "<url>" | grep -o '<article[^>]*>\|<main[^>]*>\|id="[^"]*content[^"]*"' | head -10 # Test a selector cur