← ClaudeAtlas

web-scraperlisted

Local firecrawl web scraping, crawling, site mapping, web search, structured extraction, llms.txt generation, and research synthesis. Activates when the user asks to scrape a URL, crawl a website, map site URLs, search the web, extract structured data from pages, generate llms.txt, batch scrape multiple URLs, cancel a crawl, list active crawls, convert a web page to markdown, fetch page content, or research a question using web search and scrape. Uses the self-hosted firecrawl instance on localhost:3002 — no API keys or subscriptions required.
f5-sales-demo/marketplace · ★ 0 · Data & Documents · score 71
Install: claude install-skill f5-sales-demo/marketplace
**Canonical skill URI**: `skill://firecrawl:web-scraper` # Web Scraper (Local Firecrawl) This skill provides web scraping, crawling, URL mapping, web search, LLM-powered extraction, and llms.txt generation via the local self-hosted firecrawl API. All operations run against `http://localhost:3002` with no authentication required. Delegate to the firecrawl-operator agent to keep API payloads out of the main session context. ## Capabilities | Operation | What it does | Endpoint | Type | | ----------- | ------------- | ---------- | ------ | | **Scrape** | Extract content from a single URL | `POST /v1/scrape` | Sync | | **Batch Scrape** | Scrape multiple URLs at once | `POST /v1/batch/scrape` | Async | | **Crawl** | Crawl multiple pages from a starting URL | `POST /v1/crawl` | Async | | **Crawl Cancel** | Cancel a running crawl job | `DELETE /v1/crawl/:id` | Sync | | **Crawl Active** | List all active crawl jobs | `GET /v1/crawl/active` | Sync | | **Crawl Errors** | Get error details for a crawl | `GET /v1/crawl/:id/errors` | Sync | | **Map** | Discover all URLs on a site | `POST /v1/map` | Sync | | **Search** | Web search with optional scraping | `POST /v1/search` | Sync | | **Extract** | LLM-powered structured data extraction | `POST /v1/extract` | Async | | **llms.txt** | Generate llms.txt for a site | `POST /v1/llmstxt` | Async | | **Research** | Search + scrape + synthesize answer | Multiple | Sync | ## Delegation Protocol When this skill activates, delegate immediatel