firecrawl-scrape

Featured

Scrape web pages and extract content via Firecrawl MCP

AI & Automation 3,951 stars 303 forks Updated 2 days ago MIT

Install

View on GitHub

Quality Score: 94/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
44
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Firecrawl Scrape Skill ## When to Use - Scrape content from any URL - Extract structured data from web pages - Search the web and get content ## Instructions ```bash uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \ --url "https://example.com" \ --format "markdown" ``` ### Parameters - `--url`: URL to scrape - `--format`: Output format - `markdown`, `html`, `text` (default: markdown) - `--search`: (alternative) Search query instead of direct URL ### Examples ```bash # Scrape a page uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \ --url "https://docs.python.org/3/library/asyncio.html" # Search and scrape uv run python -m runtime.harness scripts/mcp/firecrawl_scrape.py \ --search "Python asyncio best practices 2024" ``` ## MCP Server Required Requires `firecrawl` server in mcp_config.json with FIRECRAWL_API_KEY.

Details

Author
parcadei
Repository
parcadei/Continuous-Claude-v3
Created
11 months ago
Last Updated
2 days ago
Language
Python
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

firecrawl-scrape

Scrape web pages and extract content via Firecrawl MCP

552 Updated 6 days ago
vibeeval
Data & Documents Listed

seo-firecrawl

Ad-hoc web scraping, site mapping, and full-site crawling via Firecrawl MCP. Returns raw HTML, parsed metadata (og:*, twitter:*, JSON-LD, canonical, robots), JS-rendered DOM, and screenshots that WebFetch cannot. Distinct from the SE Ranking skills (which give keyword/traffic/SERP data) and from WebFetch (which gives markdown prose only). Use when the user says "scrape this page", "crawl this site", "map this site", "find all pages on", "get the OG tags", "get the JSON-LD", "render this JS-heavy page", or any task where raw HTML head metadata, structured-data scripts, or post-JS DOM are the actual deliverable. Also invoked as a sub-step from other skills that need raw HTML.

211 Updated today
seranking
Data & Documents Listed

firecrawl

Scrape, search, crawl, map, parse, or interact with web pages via the firecrawl-cli binary, writing results to disk instead of streaming them into context — actions: scrape, search, crawl, map, parse, interact, agent, monitor, update. Use when: WebFetch returns 403/429 (Cloudflare, PerimeterX, anti-bot block), a page requires JS rendering or clicks/form fills, you need web search with scraped results, bulk URL discovery and crawling, a local file (PDF/DOCX/XLSX) needs text extraction to markdown, or a natural-language web research task — skip for plain unprotected pages (WebFetch suffices) or when you want synthesis rather than primary source.

32 Updated today
melodic-software