firecrawl-automationlisted

# Firecrawl Automation Run **Firecrawl** web crawling and extraction directly from Claude Code. Scrape individual pages, crawl entire sites, extract structured data with AI, batch process URL lists, and map website structures without leaving your terminal. **Toolkit docs:** [composio.dev/toolkits/firecrawl](https://composio.dev/toolkits/firecrawl) --- ## Setup 1. Add the Composio MCP server to your configuration: ``` https://rube.app/mcp ``` 2. Connect your Firecrawl account when prompted. The agent will provide an authentication link. 3. Be mindful of credit consumption -- scope your crawls tightly and test on small URL sets before scaling. --- ## Core Workflows ### 1. Scrape a Single Page Fetch content from a URL in multiple formats with optional browser actions for dynamic pages. **Tool:** `FIRECRAWL_SCRAPE` Key parameters: - `url` (required) -- fully qualified URL to scrape - `formats` -- output formats: `markdown` (default), `html`, `rawHtml`, `links`, `screenshot`, `json` - `onlyMainContent` (default true) -- extract main content only, excluding nav/footer/ads - `waitFor` -- milliseconds to wait for JS rendering (default 0) - `timeout` -- max wait in ms (default 30000) - `actions` -- browser actions before scraping (click, write, wait, press, scroll) - `includeTags` / `excludeTags` -- filter by HTML tags - `jsonOptions` -- for structured extraction with `schema` and/or `prompt` Example prompt: *"Scrape the main content from https://example.com/prici