firecrawl-webhooks-events

# Firecrawl Webhooks & Events ## Overview Handle Firecrawl webhooks for real-time notifications on async crawl and batch scrape jobs. Instead of polling `checkCrawlStatus`, configure a webhook URL and Firecrawl will POST events as pages are scraped and jobs complete. Signed with HMAC-SHA256 via `X-Firecrawl-Signature`. ## Webhook Event Types | Event | Trigger | Payload | |-------|---------|---------| | `crawl.started` | Crawl job begins | Job ID, config | | `crawl.page` | Individual page scraped | Page markdown, metadata | | `crawl.completed` | Full crawl finishes | All pages array | | `crawl.failed` | Crawl job errors | Error message | | `batch_scrape.completed` | Batch scrape finishes | All scraped pages | ## Instructions ### Step 1: Start Crawl with Webhook ```typescript import FirecrawlApp from "@mendable/firecrawl-js"; const firecrawl = new FirecrawlApp({ apiKey: process.env.FIRECRAWL_API_KEY!, }); // Webhook as string (simple) const job = await firecrawl.asyncCrawlUrl("https://docs.example.com", { limit: 100, scrapeOptions: { formats: ["markdown"] }, webhook: "https://api.yourapp.com/webhooks/firecrawl", }); console.log(`Crawl started: ${job.id}`); // Webhook as object (with metadata and event filtering) const job2 = await firecrawl.asyncCrawlUrl("https://docs.example.com", { limit: 100, scrapeOptions: { formats: ["markdown"] }, webhook: { url: "https://api.yourapp.com/webhooks/firecrawl", events: ["completed", "page"], // only these even...