firecrawl-core-workflow-a

Featured

Execute Firecrawl primary workflow: scrape and crawl websites into LLM-ready markdown. Use when scraping single pages, crawling entire sites, or building content ingestion pipelines with Firecrawl's scrapeUrl and crawlUrl methods. Trigger with phrases like "firecrawl scrape", "firecrawl crawl site", "scrape page to markdown", "crawl documentation".

AI & Automation 2,926 stars 433 forks Updated yesterday MIT

Install

View on GitHub

Quality Score: 99/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Firecrawl Core Workflow A — Scrape & Crawl ## Overview Primary workflow for Firecrawl: convert websites into clean LLM-ready markdown. Covers single-page scraping with `scrapeUrl`, multi-page crawling with `crawlUrl`, async crawl jobs with polling, and content processing pipelines. ## Prerequisites - `@mendable/firecrawl-js` installed - `FIRECRAWL_API_KEY` environment variable set - Target URL(s) identified ## Instructions ### Step 1: Single-Page Scrape ```typescript import FirecrawlApp from "@mendable/firecrawl-js"; const firecrawl = new FirecrawlApp({ apiKey: process.env.FIRECRAWL_API_KEY!, }); // Scrape a single page to clean markdown const result = await firecrawl.scrapeUrl("https://docs.example.com/api", { formats: ["markdown"], onlyMainContent: true, // strips nav, footer, sidebars waitFor: 2000, // wait 2s for JS to render }); if (result.success) { console.log("Title:", result.metadata?.title); console.log("Source:", result.metadata?.sourceURL); console.log("Markdown:", result.markdown?.substring(0, 200)); } ``` ### Step 2: Multi-Page Synchronous Crawl ```typescript // Crawl a site — Firecrawl follows links, renders JS, returns all pages const crawlResult = await firecrawl.crawlUrl("https://docs.example.com", { limit: 50, // max pages to crawl maxDepth: 3, // link depth from start URL includePaths: ["/docs/*", "/api/*"], // only these paths excludePaths: ["/blog/*", "/changelog/*"], allowB...

Details

Author
jeremylongshore
Repository
jeremylongshore/claude-code-plugins-plus-skills
Created
1 years ago
Last Updated
yesterday
Language
Python
License
MIT

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category