firecrawl-known-pitfalls

Featured

Identify and avoid Firecrawl anti-patterns and common integration mistakes. Use when reviewing Firecrawl code, onboarding new developers, or auditing existing integrations for best practices violations. Trigger with phrases like "firecrawl mistakes", "firecrawl anti-patterns", "firecrawl pitfalls", "firecrawl what not to do", "firecrawl code review".

AI & Automation 2,926 stars 433 forks Updated yesterday MIT

Install

View on GitHub

Quality Score: 99/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Firecrawl Known Pitfalls ## Overview Real gotchas from production Firecrawl integrations. Each pitfall includes the bad pattern, why it fails, and the correct approach. Use this as a code review checklist. ## Pitfall 1: Unbounded Crawl (Credit Bomb) ```typescript import FirecrawlApp from "@mendable/firecrawl-js"; const firecrawl = new FirecrawlApp({ apiKey: process.env.FIRECRAWL_API_KEY!, }); // BAD: no limit — a docs site with 50K pages burns your entire credit balance await firecrawl.crawlUrl("https://docs.large-project.org"); // GOOD: always set limit, maxDepth, and path filters await firecrawl.crawlUrl("https://docs.large-project.org", { limit: 100, maxDepth: 3, includePaths: ["/api/*", "/guides/*"], excludePaths: ["/changelog/*", "/blog/*"], scrapeOptions: { formats: ["markdown"] }, }); ``` ## Pitfall 2: Not Specifying Output Format ```typescript // BAD: default format may not include markdown const result = await firecrawl.scrapeUrl("https://example.com"); console.log(result.markdown); // might be undefined! // GOOD: explicitly request the format you need const result = await firecrawl.scrapeUrl("https://example.com", { formats: ["markdown"], onlyMainContent: true, }); console.log(result.markdown); // guaranteed present ``` ## Pitfall 3: Not Waiting for JS-Heavy Pages ```typescript // BAD: SPAs show loading state, not content const result = await firecrawl.scrapeUrl("https://app.example.com/dashboard"); // result.markdown === "Loading..." or em...

Details

Author
jeremylongshore
Repository
jeremylongshore/claude-code-plugins-plus-skills
Created
1 years ago
Last Updated
yesterday
Language
Python
License
MIT

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category