scrapling
SolidScrape, crawl, or extract structured data from websites with Scrapling - anti-bot bypass (Cloudflare Turnstile), stealth headless browsing, JavaScript rendering, adaptive selectors that survive page changes, and a Scrapy-like spiders framework. Use when a fetch is blocked, returns empty or JavaScript-rendered content, or hits an anti-bot wall; when data must be pulled from many pages or a whole site; or when asked to write Python scraping or spider code. NOT for simply reading, summarizing, or researching a public page that fetches fine - agent-reach owns that. Windows/CLI edition; the Linux sibling is scrapling-cowork.
Install
Quality Score: 80/100
Skill Content
Details
- Author
- M4NUSH7
- Repository
- M4NUSH7/Niche-Claude-Code
- Created
- 6 days ago
- Last Updated
- today
- Language
- Python
- License
- MIT
Integrates with
Similar Skills
Semantically similar based on skill content — not just same category
web-scraping
Authorized web content extraction with trust-boundary controls, scraping cascades, poison-pill detection, browser rendering, observed API analysis, and social-media archiving. Use when extracting public content, diagnosing access failures, implementing respectful scrapers, or processing social-media sources with requests, trafilatura, Playwright, yt-dlp, or instaloader.
firecrawl
Scrape, search, crawl, map, parse, or interact with web pages via the firecrawl-cli binary, writing results to disk instead of streaming them into context — actions: scrape, search, crawl, map, parse, interact, agent, monitor, update. Use when: WebFetch returns 403/429 (Cloudflare, PerimeterX, anti-bot block), a page requires JS rendering or clicks/form fills, you need web search with scraped results, bulk URL discovery and crawling, a local file (PDF/DOCX/XLSX) needs text extraction to markdown, or a natural-language web research task — skip for plain unprotected pages (WebFetch suffices) or when you want synthesis rather than primary source.
scrape
Pull structured data from a web page with the browse shim — navigate, extract, return JSON. Read-only.