← ClaudeAtlas

scraplinglisted

Local Python web scraping with anti-bot bypass, adaptive element tracking, and stealth browser automation. This skill should be used when scraping pages behind Cloudflare or anti-bot protection, extracting specific elements with CSS/XPath selectors, stealth fetching with TLS impersonation, local scraping without API keys, or when adaptive element tracking is needed to survive site redesigns. Complements the firecrawl skill (cloud API) with 100% local execution.
tdimino/claude-code-minoan · ★ 32 · Web & Frontend · score 82
Install: claude install-skill tdimino/claude-code-minoan
# Scrapling -- Local Stealth Web Scraping 100% local Python library (BSD-3, [D4Vinci/Scrapling](https://github.com/D4Vinci/Scrapling)). No API keys, no cloud dependencies. Built-in Cloudflare solver, TLS impersonation, and adaptive element tracking. ## When to Use Scrapling vs Firecrawl | Need | Use | Why | |------|-----|-----| | Clean markdown from a URL | `firecrawl scrape --only-main-content` | Optimized for LLM markdown conversion | | Bypass Cloudflare/anti-bot | `scrapling` stealth fetch | Built-in Turnstile solver, Patchright stealth | | Extract specific elements | `scrapling` with CSS/XPath selectors | Element-level precision, adaptive tracking | | No API key available | `scrapling` | 100% local, zero credentials | | Batch cloud scraping | `firecrawl crawl` / `batch-scrape` | Cloud infrastructure, parallel processing | | Site redesign resilience | `scrapling` adaptive mode | SQLite-backed similarity matching | | Full-site concurrent crawl | `scrapling` Spider framework | Scrapy-like with pause/resume | | Web search + scrape | `firecrawl search --scrape` | Combined search + extraction | ## Installation Run once to set up Scrapling with all features: ```bash ~/.claude/skills/scrapling/scripts/scrapling_install.sh ``` Installs `scrapling[all]` via uv, downloads Chromium + system dependencies, and verifies all fetchers load. ## Quick Start -- Stdout Wrapper The wrapper uses Scrapling's Python API directly (faster than CLI, avoids curl_cffi cert issues) and outputs