← ClaudeAtlas

scraplinglisted

Guides safe, version-aware use of Scrapling for HTML extraction, adaptive selectors, static or browser-backed fetching, spiders, proxy rotation, robots.txt-aware crawling, and MCP integration. Use when choosing a Scrapling fetcher/session, building a crawl, repairing selectors after site changes, migrating from BeautifulSoup/Scrapy, or validating Scrapling API usage against the repository's pinned upstream version.
Thanane15M/scrapling-skill · ★ 0 · Web & Frontend · score 68
Install: claude install-skill Thanane15M/scrapling-skill
# Scrapling — adaptive web extraction Target upstream: **Scrapling 0.4.14**. Treat `UPSTREAM_VERSION` and `VERIFICATION.md` as the compatibility contract. This skill is intentionally version-aware. If the installed Scrapling version differs from the pinned version, verify the relevant API before copying examples. ## Safety and scope first Use Scrapling only for data and systems you are authorized to access. Respect applicable law, privacy requirements, site terms and robots directives. Prefer the least powerful mechanism that solves the task: 1. public JSON/API if available; 2. simple HTTP fetch for server-rendered HTML; 3. browser-backed fetch only when JavaScript or an explicitly authorized anti-bot flow requires it; 4. full spider only when multi-page crawling and scheduling are actually needed. Do not use stealth/browser features to defeat access controls, authentication boundaries, paywalls, account restrictions, or other controls you are not authorized to bypass. ## Decision tree ```text Need data from a URL ├─ Public/official JSON API exists → use the API, not Scrapling └─ Need HTML/DOM ├─ Server-rendered response is enough │ ├─ one-shot → Fetcher │ ├─ async fan-out → AsyncFetcher │ └─ shared state/cookies → FetcherSession └─ Browser execution required ├─ ordinary JS rendering → DynamicFetcher / DynamicSession └─ authorized anti-bot/browser-fingerprint case → StealthyFetcher / StealthySession Multi-page crawl with scheduling, ded