scrapling

Solid

Scrape, crawl, or extract structured data from websites with Scrapling - anti-bot bypass (Cloudflare Turnstile), stealth headless browsing, JavaScript rendering, adaptive selectors that survive page changes, and a Scrapy-like spiders framework. Use when a fetch is blocked, returns empty or JavaScript-rendered content, or hits an anti-bot wall; when data must be pulled from many pages or a whole site; or when asked to write Python scraping or spider code. NOT for simply reading, summarizing, or researching a public page that fetches fine - agent-reach owns that. Windows/CLI edition; the Linux sibling is scrapling-cowork.

AI & Automation 1 stars 0 forks Updated today MIT

Install

View on GitHub

Quality Score: 80/100

Stars 20%
10
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# Scrapling Adaptive web scraping: one library covering a single request, a stealth browser fetch, and a full concurrent crawl. Selectors relocate themselves when a page changes; the fetchers bypass anti-bot systems such as Cloudflare Turnstile without external solvers, credentials, or API keys. Proxy and CDP settings are optional and supplied by the user. Requires Python 3.10+ and Scrapling 0.4.11 or newer. This is the official skill for the `scrapling` library, from its author. Windows/CLI edition. ## Interop <!-- interop-contract: v1 --> **Edition:** CLI (Claude Code), Windows. **Precedence:** - Yields to `agent-reach` on reading and researching public content (a page that fetches fine is a browser launch for curl's job). - Yields to `ponytail` on scrape necessity and code volume (whether it must exist, and in how few lines). - Wins over `agent-reach` on blocked, JS-rendered or crawl fetches (the tier curl cannot reach). - Wins over `ponytail` on fetcher tier (an observed 403 is evidence, not speculation). - Complements `token-efficiency` - `-s` selectors and `--ai-targeted` are the same token-reduction family; no precedence. - Disjoint from `graphify`, `init-harness`, `install-skill`, `playwright-tester`, `production-grade-scaffold`, `skill-creator`, `ui-standout`. - External, conditional: `scrapling-cowork` - Linux sibling. **Owns:** blocked/anti-bot fetches, JS rendering, crawls, CSS/XPath extraction, spiders; `scrapling extract`, `scrapling.fetchers`/`.pa...

Details

Author
M4NUSH7
Repository
M4NUSH7/Niche-Claude-Code
Created
6 days ago
Last Updated
today
Language
Python
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category