← ClaudeAtlas

collection-skilllisted

Chinese-social-media crawler picker — recommends the right tool and actually fetches posts, notes, comments, and reviews from 小红书 / 抖音 / 哔哩哔哩 / 微博 / 知乎 / 贴吧 / 快手 / 微信公众号 / 视频号 / 淘宝 / 京东 / 拼多多 / 豆瓣 / 雪球 (xhs, douyin, bilibili, weibo, zhihu, tieba, kuaishou, wechat, taobao, jd, pdd, douban, xueqiu), behind a compliance gate. Also covers general scraping of any website or API (抓取 / 采集 / 爬取 / 爬虫 / 抓数据 / 获取数据 / 数据采集 / scrape / crawl / collect data). Maintains a curated, auto-refreshed catalog of scrapers, API collectors, MCP/agent skills, and datasets.
Yuuqq/collection-skill · ★ 0 · AI & Automation · score 70
Install: claude install-skill Yuuqq/collection-skill
<essential_principles> <principle name="Catalog First, Crawl Second"> This skill has two halves that share one knowledge base: - **Discover & catalog** — periodically scan GitHub for "collection-class" repos (scrapers, API collectors, agent skills/MCP, datasets/awesome-lists) and store them in `references/tool-catalog.{md,json}`. - **Match & crawl** — when the user names a target, recommend tools from the catalog via progressive disclosure, then start crawling. Always check the catalog freshness before recommending. If stale (> N days), surface that to the user. </principle> <principle name="Chinese-Social First"> The headline use case is Chinese social/e-commerce platforms. When the user names one (小红书/抖音/B站/微博/知乎/贴吧/快手/公众号/视频号/淘宝/京东/拼多多/豆瓣/雪球…), route **directly** to the fast path (`workflows/match-and-crawl.md` Step 3B) via `references/chinese-social-platforms.md` — never show the generic category menu. The general five-category catalog is the fallback breadth for every other target. **Compliance gate (non-negotiable):** most Chinese-platform tools are reverse-engineered and violate platform ToS. Always show the compliance reminder before tool selection, re-confirm intent before the first network request, never help evade anti-bot / risk-control systems, and default to low request rates + anonymized personal data. </principle> <principle name="Progressive Disclosure"> Never dump the whole catalog. Show a **category menu** first, then drill into tool cards within the cho