scraper-brief

# Scraper Brief ## What This Skill Does Writes a clear, technical brief describing exactly what data needs to be collected from a website or set of web pages, how it should be structured, and what edge cases and legal/ethical considerations apply — for handoff to a developer or data team. ## When To Use This Skill - You have identified a publicly accessible website containing data you need in bulk and want to brief a developer to collect it - You need to document what a scraper should collect before commissioning or building the tool - You want to think through the data structure, edge cases, and update frequency requirements before any technical work begins - You need a record of the collection methodology for editorial and legal transparency ## What You Need To Provide **Required:** The URL or website description. What data you need — the specific fields visible on the page. The scope — how many pages or records you expect to collect. The reason you need it (news investigation, research, ongoing monitoring). **Optional:** How frequently the data needs to be updated; whether pagination, search filters, or login walls are involved; any known technical obstacles (JavaScript rendering, anti-scraping measures); the output format you need. ## How the Assistant Approaches This 1. Maps the required data fields from the description of the source page, identifying what is structured (tables, clearly labelled fields) versus what requires extraction from running text. 2. Documents ...