scrape

# Job Scraper --- ## How It Works This skill searches job portals using the **installed portal-search CLIs** in `.agents/skills/` (plus WebSearch as a fallback), using queries from your profile. It deduplicates against previously seen jobs and the application tracker, and presents new matches with a quick fit assessment. ## Invocation The user triggers this skill by saying things like: - "Find new jobs" - "Scrape for jobs" - "Any new positions?" - "/scrape" Optional arguments: - A focus area, e.g. "/scrape data science" or "/scrape geophysics" - "broad" to run all search categories, e.g. "/scrape broad" - "health" to run the portal health check only (Step 4.75), without searching, deduplicating, or presenting jobs - e.g. "/scrape health", or "/scrape health jobnet" to probe one portal even if disabled --- ## Execution Steps ### Step 0: Load State 1. Read `job_scraper/seen_jobs.json` (create if missing - start with `{"seen": {}}`) 2. Read `job_search_tracker.csv` to extract already-applied companies+roles 3. Read `search-queries.md` (this directory) for the search strategy ### Step 1: Search Read `search-queries.md` (this directory) for the search strategy. By default, run the top 3 priority query categories. If the user said "broad", run all categories. If the user specified a focus area (e.g. "data science"), prioritize queries from that category. **Use the installed CLI tools as the primary search mechanism.** Fall back to `WebSearch` only for portals that do n...