arxiv-search

# arXiv Search (metadata-first) Collect an initial paper set with enough metadata to support downstream ranking, taxonomy building, and citation generation. When online, prefer rich arXiv metadata (categories, arxiv_id, pdf_url, published/updated, etc.). When offline, accept an export and convert it cleanly. ## Load Order Always read: - `references/domain_pack_overview.md` — how domain packs drive topic-specific behavior Domain packs (loaded by topic match): - `assets/domain_packs/llm_agents.json` — pinned IDs, query rewrite rules for LLM agent topics ## Script Boundary Use `scripts/run.py` only for: - arXiv API retrieval and XML parsing - offline export conversion (CSV/JSON/JSONL normalization) - metadata enrichment via `id_list` backfill Do not treat `run.py` as the place for: - hardcoded topic detection or query rewriting (use domain packs) - domain-specific pinned paper lists (externalize to `assets/domain_packs/`) ## Contract-driven behavior - Domain-pack query rewriting is the default for broad discovery Workflows. - A focused Workflow may set `quality_contract.retrieval_policy.domain_pack_query_mode: explicit`; in that mode, the query list in `queries.md` remains authoritative and the domain pack must not replace its topic focus. - `quality_contract.retrieval_policy.minimum_records` turns a Workflow's raw candidate-pool floor into a strict quality-gate check. ## Input - `queries.md` (keywords, excludes, time window) ## Outputs - `papers/papers_raw...