← ClaudeAtlas

arxiv-searchlisted

Retrieve arXiv paper metadata with keyword queries or import an offline arXiv export, and save results as JSONL (`papers/papers_raw.jsonl`).
WILLOSCAR/research-units-pipeline-skills · ★ 510 · Data & Documents · score 81
Install: claude install-skill WILLOSCAR/research-units-pipeline-skills
# arXiv Search (metadata-first) ## Triggers & routing - **Trigger**: arXiv, arxiv, paper search, metadata retrieval, 文献检索, 论文检索, 拉取元数据, 离线导入. - **Use when**: 需要一个初始论文集合(survey/snapshot 的 Stage C1),来源为 arXiv(在线检索或离线导入 export)。 Collect an initial paper set with enough metadata to support downstream ranking, taxonomy building, and citation generation. When online, prefer rich arXiv metadata (categories, arxiv_id, pdf_url, published/updated, etc.). When offline, accept an export and convert it cleanly. ## Load Order Always read: - `references/domain_pack_overview.md` — how domain packs drive topic-specific behavior Domain packs (loaded by topic match): - `assets/domain_packs/llm_agents.json` — pinned IDs, query rewrite rules for LLM agent topics ## Script Boundary Use `scripts/run.py` only for: - arXiv API retrieval and XML parsing - offline export conversion (CSV/JSON/JSONL normalization) - metadata enrichment via `id_list` backfill Do not treat `run.py` as the place for: - hardcoded topic detection or query rewriting (use domain packs) - domain-specific pinned paper lists (externalize to `assets/domain_packs/`) ## Contract-driven behavior - Domain-pack query rewriting is the default for broad discovery Workflows. - A focused Workflow may set `quality_contract.retrieval_policy.domain_pack_query_mode: explicit`; in that mode, the query list in `queries.md` remains authoritative and the domain pack must not replace its topic focus. - `quality_contract.retrieval_