mine-the-papers-you-were-given

Solid

Use when the task ships PDFs in related_work/, at literature stage and before the study plan is costed. Covers reading those papers for the named tools, benchmarks, events and metrics the work will be judged against — as a work list rather than as background — and what to record for each one.

AI & Automation 804 stars 25 forks Updated today NOASSERTION

Install

View on GitHub

Quality Score: 82/100

Stars 20%
97
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# The papers in `related_work/` are a work list, not background reading A supplied paper is not context. It names the tools the field uses on this problem, the benchmark events results are reported against, the baselines a number is compared to. Those names are what a reader checks your work for, and they are sitting in a file you already have. ## The failure this prevents It is not that runs skip the papers. Measured across a 40-task batch: every task ships them (median 4 PDFs, median 250,000 characters of extractable text) and **every run referenced 100% of them**. They are opened. They are read for framing. Then the work list is written from the task statement alone, and everything the papers name goes unused. Chemistry_002 is the clean case. `CAPRI` appears **30 times** in its supplied papers and `HADDOCK3` **22 times**. The two graded requirements that name them — a CAPRI round result, and the tool's consensus scoring workflow — scored **5 and 0**. The report discusses CAPRI *as a concept* and never reports a CAPRI result. Life_001's papers name `NetMHCpan` five times; the requirement naming it scored 5. The shape is always the same: the run knows the field's vocabulary, because it read the papers, and produces its own analysis in its own terms beside a literature it has paraphrased rather than used. ## What to do 1. While the papers are open at literature stage, write `literature/named_from_papers.json`: one row per **proper noun** the supplied papers attac...

Details

Author
tangxiangru
Repository
tangxiangru/AutoR
Created
5 months ago
Last Updated
today
Language
Python
License
NOASSERTION

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

paper-writing-bench

Reverse-engineer raw materials (Sparse idea, Dense idea, experimental log) from an existing AI research paper to build a benchmark case for evaluating paper-writing pipelines. Replicates the PaperWritingBench dataset construction procedure from arXiv:2604.05018 §3 / App. C. TRIGGER when the user asks to "build a benchmark case from this paper", "reverse-engineer raw materials", or "evaluate my pipeline against PaperWritingBench".

2 Updated 2 days ago
Aukexecutivedepartment5152
AI & Automation Solid

paper-writing-bench

Reverse-engineer raw materials (Sparse idea, Dense idea, experimental log) from an existing AI research paper to build a benchmark case for evaluating paper-writing pipelines. Replicates the PaperWritingBench dataset construction procedure from arXiv:2604.05018 §3 / App. C. TRIGGER when the user asks to "build a benchmark case from this paper", "reverse-engineer raw materials", or "evaluate my pipeline against PaperWritingBench".

643 Updated 1 weeks ago
Ar9av
AI & Automation Listed

comparing-papers

Use when comparing a draft against specific prior work head to head — checking whether a baseline was trained at the same scale, whether protocols match, how many seeds each ran, or what a competitor actually reports. Triggers on "compare this paper to X", "how does our method differ from Y", "is the baseline comparison fair", "did they train at the same scale", or a shortlist of papers from a gap sweep.

2 Updated 3 days ago
chgagne