reproduce

Featured

End-to-end paper reproduction from arxiv URL through smoke runs to replication experiments. Handles missing or partial official code, missing training scripts, missing hyperparameters, and private datasets via similar-public-dataset substitution. Use when the user asks to reproduce, implement, replicate, or re-run a paper from scratch, or pastes an arxiv URL with reproduction intent.

AI & Automation 408 stars 34 forks Updated 1 weeks ago MIT

Install

View on GitHub

Quality Score: 88/100

Stars 20%
87
Recency 20%
90
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Reproduce: paper reproduction from scratch Reproducing an ML paper often means filling gaps the authors didn't ship, training scripts, hyperparameter tables, augmentation specifics, exact dataset splits. This skill walks seven stages from "I have an arxiv link" to "I have a replication run with measurable delta vs the paper's number." Each stage has a separate reference file under `references/` so this overview stays scannable. ## When to run The user just said any of: - "reproduce / implement / replicate / re-run paper X" - pasted an arxiv URL with reproduction intent ("can you redo this", "let's try this approach") - pointed at an OpenReview / proceedings link with the same intent - said "the paper has no code, can we build it" ## Workflow | Stage | What | Reference | | ----- | -------------------------------------------------------------- | -------------------------------------------------------------- | | 1 | Paper acquisition (arxiv HTML → structured extract) | [references/01-paper-fetch.md](references/01-paper-fetch.md) | | 2 | Existing code discovery + inventory | [references/02-code-clone.md](references/02-code-clone.md) | | 3 | Gap analysis (extract every missing hyperparam from the prose) | [references/03-gap-analysis.md](references/03-gap-analysis.md) | | 4 | Implementation (uv venv, fill...

Details

Author
fcakyon
Repository
fcakyon/phd-skills
Created
6 months ago
Last Updated
1 weeks ago
Language
Shell
License
MIT

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

paper-repro

Structured workflow for reproducing a quantitative research paper or blog post analysis. Use when the user wants to reproduce, replicate, verify, or re-implement results from a paper, or asks if a paper's findings hold up.

0 Updated 1 months ago
saksham10arora-dotcom
AI & Automation Listed

prepare-to-reproduce

Turn a paper into a reproduction spec — pseudocode, the hyperparameter table, a gap list of everything the paper leaves unstated, and one minimal experiment. Run when asked to reimplement a paper, judge whether it can be reproduced at all, or find what is missing before writing code.

0 Updated 3 weeks ago
hirovel
Data & Documents Listed

academic-code-replicator

Full-lifecycle skill for replicating experiments from academic papers. Guides the agent through understanding the original codebase, constructing isolated environments, making safe platform-compatibility adaptations, executing on available hardware, and producing a documented comparison against paper-reported results. Use this skill whenever the user says things like: "replicate this paper", "reproduce this experiment", "make this old code run", "run this paper's code", "I'm trying to get this GitHub repo from a paper working", "help me replicate these results", "this code is from 2019 and won't install", "I need to reproduce Table X from this paper", or any variation of scientific code replication. PROACTIVELY trigger even if the user just says "help me run this paper's experiments" without explicitly mentioning replication.

0 Updated 1 months ago
jpmsilva1