rseng-reproducibility

Solid

Covers end-to-end computational reproducibility: making a project's results regenerable with one command, determinism and seed discipline, research compendium structure, replication packages for papers, Binder-launchable repositories, artifact evaluation and reproducibility badges. Use PROACTIVELY when the user wants results others can reproduce, prepares a replication package or artifact submission, mentions reproducibility, research compendia, Binder or badges, asks why results differ between runs or machines, or is about to publish results whose regeneration path is untested. (Pinning environments: rseng-reproducible-environments; pipeline automation: rseng-workflows; run-level lineage: rseng-provenance.)

AI & Automation 14 stars 2 forks Updated 4 days ago MIT

Install

View on GitHub

Quality Score: 83/100

Stars 20%
39
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# Computational reproducibility Reproducibility is the ability of someone else - including the author in six months - to regenerate the results from the code and data. It is not one practice but a stack: pinned environments (rseng-reproducible-environments), scripted pipelines (rseng-workflows), versioned data (rseng-data-management) and controlled randomness, assembled so that ONE documented command rebuilds the results. This skill owns the assembly and its verification; the layers below have their own skills. The bar to aim for: a stranger with the repository and the README reproduces the paper's numbers without emailing anyone. ## The one-command bar - Everything scripted, nothing manual: any step a human performs by hand (a click, a copy, an "then edit line 12") is a reproduction failure waiting to happen. Encode the full path from raw data to final figures/tables in a workflow or top-level script (rseng-workflows). - One entry point, documented: `make reproduce`, `snakemake all` or ./run.sh - named in the README with expected runtime and resource needs. Long-running steps get cached intermediates so partial reruns are practical. - Outputs land in generated directories, mapped to the paper: which script makes Figure 3 must be answerable from the repo (a results/README or a figures manifest). - Configuration explicit: every parameter that shaped the published results lives in versioned config files, not command-line lore or notebook cell edits. ##...

Details

Author
fdiblen
Repository
fdiblen/rseng-agent-skills
Created
4 days ago
Last Updated
4 days ago
Language
Python
License
MIT

Similar Skills

Semantically similar based on skill content — not just same category

DevOps & Infrastructure Solid

rseng-reproducible-environments

Covers making research software environments reproducible: pinning a language version and its dependencies in a per-project virtual environment, choosing a package/environment manager, and packaging code and its full stack into a container. Use when the user asks how to set up venv/conda/poetry/uv/renv, lock or pin dependencies, share a runnable environment, escape "dependency hell" or "works on my machine", write a Dockerfile, build an Apptainer/Singularity image for HPC, or decide between a virtual environment and a container. For regenerating a project's results end to end see rseng-reproducibility; for environments of multi-step pipelines see rseng-workflows.

14 Updated 4 days ago
fdiblen
AI & Automation Listed

reproducibility-standards

Seeding, dependency pinning, environment capture, and data versioning for fully reproducible ML workflows.

1 Updated 4 days ago
niels-emmer
AI & Automation Solid

rseng-provenance

Covers capturing and packaging the provenance of software and data: which inputs, code versions, parameters, environments and agents produced each result, recorded run by run; the W3C PROV model for describing it, RO-Crate for packaging research objects with their provenance, embedding provenance in file metadata, and data-flow lineage across pipelines. Use when the user asks where a result came from or whether it can be traced, wants provenance capture, lineage or an RO-Crate, or mentions PROV, research objects or audit trails; use PROACTIVELY when a pipeline produces results whose origins must be reconstructable long after the run.

14 Updated 4 days ago
fdiblen