reproducibility-check

Solid

Use in Stage 08 (Dissemination) when assembling the release or submission bundle — auditing whether the run's code, data, results and figures are actually reproducible by someone else, writing the readiness checklist and threats-to-validity notes, or deciding what has to be disclosed as not verified.

AI & Automation 804 stars 25 forks Updated today NOASSERTION

Install

View on GitHub

Quality Score: 82/100

Stars 20%
97
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Reproducibility check Stage 08 must write review and readiness artifacts under `workspace/reviews/`. The purpose is to state honestly what a third party could reproduce from this run's directory alone — not to assert that everything is fine. The output of this check is a record of what was **verified**, what was **not verified**, and what is **known not to reproduce**. All three categories are legitimate. Only a fourth is not: recording an unchecked item as verified. ## Audit the run directory as a stranger would Work from `runs/<run_id>/` and assume no access to the conversation, the operator's memory, or the environment the run happened in. | Question | Where the answer must live | | --- | --- | | What was the research goal? | `user_input.txt` | | What was actually run? | `workspace/code/` — scripts, not descriptions | | What data went in? | `workspace/data/`, with provenance for anything downloaded | | What came out? | `workspace/results/`, indexed by `experiment_manifest.json` | | How do the figures relate to the results? | a script under `workspace/code/` that regenerates them | | What decisions were made and why? | the decision ledger in the stage summaries | | Which stages actually completed? | `run_manifest.json` — see below | ## Read the manifest before claiming the run is complete `run_manifest.json` distinguishes stages that were **approved** from stages that were **skipped**. A skipped stage has `skipped: true` and a `skip_kind` of `human` or `auto`; an `...

Details

Author
tangxiangru
Repository
tangxiangru/AutoR
Created
5 months ago
Last Updated
today
Language
Python
License
NOASSERTION

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category