chemistry-a-cut-variant-takes-its-analyses-with-it

Solid

Use at literature survey, at study design, at every descope decision and again at writing, when the source's method is a family — the same module dropped into two or more backbones, or one architecture published in several named variants — and you are about to run only one of them. Covers listing which of the source's downstream analyses were produced from which variant before any of them is cut, shrinking a variant rather than deleting it, and what a saliency map, case study or ablation computed on the surviving variant is and is not evidence for.

AI & Automation 804 stars 25 forks Updated today NOASSERTION

Install

View on GitHub

Quality Score: 85/100

Stars 20%
97
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# An analysis inherits the model it was run on A method published as a family — the same new module dropped into a convolutional backbone and an attention backbone, the same architecture in a base and a "+" version — spreads its evidence across the variants. The benchmark table has a column each. But the *other* results are attached to one variant apiece: the worked case study was run on one of them, the saliency figure was drawn from one of them, the efficiency panel timed one of them. Those are not properties of the method in general. They are properties of a model, and only that model can produce them. `rebuild-the-sources-headline-table-row-for-row` covers the table: one column per variant, no empty legend entries, a published value in any cell you could not fill. This is the part that skill leaves out — everything downstream of the table also has a variant attached, and the attachment is invisible until you cut. ## Make the attachment explicit before you cut anything At literature stage, write the source's variants down the side and its results across the top, and mark which variant produced each: table row, ablation, case study, attribution map, runtime panel, failure analysis. It is a five-minute table and it is the only artifact that makes a descope decision visible. Then read the brief's objectives against it. When an objective is answered in the source by an analysis attached to one variant, that variant has become load-bearing for something other than a benchma...

Details

Author
tangxiangru
Repository
tangxiangru/AutoR
Created
5 months ago
Last Updated
today
Language
Python
License
NOASSERTION

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

chemistry-accuracy-and-cost-for-every-module-you-swap-in

Use at study design, through experimentation and again at analysis when the method under test is a drop-in replacement for a standard layer — a different basis, kernel, activation family or transform — and the source claims the replacement is both more accurate and cheaper. Covers giving every alternative module a cell in the accuracy column and in the cost column, fixing one matching convention across both, and dividing the runtime by the invariant already sitting in your own results file before you publish a contradiction of the source's ratio.

804 Updated today
tangxiangru
AI & Automation Featured

model-sourcing

Vet the concrete third-party model a study will be built on — this repository, this revision, this checkpoint — not the architecture family. Records a model dossier (source and version pin, licence and the file it was read from, intended use, pretrained-weight provenance, model task vs study task, reported validation, what the model was developed on, your evaluation arms) and gates it deterministically. Catches what a licence check and a citation count cannot: an evaluation arm sitting on the benchmark the model was developed or tuned on, so the arm reads like validation while being closer to a training-set score. Also an evaluation set inside a pretraining corpus, an unstated or use-incompatible licence, an unpinned revision, and a hardware claim never executed. It vets an artifact; it never downloads or runs one.

263 Updated 2 days ago
Aperivue
AI & Automation Solid

chemistry-fill-every-row-of-the-comparator-table

Use at literature stage and study design when the source publishes performance broken out by class of system, and you are about to choose your evaluation panel with a filter written for throughput. Covers transcribing the table as rows, auditing the inclusion filter against those rows before it is frozen, and buying one target per row before a second target for any row.

804 Updated today
tangxiangru