train-the-named-architecture

Solid

Use at study design, implementation and experimentation when the brief's deliverable is a model you have to build — it names an architecture family (graph network, autoencoder, diffusion module, surrogate net) or a training regime (pre-training, fine-tuning, self-supervised, inverse design). Covers why a cheaper model class scores near zero however well it performs, why a scaled-down run of the named architecture beats a released checkpoint on every architecture criterion, and what to ablate.

AI & Automation 804 stars 25 forks Updated today NOASSERTION

Install

View on GitHub

Quality Score: 85/100

Stars 20%
97
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# When the brief names an architecture, the model is a deliverable, not a line in the cut order The reasoning that loses this is good reasoning. Building the named architecture from scratch is expensive; a cheaper model class will reach a better number on the supplied data; a released checkpoint will reach the published number exactly. All three are true, and all three lose, because a brief that names an architecture is graded on the architecture: its components, its training dynamics, its ablations. Those questions have no answer that a different model can give. So: **if the budget will not carry everything, cut seeds, cut substrates, cut your own extension. Never cut the model the brief names.** ## A scale model beats a correct number from something else The trade that looks obvious — "a from-scratch version at this budget would be far worse than the published one, so it cannot win" — is a prediction, and it is usually wrong about what is being graded. A small, honest re-implementation that keeps the named components and trains for a fraction of the source's budget answers every architecture-shaped criterion. A number obtained from something else answers none of them, however good the number is. Budget one small training arm before you budget a second inference sweep. ## Do both, when a release exists A released checkpoint and a small re-implementation answer different questions, and a task that names an architecture usually asks both: | the criterion says | what an...

Details

Author
tangxiangru
Repository
tangxiangru/AutoR
Created
5 months ago
Last Updated
today
Language
Python
License
NOASSERTION

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

chemistry-ablations-and-curves-without-an-accelerator

Use at study design after you have priced a scaled-down training arm and found the machine cannot carry it — no accelerator visible, or no wall clock for one arm. Covers the one-row-per-named-component table with the inference switch that removes each part, why an input ablation does not answer a component criterion, and the ladder of curves that still ships when nothing can be trained.

804 Updated today
tangxiangru
Data & Documents Featured

architecture-zoo

Choose a model architecture for a medical-imaging research question before scaffolding. Maps the task (classification, segmentation, detection, transfer), modality and dimensionality, labelled-data scale, and class imbalance to a shortlist of architectures, each grounded in its source paper with a when-to-use, a medical-imaging use, a reference implementation, the typical validation setup, and the matching model-scaffold template. Covers the foundational curriculum (ResNet, DenseNet, EfficientNet, ViT, Swin; U-Net, 3-D U-Net, Attention/Residual U-Net, nnU-Net (+ ResEnc/MedNeXt/STU-Net), Mask R-CNN; SAM/MedSAM, nnInteractive/VISTA3D interactive-3D, TotalSegmentator, BiomedCLIP, DINO/MAE/SimCLR; and graph neural nets — GCN/GraphSAGE/GAT/GIN/BrainGNN — for brain connectomes). It teaches archetypes and the task-to-architecture logic (including the "scale the CNN, new≠better" rigour caveat), not a live SOTA leaderboard.

263 Updated 2 days ago
Aperivue
AI & Automation Featured

ai-architecture-advisor

Chooses among AI/ML approaches: classical ML, LLM, RAG, fine-tuning, agents, multimodal, embeddings/recsys, dense/MoE/SSM/diffusion. Use when picking or scaling an architecture.

80 Updated 1 weeks ago
vasilyu1983