a-serial-queue-is-a-measurement-you-did-not-take
SolidUse at study design when the run queue is priced, at implementation when the first launcher script is written, and at every stage boundary while fits, simulations or samples are still running, especially when the brief states a CPU allocation and your queue happens to run one job at a time. Covers why running nproc is not the missing step, a stated allocation versus an enforced cgroup limit, the two-job A/B and the width ladder that settle how many concurrent processes to run, processes versus per-process threads, and re-pricing every arm you declined while the node sat idle.
Install
Quality Score: 82/100
Skill Content
Details
- Author
- tangxiangru
- Repository
- tangxiangru/AutoR
- Created
- 6 months ago
- Last Updated
- 2 weeks ago
- Language
- Python
- License
- NOASSERTION
Integrates with
Similar Skills
Semantically similar based on skill content — not just same category
count-your-hypotheses-not-your-arms
Use at study design, implementation, experimentation and analysis when the run has a hard wall clock, models that take hours to train, and more than one configuration you would like to try in parallel - several seeds, several widths, a warm restart, a variant of the variant. Covers reading the machine you actually have instead of the thread count you typed, measuring the contention tax rather than assuming it, the distinct-hypothesis count that decides whether a launch buys anything, computing `converged` from the log instead of declaring it, reporting a blend of arms the clock cut as the repair it is, and the idle-cores failure at the other end of the run.
running-cluster-experiments
Use when planning, budgeting, submitting or resuming a multi-job experiment campaign on a Slurm/HPC cluster — sizing walltime, shaping jobs and arrays, deciding what to submit first, or after a job hit its walltime, produced no results, silently ran the wrong configuration, or got the wrong number of GPUs.
a-throughput-number-belongs-to-the-runtime-not-the-model
Use at the survey, study design and implementation stages when the task needs a pretrained model, solver or library you must download and run on the machine you were given, and the first configuration you try is too slow to cover the split in the time you have. Covers why the seconds-per-item you just measured is a property of the runtime, the workload and the machine as much as of the component, which field to change before demoting it, re-asking the component question after you fix the runtime, and checking that your fallback still has the property you picked the original for.