run-experiment

Featured

Deploy and run ML experiments on local or remote GPU servers. Use when user says "run experiment", "deploy to server", "跑实验", or needs to launch training jobs.

AI & Automation 19,432 stars 1560 forks Updated today MIT

Install

View on GitHub

Quality Score: 93/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Run Experiment Deploy and run ML experiment: $ARGUMENTS ## Workflow ### Step 1: Detect Environment Read the project's `AGENTS.md` to determine the experiment environment: - **Local GPU**: Look for local CUDA/MPS setup info - **Remote server**: Look for SSH alias, conda env, code directory If no server info is found in `AGENTS.md`, ask the user. ### Step 2: Pre-flight Check Check GPU availability on the target machine: **Remote:** ```bash ssh <server> nvidia-smi --query-gpu=index,memory.used,memory.total --format=csv,noheader ``` **Local:** ```bash nvidia-smi --query-gpu=index,memory.used,memory.total --format=csv,noheader # or for Mac MPS: python -c "import torch; print('MPS available:', torch.backends.mps.is_available())" ``` Free GPU = memory.used < 500 MiB. ### Step 3: Sync Code (Remote Only) Check the project's `AGENTS.md` for a `code_sync` setting. If not specified, default to `rsync`. #### Option A: rsync (default) Only sync necessary files — NOT data, checkpoints, or large files: ```bash rsync -avz --include='*.py' --exclude='*' <local_src>/ <server>:<remote_dst>/ ``` #### Option B: git (when `code_sync: git` is set in AGENTS.md) Push local changes to remote repo, then pull on the server: ```bash # 1. Push from local git add -A && git commit -m "sync: experiment deployment" && git push # 2. Pull on server ssh <server> "cd <remote_dst> && git pull" ``` Benefits: version-tracked, multi-server sync with one push, no rsync include/exclude rules needed....

Details

Author
wanshuiyin
Repository
wanshuiyin/Auto-claude-code-research-in-sleep
Created
8 months ago
Last Updated
today
Language
Python
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

experiment

Run a materials-science / ML compute job on Rockie GPU capacity. Trigger words "run experiment", "submit job", "/experiment", or requests to quote/approve GPU spend before an experiment. Picks the right GPU type and count from a natural-language description (DFT for QE/VASP/ABINIT, MD for GROMACS/LAMMPS/OpenMM, training for PyTorch/JAX), generates the script, routes Rockie-originated submits through the embedded budget-term-sheet gate plus `runtime/submit.py`, polls status, streams logs, and surfaces the final artifacts. Use this for anything that needs a GPU — single A100 up to multi-pod B200 clusters.

23 Updated 2 months ago
Rockielab
AI & Automation Listed

remote-gpu-trainer

Use when a user runs, debugs, verifies, or ships a DL experiment on a GPU they OWN or RENT (AutoDL, RunPod, vast.ai, Lambda, Paperspace, 恒源云/矩池云/Featurize/揽睿星舟, bare SSH, Slurm, K8s; single/multi-instance). Triggers (multilingual): 本地训练/local training, 远程 GPU 训练/租卡/GPU rental, spot 抢占/preemption, 断点续训/resumable, 防 SSH 断线/tmux 守护, 多实例 ablation, 关机/销毁/stop-vs-terminate billing, checkpoint 磁盘满, CUDA OOM/显存不足, loss NaN/spike/不收敛, overfit 单 batch, FSDP/DeepSpeed/torchrun, 多卡 hang, 训练太慢/GPU util 低, dataloader/数据增广 bug; 消融结果异常/ablation looks wrong, 复现/reproducibility, 数据泄漏/leakage/test-set tuning, mAP=0/全零指标, 输出恒定/model-ignores-input, train-good/val-collapse, 对比不公平/unfair baseline, 单 seed/no error bars, loss 太好/too-good-to-be-true, 跨文档对账/cross-doc drift; 交付产物/deliverable, 唯一真源/single source of truth, best ckpt 拉回, 结果可视化/论文图脚本, manifest/provenance, 一键复现/repro, EVIDENCE.json. NOT for multi-cloud price-shopping + auto spot-recovery (SkyPilot), BYOC dev environments (dstack), or zero-ops serverless inference (Modal).

42 Updated yesterday
Hanyuyuan6
AI & Automation Listed

experiment-queue

SSH job queue for multi-seed/multi-config ML experiments with OOM-aware retry, stale-screen cleanup, and wave-transition race prevention. Use when user says "batch experiments", "队列实验", "run grid", "multi-seed sweep", "auto-chain experiments", or when /run-experiment is insufficient for 10+ jobs that need orchestration.

6 Updated 3 months ago
wookat