finetuning-setup

Solid

Selects a base model and fine-tuning technique (SFT, DPO, or RLVR) for the user's use case by querying SageMaker Hub. Use when the user asks which model or technique to use, wants to start fine-tuning, or mentions a model name or family (e.g., "Llama", "Mistral") — always activate even for known model names because the exact Hub model ID must be resolved. Queries available models, validates technique compatibility, and confirms selections.

AI & Automation 765 stars 108 forks Updated 2 days ago Apache-2.0

Install

View on GitHub

Quality Score: 95/100

Stars 20%
96
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# Finetuning Setup Guides the user through selecting a base model and fine-tuning technique based on their use case. ## When to Use - User asks which fine-tuning technique to use - User wants to select or change their base model - User mentions a model name or family (e.g., "Llama", "Mistral") — the exact Hub model ID still needs to be resolved ## Prerequisites - A `use_case_spec.md` file exists. If not, activate the use-case-specification skill to generate it first. ## Workflow ### Step 1: Discover Hub 1. List all available SageMaker Hubs in the user's region by calling the SageMaker `ListHubs` API using the `aws___call_aws` tool. 2. From the results, filter out any hub whose `HubDescription` contains "AI Registry" — these do not contain JumpStart models. 3. The remaining hubs are eligible (e.g., `SageMakerPublicHub` and any private hubs). 4. If exactly one eligible hub exists, use it automatically — do not ask the user. 5. If multiple eligible hubs exist, present them to the user and ask which one to use. Example: ``` I found the following model hubs: - SageMakerPublicHub — SageMaker Public Hub - Private-Hub-XYZ — Private Hub models Which hub would you like to use? ``` 6. Store the selected hub name for use in subsequent steps. ### Step 2: Select Base Model 1. Read `use_case_spec.md` to understand the use case and success criteria. 2. Restate the use case in one sentence. 3. Always retrieve the full list of available SageMaker Hub model names b...

Details

Author
awslabs
Repository
awslabs/agent-plugins
Created
3 months ago
Last Updated
2 days ago
Language
Shell
License
Apache-2.0

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

finetuning

Generates a Jupyter notebook that fine-tunes a base model using SageMaker serverless training jobs. Use when the user says "start training", "fine-tune my model", "I'm ready to train", or when the plan reaches the finetuning step. Supports SFT, DPO, and RLVR trainers, including RLVR Lambda reward function creation.

765 Updated 2 days ago
awslabs
AI & Automation Solid

fine-tuning-expert

Use when fine-tuning LLMs, training custom models, or adapting foundation models for specific tasks. Invoke for configuring LoRA/QLoRA adapters, preparing JSONL training datasets, setting hyperparameters for fine-tuning runs, adapter training, transfer learning, finetuning with Hugging Face PEFT, OpenAI fine-tuning, instruction tuning, RLHF, DPO, or quantizing and deploying fine-tuned models. Trigger terms include: LoRA, QLoRA, PEFT, finetuning, fine-tuning, adapter tuning, LLM training, model training, custom model.

9,537 Updated 1 weeks ago
Jeffallan
AI & Automation Listed

fine-tuning-expert

Use when fine-tuning LLMs, training custom models, or optimizing model performance for specific tasks. Invoke for parameter-efficient methods, dataset preparation, or model adaptation.

2 Updated today
zacklecon
AI & Automation Listed

mission-control-keras-finetuning

Route Keras fine-tuning and transfer-learning work through Mission Control with explicit baseline, unfreeze, and evaluation steps.

1 Updated today
MN755
Data & Documents Solid

dataset-evaluation

Validates dataset formatting and quality for SageMaker model fine-tuning (SFT, DPO, or RLVR). Use when the user says "is my dataset okay", "evaluate my data", "check my training data", "I have my own data", or before starting any fine-tuning job. Detects file format, checks schema compliance against the selected model and technique, and reports whether the data is ready for training or evaluation.

765 Updated 2 days ago
awslabs