ad-test-designer

Featured

Use when the user asks to "design an A/B test", "set up a creative/landing test", "run an incrementality test", or "is this test significant — promote or kill?"; produces a hypothesis, variant matrix, sample-size/duration/power plan, a documented significance read, and a promote/kill decision on your own exported results. Not for producing the variants — use ad-creative-builder; not for reading back one shipped change vs a control — use paid-measurement-loop; not for cross-channel reporting — use performance-analyzer. 广告AB测试设计/实验设计/显著性判定/增效测试

Web & Frontend 2,354 stars 322 forks Updated today Apache-2.0

Install

View on GitHub

Quality Score: 98/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# Ad Test Designer Designs paid-ad creative/landing A/B/n and incrementality tests and reads them out: hypothesis, variant matrix, sample-size/duration/power plan, a documented significance read, and a promote/kill decision. This skill owns the **experiment design + statistical decision** — it does not produce the variants (`ad-creative-builder` does), does not read back one already-shipped change vs a control over a window (`paid-measurement-loop` does), and does not do cross-channel reporting (`performance-analyzer` does). It scores the ROAS **O (Offer)** lever, with **S** CTR/CVR as the test signal. ## Quick Start ```text Design an A/B test for two landing-page hero variants. Baseline CVR is 3%, I want to detect a 15% lift. Goal is DR. ``` ```text I have 4 RSA creative variants to test on a prospecting set. Build the variant matrix, sample size, and run duration. ``` ```text Here's my finished test results CSV (variant, sessions, conversions). Is the winner significant — promote or kill? ``` ## Skill Contract - **Expected output**: a test design (hypothesis, variant matrix, primary/secondary/guardrail metrics, sample-size + duration + power plan) **and/or** a read-out (documented significance method, lift vs minimum practical lift, a promote/kill decision). - **Reads**: what the user wants to test, the goal column (DR or prospecting), baseline CVR/CTR and traffic volume; for a read-out, the user's own exported results CSV (variant, sessions/impressions, conversions/cl...

Details

Author
aaron-he-zhu
Repository
aaron-he-zhu/aaron-marketing-skills
Created
6 months ago
Last Updated
today
Language
Python
License
Apache-2.0

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category