send-experiment-designer

Featured

Use when the user asks to "design an email A/B test", "set up a multivariate subject/CTA test", "run a send-time test", "build a hold-out group", or "is this email test significant — promote or kill?"; produces a falsifiable hypothesis, a one-variable-per-cell variant matrix, a sample-size / MDE / duration / power plan, and a documented significance read with a promote / kill / keep-testing call on your own ESP export. Not for computing the program-wide EQS or running the vetoes — use email-quality-auditor; not for writing the email itself — use email-creative-builder. 邮件AB测试设计/多变量测试/发送时间测试/留出组/显著性判定

Web & Frontend 2,354 stars 322 forks Updated today Apache-2.0

Install

View on GitHub

Quality Score: 98/100

Stars 20%
100
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
80
License 10%
100
Description 5%
100

Skill Content

# Send Experiment Designer Designs email experiments across four modes and reads them out: a falsifiable hypothesis, a variant matrix that isolates **one** variable per cell, a sample-size / minimum-detectable-effect / run-duration / power plan, and a documented significance read with a **promote / kill / keep-testing** decision. **Mode set (pick one):** | Mode | Isolated variable | Primary metric | |------|-------------------|----------------| | `a-b` | one change — subject *or* preheader *or* CTA *or* creative | open (subject) / click / CTOR (CTA/creative) | | `multivariate` | 2+ factors crossed (e.g. subject × CTA), one variable per cell | the goal metric, powered per cell | | `send-time` | deploy hour/day; subject, segment, creative held constant | same-window engagement (open/click) | | `hold-out` | send vs no-send (randomized control receives nothing / current default) | conversion or revenue-per-recipient (incremental lift) | Default the mode from the request when it is unambiguous (e.g. "test two subject lines" → `a-b`, "best hour to send" → `send-time`, "measure incremental revenue" → `hold-out`); state the picked mode back and proceed. **Scope guard:** this skill owns email **experiment design + the significance read** only. It scores the SEND **E (Engagement)** lever as a test signal — it does **not** compute the goal-weighted **EQS** or run the `S1/S2/N1/D1` vetoes ([email-quality-auditor](../email-quality-auditor/SKILL.md) does), and it does **not** write th...

Details

Author
aaron-he-zhu
Repository
aaron-he-zhu/aaron-marketing-skills
Created
6 months ago
Last Updated
today
Language
Python
License
Apache-2.0

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category