experiment

Solid

Designing A/B tests: hypothesis docs, sample size, feature flags, significance analysis, CUPED, SRM detection, switchback experiments. Use when hypothesis validation is needed.

AI & Automation 72 stars 14 forks Updated today MIT

Install

View on GitHub

Quality Score: 85/100

Stars 20%
62
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

<!-- CAPABILITIES_SUMMARY: - hypothesis_document_creation: Structure hypotheses with PICOT (Population, Intervention, Control, Outcome, Time) - ab_test_design: Variants, sample size, duration, randomization, targeting - sample_size_calculation: Power analysis from baseline rate, MDE, significance level, power - feature_flag_implementation: LaunchDarkly, Unleash, Statsig, GrowthBook, Eppo/Datadog Experiments, Spotify Confidence, custom flag patterns for gradual rollout - statistical_significance_analysis: Z-test, chi-square, and Bayesian analysis of results - experiment_report_generation: Results with confidence intervals, recommendations, learnings - sequential_testing: Anytime-valid sequential testing (confidence sequences / mSPRT) for valid early stopping - multivariate_testing: Factorial design for several variables at once - variance_reduction: CUPED/CUPAC pre-experiment covariate adjustment, CUPED++ and full regression adjustment, MLRATE for ML-predicted covariates, Winsorization for heavy-tailed metrics, and in-experiment covariate combination - srm_detection: Sample Ratio Mismatch via chi-squared with segment-level root cause analysis - switchback_experimentation: Time-based treatment alternation for marketplace and network-effect scenarios - warehouse_native_guidance: Platform architecture selection (warehouse-native vs hosted) across the major experimentation vendors - cookieless_experimentation: Server-side or first-party cookie assignment for cookieless environment...

Details

Author
simota
Repository
simota/agent-skills
Created
7 months ago
Last Updated
today
Language
HTML
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category