domains / families / marketing / ab-test-setup-and-analysis

ab-test-setup-and-analysis

separate

Designs statistically valid split tests for ads, audiences, landing pages, or bid strategies. Calculates required sample sizes before you start, monitors results during the test, and calls winners when statistical significance is actually reached — not when you feel like one is winning. Platform: Google and Meta.

When to use

• Before launching any creative, audience, or landing page test
• When someone on the team wants to call a winner after 2 days of data
• For structured testing programs where you need a pipeline of tests running sequentially
• When clients ask "is this result real or just noise" and you need a definitive answer

When not to use

• Calling winners before statistical significance is reached

Skill page

Source