SlideShare a Scribd company logo
1 of 25
Download to read offline
A/B


TESTING


BLUEPRINT
Make better data-driven choices
A/B TESTING BLUEPRINT
pirateskills.com/abtesting
New table
Metric
Not started
Started
Completed
-20%
4%
5%
5%
Registration / 
Visitors
17
8
4
5
Registration Page
8%
10.8%
10%
11%
Workshop LP 2000 25%
2500
2000
CR%
Revenue
12
5
4
3
20
5
8
7
4
3
2
1
Homepage
Fail
Unclear
Success
9%
15%
2300
What's your best test idea?
What's your best test idea?
What's your best test idea?
What's your best test idea?
5 What's your best test idea?
6 What's your best test idea?
7 What's your best test idea?
8 What's your best test idea?
9 What's your best test idea?
10 What's your best test idea?
A/B TESTING BLUEPRINT
Make better data driven choice
blog.hubspot.com
How to Do A/B Testing:
A Checklist You'll Want
to Bookmark
When marketers like us create landing
pages, write email copy, or design call-
to-action buttons, it can be tempting to
use our intuition to predict what will
make people click and convert. But
basing marketing decisions off of a
"feeling" can be pretty …
abtestguide.com
A/B-Test Calculator -
Power & Significance -
ABTestGuide.com
Calculate statistical significance and the
Power of your A/B-test
vwo.com
VWO | #1 A/B Testing
Tool in the World
Thousands of brands across the globe
use VWO as their experimentation
platform to run A/B tests on their
websites, apps and products. Import
and aggregate all metrics you care
about and measure how they get
impacted by your experiments.
cxl.com
40+ Conversion
Optimization Tools
(Reviewed by Experts)
Men have become the tools of their
tools. Henry David Thoreau AB Tasty is
another testing tool designed for the
masses, this one hailing from France.
They offer client-side, bayesian-based
A/B testing along with full factorial
multivariate testing -the …
cxl.com
AB Test Sample Size
Calculators by CXL
One test calculator to answer all your
pre- and post-test analysis questions.
vwo.com
A/B testing statistical
significance calculator -
VWO
Get comprehensive insights about
testing, optimization, UX, design, and
more. Are your results significant? Learn
more about how to research A/B testing
ideas and create winning tests through
our detailed guide. Deliver great
experiences. Grow faster, s…
www.evanmiller.org
Sample Size Calculator
Need A/B sample sizes on your iPhone
or iPad? Download A/B Buddy today.
Question: How many subjects are
needed for an A/B test?
cxl.com
A/B Testing Statistics:
An Easy-to-Understand
Guide | CXL
Testing tools are getting more
sophisticated. Blogs are brimming with
"inspiring" case studies.
Experimentation is becoming more and
more common for marketers. Statistical
know-how, however, lags behind. This
post is filled with clear explanations of
A/…
www.optimizesmart.com
Understanding A/B
testing statistics to get
REAL Lift in
Conversions
If you want to increase your chances of
getting a real lift through A/B tests then
you need to understand the statistics
behind it. If you don’t like learning
statistics then I am afraid A/B testing is
not for you.
fivethirtyeight.com
Science Isn't Broken
If you follow the headlines, your
confidence in science may have taken a
hit lately. Peer review? More like self-
review. An investigation in November
uncovered a scam in which researchers
were rubber-stamping their own work,
circumventing peer review at…
conversionsciences.com
The Ultimate A/B
Testing Guide:
Everything You Need,
All In One Place
Welcome to the ultimate A/B testing
guide! In this post, I'm going to cover
everything you need to know about A/B
testing (also referred to as "split"
testing), from start to finish. Here's what
we'll cover: By the end of this guide,
you'll have a thoro…
How to setup A/B testing Generate strong testing ideas Learn more about A/B testing
Baseline Result
Change
Variation
Control
ICE
Score
Ease
Confi-
dence
Impact
Test Idea URL / Screen
# Status Hypothesis
1. Install Google Analytics
2. Setup Conversion Goals
3. Install Google Optimize
4. Configure Google Optimze
5. Create first A/B Test
Google 
Analytics
Insights
Hotjar 
Screen 
Recordings
marketingplatform.google.com
Analytics Tools &
Solutions for Your
Business - Google
Analytics
Easily access data from other Google
solutions while working in Analytics, for
a seamless workflow that saves you
time and increases efficiency. Google
Ads Gain deeper insights into how users
from your Google Ads campaigns
engage with your site. Data St…
marketingplatform.google.com
Website, A/B Testing &
Optimization Tools -
Google Optimize
Optimize natively integrate with other
Google solutions, saving you valuable
time while increasing efficiencies across
your team. Analytics Use your Analytics
data to identify where to improve your
site, measure experiments against
business goals, and s…
Why your website reminds me of "50 First Dates" - Part
1/5
YouTube
Want to learn how deep the rabit hole goes? (in order)
How to calculate sample size and significance?
How to get enough traffic to make A/B testing viable?
pirateskills.com
Traffic Channel
Compass | Pirate Skills
The Traffic Channel Compass will give
you an overview of the most effective
growth marketing channels and help
you focus on the right ones. Should
focus scarce resources on Facebook,
SEO, Newsletter,... or maybe even
TikTok? Deciding on your most import…
Ads are the most fun In E-Commerce
YouTube
Targeting Your B2B Audience with LinkedIn Ads
YouTube
Get more Instagram followers with this ad strategy
(mobile only) - Part 1/6
YouTube
How to get more Traffic with Native Ads
YouTube
Google Analytics Demystified | Live Stream
YouTube
Qualaroo 
Customer 
Feedback
User-
Testing
.com
GTmetrix
Speed
Test
Typeform
User
Surveys
Customer Journey Map Tools
Frameworks
www.widerfunn…
LIFT Model: Most
Popular Conversion
Optimization
Framework
In 2009, Chris Goward introduced the
LIFT Model®, a framework for analyzing
web and mobile experiences and
developing A/B test hypotheses. Today,
it is the go-to conversion optimization
framework for leading companies
around the world.
Motivation = Benefits - Costs
vwo.com
What is A/B Testing? A
Practical Guide With
Examples
A/B testing (also known as split testing)
is a process of showing two variants of
the same web page to different
segments of website visitors at the same
time and comparing which variant
drives more conversions.
Start with research, end with it
www.shopify.com
The Complete Guide to
A/B Testing: Expert Tips
from Google, HubSpot
and More
This probably isn't the first time you've
read about A/B testing. You might even
already A/B test your email subject lines
or your social media posts. Despite the
fact that there's been plenty said about
A/B testing in the field of marketing, a
lot of p…
Fact & Act model
pirateskills.com/abtesting
10 What's your best test idea?
How to setup A/B testing
1. Install Google Analytics
2. Setup Conversion Goals
3. Install Google Optimize
4. Configure Google Optimze
5. Create first A/B Test
marketingplatform.google.com
Analytics Tools &
Solutions for Your
Business - Google
Analytics
Easily access data from other Google
solutions while working in Analytics, for
a seamless workflow that saves you
time and increases efficiency. Google
Ads Gain deeper insights into how users
from your Google Ads campaigns
engage with your site. Data St…
marketingplatform.google.com
Website, A/B Testing &
Optimization Tools -
Google Optimize
Optimize natively integrate with other
Google solutions, saving you valuable
time while increasing efficiencies across
your team. Analytics Use your Analytics
data to identify where to improve your
site, measure experiments against
business goals, and s…
Why your website reminds me of "50 First Dates" - Part
1/5
YouTube
Google Analytics Demystified | Live Stream
YouTube
pirateskills.com/abtesting
Generate strong testing ideas
Google 
Analytics
Insights
Hotjar 
Screen 
Recordings
Qualaroo 
Customer 
Feedback
User-
Testing
.com
GTmetrix
Speed
Test
Typeform
User
Surveys
Customer Journey Map Tools
Frameworks
www.widerfunn…
LIFT Model: Most
Popular Conversion
Optimization
Framework
In 2009, Chris Goward introduced the
LIFT Model®, a framework for analyzing
web and mobile experiences and
developing A/B test hypotheses. Today,
it is the go-to conversion optimization
framework for leading companies
around the world.
Motivation = Benefits - Costs
vwo.com
What is A/B Testing? A
Practical Guide With
Examples
A/B testing (also known as split testing)
is a process of showing two variants of
the same web page to different
segments of website visitors at the same
time and comparing which variant
drives more conversions.
Start with research, end with it
www.shopify.com
The Complete Guide to
A/B Testing: Expert Tips
from Google, HubSpot
and More
This probably isn't the first time you've
read about A/B testing. You might even
already A/B test your email subject lines
or your social media posts. Despite the
fact that there's been plenty said about
A/B testing in the field of marketing, a
lot of p…
Fact & Act model
pirateskills.com/abtesting
blog.hubspot.com
How to Do A/B Testing:
A Checklist You'll Want
to Bookmark
When marketers like us create landing
pages, write email copy, or design call-
to-action buttons, it can be tempting to
use our intuition to predict what will
make people click and convert. But
basing marketing decisions off of a
"feeling" can be pretty …
abtestguide.com
A/B-Test Calculator -
Power & Significance -
ABTestGuide.com
Calculate statistical significance and the
Power of your A/B-test
vwo.com
VWO | #1 A/B Testing
Tool in the World
Thousands of brands across the globe
use VWO as their experimentation
platform to run A/B tests on their
websites, apps and products. Import
and aggregate all metrics you care
about and measure how they get
impacted by your experiments.
cxl.com
40+ Conversion
Optimization Tools
(Reviewed by Experts)
Men have become the tools of their
tools. Henry David Thoreau AB Tasty is
another testing tool designed for the
masses, this one hailing from France.
They offer client-side, bayesian-based
A/B testing along with full factorial
multivariate testing -the …
cxl.com
AB Test Sample Size
Calculators by CXL
One test calculator to answer all your
pre- and post-test analysis questions.
vwo.com
A/B testing statistical
significance calculator -
VWO
Get comprehensive insights about
testing, optimization, UX, design, and
more. Are your results significant? Learn
more about how to research A/B testing
ideas and create winning tests through
our detailed guide. Deliver great
experiences. Grow faster, s…
www.evanmiller.org
Sample Size Calculator
Need A/B sample sizes on your iPhone
or iPad? Download A/B Buddy today.
Question: How many subjects are
needed for an A/B test?
cxl.com
A/B Testing Statistics:
An Easy-to-Understand
Guide | CXL
Testing tools are getting more
sophisticated. Blogs are brimming with
"inspiring" case studies.
Experimentation is becoming more and
more common for marketers. Statistical
know-how, however, lags behind. This
post is filled with clear explanations of
A/…
www.optimizesmart.com
Understanding A/B
testing statistics to get
REAL Lift in
Conversions
If you want to increase your chances of
getting a real lift through A/B tests then
you need to understand the statistics
behind it. If you don’t like learning
statistics then I am afraid A/B testing is
not for you.
fivethirtyeight.com
Science Isn't Broken
If you follow the headlines, your
confidence in science may have taken a
hit lately. Peer review? More like self-
review. An investigation in November
uncovered a scam in which researchers
were rubber-stamping their own work,
circumventing peer review at…
conversionsciences.com
The Ultimate A/B
Testing Guide:
Everything You Need,
All In One Place
Welcome to the ultimate A/B testing
guide! In this post, I'm going to cover
everything you need to know about A/B
testing (also referred to as "split"
testing), from start to finish. Here's what
we'll cover: By the end of this guide,
you'll have a thoro…
Learn more about A/B testing
Want to learn how deep the rabit hole goes? (in order)
How to calculate sample size and significance?
How to get enough traffic to make A/B testing viable?
pirateskills.com
Traffic Channel
Compass | Pirate Skills
The Traffic Channel Compass will give
you an overview of the most effective
growth marketing channels and help
you focus on the right ones. Should
focus scarce resources on Facebook,
SEO, Newsletter,... or maybe even
TikTok? Deciding on your most import…
Ads are the most fun In E-Commerce
YouTube
Targeting Your B2B Audience with LinkedIn Ads
YouTube
Get more Instagram followers with this ad strategy
(mobile only) - Part 1/6
YouTube
How to get more Traffic with Native Ads
YouTube
Get the blueprint
pirateskills.com/abtesting
New table
Metric
Not started
Started
Completed
-20%
4%
5%
5%
Registration / 
Visitors
17
8
4
5
Registration Page
8%
10.8%
10%
11%
Workshop LP 2000 25%
2500
2000
CR%
Revenue
12
5
4
3
20
5
8
7
4
3
2
1
Homepage
Fail
Unclear
Success
9%
15%
2300
What's your best test idea?
What's your best test idea?
What's your best test idea?
What's your best test idea?
5 What's your best test idea?
6 What's your best test idea?
7 What's your best test idea?
8 What's your best test idea?
9 What's your best test idea?
10 What's your best test idea?
A/B TESTING BLUEPRINT
Make better data driven choice
blog.hubspot.com
How to Do A/B Testing:
A Checklist You'll Want
to Bookmark
When marketers like us create landing
pages, write email copy, or design call-
to-action buttons, it can be tempting to
use our intuition to predict what will
make people click and convert. But
basing marketing decisions off of a
"feeling" can be pretty …
abtestguide.com
A/B-Test Calculator -
Power & Significance -
ABTestGuide.com
Calculate statistical significance and the
Power of your A/B-test
vwo.com
VWO | #1 A/B Testing
Tool in the World
Thousands of brands across the globe
use VWO as their experimentation
platform to run A/B tests on their
websites, apps and products. Import
and aggregate all metrics you care
about and measure how they get
impacted by your experiments.
cxl.com
40+ Conversion
Optimization Tools
(Reviewed by Experts)
Men have become the tools of their
tools. Henry David Thoreau AB Tasty is
another testing tool designed for the
masses, this one hailing from France.
They offer client-side, bayesian-based
A/B testing along with full factorial
multivariate testing -the …
cxl.com
AB Test Sample Size
Calculators by CXL
One test calculator to answer all your
pre- and post-test analysis questions.
vwo.com
A/B testing statistical
significance calculator -
VWO
Get comprehensive insights about
testing, optimization, UX, design, and
more. Are your results significant? Learn
more about how to research A/B testing
ideas and create winning tests through
our detailed guide. Deliver great
experiences. Grow faster, s…
www.evanmiller.org
Sample Size Calculator
Need A/B sample sizes on your iPhone
or iPad? Download A/B Buddy today.
Question: How many subjects are
needed for an A/B test?
cxl.com
A/B Testing Statistics:
An Easy-to-Understand
Guide | CXL
Testing tools are getting more
sophisticated. Blogs are brimming with
"inspiring" case studies.
Experimentation is becoming more and
more common for marketers. Statistical
know-how, however, lags behind. This
post is filled with clear explanations of
A/…
www.optimizesmart.com
Understanding A/B
testing statistics to get
REAL Lift in
Conversions
If you want to increase your chances of
getting a real lift through A/B tests then
you need to understand the statistics
behind it. If you don’t like learning
statistics then I am afraid A/B testing is
not for you.
fivethirtyeight.com
Science Isn't Broken
If you follow the headlines, your
confidence in science may have taken a
hit lately. Peer review? More like self-
review. An investigation in November
uncovered a scam in which researchers
were rubber-stamping their own work,
circumventing peer review at…
conversionsciences.com
The Ultimate A/B
Testing Guide:
Everything You Need,
All In One Place
Welcome to the ultimate A/B testing
guide! In this post, I'm going to cover
everything you need to know about A/B
testing (also referred to as "split"
testing), from start to finish. Here's what
we'll cover: By the end of this guide,
you'll have a thoro…
How to setup A/B testing Generate strong testing ideas Learn more about A/B testing
Baseline Result
Change
Variation
Control
ICE
Score
Ease
Confi-
dence
Impact
Test Idea URL / Screen
# Status Hypothesis
1. Install Google Analytics
2. Setup Conversion Goals
3. Install Google Optimize
4. Configure Google Optimze
5. Create first A/B Test
Google 
Analytics
Insights
Hotjar 
Screen 
Recordings
marketingplatform.google.com
Analytics Tools &
Solutions for Your
Business - Google
Analytics
Easily access data from other Google
solutions while working in Analytics, for
a seamless workflow that saves you
time and increases efficiency. Google
Ads Gain deeper insights into how users
from your Google Ads campaigns
engage with your site. Data St…
marketingplatform.google.com
Website, A/B Testing &
Optimization Tools -
Google Optimize
Optimize natively integrate with other
Google solutions, saving you valuable
time while increasing efficiencies across
your team. Analytics Use your Analytics
data to identify where to improve your
site, measure experiments against
business goals, and s…
Why your website reminds me of "50 First Dates" - Part
1/5
YouTube
Want to learn how deep the rabit hole goes? (in order)
How to calculate sample size and significance?
How to get enough traffic to make A/B testing viable?
pirateskills.com
Traffic Channel
Compass | Pirate Skills
The Traffic Channel Compass will give
you an overview of the most effective
growth marketing channels and help
you focus on the right ones. Should
focus scarce resources on Facebook,
SEO, Newsletter,... or maybe even
TikTok? Deciding on your most import…
Ads are the most fun In E-Commerce
YouTube
Targeting Your B2B Audience with LinkedIn Ads
YouTube
Get more Instagram followers with this ad strategy
(mobile only) - Part 1/6
YouTube
How to get more Traffic with Native Ads
YouTube
Google Analytics Demystified | Live Stream
YouTube
Qualaroo 
Customer 
Feedback
User-
Testing
.com
GTmetrix
Speed
Test
Typeform
User
Surveys
Customer Journey Map Tools
Frameworks
www.widerfunn…
LIFT Model: Most
Popular Conversion
Optimization
Framework
In 2009, Chris Goward introduced the
LIFT Model®, a framework for analyzing
web and mobile experiences and
developing A/B test hypotheses. Today,
it is the go-to conversion optimization
framework for leading companies
around the world.
Motivation = Benefits - Costs
vwo.com
What is A/B Testing? A
Practical Guide With
Examples
A/B testing (also known as split testing)
is a process of showing two variants of
the same web page to different
segments of website visitors at the same
time and comparing which variant
drives more conversions.
Start with research, end with it
www.shopify.com
The Complete Guide to
A/B Testing: Expert Tips
from Google, HubSpot
and More
This probably isn't the first time you've
read about A/B testing. You might even
already A/B test your email subject lines
or your social media posts. Despite the
fact that there's been plenty said about
A/B testing in the field of marketing, a
lot of p…
Fact & Act model
Ben Su
fi
ani
• Founder since 2008


• Growth Marketer


• Host of Pirate Skills


• Irrationally passioned about
the nerdy parts of marketing
Conversion
Optimization
• Improve the user
fl
ow


• Lower cost per acquisition


• Increase customer lifetime value


• CPA < CLV 💥🚀
How to reach your
conversion goals
Ideas
Priorities
Experiments
Results
Let’s dive into it
pirateskills.com/abtesting
New table
Metric
Not started
Started
Completed
-20%
4%
5%
5%
Registration / 
Visitors
17
8
4
5
Registration Page
8%
10.8%
10%
11%
Workshop LP 2000 25%
2500
2000
CR%
Revenue
12
5
4
3
20
5
8
7
4
3
2
1
Homepage
Fail
Unclear
Success
9%
15%
2300
What's your best test idea?
What's your best test idea?
What's your best test idea?
What's your best test idea?
5 What's your best test idea?
6 What's your best test idea?
7 What's your best test idea?
8 What's your best test idea?
9 What's your best test idea?
10 What's your best test idea?
A/B TESTING BLUEPRINT
Make better data driven choice
blog.hubspot.com
How to Do A/B Testing:
A Checklist You'll Want
to Bookmark
When marketers like us create landing
pages, write email copy, or design call-
to-action buttons, it can be tempting to
use our intuition to predict what will
make people click and convert. But
basing marketing decisions off of a
"feeling" can be pretty …
abtestguide.com
A/B-Test Calculator -
Power & Significance -
ABTestGuide.com
Calculate statistical significance and the
Power of your A/B-test
vwo.com
VWO | #1 A/B Testing
Tool in the World
Thousands of brands across the globe
use VWO as their experimentation
platform to run A/B tests on their
websites, apps and products. Import
and aggregate all metrics you care
about and measure how they get
impacted by your experiments.
cxl.com
40+ Conversion
Optimization Tools
(Reviewed by Experts)
Men have become the tools of their
tools. Henry David Thoreau AB Tasty is
another testing tool designed for the
masses, this one hailing from France.
They offer client-side, bayesian-based
A/B testing along with full factorial
multivariate testing -the …
cxl.com
AB Test Sample Size
Calculators by CXL
One test calculator to answer all your
pre- and post-test analysis questions.
vwo.com
A/B testing statistical
significance calculator -
VWO
Get comprehensive insights about
testing, optimization, UX, design, and
more. Are your results significant? Learn
more about how to research A/B testing
ideas and create winning tests through
our detailed guide. Deliver great
experiences. Grow faster, s…
www.evanmiller.org
Sample Size Calculator
Need A/B sample sizes on your iPhone
or iPad? Download A/B Buddy today.
Question: How many subjects are
needed for an A/B test?
cxl.com
A/B Testing Statistics:
An Easy-to-Understand
Guide | CXL
Testing tools are getting more
sophisticated. Blogs are brimming with
"inspiring" case studies.
Experimentation is becoming more and
more common for marketers. Statistical
know-how, however, lags behind. This
post is filled with clear explanations of
A/…
www.optimizesmart.com
Understanding A/B
testing statistics to get
REAL Lift in
Conversions
If you want to increase your chances of
getting a real lift through A/B tests then
you need to understand the statistics
behind it. If you don’t like learning
statistics then I am afraid A/B testing is
not for you.
fivethirtyeight.com
Science Isn't Broken
If you follow the headlines, your
confidence in science may have taken a
hit lately. Peer review? More like self-
review. An investigation in November
uncovered a scam in which researchers
were rubber-stamping their own work,
circumventing peer review at…
conversionsciences.com
The Ultimate A/B
Testing Guide:
Everything You Need,
All In One Place
Welcome to the ultimate A/B testing
guide! In this post, I'm going to cover
everything you need to know about A/B
testing (also referred to as "split"
testing), from start to finish. Here's what
we'll cover: By the end of this guide,
you'll have a thoro…
How to setup A/B testing Generate strong testing ideas Learn more about A/B testing
Baseline Result
Change
Variation
Control
ICE
Score
Ease
Confi-
dence
Impact
Test Idea URL / Screen
# Status Hypothesis
1. Install Google Analytics
2. Setup Conversion Goals
3. Install Google Optimize
4. Configure Google Optimze
5. Create first A/B Test
Google 
Analytics
Insights
Hotjar 
Screen 
Recordings
marketingplatform.google.com
Analytics Tools &
Solutions for Your
Business - Google
Analytics
Easily access data from other Google
solutions while working in Analytics, for
a seamless workflow that saves you
time and increases efficiency. Google
Ads Gain deeper insights into how users
from your Google Ads campaigns
engage with your site. Data St…
marketingplatform.google.com
Website, A/B Testing &
Optimization Tools -
Google Optimize
Optimize natively integrate with other
Google solutions, saving you valuable
time while increasing efficiencies across
your team. Analytics Use your Analytics
data to identify where to improve your
site, measure experiments against
business goals, and s…
Why your website reminds me of "50 First Dates" - Part
1/5
YouTube
Want to learn how deep the rabit hole goes? (in order)
How to calculate sample size and significance?
How to get enough traffic to make A/B testing viable?
pirateskills.com
Traffic Channel
Compass | Pirate Skills
The Traffic Channel Compass will give
you an overview of the most effective
growth marketing channels and help
you focus on the right ones. Should
focus scarce resources on Facebook,
SEO, Newsletter,... or maybe even
TikTok? Deciding on your most import…
Ads are the most fun In E-Commerce
YouTube
Targeting Your B2B Audience with LinkedIn Ads
YouTube
Get more Instagram followers with this ad strategy
(mobile only) - Part 1/6
YouTube
How to get more Traffic with Native Ads
YouTube
Google Analytics Demystified | Live Stream
YouTube
Qualaroo 
Customer 
Feedback
User-
Testing
.com
GTmetrix
Speed
Test
Typeform
User
Surveys
Customer Journey Map Tools
Frameworks
www.widerfunn…
LIFT Model: Most
Popular Conversion
Optimization
Framework
In 2009, Chris Goward introduced the
LIFT Model®, a framework for analyzing
web and mobile experiences and
developing A/B test hypotheses. Today,
it is the go-to conversion optimization
framework for leading companies
around the world.
Motivation = Benefits - Costs
vwo.com
What is A/B Testing? A
Practical Guide With
Examples
A/B testing (also known as split testing)
is a process of showing two variants of
the same web page to different
segments of website visitors at the same
time and comparing which variant
drives more conversions.
Start with research, end with it
www.shopify.com
The Complete Guide to
A/B Testing: Expert Tips
from Google, HubSpot
and More
This probably isn't the first time you've
read about A/B testing. You might even
already A/B test your email subject lines
or your social media posts. Despite the
fact that there's been plenty said about
A/B testing in the field of marketing, a
lot of p…
Fact & Act model
Youtube Channel
pirateskills.com/yt
1.03K subscribers
162,633 views
A/B


TESTING


BLUEPRINT
Make better data-driven choices
C
o
n
t
e
n
t
F
u
n
n
e
l
Analytics
T
r
a
ffi
c
C
o
n
v
e
r
s
i
o
n
Roadmap
Growth Marketing
GROWTH


MARKETING


WORKSHOPS
Master the Art and Science
pirateskills.com/workshops
of Growth Marketing
Youtube Channel
pirateskills.com/yt
1.03K subscribers
162,633 views
Discord Community
pirateskills.com/discord
A/B


TESTING


BLUEPRINT
Make better data-driven choices

More Related Content

What's hot

What's hot (20)

Analytics Configuration Strategies that Add Value for Your Clients - David Vo...
Analytics Configuration Strategies that Add Value for Your Clients - David Vo...Analytics Configuration Strategies that Add Value for Your Clients - David Vo...
Analytics Configuration Strategies that Add Value for Your Clients - David Vo...
 
10 Growth hacking tools and leveraging qualitative data to drive quantitative...
10 Growth hacking tools and leveraging qualitative data to drive quantitative...10 Growth hacking tools and leveraging qualitative data to drive quantitative...
10 Growth hacking tools and leveraging qualitative data to drive quantitative...
 
905 keynote massey
905 keynote massey905 keynote massey
905 keynote massey
 
Looking to massively improve conversions in 2022 two words— product pages
Looking to massively improve conversions in 2022  two words— product pagesLooking to massively improve conversions in 2022  two words— product pages
Looking to massively improve conversions in 2022 two words— product pages
 
A/B Test ideas to Optimize The B2B Funnel
A/B Test ideas to Optimize The B2B FunnelA/B Test ideas to Optimize The B2B Funnel
A/B Test ideas to Optimize The B2B Funnel
 
Opticon 2015-Collaborating to Scale
Opticon 2015-Collaborating to ScaleOpticon 2015-Collaborating to Scale
Opticon 2015-Collaborating to Scale
 
Opticon 2015-UX That Doesn’t Make You Think: Removing Friction and Cognitive ...
Opticon 2015-UX That Doesn’t Make You Think: Removing Friction and Cognitive ...Opticon 2015-UX That Doesn’t Make You Think: Removing Friction and Cognitive ...
Opticon 2015-UX That Doesn’t Make You Think: Removing Friction and Cognitive ...
 
Opticon 2015-The 21st Century Marketing Stack & Team
Opticon 2015-The 21st Century Marketing Stack & TeamOpticon 2015-The 21st Century Marketing Stack & Team
Opticon 2015-The 21st Century Marketing Stack & Team
 
Growth hacking: how to create converting content?
Growth hacking: how to create converting content?Growth hacking: how to create converting content?
Growth hacking: how to create converting content?
 
Stephen kenwright conversion elite
Stephen kenwright conversion eliteStephen kenwright conversion elite
Stephen kenwright conversion elite
 
Opticon 2015-Best Practices in Programmatic Ad Buying and Conversion Funnel O...
Opticon 2015-Best Practices in Programmatic Ad Buying and Conversion Funnel O...Opticon 2015-Best Practices in Programmatic Ad Buying and Conversion Funnel O...
Opticon 2015-Best Practices in Programmatic Ad Buying and Conversion Funnel O...
 
Quick wins to higher conversion rates
Quick wins to higher conversion rates Quick wins to higher conversion rates
Quick wins to higher conversion rates
 
Widemile and Microsoft Multivariate Testing Case Study
Widemile and Microsoft Multivariate Testing Case StudyWidemile and Microsoft Multivariate Testing Case Study
Widemile and Microsoft Multivariate Testing Case Study
 
Class 2: How to create solid hypotheses and set up powerful A/B Tests
Class 2: How to create solid hypotheses and set up powerful A/B TestsClass 2: How to create solid hypotheses and set up powerful A/B Tests
Class 2: How to create solid hypotheses and set up powerful A/B Tests
 
The Upside to Cross-Selling: How MVMT Watches Boosted Revenue
The Upside to Cross-Selling: How MVMT Watches Boosted RevenueThe Upside to Cross-Selling: How MVMT Watches Boosted Revenue
The Upside to Cross-Selling: How MVMT Watches Boosted Revenue
 
Optimizely Summer School Class 1 - Analyze
Optimizely Summer School Class 1 - AnalyzeOptimizely Summer School Class 1 - Analyze
Optimizely Summer School Class 1 - Analyze
 
Opticon 2015-Making it Stick
Opticon 2015-Making it StickOpticon 2015-Making it Stick
Opticon 2015-Making it Stick
 
Jw conversion elite talk final black
Jw conversion elite talk final blackJw conversion elite talk final black
Jw conversion elite talk final black
 
Gabe Wahhab - Demystifying CRO
Gabe Wahhab - Demystifying CROGabe Wahhab - Demystifying CRO
Gabe Wahhab - Demystifying CRO
 
Conquering the perfect storm share[1]
Conquering the perfect storm share[1]Conquering the perfect storm share[1]
Conquering the perfect storm share[1]
 

Similar to A/B Testing Blueprint | Pirate Skills

Introduction to ab_testing_for_marketing_optimization
Introduction to ab_testing_for_marketing_optimizationIntroduction to ab_testing_for_marketing_optimization
Introduction to ab_testing_for_marketing_optimization
Turisticae
 
Stamats: Analytics Webinar
Stamats: Analytics WebinarStamats: Analytics Webinar
Stamats: Analytics Webinar
cjcunniff
 

Similar to A/B Testing Blueprint | Pirate Skills (20)

Web Analytics: Free Yourself from Analysis Paralysis
Web Analytics: Free Yourself from Analysis ParalysisWeb Analytics: Free Yourself from Analysis Paralysis
Web Analytics: Free Yourself from Analysis Paralysis
 
Analysis Paralysis
Analysis ParalysisAnalysis Paralysis
Analysis Paralysis
 
Introduction to ab_testing_for_marketing_optimization
Introduction to ab_testing_for_marketing_optimizationIntroduction to ab_testing_for_marketing_optimization
Introduction to ab_testing_for_marketing_optimization
 
Conversion Rate Optimisation Guide
Conversion Rate Optimisation GuideConversion Rate Optimisation Guide
Conversion Rate Optimisation Guide
 
Ecommerce A/B testing
Ecommerce A/B testingEcommerce A/B testing
Ecommerce A/B testing
 
User Analytics Testing - SeleniumCamp 2015
User Analytics Testing - SeleniumCamp 2015User Analytics Testing - SeleniumCamp 2015
User Analytics Testing - SeleniumCamp 2015
 
Conversion Rate Optmization
Conversion Rate OptmizationConversion Rate Optmization
Conversion Rate Optmization
 
Christi olson-huzzah-searchand social
Christi olson-huzzah-searchand socialChristi olson-huzzah-searchand social
Christi olson-huzzah-searchand social
 
Taming The HiPPO
Taming The HiPPOTaming The HiPPO
Taming The HiPPO
 
Growing Your Business Through Experimentation
Growing Your Business Through ExperimentationGrowing Your Business Through Experimentation
Growing Your Business Through Experimentation
 
Accelerate your website sales today
Accelerate your website sales todayAccelerate your website sales today
Accelerate your website sales today
 
Dynamic Shopping–Content Conversion Analytics
Dynamic Shopping–Content Conversion AnalyticsDynamic Shopping–Content Conversion Analytics
Dynamic Shopping–Content Conversion Analytics
 
Stamats: Analytics Webinar
Stamats: Analytics WebinarStamats: Analytics Webinar
Stamats: Analytics Webinar
 
How to fortify UA strategy with creatives testing
How to fortify UA strategy with creatives testingHow to fortify UA strategy with creatives testing
How to fortify UA strategy with creatives testing
 
Hong Kong Web Analytics Wednesday #10
Hong Kong Web Analytics Wednesday #10Hong Kong Web Analytics Wednesday #10
Hong Kong Web Analytics Wednesday #10
 
The Power of A/B Testing
The Power of A/B TestingThe Power of A/B Testing
The Power of A/B Testing
 
Beginners guide to_growth_hacking
Beginners guide to_growth_hackingBeginners guide to_growth_hacking
Beginners guide to_growth_hacking
 
Growth Hacking
Growth HackingGrowth Hacking
Growth Hacking
 
Optimising Your Digital Marketing Mix
Optimising Your Digital Marketing MixOptimising Your Digital Marketing Mix
Optimising Your Digital Marketing Mix
 
Gerson and Levy
Gerson and LevyGerson and Levy
Gerson and Levy
 

More from Pirate Skills

Savage Channel Battle | Let the most profitable ads win
Savage Channel Battle | Let the most profitable ads winSavage Channel Battle | Let the most profitable ads win
Savage Channel Battle | Let the most profitable ads win
Pirate Skills
 
Sneaky Idea Validation | Don't start coding before 1000 subs
Sneaky Idea Validation | Don't start coding before 1000 subsSneaky Idea Validation | Don't start coding before 1000 subs
Sneaky Idea Validation | Don't start coding before 1000 subs
Pirate Skills
 
Converting 1K€ ads into 5K€ revenue | Pirate Skills
Converting 1K€ ads into 5K€ revenue | Pirate Skills Converting 1K€ ads into 5K€ revenue | Pirate Skills
Converting 1K€ ads into 5K€ revenue | Pirate Skills
Pirate Skills
 

More from Pirate Skills (20)

Relentless Funnel Optimization | Search and Destroy your Bottleneck
Relentless Funnel Optimization | Search and Destroy your BottleneckRelentless Funnel Optimization | Search and Destroy your Bottleneck
Relentless Funnel Optimization | Search and Destroy your Bottleneck
 
Savage Channel Battle | Let the most profitable ads win
Savage Channel Battle | Let the most profitable ads winSavage Channel Battle | Let the most profitable ads win
Savage Channel Battle | Let the most profitable ads win
 
Sinless Analytics Setup | Pirate Skills
Sinless Analytics Setup | Pirate SkillsSinless Analytics Setup | Pirate Skills
Sinless Analytics Setup | Pirate Skills
 
Sneaky Idea Validation | Don't start coding before 1000 subs
Sneaky Idea Validation | Don't start coding before 1000 subsSneaky Idea Validation | Don't start coding before 1000 subs
Sneaky Idea Validation | Don't start coding before 1000 subs
 
Mad Marketing Skills | The Growth Marketing Skill Tree
Mad Marketing Skills | The Growth Marketing Skill TreeMad Marketing Skills | The Growth Marketing Skill Tree
Mad Marketing Skills | The Growth Marketing Skill Tree
 
Lead Generation at Scale | Maximizing your lead gen potential
Lead Generation at Scale | Maximizing your lead gen potentialLead Generation at Scale | Maximizing your lead gen potential
Lead Generation at Scale | Maximizing your lead gen potential
 
Lead Tracking Guide | Pirate Skills
Lead Tracking Guide | Pirate SkillsLead Tracking Guide | Pirate Skills
Lead Tracking Guide | Pirate Skills
 
6 Lead Nurturing Tactics | Pirate Skills Slides
6 Lead Nurturing Tactics | Pirate Skills Slides6 Lead Nurturing Tactics | Pirate Skills Slides
6 Lead Nurturing Tactics | Pirate Skills Slides
 
Interactive Lead Magnets | Pirate Skills Slides
Interactive Lead Magnets | Pirate Skills SlidesInteractive Lead Magnets | Pirate Skills Slides
Interactive Lead Magnets | Pirate Skills Slides
 
Traffic Channel Compass | Pirate Skills Slides
Traffic Channel Compass | Pirate Skills SlidesTraffic Channel Compass | Pirate Skills Slides
Traffic Channel Compass | Pirate Skills Slides
 
Landing Page Setup | Pirate Skills
Landing Page Setup | Pirate SkillsLanding Page Setup | Pirate Skills
Landing Page Setup | Pirate Skills
 
Content Journey Map | Pirate Skills Slides
Content Journey Map | Pirate Skills SlidesContent Journey Map | Pirate Skills Slides
Content Journey Map | Pirate Skills Slides
 
Converting 1K€ ads into 5K€ revenue | Pirate Skills
Converting 1K€ ads into 5K€ revenue | Pirate Skills Converting 1K€ ads into 5K€ revenue | Pirate Skills
Converting 1K€ ads into 5K€ revenue | Pirate Skills
 
Pulling your audience into your Product Story | Pirate Skills
Pulling your audience into your Product Story | Pirate SkillsPulling your audience into your Product Story | Pirate Skills
Pulling your audience into your Product Story | Pirate Skills
 
Doubling your E-Commerce profits | Pirate Skills
Doubling your E-Commerce profits | Pirate SkillsDoubling your E-Commerce profits | Pirate Skills
Doubling your E-Commerce profits | Pirate Skills
 
Building a solid Growth Strategy
Building a solid Growth StrategyBuilding a solid Growth Strategy
Building a solid Growth Strategy
 
Your Growth Marketing Stack 2020
Your Growth Marketing Stack 2020Your Growth Marketing Stack 2020
Your Growth Marketing Stack 2020
 
Personalization is the new A/B Testing
Personalization is the new A/B TestingPersonalization is the new A/B Testing
Personalization is the new A/B Testing
 
How to create more video content faster | Pirate Skills
How to create more video content faster | Pirate SkillsHow to create more video content faster | Pirate Skills
How to create more video content faster | Pirate Skills
 
Make Instagram Ads Profitable Again | Pirate Skills
Make Instagram Ads Profitable Again | Pirate SkillsMake Instagram Ads Profitable Again | Pirate Skills
Make Instagram Ads Profitable Again | Pirate Skills
 

Recently uploaded

Affiliate Marketing Basic Guide For Beginners _20240521_091615_0000.pdf
Affiliate Marketing Basic Guide For Beginners _20240521_091615_0000.pdfAffiliate Marketing Basic Guide For Beginners _20240521_091615_0000.pdf
Affiliate Marketing Basic Guide For Beginners _20240521_091615_0000.pdf
atinukehassan87
 
WA | 0821-8888-6412 | Apotik Jual Obat Aborsi Cytotec Asli Di Magetan
WA | 0821-8888-6412 | Apotik Jual Obat Aborsi Cytotec Asli Di MagetanWA | 0821-8888-6412 | Apotik Jual Obat Aborsi Cytotec Asli Di Magetan
WA | 0821-8888-6412 | Apotik Jual Obat Aborsi Cytotec Asli Di Magetan
infoobataborsi24
 
How To Structure Your Web3 Website For Max Visibility In The Bull Market🚀
How To Structure Your Web3 Website For Max Visibility In The Bull Market🚀How To Structure Your Web3 Website For Max Visibility In The Bull Market🚀
How To Structure Your Web3 Website For Max Visibility In The Bull Market🚀
Victoria Olsina
 
Top 10 Recommended Fragrances for Father's Day
Top 10 Recommended Fragrances for Father's DayTop 10 Recommended Fragrances for Father's Day
Top 10 Recommended Fragrances for Father's Day
disenylurial
 
obat pelancar haid di apotik dan harganya
obat pelancar haid di apotik dan harganyaobat pelancar haid di apotik dan harganya
obat pelancar haid di apotik dan harganya
infoobataborsi24
 

Recently uploaded (20)

Unit 3 - Liberalization, Privatization & Globalization
Unit 3 - Liberalization, Privatization & GlobalizationUnit 3 - Liberalization, Privatization & Globalization
Unit 3 - Liberalization, Privatization & Globalization
 
Generating Leads with Analyst Content Webinar Slides_SJN Final.pdf
Generating Leads with Analyst Content Webinar Slides_SJN Final.pdfGenerating Leads with Analyst Content Webinar Slides_SJN Final.pdf
Generating Leads with Analyst Content Webinar Slides_SJN Final.pdf
 
Content Segmentation for Organic Visibility
Content Segmentation for Organic VisibilityContent Segmentation for Organic Visibility
Content Segmentation for Organic Visibility
 
Social Media Paid Ads Performance Report.pdf
Social Media Paid Ads Performance Report.pdfSocial Media Paid Ads Performance Report.pdf
Social Media Paid Ads Performance Report.pdf
 
Beyond Silos: How Holistic B2B Digital Strategy Drives Pipeline
Beyond Silos: How Holistic B2B Digital Strategy Drives PipelineBeyond Silos: How Holistic B2B Digital Strategy Drives Pipeline
Beyond Silos: How Holistic B2B Digital Strategy Drives Pipeline
 
Affiliate Marketing Basic Guide For Beginners _20240521_091615_0000.pdf
Affiliate Marketing Basic Guide For Beginners _20240521_091615_0000.pdfAffiliate Marketing Basic Guide For Beginners _20240521_091615_0000.pdf
Affiliate Marketing Basic Guide For Beginners _20240521_091615_0000.pdf
 
The Future Normal - DIGGIT - Henry Coutinho-Mason.pdf
The Future Normal - DIGGIT - Henry Coutinho-Mason.pdfThe Future Normal - DIGGIT - Henry Coutinho-Mason.pdf
The Future Normal - DIGGIT - Henry Coutinho-Mason.pdf
 
buy best digital marketing course in india
buy best digital marketing course in indiabuy best digital marketing course in india
buy best digital marketing course in india
 
WA | 0821-8888-6412 | Apotik Jual Obat Aborsi Cytotec Asli Di Magetan
WA | 0821-8888-6412 | Apotik Jual Obat Aborsi Cytotec Asli Di MagetanWA | 0821-8888-6412 | Apotik Jual Obat Aborsi Cytotec Asli Di Magetan
WA | 0821-8888-6412 | Apotik Jual Obat Aborsi Cytotec Asli Di Magetan
 
Klaus Schweighofer, Zakaj je digitalizacija odlična priložnost za medije, Sty...
Klaus Schweighofer, Zakaj je digitalizacija odlična priložnost za medije, Sty...Klaus Schweighofer, Zakaj je digitalizacija odlična priložnost za medije, Sty...
Klaus Schweighofer, Zakaj je digitalizacija odlična priložnost za medije, Sty...
 
How To Structure Your Web3 Website For Max Visibility In The Bull Market🚀
How To Structure Your Web3 Website For Max Visibility In The Bull Market🚀How To Structure Your Web3 Website For Max Visibility In The Bull Market🚀
How To Structure Your Web3 Website For Max Visibility In The Bull Market🚀
 
The BoF Brand Magic Index Volume Two — Preview.pdf
The BoF Brand Magic Index Volume Two — Preview.pdfThe BoF Brand Magic Index Volume Two — Preview.pdf
The BoF Brand Magic Index Volume Two — Preview.pdf
 
The Indian Ocean Tsunami of 2004 Remembering a Catastrophe.pptx
The Indian Ocean Tsunami of 2004 Remembering a Catastrophe.pptxThe Indian Ocean Tsunami of 2004 Remembering a Catastrophe.pptx
The Indian Ocean Tsunami of 2004 Remembering a Catastrophe.pptx
 
Top tips for effective SEO copywriting.pdf
Top tips for effective SEO copywriting.pdfTop tips for effective SEO copywriting.pdf
Top tips for effective SEO copywriting.pdf
 
Top 10 Recommended Fragrances for Father's Day
Top 10 Recommended Fragrances for Father's DayTop 10 Recommended Fragrances for Father's Day
Top 10 Recommended Fragrances for Father's Day
 
Admya Infotech is the Best Digital Marketing Company
Admya Infotech is the Best Digital Marketing CompanyAdmya Infotech is the Best Digital Marketing Company
Admya Infotech is the Best Digital Marketing Company
 
How to Scale Your Digital Marketing Services in 2024
How to Scale Your Digital Marketing Services in 2024How to Scale Your Digital Marketing Services in 2024
How to Scale Your Digital Marketing Services in 2024
 
obat pelancar haid di apotik dan harganya
obat pelancar haid di apotik dan harganyaobat pelancar haid di apotik dan harganya
obat pelancar haid di apotik dan harganya
 
Snapshot of Consumer Behaviors of April 2024-EOLiSurvey (EN).pdf
Snapshot of Consumer Behaviors of April 2024-EOLiSurvey (EN).pdfSnapshot of Consumer Behaviors of April 2024-EOLiSurvey (EN).pdf
Snapshot of Consumer Behaviors of April 2024-EOLiSurvey (EN).pdf
 
Impacts Of Smart Watch & Wearable Technology On Daily Life
Impacts Of Smart Watch & Wearable Technology On Daily LifeImpacts Of Smart Watch & Wearable Technology On Daily Life
Impacts Of Smart Watch & Wearable Technology On Daily Life
 

A/B Testing Blueprint | Pirate Skills

  • 2. A/B TESTING BLUEPRINT pirateskills.com/abtesting New table Metric Not started Started Completed -20% 4% 5% 5% Registration /  Visitors 17 8 4 5 Registration Page 8% 10.8% 10% 11% Workshop LP 2000 25% 2500 2000 CR% Revenue 12 5 4 3 20 5 8 7 4 3 2 1 Homepage Fail Unclear Success 9% 15% 2300 What's your best test idea? What's your best test idea? What's your best test idea? What's your best test idea? 5 What's your best test idea? 6 What's your best test idea? 7 What's your best test idea? 8 What's your best test idea? 9 What's your best test idea? 10 What's your best test idea? A/B TESTING BLUEPRINT Make better data driven choice blog.hubspot.com How to Do A/B Testing: A Checklist You'll Want to Bookmark When marketers like us create landing pages, write email copy, or design call- to-action buttons, it can be tempting to use our intuition to predict what will make people click and convert. But basing marketing decisions off of a "feeling" can be pretty … abtestguide.com A/B-Test Calculator - Power & Significance - ABTestGuide.com Calculate statistical significance and the Power of your A/B-test vwo.com VWO | #1 A/B Testing Tool in the World Thousands of brands across the globe use VWO as their experimentation platform to run A/B tests on their websites, apps and products. Import and aggregate all metrics you care about and measure how they get impacted by your experiments. cxl.com 40+ Conversion Optimization Tools (Reviewed by Experts) Men have become the tools of their tools. Henry David Thoreau AB Tasty is another testing tool designed for the masses, this one hailing from France. They offer client-side, bayesian-based A/B testing along with full factorial multivariate testing -the … cxl.com AB Test Sample Size Calculators by CXL One test calculator to answer all your pre- and post-test analysis questions. vwo.com A/B testing statistical significance calculator - VWO Get comprehensive insights about testing, optimization, UX, design, and more. Are your results significant? Learn more about how to research A/B testing ideas and create winning tests through our detailed guide. Deliver great experiences. Grow faster, s… www.evanmiller.org Sample Size Calculator Need A/B sample sizes on your iPhone or iPad? Download A/B Buddy today. Question: How many subjects are needed for an A/B test? cxl.com A/B Testing Statistics: An Easy-to-Understand Guide | CXL Testing tools are getting more sophisticated. Blogs are brimming with "inspiring" case studies. Experimentation is becoming more and more common for marketers. Statistical know-how, however, lags behind. This post is filled with clear explanations of A/… www.optimizesmart.com Understanding A/B testing statistics to get REAL Lift in Conversions If you want to increase your chances of getting a real lift through A/B tests then you need to understand the statistics behind it. If you don’t like learning statistics then I am afraid A/B testing is not for you. fivethirtyeight.com Science Isn't Broken If you follow the headlines, your confidence in science may have taken a hit lately. Peer review? More like self- review. An investigation in November uncovered a scam in which researchers were rubber-stamping their own work, circumventing peer review at… conversionsciences.com The Ultimate A/B Testing Guide: Everything You Need, All In One Place Welcome to the ultimate A/B testing guide! In this post, I'm going to cover everything you need to know about A/B testing (also referred to as "split" testing), from start to finish. Here's what we'll cover: By the end of this guide, you'll have a thoro… How to setup A/B testing Generate strong testing ideas Learn more about A/B testing Baseline Result Change Variation Control ICE Score Ease Confi- dence Impact Test Idea URL / Screen # Status Hypothesis 1. Install Google Analytics 2. Setup Conversion Goals 3. Install Google Optimize 4. Configure Google Optimze 5. Create first A/B Test Google  Analytics Insights Hotjar  Screen  Recordings marketingplatform.google.com Analytics Tools & Solutions for Your Business - Google Analytics Easily access data from other Google solutions while working in Analytics, for a seamless workflow that saves you time and increases efficiency. Google Ads Gain deeper insights into how users from your Google Ads campaigns engage with your site. Data St… marketingplatform.google.com Website, A/B Testing & Optimization Tools - Google Optimize Optimize natively integrate with other Google solutions, saving you valuable time while increasing efficiencies across your team. Analytics Use your Analytics data to identify where to improve your site, measure experiments against business goals, and s… Why your website reminds me of "50 First Dates" - Part 1/5 YouTube Want to learn how deep the rabit hole goes? (in order) How to calculate sample size and significance? How to get enough traffic to make A/B testing viable? pirateskills.com Traffic Channel Compass | Pirate Skills The Traffic Channel Compass will give you an overview of the most effective growth marketing channels and help you focus on the right ones. Should focus scarce resources on Facebook, SEO, Newsletter,... or maybe even TikTok? Deciding on your most import… Ads are the most fun In E-Commerce YouTube Targeting Your B2B Audience with LinkedIn Ads YouTube Get more Instagram followers with this ad strategy (mobile only) - Part 1/6 YouTube How to get more Traffic with Native Ads YouTube Google Analytics Demystified | Live Stream YouTube Qualaroo  Customer  Feedback User- Testing .com GTmetrix Speed Test Typeform User Surveys Customer Journey Map Tools Frameworks www.widerfunn… LIFT Model: Most Popular Conversion Optimization Framework In 2009, Chris Goward introduced the LIFT Model®, a framework for analyzing web and mobile experiences and developing A/B test hypotheses. Today, it is the go-to conversion optimization framework for leading companies around the world. Motivation = Benefits - Costs vwo.com What is A/B Testing? A Practical Guide With Examples A/B testing (also known as split testing) is a process of showing two variants of the same web page to different segments of website visitors at the same time and comparing which variant drives more conversions. Start with research, end with it www.shopify.com The Complete Guide to A/B Testing: Expert Tips from Google, HubSpot and More This probably isn't the first time you've read about A/B testing. You might even already A/B test your email subject lines or your social media posts. Despite the fact that there's been plenty said about A/B testing in the field of marketing, a lot of p… Fact & Act model
  • 3. pirateskills.com/abtesting 10 What's your best test idea? How to setup A/B testing 1. Install Google Analytics 2. Setup Conversion Goals 3. Install Google Optimize 4. Configure Google Optimze 5. Create first A/B Test marketingplatform.google.com Analytics Tools & Solutions for Your Business - Google Analytics Easily access data from other Google solutions while working in Analytics, for a seamless workflow that saves you time and increases efficiency. Google Ads Gain deeper insights into how users from your Google Ads campaigns engage with your site. Data St… marketingplatform.google.com Website, A/B Testing & Optimization Tools - Google Optimize Optimize natively integrate with other Google solutions, saving you valuable time while increasing efficiencies across your team. Analytics Use your Analytics data to identify where to improve your site, measure experiments against business goals, and s… Why your website reminds me of "50 First Dates" - Part 1/5 YouTube Google Analytics Demystified | Live Stream YouTube
  • 4. pirateskills.com/abtesting Generate strong testing ideas Google  Analytics Insights Hotjar  Screen  Recordings Qualaroo  Customer  Feedback User- Testing .com GTmetrix Speed Test Typeform User Surveys Customer Journey Map Tools Frameworks www.widerfunn… LIFT Model: Most Popular Conversion Optimization Framework In 2009, Chris Goward introduced the LIFT Model®, a framework for analyzing web and mobile experiences and developing A/B test hypotheses. Today, it is the go-to conversion optimization framework for leading companies around the world. Motivation = Benefits - Costs vwo.com What is A/B Testing? A Practical Guide With Examples A/B testing (also known as split testing) is a process of showing two variants of the same web page to different segments of website visitors at the same time and comparing which variant drives more conversions. Start with research, end with it www.shopify.com The Complete Guide to A/B Testing: Expert Tips from Google, HubSpot and More This probably isn't the first time you've read about A/B testing. You might even already A/B test your email subject lines or your social media posts. Despite the fact that there's been plenty said about A/B testing in the field of marketing, a lot of p… Fact & Act model
  • 5. pirateskills.com/abtesting blog.hubspot.com How to Do A/B Testing: A Checklist You'll Want to Bookmark When marketers like us create landing pages, write email copy, or design call- to-action buttons, it can be tempting to use our intuition to predict what will make people click and convert. But basing marketing decisions off of a "feeling" can be pretty … abtestguide.com A/B-Test Calculator - Power & Significance - ABTestGuide.com Calculate statistical significance and the Power of your A/B-test vwo.com VWO | #1 A/B Testing Tool in the World Thousands of brands across the globe use VWO as their experimentation platform to run A/B tests on their websites, apps and products. Import and aggregate all metrics you care about and measure how they get impacted by your experiments. cxl.com 40+ Conversion Optimization Tools (Reviewed by Experts) Men have become the tools of their tools. Henry David Thoreau AB Tasty is another testing tool designed for the masses, this one hailing from France. They offer client-side, bayesian-based A/B testing along with full factorial multivariate testing -the … cxl.com AB Test Sample Size Calculators by CXL One test calculator to answer all your pre- and post-test analysis questions. vwo.com A/B testing statistical significance calculator - VWO Get comprehensive insights about testing, optimization, UX, design, and more. Are your results significant? Learn more about how to research A/B testing ideas and create winning tests through our detailed guide. Deliver great experiences. Grow faster, s… www.evanmiller.org Sample Size Calculator Need A/B sample sizes on your iPhone or iPad? Download A/B Buddy today. Question: How many subjects are needed for an A/B test? cxl.com A/B Testing Statistics: An Easy-to-Understand Guide | CXL Testing tools are getting more sophisticated. Blogs are brimming with "inspiring" case studies. Experimentation is becoming more and more common for marketers. Statistical know-how, however, lags behind. This post is filled with clear explanations of A/… www.optimizesmart.com Understanding A/B testing statistics to get REAL Lift in Conversions If you want to increase your chances of getting a real lift through A/B tests then you need to understand the statistics behind it. If you don’t like learning statistics then I am afraid A/B testing is not for you. fivethirtyeight.com Science Isn't Broken If you follow the headlines, your confidence in science may have taken a hit lately. Peer review? More like self- review. An investigation in November uncovered a scam in which researchers were rubber-stamping their own work, circumventing peer review at… conversionsciences.com The Ultimate A/B Testing Guide: Everything You Need, All In One Place Welcome to the ultimate A/B testing guide! In this post, I'm going to cover everything you need to know about A/B testing (also referred to as "split" testing), from start to finish. Here's what we'll cover: By the end of this guide, you'll have a thoro… Learn more about A/B testing Want to learn how deep the rabit hole goes? (in order) How to calculate sample size and significance? How to get enough traffic to make A/B testing viable? pirateskills.com Traffic Channel Compass | Pirate Skills The Traffic Channel Compass will give you an overview of the most effective growth marketing channels and help you focus on the right ones. Should focus scarce resources on Facebook, SEO, Newsletter,... or maybe even TikTok? Deciding on your most import… Ads are the most fun In E-Commerce YouTube Targeting Your B2B Audience with LinkedIn Ads YouTube Get more Instagram followers with this ad strategy (mobile only) - Part 1/6 YouTube How to get more Traffic with Native Ads YouTube
  • 6. Get the blueprint pirateskills.com/abtesting New table Metric Not started Started Completed -20% 4% 5% 5% Registration /  Visitors 17 8 4 5 Registration Page 8% 10.8% 10% 11% Workshop LP 2000 25% 2500 2000 CR% Revenue 12 5 4 3 20 5 8 7 4 3 2 1 Homepage Fail Unclear Success 9% 15% 2300 What's your best test idea? What's your best test idea? What's your best test idea? What's your best test idea? 5 What's your best test idea? 6 What's your best test idea? 7 What's your best test idea? 8 What's your best test idea? 9 What's your best test idea? 10 What's your best test idea? A/B TESTING BLUEPRINT Make better data driven choice blog.hubspot.com How to Do A/B Testing: A Checklist You'll Want to Bookmark When marketers like us create landing pages, write email copy, or design call- to-action buttons, it can be tempting to use our intuition to predict what will make people click and convert. But basing marketing decisions off of a "feeling" can be pretty … abtestguide.com A/B-Test Calculator - Power & Significance - ABTestGuide.com Calculate statistical significance and the Power of your A/B-test vwo.com VWO | #1 A/B Testing Tool in the World Thousands of brands across the globe use VWO as their experimentation platform to run A/B tests on their websites, apps and products. Import and aggregate all metrics you care about and measure how they get impacted by your experiments. cxl.com 40+ Conversion Optimization Tools (Reviewed by Experts) Men have become the tools of their tools. Henry David Thoreau AB Tasty is another testing tool designed for the masses, this one hailing from France. They offer client-side, bayesian-based A/B testing along with full factorial multivariate testing -the … cxl.com AB Test Sample Size Calculators by CXL One test calculator to answer all your pre- and post-test analysis questions. vwo.com A/B testing statistical significance calculator - VWO Get comprehensive insights about testing, optimization, UX, design, and more. Are your results significant? Learn more about how to research A/B testing ideas and create winning tests through our detailed guide. Deliver great experiences. Grow faster, s… www.evanmiller.org Sample Size Calculator Need A/B sample sizes on your iPhone or iPad? Download A/B Buddy today. Question: How many subjects are needed for an A/B test? cxl.com A/B Testing Statistics: An Easy-to-Understand Guide | CXL Testing tools are getting more sophisticated. Blogs are brimming with "inspiring" case studies. Experimentation is becoming more and more common for marketers. Statistical know-how, however, lags behind. This post is filled with clear explanations of A/… www.optimizesmart.com Understanding A/B testing statistics to get REAL Lift in Conversions If you want to increase your chances of getting a real lift through A/B tests then you need to understand the statistics behind it. If you don’t like learning statistics then I am afraid A/B testing is not for you. fivethirtyeight.com Science Isn't Broken If you follow the headlines, your confidence in science may have taken a hit lately. Peer review? More like self- review. An investigation in November uncovered a scam in which researchers were rubber-stamping their own work, circumventing peer review at… conversionsciences.com The Ultimate A/B Testing Guide: Everything You Need, All In One Place Welcome to the ultimate A/B testing guide! In this post, I'm going to cover everything you need to know about A/B testing (also referred to as "split" testing), from start to finish. Here's what we'll cover: By the end of this guide, you'll have a thoro… How to setup A/B testing Generate strong testing ideas Learn more about A/B testing Baseline Result Change Variation Control ICE Score Ease Confi- dence Impact Test Idea URL / Screen # Status Hypothesis 1. Install Google Analytics 2. Setup Conversion Goals 3. Install Google Optimize 4. Configure Google Optimze 5. Create first A/B Test Google  Analytics Insights Hotjar  Screen  Recordings marketingplatform.google.com Analytics Tools & Solutions for Your Business - Google Analytics Easily access data from other Google solutions while working in Analytics, for a seamless workflow that saves you time and increases efficiency. Google Ads Gain deeper insights into how users from your Google Ads campaigns engage with your site. Data St… marketingplatform.google.com Website, A/B Testing & Optimization Tools - Google Optimize Optimize natively integrate with other Google solutions, saving you valuable time while increasing efficiencies across your team. Analytics Use your Analytics data to identify where to improve your site, measure experiments against business goals, and s… Why your website reminds me of "50 First Dates" - Part 1/5 YouTube Want to learn how deep the rabit hole goes? (in order) How to calculate sample size and significance? How to get enough traffic to make A/B testing viable? pirateskills.com Traffic Channel Compass | Pirate Skills The Traffic Channel Compass will give you an overview of the most effective growth marketing channels and help you focus on the right ones. Should focus scarce resources on Facebook, SEO, Newsletter,... or maybe even TikTok? Deciding on your most import… Ads are the most fun In E-Commerce YouTube Targeting Your B2B Audience with LinkedIn Ads YouTube Get more Instagram followers with this ad strategy (mobile only) - Part 1/6 YouTube How to get more Traffic with Native Ads YouTube Google Analytics Demystified | Live Stream YouTube Qualaroo  Customer  Feedback User- Testing .com GTmetrix Speed Test Typeform User Surveys Customer Journey Map Tools Frameworks www.widerfunn… LIFT Model: Most Popular Conversion Optimization Framework In 2009, Chris Goward introduced the LIFT Model®, a framework for analyzing web and mobile experiences and developing A/B test hypotheses. Today, it is the go-to conversion optimization framework for leading companies around the world. Motivation = Benefits - Costs vwo.com What is A/B Testing? A Practical Guide With Examples A/B testing (also known as split testing) is a process of showing two variants of the same web page to different segments of website visitors at the same time and comparing which variant drives more conversions. Start with research, end with it www.shopify.com The Complete Guide to A/B Testing: Expert Tips from Google, HubSpot and More This probably isn't the first time you've read about A/B testing. You might even already A/B test your email subject lines or your social media posts. Despite the fact that there's been plenty said about A/B testing in the field of marketing, a lot of p… Fact & Act model
  • 7. Ben Su fi ani • Founder since 2008 • Growth Marketer • Host of Pirate Skills • Irrationally passioned about the nerdy parts of marketing
  • 8. Conversion Optimization • Improve the user fl ow • Lower cost per acquisition • Increase customer lifetime value • CPA < CLV 💥🚀
  • 9. How to reach your conversion goals Ideas Priorities Experiments Results
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18. Let’s dive into it pirateskills.com/abtesting New table Metric Not started Started Completed -20% 4% 5% 5% Registration /  Visitors 17 8 4 5 Registration Page 8% 10.8% 10% 11% Workshop LP 2000 25% 2500 2000 CR% Revenue 12 5 4 3 20 5 8 7 4 3 2 1 Homepage Fail Unclear Success 9% 15% 2300 What's your best test idea? What's your best test idea? What's your best test idea? What's your best test idea? 5 What's your best test idea? 6 What's your best test idea? 7 What's your best test idea? 8 What's your best test idea? 9 What's your best test idea? 10 What's your best test idea? A/B TESTING BLUEPRINT Make better data driven choice blog.hubspot.com How to Do A/B Testing: A Checklist You'll Want to Bookmark When marketers like us create landing pages, write email copy, or design call- to-action buttons, it can be tempting to use our intuition to predict what will make people click and convert. But basing marketing decisions off of a "feeling" can be pretty … abtestguide.com A/B-Test Calculator - Power & Significance - ABTestGuide.com Calculate statistical significance and the Power of your A/B-test vwo.com VWO | #1 A/B Testing Tool in the World Thousands of brands across the globe use VWO as their experimentation platform to run A/B tests on their websites, apps and products. Import and aggregate all metrics you care about and measure how they get impacted by your experiments. cxl.com 40+ Conversion Optimization Tools (Reviewed by Experts) Men have become the tools of their tools. Henry David Thoreau AB Tasty is another testing tool designed for the masses, this one hailing from France. They offer client-side, bayesian-based A/B testing along with full factorial multivariate testing -the … cxl.com AB Test Sample Size Calculators by CXL One test calculator to answer all your pre- and post-test analysis questions. vwo.com A/B testing statistical significance calculator - VWO Get comprehensive insights about testing, optimization, UX, design, and more. Are your results significant? Learn more about how to research A/B testing ideas and create winning tests through our detailed guide. Deliver great experiences. Grow faster, s… www.evanmiller.org Sample Size Calculator Need A/B sample sizes on your iPhone or iPad? Download A/B Buddy today. Question: How many subjects are needed for an A/B test? cxl.com A/B Testing Statistics: An Easy-to-Understand Guide | CXL Testing tools are getting more sophisticated. Blogs are brimming with "inspiring" case studies. Experimentation is becoming more and more common for marketers. Statistical know-how, however, lags behind. This post is filled with clear explanations of A/… www.optimizesmart.com Understanding A/B testing statistics to get REAL Lift in Conversions If you want to increase your chances of getting a real lift through A/B tests then you need to understand the statistics behind it. If you don’t like learning statistics then I am afraid A/B testing is not for you. fivethirtyeight.com Science Isn't Broken If you follow the headlines, your confidence in science may have taken a hit lately. Peer review? More like self- review. An investigation in November uncovered a scam in which researchers were rubber-stamping their own work, circumventing peer review at… conversionsciences.com The Ultimate A/B Testing Guide: Everything You Need, All In One Place Welcome to the ultimate A/B testing guide! In this post, I'm going to cover everything you need to know about A/B testing (also referred to as "split" testing), from start to finish. Here's what we'll cover: By the end of this guide, you'll have a thoro… How to setup A/B testing Generate strong testing ideas Learn more about A/B testing Baseline Result Change Variation Control ICE Score Ease Confi- dence Impact Test Idea URL / Screen # Status Hypothesis 1. Install Google Analytics 2. Setup Conversion Goals 3. Install Google Optimize 4. Configure Google Optimze 5. Create first A/B Test Google  Analytics Insights Hotjar  Screen  Recordings marketingplatform.google.com Analytics Tools & Solutions for Your Business - Google Analytics Easily access data from other Google solutions while working in Analytics, for a seamless workflow that saves you time and increases efficiency. Google Ads Gain deeper insights into how users from your Google Ads campaigns engage with your site. Data St… marketingplatform.google.com Website, A/B Testing & Optimization Tools - Google Optimize Optimize natively integrate with other Google solutions, saving you valuable time while increasing efficiencies across your team. Analytics Use your Analytics data to identify where to improve your site, measure experiments against business goals, and s… Why your website reminds me of "50 First Dates" - Part 1/5 YouTube Want to learn how deep the rabit hole goes? (in order) How to calculate sample size and significance? How to get enough traffic to make A/B testing viable? pirateskills.com Traffic Channel Compass | Pirate Skills The Traffic Channel Compass will give you an overview of the most effective growth marketing channels and help you focus on the right ones. Should focus scarce resources on Facebook, SEO, Newsletter,... or maybe even TikTok? Deciding on your most import… Ads are the most fun In E-Commerce YouTube Targeting Your B2B Audience with LinkedIn Ads YouTube Get more Instagram followers with this ad strategy (mobile only) - Part 1/6 YouTube How to get more Traffic with Native Ads YouTube Google Analytics Demystified | Live Stream YouTube Qualaroo  Customer  Feedback User- Testing .com GTmetrix Speed Test Typeform User Surveys Customer Journey Map Tools Frameworks www.widerfunn… LIFT Model: Most Popular Conversion Optimization Framework In 2009, Chris Goward introduced the LIFT Model®, a framework for analyzing web and mobile experiences and developing A/B test hypotheses. Today, it is the go-to conversion optimization framework for leading companies around the world. Motivation = Benefits - Costs vwo.com What is A/B Testing? A Practical Guide With Examples A/B testing (also known as split testing) is a process of showing two variants of the same web page to different segments of website visitors at the same time and comparing which variant drives more conversions. Start with research, end with it www.shopify.com The Complete Guide to A/B Testing: Expert Tips from Google, HubSpot and More This probably isn't the first time you've read about A/B testing. You might even already A/B test your email subject lines or your social media posts. Despite the fact that there's been plenty said about A/B testing in the field of marketing, a lot of p… Fact & Act model
  • 22. GROWTH 
 MARKETING 
 WORKSHOPS Master the Art and Science pirateskills.com/workshops of Growth Marketing