SlideShare a Scribd company logo
How to Leverage Experimentation
as a Growth Strategy
A conversation with The Motley Fool
Before we get started:
● Presentation slides and recording
will be available to you
● Use the Q&A panel to ask questions
or make comments - these will be
answered during the Q&A segment
at the end of the panel
Today’s panelists:
● Leads US Marketing operations and
optimization at The Motley Fool
● Works with Marketing, Tech, Editorial
and Product teams to scale testing
● Prior, Nate drove testing strategy for the
user acquisition team
James Flory
Experimentation Strategist
WiderFunnel
● Experimentation Strategist partnered
with companies like Intercom, Direct
Energy, and Providence Healthcare
● Expertise in behavioral psychology and
personalization
Nate Wallingsford
Head of US Marketing
Operations & Optimization
The Motley Fool
Q: How does “experimentation” fit
into your role at The Motley Fool?
Q: You described your initial tests as
“good idea tests”—why did you start
looking for an alternative method?
Q: How did the first experiment we
ran together differ from these good
idea tests?
+7.90%
+11.62%
+11.62%
Variation A
Variation B
Variation C
Variation D
+0.2%
-3.0%
-18.5%
-12.2%
Q: How do you respond to losing tests?
What has been the team and the
organization’s response to this side of
experimentation?
Variation B
Variation CVariation D
+23%+19.1%
Variation B
Variation A Variation B Variation C
+9.15%+14.45%
+8.88%
Q: Many testing teams focus on fixing
usability problems but understanding
your customers is crucial to providing an
ideal customer experience. How should
Optimizers balance the two?
The Two Sides of Optimization
The BJ Fogg Model describes behavioural
change as a function of two factors,
motivation and ability.
In optimization, both of these factors
play a pivotal role in developing good
hypotheses either together or apart.
-11.2%
+0.41%
-6.05%
Q: What does “experimentation at scale”
mean to you? How are you working to
scale experimentation at The Motley
Fool?
Q: How do you transfer and leverage
insights across multiple teams at The
Motley Fool?
Q: What does your technology stack for
experimentation look like?
Q: What are you most proud of when
you think about the experimentation
program at The Motley Fool?
Q: What does the future of
experimentation look like at The Motley
Fool?
Q&A
Looking to implement or scale an
experimentation program at your organization?
Send us an email to find out if you qualify for our
services!
Email: iwant@widerfunnel.com
Thank you!

More Related Content

What's hot

Optimizely Experience Customer Story - Atlassian
Optimizely Experience Customer Story - AtlassianOptimizely Experience Customer Story - Atlassian
Optimizely Experience Customer Story - Atlassian
Optimizely
 
Product Experimentation | Forming Strong Experiment Hypotheses
Product Experimentation | Forming Strong Experiment HypothesesProduct Experimentation | Forming Strong Experiment Hypotheses
Product Experimentation | Forming Strong Experiment Hypotheses
Optimizely
 
Optimizing Your B2B Demand Generation Machine
Optimizing Your B2B Demand Generation MachineOptimizing Your B2B Demand Generation Machine
Optimizing Your B2B Demand Generation Machine
Optimizely
 
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely
 
UX Analytics and Experimentation for eCommerce Growth
UX Analytics and Experimentation for eCommerce GrowthUX Analytics and Experimentation for eCommerce Growth
UX Analytics and Experimentation for eCommerce Growth
VWO
 
Magento Meetup New Delhi- AB Testing
Magento Meetup New Delhi- AB TestingMagento Meetup New Delhi- AB Testing
Magento Meetup New Delhi- AB Testing
Webkul Software Pvt. Ltd.
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New Winning
Optimizely
 
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Optimizely
 
Optimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar SlidesOptimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar Slides
Optimizely
 
How Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into ConsumersHow Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into Consumers
Optimizely
 
Maximizing Optimizely Website Performance
Maximizing Optimizely Website PerformanceMaximizing Optimizely Website Performance
Maximizing Optimizely Website Performance
Optimizely
 
VWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation RoadmapVWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation Roadmap
VWO
 
Measure Your Way To Maturity
Measure Your Way To MaturityMeasure Your Way To Maturity
Measure Your Way To Maturity
Optimizely
 
Art of Conducting Visitor Research
Art of Conducting Visitor ResearchArt of Conducting Visitor Research
Art of Conducting Visitor Research
VWO
 
Testing Your Testing Program
Testing Your Testing ProgramTesting Your Testing Program
Testing Your Testing Program
Jill Martay
 
WAW Houston presentation- Sunny Taj
WAW Houston presentation- Sunny TajWAW Houston presentation- Sunny Taj
WAW Houston presentation- Sunny Taj
Kashif Khurshid
 
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely
 
Are You Ready To Move Towards Conversion Optimization?
Are You Ready To Move Towards Conversion Optimization?Are You Ready To Move Towards Conversion Optimization?
Are You Ready To Move Towards Conversion Optimization?
VWO
 
How To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization StrategyHow To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization Strategy
VWO
 
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough
Optimizely
 

What's hot (20)

Optimizely Experience Customer Story - Atlassian
Optimizely Experience Customer Story - AtlassianOptimizely Experience Customer Story - Atlassian
Optimizely Experience Customer Story - Atlassian
 
Product Experimentation | Forming Strong Experiment Hypotheses
Product Experimentation | Forming Strong Experiment HypothesesProduct Experimentation | Forming Strong Experiment Hypotheses
Product Experimentation | Forming Strong Experiment Hypotheses
 
Optimizing Your B2B Demand Generation Machine
Optimizing Your B2B Demand Generation MachineOptimizing Your B2B Demand Generation Machine
Optimizing Your B2B Demand Generation Machine
 
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
 
UX Analytics and Experimentation for eCommerce Growth
UX Analytics and Experimentation for eCommerce GrowthUX Analytics and Experimentation for eCommerce Growth
UX Analytics and Experimentation for eCommerce Growth
 
Magento Meetup New Delhi- AB Testing
Magento Meetup New Delhi- AB TestingMagento Meetup New Delhi- AB Testing
Magento Meetup New Delhi- AB Testing
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New Winning
 
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
 
Optimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar SlidesOptimizely's Optimization Benchmark Findings Webinar Slides
Optimizely's Optimization Benchmark Findings Webinar Slides
 
How Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into ConsumersHow Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into Consumers
 
Maximizing Optimizely Website Performance
Maximizing Optimizely Website PerformanceMaximizing Optimizely Website Performance
Maximizing Optimizely Website Performance
 
VWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation RoadmapVWO Webinar: How To Plan Your Optimisation Roadmap
VWO Webinar: How To Plan Your Optimisation Roadmap
 
Measure Your Way To Maturity
Measure Your Way To MaturityMeasure Your Way To Maturity
Measure Your Way To Maturity
 
Art of Conducting Visitor Research
Art of Conducting Visitor ResearchArt of Conducting Visitor Research
Art of Conducting Visitor Research
 
Testing Your Testing Program
Testing Your Testing ProgramTesting Your Testing Program
Testing Your Testing Program
 
WAW Houston presentation- Sunny Taj
WAW Houston presentation- Sunny TajWAW Houston presentation- Sunny Taj
WAW Houston presentation- Sunny Taj
 
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
 
Are You Ready To Move Towards Conversion Optimization?
Are You Ready To Move Towards Conversion Optimization?Are You Ready To Move Towards Conversion Optimization?
Are You Ready To Move Towards Conversion Optimization?
 
How To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization StrategyHow To Build a Winning Conversion Optimization Strategy
How To Build a Winning Conversion Optimization Strategy
 
Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough Optimizely Workshop: Mobile Walkthrough
Optimizely Workshop: Mobile Walkthrough
 

Similar to Experimentation as a growth strategy: A conversation with The Motley Fool

__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...
__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...
__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...
JunniferParaiso1
 
Why We Test - Rethinking Your Approach
Why We Test - Rethinking Your ApproachWhy We Test - Rethinking Your Approach
Why We Test - Rethinking Your Approachaudreybloemer
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PM
Product School
 
Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010
Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010
Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010
TEST Huddle
 
How to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO programHow to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO program
VWO
 
Growth Hacking - High Tempo Testing
Growth Hacking - High Tempo TestingGrowth Hacking - High Tempo Testing
Growth Hacking - High Tempo Testing
Tomek Duda
 
How to Master Product Management Case Studies by fmr Groupon PM
How to Master Product Management Case Studies by fmr Groupon PMHow to Master Product Management Case Studies by fmr Groupon PM
How to Master Product Management Case Studies by fmr Groupon PM
Product School
 
uShip - Building a Culture Rooted in Experimentation
uShip - Building a Culture Rooted in ExperimentationuShip - Building a Culture Rooted in Experimentation
uShip - Building a Culture Rooted in Experimentation
Optimizely
 
Conversion Conference 2011 NYC presentation
Conversion Conference 2011 NYC presentationConversion Conference 2011 NYC presentation
Conversion Conference 2011 NYC presentation
Brian Jones
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
Optimizely
 
Trade up from cube to corner office - OpenText TeamSite Optimost
Trade up from cube to corner office - OpenText TeamSite OptimostTrade up from cube to corner office - OpenText TeamSite Optimost
Trade up from cube to corner office - OpenText TeamSite Optimost
suparupaa
 
Trade up from cube to corner office - OpenText Optimost
Trade up from cube to corner office - OpenText OptimostTrade up from cube to corner office - OpenText Optimost
Trade up from cube to corner office - OpenText Optimost
OpenText
 
Agile Marketing Methodology PowerPoint Presentation Slides
Agile Marketing Methodology PowerPoint Presentation SlidesAgile Marketing Methodology PowerPoint Presentation Slides
Agile Marketing Methodology PowerPoint Presentation Slides
SlideTeam
 
Why the first 2 stages of Design thinking are important for a startup?
Why the first 2 stages of Design thinking are important for a startup?Why the first 2 stages of Design thinking are important for a startup?
Why the first 2 stages of Design thinking are important for a startup?
Anuradha Sridharan
 
PMP® Sample Questions
PMP® Sample QuestionsPMP® Sample Questions
PMP® Sample Questions
OSP International LLC
 
DRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKES
DRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKESDRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKES
DRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKES
Human Capital Media
 
Conducting the Experimentation Orchestra
Conducting the Experimentation OrchestraConducting the Experimentation Orchestra
Conducting the Experimentation Orchestra
Optimizely
 
DV 2016: Building a Culture of Testing and Optimization
DV 2016: Building a Culture of Testing and OptimizationDV 2016: Building a Culture of Testing and Optimization
DV 2016: Building a Culture of Testing and Optimization
Tealium
 
How to Keep Up Your Creative Testing After Budget Cuts
How to Keep Up Your Creative Testing After Budget CutsHow to Keep Up Your Creative Testing After Budget Cuts
How to Keep Up Your Creative Testing After Budget Cuts
Tinuiti
 

Similar to Experimentation as a growth strategy: A conversation with The Motley Fool (20)

__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...
__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...
__qs_documents_15624_Paving_the_path_to_proven_sucess_-_Your_playbook_on_expe...
 
Why We Test - Rethinking Your Approach
Why We Test - Rethinking Your ApproachWhy We Test - Rethinking Your Approach
Why We Test - Rethinking Your Approach
 
How to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PMHow to Effectively Experiment in PM by LendingTree Sr PM
How to Effectively Experiment in PM by LendingTree Sr PM
 
Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010
Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010
Bob Galen - Differentiating Ourselves & Demonstrating Value - EuroSTAR 2010
 
How to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO programHow to Balance Innovation and Optimization in your CRO program
How to Balance Innovation and Optimization in your CRO program
 
Growth Hacking - High Tempo Testing
Growth Hacking - High Tempo TestingGrowth Hacking - High Tempo Testing
Growth Hacking - High Tempo Testing
 
How to Master Product Management Case Studies by fmr Groupon PM
How to Master Product Management Case Studies by fmr Groupon PMHow to Master Product Management Case Studies by fmr Groupon PM
How to Master Product Management Case Studies by fmr Groupon PM
 
uShip - Building a Culture Rooted in Experimentation
uShip - Building a Culture Rooted in ExperimentationuShip - Building a Culture Rooted in Experimentation
uShip - Building a Culture Rooted in Experimentation
 
Conversion Conference 2011 NYC presentation
Conversion Conference 2011 NYC presentationConversion Conference 2011 NYC presentation
Conversion Conference 2011 NYC presentation
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
 
Trade up from cube to corner office - OpenText TeamSite Optimost
Trade up from cube to corner office - OpenText TeamSite OptimostTrade up from cube to corner office - OpenText TeamSite Optimost
Trade up from cube to corner office - OpenText TeamSite Optimost
 
Trade up from cube to corner office - OpenText Optimost
Trade up from cube to corner office - OpenText OptimostTrade up from cube to corner office - OpenText Optimost
Trade up from cube to corner office - OpenText Optimost
 
Agile Marketing Methodology PowerPoint Presentation Slides
Agile Marketing Methodology PowerPoint Presentation SlidesAgile Marketing Methodology PowerPoint Presentation Slides
Agile Marketing Methodology PowerPoint Presentation Slides
 
Why the first 2 stages of Design thinking are important for a startup?
Why the first 2 stages of Design thinking are important for a startup?Why the first 2 stages of Design thinking are important for a startup?
Why the first 2 stages of Design thinking are important for a startup?
 
Going to the Source
Going to the SourceGoing to the Source
Going to the Source
 
PMP® Sample Questions
PMP® Sample QuestionsPMP® Sample Questions
PMP® Sample Questions
 
DRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKES
DRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKESDRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKES
DRIVING STRATEGY: HOW TO AVOID THE TOP THREE MISTAKES
 
Conducting the Experimentation Orchestra
Conducting the Experimentation OrchestraConducting the Experimentation Orchestra
Conducting the Experimentation Orchestra
 
DV 2016: Building a Culture of Testing and Optimization
DV 2016: Building a Culture of Testing and OptimizationDV 2016: Building a Culture of Testing and Optimization
DV 2016: Building a Culture of Testing and Optimization
 
How to Keep Up Your Creative Testing After Budget Cuts
How to Keep Up Your Creative Testing After Budget CutsHow to Keep Up Your Creative Testing After Budget Cuts
How to Keep Up Your Creative Testing After Budget Cuts
 

More from Chris Goward

[Webinar] The power of experimentation in direct-to-consumer eCommerce
[Webinar] The power of experimentation in direct-to-consumer eCommerce[Webinar] The power of experimentation in direct-to-consumer eCommerce
[Webinar] The power of experimentation in direct-to-consumer eCommerce
Chris Goward
 
Culture of experimentation: A conversation with Microsoft
Culture of experimentation: A conversation with MicrosoftCulture of experimentation: A conversation with Microsoft
Culture of experimentation: A conversation with Microsoft
Chris Goward
 
Thriving Through COVID: The Surprising Science of Emotion Behind Fast Growth
Thriving Through COVID: The Surprising Science of Emotion Behind Fast GrowthThriving Through COVID: The Surprising Science of Emotion Behind Fast Growth
Thriving Through COVID: The Surprising Science of Emotion Behind Fast Growth
Chris Goward
 
[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation
[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation
[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation
Chris Goward
 
How to optimize your e-commerce website at every touch point
How to optimize your e-commerce website at every touch pointHow to optimize your e-commerce website at every touch point
How to optimize your e-commerce website at every touch point
Chris Goward
 
[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...
[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...
[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...
Chris Goward
 
[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...
[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...
[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...
Chris Goward
 
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
Chris Goward
 
How to Partner With WiderFunnel
How to Partner With WiderFunnelHow to Partner With WiderFunnel
How to Partner With WiderFunnel
Chris Goward
 
Lunch & Learn - Secret to Successful Experimentation
Lunch & Learn - Secret to Successful ExperimentationLunch & Learn - Secret to Successful Experimentation
Lunch & Learn - Secret to Successful Experimentation
Chris Goward
 
[Webinar] Getting started with server-side testing - presented by WiderFunnel...
[Webinar] Getting started with server-side testing - presented by WiderFunnel...[Webinar] Getting started with server-side testing - presented by WiderFunnel...
[Webinar] Getting started with server-side testing - presented by WiderFunnel...
Chris Goward
 
Segment. Personalize. Optimize - by Chris Goward
Segment. Personalize. Optimize - by Chris GowardSegment. Personalize. Optimize - by Chris Goward
Segment. Personalize. Optimize - by Chris Goward
Chris Goward
 
Beyond CRO Basics - by Chris Goward of WiderFunnel - hosted by Optimizely
Beyond CRO Basics - by Chris Goward of WiderFunnel - hosted by OptimizelyBeyond CRO Basics - by Chris Goward of WiderFunnel - hosted by Optimizely
Beyond CRO Basics - by Chris Goward of WiderFunnel - hosted by Optimizely
Chris Goward
 
How to increase your sales by more than 40% like weBoost did
How to increase your sales by more than 40% like weBoost didHow to increase your sales by more than 40% like weBoost did
How to increase your sales by more than 40% like weBoost did
Chris Goward
 
Create your never-ending marketing idea engine for A/B testing and personaliz...
Create your never-ending marketing idea engine for A/B testing and personaliz...Create your never-ending marketing idea engine for A/B testing and personaliz...
Create your never-ending marketing idea engine for A/B testing and personaliz...
Chris Goward
 
Learn from failed A/B tests to create winning results
Learn from failed A/B tests to create winning resultsLearn from failed A/B tests to create winning results
Learn from failed A/B tests to create winning results
Chris Goward
 
Strategic personalization: Better process, better insights, better sales.
Strategic personalization: Better process, better insights, better sales.Strategic personalization: Better process, better insights, better sales.
Strategic personalization: Better process, better insights, better sales.
Chris Goward
 
Mastering the A/B Testing Idea Engine
Mastering the A/B Testing Idea EngineMastering the A/B Testing Idea Engine
Mastering the A/B Testing Idea Engine
Chris Goward
 
Personal branding for business and marketing students
Personal branding for business and marketing studentsPersonal branding for business and marketing students
Personal branding for business and marketing students
Chris Goward
 
Do Conversion Optimization Like the Pros
Do Conversion Optimization Like the ProsDo Conversion Optimization Like the Pros
Do Conversion Optimization Like the Pros
Chris Goward
 

More from Chris Goward (20)

[Webinar] The power of experimentation in direct-to-consumer eCommerce
[Webinar] The power of experimentation in direct-to-consumer eCommerce[Webinar] The power of experimentation in direct-to-consumer eCommerce
[Webinar] The power of experimentation in direct-to-consumer eCommerce
 
Culture of experimentation: A conversation with Microsoft
Culture of experimentation: A conversation with MicrosoftCulture of experimentation: A conversation with Microsoft
Culture of experimentation: A conversation with Microsoft
 
Thriving Through COVID: The Surprising Science of Emotion Behind Fast Growth
Thriving Through COVID: The Surprising Science of Emotion Behind Fast GrowthThriving Through COVID: The Surprising Science of Emotion Behind Fast Growth
Thriving Through COVID: The Surprising Science of Emotion Behind Fast Growth
 
[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation
[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation
[Webinar] Groomed for Success: Dollar Shave Club Wins with Experimentation
 
How to optimize your e-commerce website at every touch point
How to optimize your e-commerce website at every touch pointHow to optimize your e-commerce website at every touch point
How to optimize your e-commerce website at every touch point
 
[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...
[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...
[Webinar] Creating Emotionally Relevant Customer Experiences - WiderFunnel & ...
 
[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...
[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...
[Webinar] Building Your Organizations Experimentation Engine - Chris Goward &...
 
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
[Webinar] Scaling experimentation: 5 key pillars of maturity by Nick So
 
How to Partner With WiderFunnel
How to Partner With WiderFunnelHow to Partner With WiderFunnel
How to Partner With WiderFunnel
 
Lunch & Learn - Secret to Successful Experimentation
Lunch & Learn - Secret to Successful ExperimentationLunch & Learn - Secret to Successful Experimentation
Lunch & Learn - Secret to Successful Experimentation
 
[Webinar] Getting started with server-side testing - presented by WiderFunnel...
[Webinar] Getting started with server-side testing - presented by WiderFunnel...[Webinar] Getting started with server-side testing - presented by WiderFunnel...
[Webinar] Getting started with server-side testing - presented by WiderFunnel...
 
Segment. Personalize. Optimize - by Chris Goward
Segment. Personalize. Optimize - by Chris GowardSegment. Personalize. Optimize - by Chris Goward
Segment. Personalize. Optimize - by Chris Goward
 
Beyond CRO Basics - by Chris Goward of WiderFunnel - hosted by Optimizely
Beyond CRO Basics - by Chris Goward of WiderFunnel - hosted by OptimizelyBeyond CRO Basics - by Chris Goward of WiderFunnel - hosted by Optimizely
Beyond CRO Basics - by Chris Goward of WiderFunnel - hosted by Optimizely
 
How to increase your sales by more than 40% like weBoost did
How to increase your sales by more than 40% like weBoost didHow to increase your sales by more than 40% like weBoost did
How to increase your sales by more than 40% like weBoost did
 
Create your never-ending marketing idea engine for A/B testing and personaliz...
Create your never-ending marketing idea engine for A/B testing and personaliz...Create your never-ending marketing idea engine for A/B testing and personaliz...
Create your never-ending marketing idea engine for A/B testing and personaliz...
 
Learn from failed A/B tests to create winning results
Learn from failed A/B tests to create winning resultsLearn from failed A/B tests to create winning results
Learn from failed A/B tests to create winning results
 
Strategic personalization: Better process, better insights, better sales.
Strategic personalization: Better process, better insights, better sales.Strategic personalization: Better process, better insights, better sales.
Strategic personalization: Better process, better insights, better sales.
 
Mastering the A/B Testing Idea Engine
Mastering the A/B Testing Idea EngineMastering the A/B Testing Idea Engine
Mastering the A/B Testing Idea Engine
 
Personal branding for business and marketing students
Personal branding for business and marketing studentsPersonal branding for business and marketing students
Personal branding for business and marketing students
 
Do Conversion Optimization Like the Pros
Do Conversion Optimization Like the ProsDo Conversion Optimization Like the Pros
Do Conversion Optimization Like the Pros
 

Recently uploaded

Digital Marketing Trends - Experts Insights on How to Gain a Competitive Edge
Digital Marketing Trends - Experts Insights on How to Gain a Competitive EdgeDigital Marketing Trends - Experts Insights on How to Gain a Competitive Edge
Digital Marketing Trends - Experts Insights on How to Gain a Competitive Edge
DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions
 
The New Era Of SEO - How AI Has Changed SEO Forever - Danny Leibrandt
The New Era Of SEO - How AI Has Changed SEO Forever - Danny LeibrandtThe New Era Of SEO - How AI Has Changed SEO Forever - Danny Leibrandt
The New Era Of SEO - How AI Has Changed SEO Forever - Danny Leibrandt
DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions
 
Digital Commerce Lecture for Advanced Digital & Social Media Strategy at UCLA...
Digital Commerce Lecture for Advanced Digital & Social Media Strategy at UCLA...Digital Commerce Lecture for Advanced Digital & Social Media Strategy at UCLA...
Digital Commerce Lecture for Advanced Digital & Social Media Strategy at UCLA...
Valters Lauzums
 
5 Big Bets for 2024 - Jamie A. Lee, Stripes Co
5 Big Bets for 2024 - Jamie A. Lee, Stripes Co5 Big Bets for 2024 - Jamie A. Lee, Stripes Co
15 ideas and frameworks on the art of storytelling
15 ideas and frameworks on the art of storytelling15 ideas and frameworks on the art of storytelling
15 ideas and frameworks on the art of storytelling
Aatir Abdul Rauf
 
SEO as the Backbone of Digital Marketing
SEO as the Backbone of Digital MarketingSEO as the Backbone of Digital Marketing
SEO as the Backbone of Digital Marketing
Felipe Bazon
 
How to use Short Form Video To Grow Your Brand and Business - Keenya Kelly
How to use Short Form Video To Grow Your Brand and Business - Keenya KellyHow to use Short Form Video To Grow Your Brand and Business - Keenya Kelly
How to use Short Form Video To Grow Your Brand and Business - Keenya Kelly
DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions
 
SEO Master Class - Steve Wiideman, Wiideman Consulting Group
SEO Master Class - Steve Wiideman,  Wiideman Consulting GroupSEO Master Class - Steve Wiideman,  Wiideman Consulting Group
SEO Master Class - Steve Wiideman, Wiideman Consulting Group
DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions
 
BLOOM_May2024. Balmer Lawrie Online Monthly Bulletin
BLOOM_May2024. Balmer Lawrie Online Monthly BulletinBLOOM_May2024. Balmer Lawrie Online Monthly Bulletin
BLOOM_May2024. Balmer Lawrie Online Monthly Bulletin
BalmerLawrie
 
Unknown to Unforgettable - The Art and Science to Being Irresistible on Camer...
Unknown to Unforgettable - The Art and Science to Being Irresistible on Camer...Unknown to Unforgettable - The Art and Science to Being Irresistible on Camer...
Unknown to Unforgettable - The Art and Science to Being Irresistible on Camer...
DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions
 
Digital Marketing Training In Bangalore
Digital Marketing Training In BangaloreDigital Marketing Training In Bangalore
Digital Marketing Training In Bangalore
syedasifsyed46
 
Digital Strategy Master Class - Andrew Rupert
Digital Strategy Master Class - Andrew RupertDigital Strategy Master Class - Andrew Rupert
De-risk Your Digital Evolution - Hannah Grap
De-risk Your Digital Evolution - Hannah GrapDe-risk Your Digital Evolution - Hannah Grap
Mastering Multi-Touchpoint Content Strategy: Navigate Fragmented User Journeys
Mastering Multi-Touchpoint Content Strategy: Navigate Fragmented User JourneysMastering Multi-Touchpoint Content Strategy: Navigate Fragmented User Journeys
Mastering Multi-Touchpoint Content Strategy: Navigate Fragmented User Journeys
Search Engine Journal
 
How to Run Landing Page Tests On and Off Paid Social Platforms
How to Run Landing Page Tests On and Off Paid Social PlatformsHow to Run Landing Page Tests On and Off Paid Social Platforms
How to Run Landing Page Tests On and Off Paid Social Platforms
VWO
 
Monthly Social Media News Update May 2024
Monthly Social Media News Update May 2024Monthly Social Media News Update May 2024
Monthly Social Media News Update May 2024
Andy Lambert
 
How to Use AI to Write a High-Quality Article that Ranks
How to Use AI to Write a High-Quality Article that RanksHow to Use AI to Write a High-Quality Article that Ranks
How to Use AI to Write a High-Quality Article that Ranks
minatamang0021
 
10 Videos Any Business Can Make Right Now! - Shelly Nathan
10 Videos Any Business Can Make Right Now! - Shelly Nathan10 Videos Any Business Can Make Right Now! - Shelly Nathan
10 Videos Any Business Can Make Right Now! - Shelly Nathan
DigiMarCon - Digital Marketing, Media and Advertising Conferences & Exhibitions
 
BLOOM_May2024 (r). Balmer Lawrie Online Monthly Bulletin
BLOOM_May2024 (r). Balmer Lawrie Online Monthly BulletinBLOOM_May2024 (r). Balmer Lawrie Online Monthly Bulletin
BLOOM_May2024 (r). Balmer Lawrie Online Monthly Bulletin
BalmerLawrie
 
ThinkNow 2024 Consumer Financial Wellness Report
ThinkNow 2024 Consumer Financial Wellness ReportThinkNow 2024 Consumer Financial Wellness Report
ThinkNow 2024 Consumer Financial Wellness Report
ThinkNow
 

Recently uploaded (20)

Digital Marketing Trends - Experts Insights on How to Gain a Competitive Edge
Digital Marketing Trends - Experts Insights on How to Gain a Competitive EdgeDigital Marketing Trends - Experts Insights on How to Gain a Competitive Edge
Digital Marketing Trends - Experts Insights on How to Gain a Competitive Edge
 
The New Era Of SEO - How AI Has Changed SEO Forever - Danny Leibrandt
The New Era Of SEO - How AI Has Changed SEO Forever - Danny LeibrandtThe New Era Of SEO - How AI Has Changed SEO Forever - Danny Leibrandt
The New Era Of SEO - How AI Has Changed SEO Forever - Danny Leibrandt
 
Digital Commerce Lecture for Advanced Digital & Social Media Strategy at UCLA...
Digital Commerce Lecture for Advanced Digital & Social Media Strategy at UCLA...Digital Commerce Lecture for Advanced Digital & Social Media Strategy at UCLA...
Digital Commerce Lecture for Advanced Digital & Social Media Strategy at UCLA...
 
5 Big Bets for 2024 - Jamie A. Lee, Stripes Co
5 Big Bets for 2024 - Jamie A. Lee, Stripes Co5 Big Bets for 2024 - Jamie A. Lee, Stripes Co
5 Big Bets for 2024 - Jamie A. Lee, Stripes Co
 
15 ideas and frameworks on the art of storytelling
15 ideas and frameworks on the art of storytelling15 ideas and frameworks on the art of storytelling
15 ideas and frameworks on the art of storytelling
 
SEO as the Backbone of Digital Marketing
SEO as the Backbone of Digital MarketingSEO as the Backbone of Digital Marketing
SEO as the Backbone of Digital Marketing
 
How to use Short Form Video To Grow Your Brand and Business - Keenya Kelly
How to use Short Form Video To Grow Your Brand and Business - Keenya KellyHow to use Short Form Video To Grow Your Brand and Business - Keenya Kelly
How to use Short Form Video To Grow Your Brand and Business - Keenya Kelly
 
SEO Master Class - Steve Wiideman, Wiideman Consulting Group
SEO Master Class - Steve Wiideman,  Wiideman Consulting GroupSEO Master Class - Steve Wiideman,  Wiideman Consulting Group
SEO Master Class - Steve Wiideman, Wiideman Consulting Group
 
BLOOM_May2024. Balmer Lawrie Online Monthly Bulletin
BLOOM_May2024. Balmer Lawrie Online Monthly BulletinBLOOM_May2024. Balmer Lawrie Online Monthly Bulletin
BLOOM_May2024. Balmer Lawrie Online Monthly Bulletin
 
Unknown to Unforgettable - The Art and Science to Being Irresistible on Camer...
Unknown to Unforgettable - The Art and Science to Being Irresistible on Camer...Unknown to Unforgettable - The Art and Science to Being Irresistible on Camer...
Unknown to Unforgettable - The Art and Science to Being Irresistible on Camer...
 
Digital Marketing Training In Bangalore
Digital Marketing Training In BangaloreDigital Marketing Training In Bangalore
Digital Marketing Training In Bangalore
 
Digital Strategy Master Class - Andrew Rupert
Digital Strategy Master Class - Andrew RupertDigital Strategy Master Class - Andrew Rupert
Digital Strategy Master Class - Andrew Rupert
 
De-risk Your Digital Evolution - Hannah Grap
De-risk Your Digital Evolution - Hannah GrapDe-risk Your Digital Evolution - Hannah Grap
De-risk Your Digital Evolution - Hannah Grap
 
Mastering Multi-Touchpoint Content Strategy: Navigate Fragmented User Journeys
Mastering Multi-Touchpoint Content Strategy: Navigate Fragmented User JourneysMastering Multi-Touchpoint Content Strategy: Navigate Fragmented User Journeys
Mastering Multi-Touchpoint Content Strategy: Navigate Fragmented User Journeys
 
How to Run Landing Page Tests On and Off Paid Social Platforms
How to Run Landing Page Tests On and Off Paid Social PlatformsHow to Run Landing Page Tests On and Off Paid Social Platforms
How to Run Landing Page Tests On and Off Paid Social Platforms
 
Monthly Social Media News Update May 2024
Monthly Social Media News Update May 2024Monthly Social Media News Update May 2024
Monthly Social Media News Update May 2024
 
How to Use AI to Write a High-Quality Article that Ranks
How to Use AI to Write a High-Quality Article that RanksHow to Use AI to Write a High-Quality Article that Ranks
How to Use AI to Write a High-Quality Article that Ranks
 
10 Videos Any Business Can Make Right Now! - Shelly Nathan
10 Videos Any Business Can Make Right Now! - Shelly Nathan10 Videos Any Business Can Make Right Now! - Shelly Nathan
10 Videos Any Business Can Make Right Now! - Shelly Nathan
 
BLOOM_May2024 (r). Balmer Lawrie Online Monthly Bulletin
BLOOM_May2024 (r). Balmer Lawrie Online Monthly BulletinBLOOM_May2024 (r). Balmer Lawrie Online Monthly Bulletin
BLOOM_May2024 (r). Balmer Lawrie Online Monthly Bulletin
 
ThinkNow 2024 Consumer Financial Wellness Report
ThinkNow 2024 Consumer Financial Wellness ReportThinkNow 2024 Consumer Financial Wellness Report
ThinkNow 2024 Consumer Financial Wellness Report
 

Experimentation as a growth strategy: A conversation with The Motley Fool

  • 1. How to Leverage Experimentation as a Growth Strategy A conversation with The Motley Fool
  • 2. Before we get started: ● Presentation slides and recording will be available to you ● Use the Q&A panel to ask questions or make comments - these will be answered during the Q&A segment at the end of the panel
  • 3. Today’s panelists: ● Leads US Marketing operations and optimization at The Motley Fool ● Works with Marketing, Tech, Editorial and Product teams to scale testing ● Prior, Nate drove testing strategy for the user acquisition team James Flory Experimentation Strategist WiderFunnel ● Experimentation Strategist partnered with companies like Intercom, Direct Energy, and Providence Healthcare ● Expertise in behavioral psychology and personalization Nate Wallingsford Head of US Marketing Operations & Optimization The Motley Fool
  • 4. Q: How does “experimentation” fit into your role at The Motley Fool?
  • 5. Q: You described your initial tests as “good idea tests”—why did you start looking for an alternative method?
  • 6. Q: How did the first experiment we ran together differ from these good idea tests?
  • 7.
  • 8.
  • 11.
  • 12. Variation A Variation B Variation C Variation D +0.2% -3.0% -18.5% -12.2%
  • 13. Q: How do you respond to losing tests? What has been the team and the organization’s response to this side of experimentation?
  • 14. Variation B Variation CVariation D +23%+19.1% Variation B
  • 15.
  • 16. Variation A Variation B Variation C +9.15%+14.45% +8.88%
  • 17. Q: Many testing teams focus on fixing usability problems but understanding your customers is crucial to providing an ideal customer experience. How should Optimizers balance the two?
  • 18. The Two Sides of Optimization The BJ Fogg Model describes behavioural change as a function of two factors, motivation and ability. In optimization, both of these factors play a pivotal role in developing good hypotheses either together or apart.
  • 20.
  • 23. Q: What does “experimentation at scale” mean to you? How are you working to scale experimentation at The Motley Fool?
  • 24. Q: How do you transfer and leverage insights across multiple teams at The Motley Fool?
  • 25. Q: What does your technology stack for experimentation look like?
  • 26. Q: What are you most proud of when you think about the experimentation program at The Motley Fool?
  • 27. Q: What does the future of experimentation look like at The Motley Fool?
  • 28. Q&A
  • 29. Looking to implement or scale an experimentation program at your organization? Send us an email to find out if you qualify for our services! Email: iwant@widerfunnel.com