SlideShare a Scribd company logo
Congratulations to our
Outperform Award Winners!
Most Dramatic
Business Impact
Most Customer-
Obsessed Company
Culture
Most Transformative
Innovation
Most Inspiring Social
Impact
• Welcome to Opticon!
• Sessions today will be recorded and will be available after Opticon
• Join the conversation on Twitter at #Opticon19
• We want to hear from you! Give feedback and rate sessions on the
mobile app
Chris Darner
VP Product,
The Venetian Casino Resort
Las Vegas
Jeff Blettner
CRO Strategist,
Tinuiti
Kate Nichol
Director,
Optimizely Success Programs
Quantifying the ROI of Your
Experimentation Program
4
Value Journey Model
Building a Team to Accelerate Success
5
Optimizely Delivers ROI + Value
 Learn before you launch
 Reduce risk
 Drive innovation
 Competitive advantage
 Financial Model
 Revenue
 Core Metrics
ROI Value
6
Definitions
Attribution - The action of regarding something as being caused by a person or thing.
Attribution Model - The rule, or set of rules, that determines how credit for conversions assigned to
touchpoints in a conversion paths.
Value - the regard that something is held to deserve; the importance, worth, or usefulness of
something.
ROI - Return on Investment.
Return - A profit from an investment.
ROI Model - This is a mathematical model, designed to represent the performance of a business, or a
project where the output is shown as a return on investment.
Why is ROI Modeling
Important?
8
RESOURCE
JUSTIFICATION
The Value of ROI Modeling
EVIDENCE
OF VALUE
SUCCESS
TRAJECTORY
PRIORITIZATION
QUANTIFIABLE
REVENUE
Venetian Casino Resort
ROI Model Journey
 Build a team
 Align with corporate strategy
 Bring perspective to the business
 Create visibility
 Reinforce the program value
 Collaborate and refine
ROI Journey
The Venetian’s experience developing a model
 Aligning ‘Global Product KPIs’
 Bootstrapping
 Backfilling
 Housekeeping
 Evaluating and adjusting the model
 Reducing overhead
Overcoming Challenges
The Venetian’s experience developing a model
12
Common Pitfalls in ROI Modeling
VALUATION WEIGHTING PROJECTION
EFFICIENCY VISUALIZATION OVERLAP
Optimizely’s
ROI Model
14
Optimizely’s ROI Model
Supported by your data!
Foundational Approach
Rooted in logic and math
Transparent
Flexible
15
Model Drivers
1. Metric Alignment
2. Time-Horizon Discount
3. Intangible Discount
16
Optimizely’s ROI Model:
Metric Alignment
 Connect to Organizational Strategy
 Focus on Business Outcomes
(purchases, ads, subscriptions, leads etc.)
 Attribute financial value
17
Optimizely’s ROI Model:
Time-Horizon Discount
 The Novelty Effect
 Diminishing Returns
 Forecast Adjustment
18
Optimizely’s ROI Model:
Intangible Discount
Landing
Page
Product
Page
Shopping
Cart
Checkout
experiment A
experiment B
Join our ROI
Program
Come visit us
at the Booth!
To sign-up to receive your
custom model and 1:1
getting started session!
Q&A
Thank you!
 Head to the Expo Hall for a quick break and say
hello to our sponsors
 Up next…hear from our panel at Accenture how
inclusion and diversity fosters growth

More Related Content

What's hot

Optimism Webinar 1: Improving your digital experiences - what's next in 2019?
Optimism Webinar 1:  Improving your digital experiences - what's next in 2019?Optimism Webinar 1:  Improving your digital experiences - what's next in 2019?
Optimism Webinar 1: Improving your digital experiences - what's next in 2019?
Optimizely
 
Speed Matters - Strategies to Improve Your Site Performance
Speed Matters - Strategies to Improve Your Site PerformanceSpeed Matters - Strategies to Improve Your Site Performance
Speed Matters - Strategies to Improve Your Site Performance
Optimizely
 
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
Optimizely
 
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New Winning
Optimizely
 
Building a Culture of Experimentation at HP
Building a Culture of Experimentation at HPBuilding a Culture of Experimentation at HP
Building a Culture of Experimentation at HP
Optimizely
 
How to Reduce Customer Acquisition Costs and Optimize Advertising Spend
How to Reduce Customer Acquisition Costs and Optimize Advertising SpendHow to Reduce Customer Acquisition Costs and Optimize Advertising Spend
How to Reduce Customer Acquisition Costs and Optimize Advertising Spend
Optimizely
 
Optimism Webinar 3: Lessons from Digital Leaders - How to go beyond A/B testing
Optimism Webinar 3: Lessons from Digital Leaders - How to go beyond A/B testingOptimism Webinar 3: Lessons from Digital Leaders - How to go beyond A/B testing
Optimism Webinar 3: Lessons from Digital Leaders - How to go beyond A/B testing
Optimizely
 
An Experimentation Framework: How to Position for Triple Digit Growth
An Experimentation Framework: How to Position for Triple Digit GrowthAn Experimentation Framework: How to Position for Triple Digit Growth
An Experimentation Framework: How to Position for Triple Digit Growth
Optimizely
 
Optimism Webinar 2 - Moving from AB testing to true experimentation
Optimism Webinar 2 - Moving from AB testing to true experimentationOptimism Webinar 2 - Moving from AB testing to true experimentation
Optimism Webinar 2 - Moving from AB testing to true experimentation
Optimizely
 
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely
 
From iOS to TiVo: In-app Digital Experience Testing
From iOS to TiVo: In-app Digital Experience TestingFrom iOS to TiVo: In-app Digital Experience Testing
From iOS to TiVo: In-app Digital Experience Testing
Optimizely
 
Testing Your Testing Program
Testing Your Testing ProgramTesting Your Testing Program
Testing Your Testing Program
Jill Martay
 
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing Right
Optimizely
 
uShip - Building a Culture Rooted in Experimentation
uShip - Building a Culture Rooted in ExperimentationuShip - Building a Culture Rooted in Experimentation
uShip - Building a Culture Rooted in Experimentation
Optimizely
 
Experimentation Excellence Webinar Series: Time to scale up
Experimentation Excellence Webinar Series: Time to scale upExperimentation Excellence Webinar Series: Time to scale up
Experimentation Excellence Webinar Series: Time to scale up
Optimizely
 
The Wall Street Journal - Optimizing Membership
The Wall Street Journal - Optimizing MembershipThe Wall Street Journal - Optimizing Membership
The Wall Street Journal - Optimizing Membership
Optimizely
 
How Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into ConsumersHow Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into Consumers
Optimizely
 
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Optimizely
 

What's hot (20)

Optimism Webinar 1: Improving your digital experiences - what's next in 2019?
Optimism Webinar 1:  Improving your digital experiences - what's next in 2019?Optimism Webinar 1:  Improving your digital experiences - what's next in 2019?
Optimism Webinar 1: Improving your digital experiences - what's next in 2019?
 
Speed Matters - Strategies to Improve Your Site Performance
Speed Matters - Strategies to Improve Your Site PerformanceSpeed Matters - Strategies to Improve Your Site Performance
Speed Matters - Strategies to Improve Your Site Performance
 
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
Testing Across the Enterprise: How Cox Automotive Scales Experimentation to M...
 
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
Optimizely, HEMA & Farfetch - Unlock the Potential of Digital Experimentation...
 
Losing is the New Winning
Losing is the New WinningLosing is the New Winning
Losing is the New Winning
 
Building a Culture of Experimentation at HP
Building a Culture of Experimentation at HPBuilding a Culture of Experimentation at HP
Building a Culture of Experimentation at HP
 
How to Reduce Customer Acquisition Costs and Optimize Advertising Spend
How to Reduce Customer Acquisition Costs and Optimize Advertising SpendHow to Reduce Customer Acquisition Costs and Optimize Advertising Spend
How to Reduce Customer Acquisition Costs and Optimize Advertising Spend
 
Optimism Webinar 3: Lessons from Digital Leaders - How to go beyond A/B testing
Optimism Webinar 3: Lessons from Digital Leaders - How to go beyond A/B testingOptimism Webinar 3: Lessons from Digital Leaders - How to go beyond A/B testing
Optimism Webinar 3: Lessons from Digital Leaders - How to go beyond A/B testing
 
An Experimentation Framework: How to Position for Triple Digit Growth
An Experimentation Framework: How to Position for Triple Digit GrowthAn Experimentation Framework: How to Position for Triple Digit Growth
An Experimentation Framework: How to Position for Triple Digit Growth
 
Optimism Webinar 2 - Moving from AB testing to true experimentation
Optimism Webinar 2 - Moving from AB testing to true experimentationOptimism Webinar 2 - Moving from AB testing to true experimentation
Optimism Webinar 2 - Moving from AB testing to true experimentation
 
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
Optimizely & Photobox - DON'T PANIC: The No-Confusion Experimentation Startup...
 
From iOS to TiVo: In-app Digital Experience Testing
From iOS to TiVo: In-app Digital Experience TestingFrom iOS to TiVo: In-app Digital Experience Testing
From iOS to TiVo: In-app Digital Experience Testing
 
Testing Your Testing Program
Testing Your Testing ProgramTesting Your Testing Program
Testing Your Testing Program
 
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
Optimizely & FedEx - Setting North-Star Metrics to Drive ROI from Experimenta...
 
The Science of Getting Testing Right
The Science of Getting Testing RightThe Science of Getting Testing Right
The Science of Getting Testing Right
 
uShip - Building a Culture Rooted in Experimentation
uShip - Building a Culture Rooted in ExperimentationuShip - Building a Culture Rooted in Experimentation
uShip - Building a Culture Rooted in Experimentation
 
Experimentation Excellence Webinar Series: Time to scale up
Experimentation Excellence Webinar Series: Time to scale upExperimentation Excellence Webinar Series: Time to scale up
Experimentation Excellence Webinar Series: Time to scale up
 
The Wall Street Journal - Optimizing Membership
The Wall Street Journal - Optimizing MembershipThe Wall Street Journal - Optimizing Membership
The Wall Street Journal - Optimizing Membership
 
How Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into ConsumersHow Clorox Experiments Across Brands to Turn Visitors into Consumers
How Clorox Experiments Across Brands to Turn Visitors into Consumers
 
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
Outperform Webinar Series: How to Capture Your Customers at the Top of the Fu...
 

Similar to Quantify the ROI of Your Experimentation Program

Building Business Value
Building Business ValueBuilding Business Value
Building Business Value
Mitcharlesworth
 
The 4 Parts of an Effective Pay Design Process
The 4 Parts of an Effective Pay Design ProcessThe 4 Parts of an Effective Pay Design Process
The 4 Parts of an Effective Pay Design Process
The VisionLink Advisory Group
 
Your VoC Programme is underperforming - and you know it
Your VoC Programme is underperforming - and you know itYour VoC Programme is underperforming - and you know it
Your VoC Programme is underperforming - and you know it
Futurelab
 
Your VoC Programme is underperforming - do something about it
Your VoC Programme is underperforming - do something about itYour VoC Programme is underperforming - do something about it
Your VoC Programme is underperforming - do something about it
Futurelab
 
MRS Speaker Evening- hosted by the ADA Network
MRS Speaker Evening- hosted by the ADA NetworkMRS Speaker Evening- hosted by the ADA Network
MRS Speaker Evening- hosted by the ADA Network
MRS
 
5 Keys to Building a High Performance Pay Strategy
5 Keys to Building a High Performance Pay Strategy5 Keys to Building a High Performance Pay Strategy
5 Keys to Building a High Performance Pay Strategy
The VisionLink Advisory Group
 
rally-business-agility-survival-guide-digital
rally-business-agility-survival-guide-digitalrally-business-agility-survival-guide-digital
rally-business-agility-survival-guide-digitalPhillip McKenzie Smith
 
Achieve Digital Transformation Success with Value Management
Achieve Digital Transformation Success with Value ManagementAchieve Digital Transformation Success with Value Management
Achieve Digital Transformation Success with Value Management
Anurag Goel
 
3 Pay Strategy Decisions Only the CEO Should Make
3 Pay Strategy Decisions Only the CEO Should Make3 Pay Strategy Decisions Only the CEO Should Make
3 Pay Strategy Decisions Only the CEO Should Make
The VisionLink Advisory Group
 
Rise of the Value Based Product Manager
Rise of the Value Based Product ManagerRise of the Value Based Product Manager
Rise of the Value Based Product Manager
Sapna Anil
 
How to Link Pay and Performance Management in the New Economy
How to Link Pay and Performance Management in the New EconomyHow to Link Pay and Performance Management in the New Economy
How to Link Pay and Performance Management in the New Economy
The VisionLink Advisory Group
 
Financial Management Best Practices
Financial Management Best PracticesFinancial Management Best Practices
Financial Management Best Practices
Autotask
 
Financial realities to strategy (public)
Financial realities to strategy (public)Financial realities to strategy (public)
Financial realities to strategy (public)
ParCon Consulting, LLC
 
Core value vital signs 5.0
Core value vital signs 5.0Core value vital signs 5.0
Core value vital signs 5.0
Bill Dunnington
 
Core value vital signs 5.0
Core value vital signs 5.0Core value vital signs 5.0
Core value vital signs 5.0
Bill Dunnington
 
CFO Summit XXI-A.Elli M&A
CFO Summit XXI-A.Elli M&ACFO Summit XXI-A.Elli M&A
CFO Summit XXI-A.Elli M&AAlberto Elli
 
Pay Strategies that Increase Shareholder Value
Pay Strategies that Increase Shareholder ValuePay Strategies that Increase Shareholder Value
Pay Strategies that Increase Shareholder Value
The VisionLink Advisory Group
 
Value Creation Concept and Approach for VC
Value Creation Concept and Approach for VCValue Creation Concept and Approach for VC
Value Creation Concept and Approach for VC
Yee Jie NG
 
Dark art of benefits managemenet iiba - brisbane - 24 august 2018
Dark art of benefits managemenet   iiba - brisbane - 24 august 2018Dark art of benefits managemenet   iiba - brisbane - 24 august 2018
Dark art of benefits managemenet iiba - brisbane - 24 august 2018
Ian Gomez
 
Growth Framework
Growth FrameworkGrowth Framework
Growth Framework
Bob Kimball
 

Similar to Quantify the ROI of Your Experimentation Program (20)

Building Business Value
Building Business ValueBuilding Business Value
Building Business Value
 
The 4 Parts of an Effective Pay Design Process
The 4 Parts of an Effective Pay Design ProcessThe 4 Parts of an Effective Pay Design Process
The 4 Parts of an Effective Pay Design Process
 
Your VoC Programme is underperforming - and you know it
Your VoC Programme is underperforming - and you know itYour VoC Programme is underperforming - and you know it
Your VoC Programme is underperforming - and you know it
 
Your VoC Programme is underperforming - do something about it
Your VoC Programme is underperforming - do something about itYour VoC Programme is underperforming - do something about it
Your VoC Programme is underperforming - do something about it
 
MRS Speaker Evening- hosted by the ADA Network
MRS Speaker Evening- hosted by the ADA NetworkMRS Speaker Evening- hosted by the ADA Network
MRS Speaker Evening- hosted by the ADA Network
 
5 Keys to Building a High Performance Pay Strategy
5 Keys to Building a High Performance Pay Strategy5 Keys to Building a High Performance Pay Strategy
5 Keys to Building a High Performance Pay Strategy
 
rally-business-agility-survival-guide-digital
rally-business-agility-survival-guide-digitalrally-business-agility-survival-guide-digital
rally-business-agility-survival-guide-digital
 
Achieve Digital Transformation Success with Value Management
Achieve Digital Transformation Success with Value ManagementAchieve Digital Transformation Success with Value Management
Achieve Digital Transformation Success with Value Management
 
3 Pay Strategy Decisions Only the CEO Should Make
3 Pay Strategy Decisions Only the CEO Should Make3 Pay Strategy Decisions Only the CEO Should Make
3 Pay Strategy Decisions Only the CEO Should Make
 
Rise of the Value Based Product Manager
Rise of the Value Based Product ManagerRise of the Value Based Product Manager
Rise of the Value Based Product Manager
 
How to Link Pay and Performance Management in the New Economy
How to Link Pay and Performance Management in the New EconomyHow to Link Pay and Performance Management in the New Economy
How to Link Pay and Performance Management in the New Economy
 
Financial Management Best Practices
Financial Management Best PracticesFinancial Management Best Practices
Financial Management Best Practices
 
Financial realities to strategy (public)
Financial realities to strategy (public)Financial realities to strategy (public)
Financial realities to strategy (public)
 
Core value vital signs 5.0
Core value vital signs 5.0Core value vital signs 5.0
Core value vital signs 5.0
 
Core value vital signs 5.0
Core value vital signs 5.0Core value vital signs 5.0
Core value vital signs 5.0
 
CFO Summit XXI-A.Elli M&A
CFO Summit XXI-A.Elli M&ACFO Summit XXI-A.Elli M&A
CFO Summit XXI-A.Elli M&A
 
Pay Strategies that Increase Shareholder Value
Pay Strategies that Increase Shareholder ValuePay Strategies that Increase Shareholder Value
Pay Strategies that Increase Shareholder Value
 
Value Creation Concept and Approach for VC
Value Creation Concept and Approach for VCValue Creation Concept and Approach for VC
Value Creation Concept and Approach for VC
 
Dark art of benefits managemenet iiba - brisbane - 24 august 2018
Dark art of benefits managemenet   iiba - brisbane - 24 august 2018Dark art of benefits managemenet   iiba - brisbane - 24 august 2018
Dark art of benefits managemenet iiba - brisbane - 24 august 2018
 
Growth Framework
Growth FrameworkGrowth Framework
Growth Framework
 

More from Optimizely

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
Optimizely
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Optimizely
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Optimizely
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Optimizely
 
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueZillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Optimizely
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical Teams
Optimizely
 
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Optimizely
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Optimizely
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Optimizely
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server Side
Optimizely
 
Evolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentEvolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product Development
Optimizely
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Optimizely
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
Optimizely
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Optimizely
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Optimizely
 
Experimentation through Clients' Eyes
Experimentation through Clients' EyesExperimentation through Clients' Eyes
Experimentation through Clients' Eyes
Optimizely
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHub
Optimizely
 
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationTest Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Optimizely
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely
 
The Future of Software Development
The Future of Software DevelopmentThe Future of Software Development
The Future of Software Development
Optimizely
 

More from Optimizely (20)

Clover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive ExperimentationClover Rings Up Digital Growth to Drive Experimentation
Clover Rings Up Digital Growth to Drive Experimentation
 
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
Make Every Touchpoint Count: How to Drive Revenue in an Increasingly Online W...
 
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development CycleAtlassian's Mystique CLI, Minimizing the Experiment Development Cycle
Atlassian's Mystique CLI, Minimizing the Experiment Development Cycle
 
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
Autotrader Case Study: Migrating from Home-Grown Testing to Best-in-Class Too...
 
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion RevenueZillow + Optimizely: Building the Bridge to $20 Billion Revenue
Zillow + Optimizely: Building the Bridge to $20 Billion Revenue
 
The Future of Optimizely for Technical Teams
The Future of Optimizely for Technical TeamsThe Future of Optimizely for Technical Teams
The Future of Optimizely for Technical Teams
 
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
Empowering Agents to Provide Service from Anywhere: Contact Centers in the Ti...
 
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
Experimentation Everywhere: Create Exceptional Online Shopping Experiences an...
 
Building an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team OfferingBuilding an Experiment Pipeline for GitHub’s New Free Team Offering
Building an Experiment Pipeline for GitHub’s New Free Team Offering
 
AMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server SideAMC Networks Experiments Faster on the Server Side
AMC Networks Experiments Faster on the Server Side
 
Evolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product DevelopmentEvolving Experimentation from CRO to Product Development
Evolving Experimentation from CRO to Product Development
 
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented ArchitectureOvercoming the Challenges of Experimentation on a Service Oriented Architecture
Overcoming the Challenges of Experimentation on a Service Oriented Architecture
 
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
How The Zebra Utilized Feature Experiments To Increase Carrier Card Engagemen...
 
Making Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product StrategyMaking Your Hypothesis Work Harder to Inform Future Product Strategy
Making Your Hypothesis Work Harder to Inform Future Product Strategy
 
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives RevenueKick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
Kick Your Assumptions: How Scholl's Test-Everything Culture Drives Revenue
 
Experimentation through Clients' Eyes
Experimentation through Clients' EyesExperimentation through Clients' Eyes
Experimentation through Clients' Eyes
 
Shipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHubShipping to Learn and Accelerate Growth with GitHub
Shipping to Learn and Accelerate Growth with GitHub
 
Test Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with ExperimentationTest Everything: TrustRadius Delivers Customer Value with Experimentation
Test Everything: TrustRadius Delivers Customer Value with Experimentation
 
Optimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature DeliveryOptimizely Agent: Scaling Resilient Feature Delivery
Optimizely Agent: Scaling Resilient Feature Delivery
 
The Future of Software Development
The Future of Software DevelopmentThe Future of Software Development
The Future of Software Development
 

Recently uploaded

Introduction to Amazon company 111111111111
Introduction to Amazon company 111111111111Introduction to Amazon company 111111111111
Introduction to Amazon company 111111111111
zoyaansari11365
 
Project File Report BBA 6th semester.pdf
Project File Report BBA 6th semester.pdfProject File Report BBA 6th semester.pdf
Project File Report BBA 6th semester.pdf
RajPriye
 
BeMetals Presentation_May_22_2024 .pdf
BeMetals Presentation_May_22_2024   .pdfBeMetals Presentation_May_22_2024   .pdf
BeMetals Presentation_May_22_2024 .pdf
DerekIwanaka1
 
Sustainability: Balancing the Environment, Equity & Economy
Sustainability: Balancing the Environment, Equity & EconomySustainability: Balancing the Environment, Equity & Economy
Sustainability: Balancing the Environment, Equity & Economy
Operational Excellence Consulting
 
What are the main advantages of using HR recruiter services.pdf
What are the main advantages of using HR recruiter services.pdfWhat are the main advantages of using HR recruiter services.pdf
What are the main advantages of using HR recruiter services.pdf
HumanResourceDimensi1
 
The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...
Adam Smith
 
LA HUG - Video Testimonials with Chynna Morgan - June 2024
LA HUG - Video Testimonials with Chynna Morgan - June 2024LA HUG - Video Testimonials with Chynna Morgan - June 2024
LA HUG - Video Testimonials with Chynna Morgan - June 2024
Lital Barkan
 
ikea_woodgreen_petscharity_cat-alogue_digital.pdf
ikea_woodgreen_petscharity_cat-alogue_digital.pdfikea_woodgreen_petscharity_cat-alogue_digital.pdf
ikea_woodgreen_petscharity_cat-alogue_digital.pdf
agatadrynko
 
VAT Registration Outlined In UAE: Benefits and Requirements
VAT Registration Outlined In UAE: Benefits and RequirementsVAT Registration Outlined In UAE: Benefits and Requirements
VAT Registration Outlined In UAE: Benefits and Requirements
uae taxgpt
 
3.0 Project 2_ Developing My Brand Identity Kit.pptx
3.0 Project 2_ Developing My Brand Identity Kit.pptx3.0 Project 2_ Developing My Brand Identity Kit.pptx
3.0 Project 2_ Developing My Brand Identity Kit.pptx
tanyjahb
 
Business Valuation Principles for Entrepreneurs
Business Valuation Principles for EntrepreneursBusiness Valuation Principles for Entrepreneurs
Business Valuation Principles for Entrepreneurs
Ben Wann
 
FINAL PRESENTATION.pptx12143241324134134
FINAL PRESENTATION.pptx12143241324134134FINAL PRESENTATION.pptx12143241324134134
FINAL PRESENTATION.pptx12143241324134134
LR1709MUSIC
 
Premium MEAN Stack Development Solutions for Modern Businesses
Premium MEAN Stack Development Solutions for Modern BusinessesPremium MEAN Stack Development Solutions for Modern Businesses
Premium MEAN Stack Development Solutions for Modern Businesses
SynapseIndia
 
Buy Verified PayPal Account | Buy Google 5 Star Reviews
Buy Verified PayPal Account | Buy Google 5 Star ReviewsBuy Verified PayPal Account | Buy Google 5 Star Reviews
Buy Verified PayPal Account | Buy Google 5 Star Reviews
usawebmarket
 
falcon-invoice-discounting-a-premier-platform-for-investors-in-india
falcon-invoice-discounting-a-premier-platform-for-investors-in-indiafalcon-invoice-discounting-a-premier-platform-for-investors-in-india
falcon-invoice-discounting-a-premier-platform-for-investors-in-india
Falcon Invoice Discounting
 
Search Disrupted Google’s Leaked Documents Rock the SEO World.pdf
Search Disrupted Google’s Leaked Documents Rock the SEO World.pdfSearch Disrupted Google’s Leaked Documents Rock the SEO World.pdf
Search Disrupted Google’s Leaked Documents Rock the SEO World.pdf
Arihant Webtech Pvt. Ltd
 
Maksym Vyshnivetskyi: PMO Quality Management (UA)
Maksym Vyshnivetskyi: PMO Quality Management (UA)Maksym Vyshnivetskyi: PMO Quality Management (UA)
Maksym Vyshnivetskyi: PMO Quality Management (UA)
Lviv Startup Club
 
Discover the innovative and creative projects that highlight my journey throu...
Discover the innovative and creative projects that highlight my journey throu...Discover the innovative and creative projects that highlight my journey throu...
Discover the innovative and creative projects that highlight my journey throu...
dylandmeas
 
Enterprise Excellence is Inclusive Excellence.pdf
Enterprise Excellence is Inclusive Excellence.pdfEnterprise Excellence is Inclusive Excellence.pdf
Enterprise Excellence is Inclusive Excellence.pdf
KaiNexus
 
Tata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s Dholera
Tata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s DholeraTata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s Dholera
Tata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s Dholera
Avirahi City Dholera
 

Recently uploaded (20)

Introduction to Amazon company 111111111111
Introduction to Amazon company 111111111111Introduction to Amazon company 111111111111
Introduction to Amazon company 111111111111
 
Project File Report BBA 6th semester.pdf
Project File Report BBA 6th semester.pdfProject File Report BBA 6th semester.pdf
Project File Report BBA 6th semester.pdf
 
BeMetals Presentation_May_22_2024 .pdf
BeMetals Presentation_May_22_2024   .pdfBeMetals Presentation_May_22_2024   .pdf
BeMetals Presentation_May_22_2024 .pdf
 
Sustainability: Balancing the Environment, Equity & Economy
Sustainability: Balancing the Environment, Equity & EconomySustainability: Balancing the Environment, Equity & Economy
Sustainability: Balancing the Environment, Equity & Economy
 
What are the main advantages of using HR recruiter services.pdf
What are the main advantages of using HR recruiter services.pdfWhat are the main advantages of using HR recruiter services.pdf
What are the main advantages of using HR recruiter services.pdf
 
The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...The Influence of Marketing Strategy and Market Competition on Business Perfor...
The Influence of Marketing Strategy and Market Competition on Business Perfor...
 
LA HUG - Video Testimonials with Chynna Morgan - June 2024
LA HUG - Video Testimonials with Chynna Morgan - June 2024LA HUG - Video Testimonials with Chynna Morgan - June 2024
LA HUG - Video Testimonials with Chynna Morgan - June 2024
 
ikea_woodgreen_petscharity_cat-alogue_digital.pdf
ikea_woodgreen_petscharity_cat-alogue_digital.pdfikea_woodgreen_petscharity_cat-alogue_digital.pdf
ikea_woodgreen_petscharity_cat-alogue_digital.pdf
 
VAT Registration Outlined In UAE: Benefits and Requirements
VAT Registration Outlined In UAE: Benefits and RequirementsVAT Registration Outlined In UAE: Benefits and Requirements
VAT Registration Outlined In UAE: Benefits and Requirements
 
3.0 Project 2_ Developing My Brand Identity Kit.pptx
3.0 Project 2_ Developing My Brand Identity Kit.pptx3.0 Project 2_ Developing My Brand Identity Kit.pptx
3.0 Project 2_ Developing My Brand Identity Kit.pptx
 
Business Valuation Principles for Entrepreneurs
Business Valuation Principles for EntrepreneursBusiness Valuation Principles for Entrepreneurs
Business Valuation Principles for Entrepreneurs
 
FINAL PRESENTATION.pptx12143241324134134
FINAL PRESENTATION.pptx12143241324134134FINAL PRESENTATION.pptx12143241324134134
FINAL PRESENTATION.pptx12143241324134134
 
Premium MEAN Stack Development Solutions for Modern Businesses
Premium MEAN Stack Development Solutions for Modern BusinessesPremium MEAN Stack Development Solutions for Modern Businesses
Premium MEAN Stack Development Solutions for Modern Businesses
 
Buy Verified PayPal Account | Buy Google 5 Star Reviews
Buy Verified PayPal Account | Buy Google 5 Star ReviewsBuy Verified PayPal Account | Buy Google 5 Star Reviews
Buy Verified PayPal Account | Buy Google 5 Star Reviews
 
falcon-invoice-discounting-a-premier-platform-for-investors-in-india
falcon-invoice-discounting-a-premier-platform-for-investors-in-indiafalcon-invoice-discounting-a-premier-platform-for-investors-in-india
falcon-invoice-discounting-a-premier-platform-for-investors-in-india
 
Search Disrupted Google’s Leaked Documents Rock the SEO World.pdf
Search Disrupted Google’s Leaked Documents Rock the SEO World.pdfSearch Disrupted Google’s Leaked Documents Rock the SEO World.pdf
Search Disrupted Google’s Leaked Documents Rock the SEO World.pdf
 
Maksym Vyshnivetskyi: PMO Quality Management (UA)
Maksym Vyshnivetskyi: PMO Quality Management (UA)Maksym Vyshnivetskyi: PMO Quality Management (UA)
Maksym Vyshnivetskyi: PMO Quality Management (UA)
 
Discover the innovative and creative projects that highlight my journey throu...
Discover the innovative and creative projects that highlight my journey throu...Discover the innovative and creative projects that highlight my journey throu...
Discover the innovative and creative projects that highlight my journey throu...
 
Enterprise Excellence is Inclusive Excellence.pdf
Enterprise Excellence is Inclusive Excellence.pdfEnterprise Excellence is Inclusive Excellence.pdf
Enterprise Excellence is Inclusive Excellence.pdf
 
Tata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s Dholera
Tata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s DholeraTata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s Dholera
Tata Group Dials Taiwan for Its Chipmaking Ambition in Gujarat’s Dholera
 

Quantify the ROI of Your Experimentation Program

  • 1. Congratulations to our Outperform Award Winners! Most Dramatic Business Impact Most Customer- Obsessed Company Culture Most Transformative Innovation Most Inspiring Social Impact
  • 2. • Welcome to Opticon! • Sessions today will be recorded and will be available after Opticon • Join the conversation on Twitter at #Opticon19 • We want to hear from you! Give feedback and rate sessions on the mobile app
  • 3. Chris Darner VP Product, The Venetian Casino Resort Las Vegas Jeff Blettner CRO Strategist, Tinuiti Kate Nichol Director, Optimizely Success Programs Quantifying the ROI of Your Experimentation Program
  • 4. 4 Value Journey Model Building a Team to Accelerate Success
  • 5. 5 Optimizely Delivers ROI + Value  Learn before you launch  Reduce risk  Drive innovation  Competitive advantage  Financial Model  Revenue  Core Metrics ROI Value
  • 6. 6 Definitions Attribution - The action of regarding something as being caused by a person or thing. Attribution Model - The rule, or set of rules, that determines how credit for conversions assigned to touchpoints in a conversion paths. Value - the regard that something is held to deserve; the importance, worth, or usefulness of something. ROI - Return on Investment. Return - A profit from an investment. ROI Model - This is a mathematical model, designed to represent the performance of a business, or a project where the output is shown as a return on investment.
  • 7. Why is ROI Modeling Important?
  • 8. 8 RESOURCE JUSTIFICATION The Value of ROI Modeling EVIDENCE OF VALUE SUCCESS TRAJECTORY PRIORITIZATION QUANTIFIABLE REVENUE
  • 10.  Build a team  Align with corporate strategy  Bring perspective to the business  Create visibility  Reinforce the program value  Collaborate and refine ROI Journey The Venetian’s experience developing a model
  • 11.  Aligning ‘Global Product KPIs’  Bootstrapping  Backfilling  Housekeeping  Evaluating and adjusting the model  Reducing overhead Overcoming Challenges The Venetian’s experience developing a model
  • 12. 12 Common Pitfalls in ROI Modeling VALUATION WEIGHTING PROJECTION EFFICIENCY VISUALIZATION OVERLAP
  • 14. 14 Optimizely’s ROI Model Supported by your data! Foundational Approach Rooted in logic and math Transparent Flexible
  • 15. 15 Model Drivers 1. Metric Alignment 2. Time-Horizon Discount 3. Intangible Discount
  • 16. 16 Optimizely’s ROI Model: Metric Alignment  Connect to Organizational Strategy  Focus on Business Outcomes (purchases, ads, subscriptions, leads etc.)  Attribute financial value
  • 17. 17 Optimizely’s ROI Model: Time-Horizon Discount  The Novelty Effect  Diminishing Returns  Forecast Adjustment
  • 18. 18 Optimizely’s ROI Model: Intangible Discount Landing Page Product Page Shopping Cart Checkout experiment A experiment B
  • 20. Come visit us at the Booth! To sign-up to receive your custom model and 1:1 getting started session!
  • 21. Q&A
  • 23.  Head to the Expo Hall for a quick break and say hello to our sponsors  Up next…hear from our panel at Accenture how inclusion and diversity fosters growth