SlideShare a Scribd company logo
© 2013 Forrester Research, Inc. Reproduction Prohibited 1
the world of e-Commerce
testing and personalization
is changing
Zee Aganovic, Ph.D.
Founder & CEO, HiConversion
2000 2014
Site
Analytics
PersonalizationA/B Split and
Multivariate
Testing
Sustainablevalue
EVOLUTION OF e-COMMERCE OPTIMIZATION
2006 2009
e-Commerce
Revenue
Performance
Management
eRPM is a disruptive
technology framework
for sustainable online
revenue growth
!
!
eRPM!
EVERYTHING!
INTERACTS!
WITH!
EVERYTHING
multi-
everything
E-COMMERCE!
TECHNOLOGY IS!
VERY COMPLEX !
virtualization
(no IT needed)
CUSTOMER!
PREFERENCES!
ARE ALWAYS!
CHANGING
real-time
e-commerce technology is very complex
OVERCOMING SUSTAINABLE REVENUE GROWTH BARRIERS
traditional optimization
requires IT resources
1.  Custom tagging of pages
2.  Custom scripting of
optimization variables
3.  Implementing your
optimization results
solution. virtualization
US PATENTS: 7779161 and 8499237
<HEAD>
HICONVERSION
HEAD TAG
</HEAD>
<BODY>
HICONVERSION
BODY TAG
</BODY>
US PATENTS 7779161 and 8499237
solution. virtualization
STEP 1: Select an element to add to the campaign.
solution. virtualization
US PATENTS 7779161 and 8499237
STEP 2: Click on ‘move’ to relocate the element.
solution. virtualization
STEP 3: View the new variable you just created.
everything interacts with everything else
OVERCOMING SUSTAINABLE REVENUE GROWTH BARRIERS
optimization requirements are escalating;
finding what works is getting more difficult
MULTI-DEVICE
MULTI-PAGE
MULTI-VARIATE
MULTI-SEGMENT
combining A/B test results doesn’t work.
full-funnel, multi-segment, multi-variate, multi-targeting, and more
solution. multi-everything optimization
$$$
SINGLE CAMPAIGN. END-TO-END RESULTS.
customer preferences are constantly changing
OVERCOMING SUSTAINABLE REVENUE GROWTH BARRIERS
case study. free shipping experiment
week one. strong performance with $50 min.
week two. can significant results change?
e-Commerce surprise: the magnitude of
visitor time varying behavior
figure 1. REVENUE PER VISITOR (RPV) OVER TIME – ONE PAGE
visitors reactions to the same experience
can fluctuate significantly over time.
POINT 1 RPV = $1.82 POINT 2 RPV = $4.09
solution. real time optimization
VERSION A VERSION B
15%88%
figure 2. CAMPAIGN VS. BASELINE RPV PERFORMANCE
85%12%
$95.00$95.00
US PATENT 8321359
benefit. sustainable revenue growth
ready, set, launch
operating in a world of
Kristopher Jean
e-Commerce Content Manager, L’Orèal USA
multi-everything
MULTIPLE!
STAKEHOLDERS
MULTIPLE!
PHASES
MULTIPLE!
PAGES
MULTIPLE!
TECH RESOURCES
MULTIPLE!
VARIABLES
MULTIPLE!
SEGMENTS
MULTIPLE!
DEVICES
MULTIPLE!
TARGETS
we live in the age of multi-everything e-Commerce
each of these tenets can fit together
under the umbrella of one
multi-everything optimization strategy
… but how are these moving parts
orchestrated to work seamlessly?
GETTING STARTED WITH ERPM
build your very own
optimization roadmap.
four key aspects of any roadmap:
1.  Brainstorming ideas
2.  Setting expectations
3.  Aligning tactical resources
4.  Managing expectations
part 1. brainstorming ideas
Get the scoop on anti-aging and find the routine right for your skin concern Learn More
PERSONALIZATION A: ANTI-AGING
part 1. brainstorming ideas
Get the scoop on anti-aging and find the routine right for your skin concern Learn MoreThe Ultimate Man 3-step routine: Cleanse, Shave, and Moisturize! Learn More
PERSONALIZATION B: MALE
part 2. setting expectations
what do we want to accomplish and how does this campaign look?
A
PERSONALIZATION PERSONALIZATION
B
SEGMENT: SEO SEGMENT: PES SEGMENT: SEO SEGMENT: PES
•  ANTI-AGING
KEYWORDS
•  5-PAGE
FUNNEL
•  5 BANNERS
•  6 POSSIBLE
PES SCORES
•  5-PAGE
FUNNEL
•  5 BANNERS
•  3 POSSIBLE
PES SCORES
•  5-PAGE
FUNNEL
•  2 BANNERS
•  MALE
KEYWORDS
•  5-PAGE
FUNNEL
•  2 BANNERS
ANTI-AGING MALE
part 2. setting expectations
what do we want to accomplish and how does this campaign look?
part 3. aligning resources
what tactical resources are necessary to get this strategy off the ground?
DEVELOPMENT RESOURCES
part 4. managing expectations
PRELIMINARY NET RESULTS – CAMPAIGN-WIDE
+59.76% RPV, +127% CONVERSION RATE
The Ultimate Man 3-step routine: Cleanse, Shave, and Moisturize! Learn More
MALE
RPV CONVERSION RATE AOV
+3.86% +2.08% +1.74%
TOP
PERFORMER
+230.77% RPV, +148% CONVERSION RATE
ANTI
AGE
TOP
PERFORMER
Repair and replenish skin overnight with the Midnight Recovery Concentrate collection Learn More
The ABC’s
of eRPM
Just e-mail Maeve at:
info@hiconversion.com
FREE ECOMMERCE GUIDE

More Related Content

Similar to e-Commerce Testing: The Coming of Age

Business of Mobile Apps
Business of Mobile AppsBusiness of Mobile Apps
Business of Mobile Apps
GBG Mumbai
 
Content Marketing for High Tech
Content Marketing for High TechContent Marketing for High Tech
Content Marketing for High Tech
Visible Logic, Inc.
 
Adam Sharp - Funnel 16-9-2013
Adam Sharp - Funnel 16-9-2013Adam Sharp - Funnel 16-9-2013
Adam Sharp - Funnel 16-9-2013
CleverTouch
 
Mango Marketing Tools
Mango Marketing ToolsMango Marketing Tools
Mango Marketing Tools
Craig Thornton
 
Make Experience Your Business
Make Experience Your BusinessMake Experience Your Business
Make Experience Your Business
MediaPost
 
How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...
How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...
How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...
Matt Davis
 
How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...
How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...
How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...
Uberflip
 
Being a Product Manager for Enterprise Products by Snapchat PM
Being a Product Manager for Enterprise Products by Snapchat PMBeing a Product Manager for Enterprise Products by Snapchat PM
Being a Product Manager for Enterprise Products by Snapchat PM
Product School
 
The Role of Technology in the Creative Agency
The Role of Technology in the Creative AgencyThe Role of Technology in the Creative Agency
The Role of Technology in the Creative Agency
MarTech Conference
 
Aligning Business Goals & ROI - Sagittarius Travel Marketing Masterclass
Aligning Business Goals & ROI - Sagittarius Travel Marketing MasterclassAligning Business Goals & ROI - Sagittarius Travel Marketing Masterclass
Aligning Business Goals & ROI - Sagittarius Travel Marketing Masterclass
Sagittarius
 
The power of Programmatic marketing!
The power of Programmatic marketing! The power of Programmatic marketing!
The power of Programmatic marketing!
snvrtt
 
Pitstop brochure slideshare-1
Pitstop brochure slideshare-1Pitstop brochure slideshare-1
Pitstop brochure slideshare-1
Lizelle Nel
 
Marketing de Buscadores
Marketing de BuscadoresMarketing de Buscadores
Marketing de Buscadores
guest40e6566
 
How to squeeze more demand gen, sales enablement & ABM juice out of your mark...
How to squeeze more demand gen, sales enablement & ABM juice out of your mark...How to squeeze more demand gen, sales enablement & ABM juice out of your mark...
How to squeeze more demand gen, sales enablement & ABM juice out of your mark...
Uberflip
 
How To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To Make
How To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To MakeHow To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To Make
How To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To Make
Marketo
 
Mastering Product Positioning with Mike Gospe: Moderated by Cindy F. Solomon
Mastering Product Positioning with Mike Gospe: Moderated by Cindy F. SolomonMastering Product Positioning with Mike Gospe: Moderated by Cindy F. Solomon
Mastering Product Positioning with Mike Gospe: Moderated by Cindy F. Solomon
Startup Product Academy, LLC
 
Get social: How to create a social content strategy to change perceptions
Get social: How to create a social content strategy to change perceptionsGet social: How to create a social content strategy to change perceptions
Get social: How to create a social content strategy to change perceptions
LinkedIn Talent Solutions
 
Turn Your Business Vision into Reality with “Jewel – ERP"
Turn Your Business Vision into Reality with “Jewel – ERP"Turn Your Business Vision into Reality with “Jewel – ERP"
Turn Your Business Vision into Reality with “Jewel – ERP"
Faruk Shah
 
Succesful Product Strategy | Moe Ali | ProductTank Toronto
Succesful Product Strategy | Moe Ali | ProductTank TorontoSuccesful Product Strategy | Moe Ali | ProductTank Toronto
Succesful Product Strategy | Moe Ali | ProductTank Toronto
Product Tank Toronto
 
DIGIT Leader Summit 2017
DIGIT Leader Summit 2017DIGIT Leader Summit 2017
DIGIT Leader Summit 2017
Ray Bugg
 

Similar to e-Commerce Testing: The Coming of Age (20)

Business of Mobile Apps
Business of Mobile AppsBusiness of Mobile Apps
Business of Mobile Apps
 
Content Marketing for High Tech
Content Marketing for High TechContent Marketing for High Tech
Content Marketing for High Tech
 
Adam Sharp - Funnel 16-9-2013
Adam Sharp - Funnel 16-9-2013Adam Sharp - Funnel 16-9-2013
Adam Sharp - Funnel 16-9-2013
 
Mango Marketing Tools
Mango Marketing ToolsMango Marketing Tools
Mango Marketing Tools
 
Make Experience Your Business
Make Experience Your BusinessMake Experience Your Business
Make Experience Your Business
 
How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...
How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...
How to Squeeze More Demand Gen, Sales Enablement & ABM Juice Out of Your Mark...
 
How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...
How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...
How Allocadia Squeezed More Demand Gen, Sales Enablement & ABM Juice Out of O...
 
Being a Product Manager for Enterprise Products by Snapchat PM
Being a Product Manager for Enterprise Products by Snapchat PMBeing a Product Manager for Enterprise Products by Snapchat PM
Being a Product Manager for Enterprise Products by Snapchat PM
 
The Role of Technology in the Creative Agency
The Role of Technology in the Creative AgencyThe Role of Technology in the Creative Agency
The Role of Technology in the Creative Agency
 
Aligning Business Goals & ROI - Sagittarius Travel Marketing Masterclass
Aligning Business Goals & ROI - Sagittarius Travel Marketing MasterclassAligning Business Goals & ROI - Sagittarius Travel Marketing Masterclass
Aligning Business Goals & ROI - Sagittarius Travel Marketing Masterclass
 
The power of Programmatic marketing!
The power of Programmatic marketing! The power of Programmatic marketing!
The power of Programmatic marketing!
 
Pitstop brochure slideshare-1
Pitstop brochure slideshare-1Pitstop brochure slideshare-1
Pitstop brochure slideshare-1
 
Marketing de Buscadores
Marketing de BuscadoresMarketing de Buscadores
Marketing de Buscadores
 
How to squeeze more demand gen, sales enablement & ABM juice out of your mark...
How to squeeze more demand gen, sales enablement & ABM juice out of your mark...How to squeeze more demand gen, sales enablement & ABM juice out of your mark...
How to squeeze more demand gen, sales enablement & ABM juice out of your mark...
 
How To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To Make
How To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To MakeHow To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To Make
How To Build A Website Experience That'll 10x Your Conversions: 5 Tweaks To Make
 
Mastering Product Positioning with Mike Gospe: Moderated by Cindy F. Solomon
Mastering Product Positioning with Mike Gospe: Moderated by Cindy F. SolomonMastering Product Positioning with Mike Gospe: Moderated by Cindy F. Solomon
Mastering Product Positioning with Mike Gospe: Moderated by Cindy F. Solomon
 
Get social: How to create a social content strategy to change perceptions
Get social: How to create a social content strategy to change perceptionsGet social: How to create a social content strategy to change perceptions
Get social: How to create a social content strategy to change perceptions
 
Turn Your Business Vision into Reality with “Jewel – ERP"
Turn Your Business Vision into Reality with “Jewel – ERP"Turn Your Business Vision into Reality with “Jewel – ERP"
Turn Your Business Vision into Reality with “Jewel – ERP"
 
Succesful Product Strategy | Moe Ali | ProductTank Toronto
Succesful Product Strategy | Moe Ali | ProductTank TorontoSuccesful Product Strategy | Moe Ali | ProductTank Toronto
Succesful Product Strategy | Moe Ali | ProductTank Toronto
 
DIGIT Leader Summit 2017
DIGIT Leader Summit 2017DIGIT Leader Summit 2017
DIGIT Leader Summit 2017
 

Recently uploaded

UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
Wouter Lemaire
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
Tatiana Kojar
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
kumardaparthi1024
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
Quotidiano Piemontese
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Wask
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
Postman
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
IndexBug
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Tosin Akinosho
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 

Recently uploaded (20)

UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
National Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practicesNational Security Agency - NSA mobile device best practices
National Security Agency - NSA mobile device best practices
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
Digital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying AheadDigital Marketing Trends in 2024 | Guide for Staying Ahead
Digital Marketing Trends in 2024 | Guide for Staying Ahead
 
WeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation TechniquesWeTestAthens: Postman's AI & Automation Techniques
WeTestAthens: Postman's AI & Automation Techniques
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial IntelligenceAI 101: An Introduction to the Basics and Impact of Artificial Intelligence
AI 101: An Introduction to the Basics and Impact of Artificial Intelligence
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
Monitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdfMonitoring and Managing Anomaly Detection on OpenShift.pdf
Monitoring and Managing Anomaly Detection on OpenShift.pdf
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 

e-Commerce Testing: The Coming of Age

  • 1. © 2013 Forrester Research, Inc. Reproduction Prohibited 1
  • 2. the world of e-Commerce testing and personalization is changing Zee Aganovic, Ph.D. Founder & CEO, HiConversion
  • 3. 2000 2014 Site Analytics PersonalizationA/B Split and Multivariate Testing Sustainablevalue EVOLUTION OF e-COMMERCE OPTIMIZATION 2006 2009 e-Commerce Revenue Performance Management
  • 4. eRPM is a disruptive technology framework for sustainable online revenue growth ! ! eRPM! EVERYTHING! INTERACTS! WITH! EVERYTHING multi- everything E-COMMERCE! TECHNOLOGY IS! VERY COMPLEX ! virtualization (no IT needed) CUSTOMER! PREFERENCES! ARE ALWAYS! CHANGING real-time
  • 5. e-commerce technology is very complex OVERCOMING SUSTAINABLE REVENUE GROWTH BARRIERS
  • 6. traditional optimization requires IT resources 1.  Custom tagging of pages 2.  Custom scripting of optimization variables 3.  Implementing your optimization results
  • 7. solution. virtualization US PATENTS: 7779161 and 8499237 <HEAD> HICONVERSION HEAD TAG </HEAD> <BODY> HICONVERSION BODY TAG </BODY>
  • 8. US PATENTS 7779161 and 8499237 solution. virtualization STEP 1: Select an element to add to the campaign.
  • 9. solution. virtualization US PATENTS 7779161 and 8499237 STEP 2: Click on ‘move’ to relocate the element.
  • 10. solution. virtualization STEP 3: View the new variable you just created.
  • 11. everything interacts with everything else OVERCOMING SUSTAINABLE REVENUE GROWTH BARRIERS
  • 12. optimization requirements are escalating; finding what works is getting more difficult MULTI-DEVICE MULTI-PAGE MULTI-VARIATE MULTI-SEGMENT
  • 13. combining A/B test results doesn’t work.
  • 14. full-funnel, multi-segment, multi-variate, multi-targeting, and more solution. multi-everything optimization $$$ SINGLE CAMPAIGN. END-TO-END RESULTS.
  • 15. customer preferences are constantly changing OVERCOMING SUSTAINABLE REVENUE GROWTH BARRIERS
  • 16. case study. free shipping experiment
  • 17. week one. strong performance with $50 min.
  • 18. week two. can significant results change?
  • 19. e-Commerce surprise: the magnitude of visitor time varying behavior
  • 20. figure 1. REVENUE PER VISITOR (RPV) OVER TIME – ONE PAGE visitors reactions to the same experience can fluctuate significantly over time. POINT 1 RPV = $1.82 POINT 2 RPV = $4.09
  • 21. solution. real time optimization VERSION A VERSION B 15%88% figure 2. CAMPAIGN VS. BASELINE RPV PERFORMANCE 85%12% $95.00$95.00 US PATENT 8321359
  • 23. ready, set, launch operating in a world of Kristopher Jean e-Commerce Content Manager, L’Orèal USA multi-everything
  • 25. each of these tenets can fit together under the umbrella of one multi-everything optimization strategy … but how are these moving parts orchestrated to work seamlessly?
  • 26. GETTING STARTED WITH ERPM build your very own optimization roadmap. four key aspects of any roadmap: 1.  Brainstorming ideas 2.  Setting expectations 3.  Aligning tactical resources 4.  Managing expectations
  • 27. part 1. brainstorming ideas Get the scoop on anti-aging and find the routine right for your skin concern Learn More PERSONALIZATION A: ANTI-AGING
  • 28. part 1. brainstorming ideas Get the scoop on anti-aging and find the routine right for your skin concern Learn MoreThe Ultimate Man 3-step routine: Cleanse, Shave, and Moisturize! Learn More PERSONALIZATION B: MALE
  • 29. part 2. setting expectations what do we want to accomplish and how does this campaign look? A PERSONALIZATION PERSONALIZATION B SEGMENT: SEO SEGMENT: PES SEGMENT: SEO SEGMENT: PES •  ANTI-AGING KEYWORDS •  5-PAGE FUNNEL •  5 BANNERS •  6 POSSIBLE PES SCORES •  5-PAGE FUNNEL •  5 BANNERS •  3 POSSIBLE PES SCORES •  5-PAGE FUNNEL •  2 BANNERS •  MALE KEYWORDS •  5-PAGE FUNNEL •  2 BANNERS ANTI-AGING MALE
  • 30. part 2. setting expectations what do we want to accomplish and how does this campaign look?
  • 31. part 3. aligning resources what tactical resources are necessary to get this strategy off the ground? DEVELOPMENT RESOURCES
  • 32. part 4. managing expectations PRELIMINARY NET RESULTS – CAMPAIGN-WIDE +59.76% RPV, +127% CONVERSION RATE The Ultimate Man 3-step routine: Cleanse, Shave, and Moisturize! Learn More MALE RPV CONVERSION RATE AOV +3.86% +2.08% +1.74% TOP PERFORMER +230.77% RPV, +148% CONVERSION RATE ANTI AGE TOP PERFORMER Repair and replenish skin overnight with the Midnight Recovery Concentrate collection Learn More
  • 33. The ABC’s of eRPM Just e-mail Maeve at: info@hiconversion.com FREE ECOMMERCE GUIDE