SlideShare a Scribd company logo
1 of 28
NCR Confidential
MILLION DOLLAR
IMPACT THROUGH
METRICS, ANALYTICS,
AND A/B TESTING
AZHAR BANDE-ALI
SEPTEMBER 17, 2016
NCR Confidential
What will we talk about?
• Who?
• What is NCR?
• The Product
• How we use Google Analytics
• Opportunity
• Discovery
• Buy-in
• A/B test
Questions
NCR Confidential
What will we talk about?
AZHAR
PM, NCR
NCR Confidential
Azhar Bande-Ali
NCR Confidential
NCR Confidential
NCR POWERS
WORLDWIDE,
EVERY SECOND
DOLLARS IN CASH
GOES THROUGH NCR
ATMs EACH YEAR
NCR SERVICES ARE HERE
TO SUPPORT OUR CUSTOMERS
SPEAKING
AND SPANNING FROM:
THE WEST
COAST OF
THE US…
…TO THE
FAR EAST
OF RUSSIA
CONSUMERS USING FASTLANE
SELFSERV CHECKOUTS SCAN
EVERY YEAR – OVER 6 ITEMS FOR
EVERY MAN, WOMAN AND CHILD ON EARTH.
ON AVERAGE, AN
AUTOMOBILE HAS
NCR ACTIVELY
MANAGES
IN 2014
VISITED OUR
EXECUTIVE
BRIEFING CENTERS
IN DULUTH, DUNDEE
AND NYC TO LEARN
HOW NCR IS
SOLUTIONS
NCR CONNECTED PAYMENTS CURRENTLY
PROTECTS MORE THAN
AND MORE THAN
ANNUALLY (SPECIALIZES IN CLOUD, MOBILE
eWALLET PAYMENTS)
NCR SERVICES
CENTERS RESPOND TO
CUSTOMER INCIDENTS
EACH YEAR
ATM’S + APTRA SOFTWARE SERVE OVER
MORE THAN TWITTER
AND IPHONE COMBINED
NCR FACILITATES
EVERY SECOND
NCR Confidential
Product
NCR Confidential
NCR Confidential
Product
NCR Confidential
Scorecard Metrics
Sessions that end on
page/Unique page visits
Monitor each stage in
ordering funnel
Conversion Rate Drop Off Rate Return Rate
Food industry standard:
10%
Highlights areas of
friction and confusion for
users
Most annoying metric of
all
Sessions with a
transaction/Total
Sessions
Monitor weekly change
Cohort: new transacting
users between 5 and 4
weeks ago
Repeat visits from
cohort in last 4 weeks/
Cohort size
NCR Confidential
NCR Confidential
Google Analytics
• Ecommerce
• Funnel Visualization
• Events
• Custom events not tracked by page views
• Metrics
• Conversion Rate
• Drop-off Rate
NCR Confidential
Google Analytics
Ecommerce & Goals Events
NCR Confidential
Opportunity
NCR Confidential
Ordering Funnel – Conversion Rate
Select Location: 83%
Select Pick Up Time: 85%
Build Bag: 56%
NCR Confidential
Events
• Track every action on menu
page that could result in
abandonment
• Events can be a part of a
Category, have Labels, and an
Event Value
• Careful! Can lead to analysis
paralysis
NCR Confidential
AIDA Framework
Exits
%
Interest: are users exploring? Submenu Events 5.26%
Desire: are they interested in shopping? Add Item Events 18.22%
Revenue: are users checking out? Checkout Events 23.84%
NCR Confidential
ROI
ROI
Improve by # transactions $ $ yearly
Interest: are
users exploring?
Submenu Events 176.1 110 $3,303.73 $171,793.86
Desire: are they
interested in
shopping?
Add Item Events 720.99 557 $16,713.02 $869,077.24
Revenue: are
users checking
out?
Checkout Events 695.6 696 $20,868.00 $1,085,136.00
NCR Confidential
$1,085,136.00
How to get buy in from your boss and customers
NCR Confidential
A/B Test
NCR Confidential
Google Tag Manager
• Inject “tags” to websites
without needing a
deployment
• Add backdoor to your
website
NCR Confidential
Google Analytics Experiments
• Create experiment
• Define variants
• Use experiment ID to inject
code via GTM
NCR Confidential
Current State
Hypothesis: Making “Continue”
button more prominent will improve
the checkout conversion rate.
NCR Confidential
Variant 1
Remove “Cancel” button
NCR Confidential
Variant 2
Remove “Cancel” and change
button text from “Continue” to
“Checkout”
NCR Confidential
Results
bit.ly/pcncr
NCR Confidential
Questions?
NCR Confidential

More Related Content

Similar to Million Dollar Impact Through Metrics, Analytics, and A/B Testing

Super Duper Burger_Brand Awareness Campaign
Super Duper Burger_Brand Awareness CampaignSuper Duper Burger_Brand Awareness Campaign
Super Duper Burger_Brand Awareness Campaign
Sara Faizpour
 
Biz to Biz Presentation
Biz to Biz PresentationBiz to Biz Presentation
Biz to Biz Presentation
Don Blaylock
 
Cnx2014 breakouts-industry trendsetters-windsor-circle-surfstitch-v7
Cnx2014 breakouts-industry trendsetters-windsor-circle-surfstitch-v7Cnx2014 breakouts-industry trendsetters-windsor-circle-surfstitch-v7
Cnx2014 breakouts-industry trendsetters-windsor-circle-surfstitch-v7
WhatConts
 
Commerce Optimization_OSF Global Services
Commerce Optimization_OSF Global ServicesCommerce Optimization_OSF Global Services
Commerce Optimization_OSF Global Services
Adela Szatvanyi
 

Similar to Million Dollar Impact Through Metrics, Analytics, and A/B Testing (20)

Super Duper Burger_Brand Awareness Campaign
Super Duper Burger_Brand Awareness CampaignSuper Duper Burger_Brand Awareness Campaign
Super Duper Burger_Brand Awareness Campaign
 
Biz to Biz Presentation
Biz to Biz PresentationBiz to Biz Presentation
Biz to Biz Presentation
 
Using Google Analytics to improve your digital marketing and website
Using Google Analytics to improve your digital marketing and websiteUsing Google Analytics to improve your digital marketing and website
Using Google Analytics to improve your digital marketing and website
 
How to get started? Digital Transformation: A Down-to-Earth Approach
How to get started? Digital Transformation: A Down-to-Earth ApproachHow to get started? Digital Transformation: A Down-to-Earth Approach
How to get started? Digital Transformation: A Down-to-Earth Approach
 
Personalization - Use cases for enabling customer experience and ROI
Personalization - Use cases for enabling customer experience and ROIPersonalization - Use cases for enabling customer experience and ROI
Personalization - Use cases for enabling customer experience and ROI
 
Attention: Paid Search
Attention: Paid SearchAttention: Paid Search
Attention: Paid Search
 
Mining Google Analytics for Marketing Insights
Mining Google Analytics for Marketing InsightsMining Google Analytics for Marketing Insights
Mining Google Analytics for Marketing Insights
 
Cnx2014 breakouts-industry trendsetters-windsor-circle-surfstitch-v7
Cnx2014 breakouts-industry trendsetters-windsor-circle-surfstitch-v7Cnx2014 breakouts-industry trendsetters-windsor-circle-surfstitch-v7
Cnx2014 breakouts-industry trendsetters-windsor-circle-surfstitch-v7
 
E-ticaret siteleri, kullanıcı dönüşüm oranlarını geliştirmek için hangi tekno...
E-ticaret siteleri, kullanıcı dönüşüm oranlarını geliştirmek için hangi tekno...E-ticaret siteleri, kullanıcı dönüşüm oranlarını geliştirmek için hangi tekno...
E-ticaret siteleri, kullanıcı dönüşüm oranlarını geliştirmek için hangi tekno...
 
Commerce Optimization_OSF Global Services
Commerce Optimization_OSF Global ServicesCommerce Optimization_OSF Global Services
Commerce Optimization_OSF Global Services
 
How to Effectively Use Shopper Analysis in Retail Business
How to Effectively Use Shopper Analysis in Retail BusinessHow to Effectively Use Shopper Analysis in Retail Business
How to Effectively Use Shopper Analysis in Retail Business
 
NJLCA
NJLCANJLCA
NJLCA
 
The SaaS Sales Funnel
The SaaS Sales FunnelThe SaaS Sales Funnel
The SaaS Sales Funnel
 
Saa s sales funnel brand24_mick griffin
Saa s sales funnel brand24_mick griffinSaa s sales funnel brand24_mick griffin
Saa s sales funnel brand24_mick griffin
 
Ecommerce In/And India: Stats, Trends, and Consumer Behavior
Ecommerce In/And India: Stats, Trends, and Consumer BehaviorEcommerce In/And India: Stats, Trends, and Consumer Behavior
Ecommerce In/And India: Stats, Trends, and Consumer Behavior
 
Digital Marketing Strategy for SampathCards (2016)
Digital Marketing Strategy for SampathCards (2016)Digital Marketing Strategy for SampathCards (2016)
Digital Marketing Strategy for SampathCards (2016)
 
Google Analytics
Google AnalyticsGoogle Analytics
Google Analytics
 
Playing the Long Game: Revitalize Your Digital Marketing by Spending on the R...
Playing the Long Game: Revitalize Your Digital Marketing by Spending on the R...Playing the Long Game: Revitalize Your Digital Marketing by Spending on the R...
Playing the Long Game: Revitalize Your Digital Marketing by Spending on the R...
 
Analytics peresentation
Analytics peresentation Analytics peresentation
Analytics peresentation
 
#CNX14 - How Australian Retailer SurfStitch is Making Waves with Data-Drive L...
#CNX14 - How Australian Retailer SurfStitch is Making Waves with Data-Drive L...#CNX14 - How Australian Retailer SurfStitch is Making Waves with Data-Drive L...
#CNX14 - How Australian Retailer SurfStitch is Making Waves with Data-Drive L...
 

Recently uploaded

Unlocking Exploration: Self-Motivated Agents Thrive on Memory-Driven Curiosity
Unlocking Exploration: Self-Motivated Agents Thrive on Memory-Driven CuriosityUnlocking Exploration: Self-Motivated Agents Thrive on Memory-Driven Curiosity
Unlocking Exploration: Self-Motivated Agents Thrive on Memory-Driven Curiosity
Hung Le
 
Jual obat aborsi Jakarta 085657271886 Cytote pil telat bulan penggugur kandun...
Jual obat aborsi Jakarta 085657271886 Cytote pil telat bulan penggugur kandun...Jual obat aborsi Jakarta 085657271886 Cytote pil telat bulan penggugur kandun...
Jual obat aborsi Jakarta 085657271886 Cytote pil telat bulan penggugur kandun...
ZurliaSoop
 
Proofreading- Basics to Artificial Intelligence Integration - Presentation:Sl...
Proofreading- Basics to Artificial Intelligence Integration - Presentation:Sl...Proofreading- Basics to Artificial Intelligence Integration - Presentation:Sl...
Proofreading- Basics to Artificial Intelligence Integration - Presentation:Sl...
David Celestin
 

Recently uploaded (19)

Unlocking Exploration: Self-Motivated Agents Thrive on Memory-Driven Curiosity
Unlocking Exploration: Self-Motivated Agents Thrive on Memory-Driven CuriosityUnlocking Exploration: Self-Motivated Agents Thrive on Memory-Driven Curiosity
Unlocking Exploration: Self-Motivated Agents Thrive on Memory-Driven Curiosity
 
Jual obat aborsi Jakarta 085657271886 Cytote pil telat bulan penggugur kandun...
Jual obat aborsi Jakarta 085657271886 Cytote pil telat bulan penggugur kandun...Jual obat aborsi Jakarta 085657271886 Cytote pil telat bulan penggugur kandun...
Jual obat aborsi Jakarta 085657271886 Cytote pil telat bulan penggugur kandun...
 
SOLID WASTE MANAGEMENT SYSTEM OF FENI PAURASHAVA, BANGLADESH.pdf
SOLID WASTE MANAGEMENT SYSTEM OF FENI PAURASHAVA, BANGLADESH.pdfSOLID WASTE MANAGEMENT SYSTEM OF FENI PAURASHAVA, BANGLADESH.pdf
SOLID WASTE MANAGEMENT SYSTEM OF FENI PAURASHAVA, BANGLADESH.pdf
 
ICT role in 21st century education and it's challenges.pdf
ICT role in 21st century education and it's challenges.pdfICT role in 21st century education and it's challenges.pdf
ICT role in 21st century education and it's challenges.pdf
 
"I hear you": Moving beyond empathy in UXR
"I hear you": Moving beyond empathy in UXR"I hear you": Moving beyond empathy in UXR
"I hear you": Moving beyond empathy in UXR
 
2024 mega trends for the digital workplace - FINAL.pdf
2024 mega trends for the digital workplace - FINAL.pdf2024 mega trends for the digital workplace - FINAL.pdf
2024 mega trends for the digital workplace - FINAL.pdf
 
Proofreading- Basics to Artificial Intelligence Integration - Presentation:Sl...
Proofreading- Basics to Artificial Intelligence Integration - Presentation:Sl...Proofreading- Basics to Artificial Intelligence Integration - Presentation:Sl...
Proofreading- Basics to Artificial Intelligence Integration - Presentation:Sl...
 
BIG DEVELOPMENTS IN LESOTHO(DAMS & MINES
BIG DEVELOPMENTS IN LESOTHO(DAMS & MINESBIG DEVELOPMENTS IN LESOTHO(DAMS & MINES
BIG DEVELOPMENTS IN LESOTHO(DAMS & MINES
 
BEAUTIFUL PLACES TO VISIT IN LESOTHO.pptx
BEAUTIFUL PLACES TO VISIT IN LESOTHO.pptxBEAUTIFUL PLACES TO VISIT IN LESOTHO.pptx
BEAUTIFUL PLACES TO VISIT IN LESOTHO.pptx
 
Introduction to Artificial intelligence.
Introduction to Artificial intelligence.Introduction to Artificial intelligence.
Introduction to Artificial intelligence.
 
LITTLE ABOUT LESOTHO FROM THE TIME MOSHOESHOE THE FIRST WAS BORN
LITTLE ABOUT LESOTHO FROM THE TIME MOSHOESHOE THE FIRST WAS BORNLITTLE ABOUT LESOTHO FROM THE TIME MOSHOESHOE THE FIRST WAS BORN
LITTLE ABOUT LESOTHO FROM THE TIME MOSHOESHOE THE FIRST WAS BORN
 
Using AI to boost productivity for developers
Using AI to boost productivity for developersUsing AI to boost productivity for developers
Using AI to boost productivity for developers
 
ECOLOGY OF FISHES.pptx full presentation
ECOLOGY OF FISHES.pptx full presentationECOLOGY OF FISHES.pptx full presentation
ECOLOGY OF FISHES.pptx full presentation
 
Digital collaboration with Microsoft 365 as extension of Drupal
Digital collaboration with Microsoft 365 as extension of DrupalDigital collaboration with Microsoft 365 as extension of Drupal
Digital collaboration with Microsoft 365 as extension of Drupal
 
The Concession of Asaba International Airport: Balancing Politics and Policy ...
The Concession of Asaba International Airport: Balancing Politics and Policy ...The Concession of Asaba International Airport: Balancing Politics and Policy ...
The Concession of Asaba International Airport: Balancing Politics and Policy ...
 
History of Morena Moshoeshoe birth death
History of Morena Moshoeshoe birth deathHistory of Morena Moshoeshoe birth death
History of Morena Moshoeshoe birth death
 
Abortion Pills Fahaheel ௹+918133066128💬@ Safe and Effective Mifepristion and ...
Abortion Pills Fahaheel ௹+918133066128💬@ Safe and Effective Mifepristion and ...Abortion Pills Fahaheel ௹+918133066128💬@ Safe and Effective Mifepristion and ...
Abortion Pills Fahaheel ௹+918133066128💬@ Safe and Effective Mifepristion and ...
 
Ready Set Go Children Sermon about Mark 16:15-20
Ready Set Go Children Sermon about Mark 16:15-20Ready Set Go Children Sermon about Mark 16:15-20
Ready Set Go Children Sermon about Mark 16:15-20
 
in kuwait௹+918133066128....) @abortion pills for sale in Kuwait City
in kuwait௹+918133066128....) @abortion pills for sale in Kuwait Cityin kuwait௹+918133066128....) @abortion pills for sale in Kuwait City
in kuwait௹+918133066128....) @abortion pills for sale in Kuwait City
 

Million Dollar Impact Through Metrics, Analytics, and A/B Testing

Editor's Notes

  1. Survey: Google Analytics – beginner, intermediate, pro; Google Tag Manager: heard of it? NCR? Pitch: Every business has untapped revenue. At NCR, we were able to discover a million dollar opportunity by tracking product metrics, using analytics, and conducting A/B tests – all using tools that are available for free. My session is a case study of one such project and we will cover the framework, methodologies and tools we used that you can start using at your job starting Monday. The session is called “Million dollar impact through metrics, analytics, and A/B testing”. The number is 18. You can find it at …
  2. We’re going to cover two big things