Mobile A/B Test
•
9 likes•1,093 views
This document discusses A/B testing and optimization. It provides examples of how to define metrics, understand bottlenecks, explore opportunities, and refine tests. Key points include measuring success metrics, analyzing user flows to find bottlenecks, exploring variants before refining, and letting tools handle auto-optimization on the fly.
Report
Share
Report
Share
Download to read offline
Recommended
How to build your own emerging technologies function
Business has been going swimmingly until recently when you found out that a competitor you’ve never heard of, or taken seriously, is now capturing significant portions of your market. How did this happen? How could it have been prevented? Are you focusing on building a better horse and buggy when someone else is building the first Model T? In this session, I’ll share my experiences working in and leading Emerging Technologies teams at IBM, HP and Red Hat and provide you with a step-by-step guide for building a unique function within your business that can identify and manage disruption ahead of your own product teams and your competitors.
How to make SAFe really safe using pull invite change management - agile 2016...
Results of polls I ran during my Agile2016 talk about making SAFe safer using ideas from pull/invite based leadership/change management
Google Partner Agency Digital Breakfast with Geary LSF
Geary LSF and Google partnered up to present the latest innovation at Google and in digital marketing at an exclusive Google Partner Agency event in San Francisco.
University of Nebraska Think Tank: Google Analytics as your Digital Marketing...
A presentation covering the what, why, and how for using Google Analytics as the central hub for gaining marketing insights and acting on them to drive business growth.
A/B Testing With Real Examples And Results
Here is a bunch of A/B test examples and results that I gathered from all over web. Hope this will help people understand A/B test more :)
How Hospital Administrators Make Purchase Decision - Think with Google Report
What and how digital resources influence hospital administrators during their purchase journey.
comScore's Presentation Google's Think Digital Vietnam 11-Dec-2012
Joe Nguyen presents trends for online in Vietnam for Google's first ever Think Digital in VN
Evolution of TV Measuring Across All Screens | Think With Google
No matter how measurement is structured in the future, or what changes are on the horizon in terms of technology and viewer behavior, digital will continue to lead the way to greater clarity and precision. Advertisers will have better efficiency, programmers can maximize the value of their inventory, and consumers will have a better viewing experience. And that’s a win-win for everyone.
Recommended
How to build your own emerging technologies function
Business has been going swimmingly until recently when you found out that a competitor you’ve never heard of, or taken seriously, is now capturing significant portions of your market. How did this happen? How could it have been prevented? Are you focusing on building a better horse and buggy when someone else is building the first Model T? In this session, I’ll share my experiences working in and leading Emerging Technologies teams at IBM, HP and Red Hat and provide you with a step-by-step guide for building a unique function within your business that can identify and manage disruption ahead of your own product teams and your competitors.
How to make SAFe really safe using pull invite change management - agile 2016...
Results of polls I ran during my Agile2016 talk about making SAFe safer using ideas from pull/invite based leadership/change management
Google Partner Agency Digital Breakfast with Geary LSF
Geary LSF and Google partnered up to present the latest innovation at Google and in digital marketing at an exclusive Google Partner Agency event in San Francisco.
University of Nebraska Think Tank: Google Analytics as your Digital Marketing...
A presentation covering the what, why, and how for using Google Analytics as the central hub for gaining marketing insights and acting on them to drive business growth.
A/B Testing With Real Examples And Results
Here is a bunch of A/B test examples and results that I gathered from all over web. Hope this will help people understand A/B test more :)
How Hospital Administrators Make Purchase Decision - Think with Google Report
What and how digital resources influence hospital administrators during their purchase journey.
comScore's Presentation Google's Think Digital Vietnam 11-Dec-2012
Joe Nguyen presents trends for online in Vietnam for Google's first ever Think Digital in VN
Evolution of TV Measuring Across All Screens | Think With Google
No matter how measurement is structured in the future, or what changes are on the horizon in terms of technology and viewer behavior, digital will continue to lead the way to greater clarity and precision. Advertisers will have better efficiency, programmers can maximize the value of their inventory, and consumers will have a better viewing experience. And that’s a win-win for everyone.
Keynote Digital Data Tips Tuesday - Amsterdam - June 24th 2014 - A/B-testing ...
Keynote by @tonw / Ton Wesseling - CEO of http://testing.agency - he shares all the failures he saw and also made himself on analytics and A/B-testing.
Are you also questioning why your total website revenue is not exploding after you've put all those A/B-test winners live? Find the answers in these slides.
The Best A/B Test Idea You Haven’t Thought Of
The problem
Not so much Winner! Not so much Not so much Not so much Not so much Not so much Not so much Not so much Not so much
The real problem
One month Winner! Two months Three months Four months Five months Six months Seven months Eight months Nine months
1 winner per year
QUOTE FROM ELON MUSK BIOGRAPHY “ He would place this urgency that he expected the revenue in ten years to be ten million dollars a day and that every day we were slower to achieve our goals was a day of missing out on that money.
We’re missing out on this
But…why?
TOO MANY IDEAS!
170 ideas in 3 minutes
Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price
Er.
We need a process
Find out what’s stopping folks from converting…
…fix it.
Thanks
I’ll be here all night
Step 1: Take these ideas…
Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price
…and throw them away.
Step 2: Listen to your customers and prospects
Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price These ideas are good. They just might not be for you.
Gut Your gut is good. It just knows too much.
Curse of knowledge
USER TESTING
Send 3 users through your funnel
Send 3 users to your competition
Send 3 users to a HUGE company in your space
PEEK
QUALAROO
CHAT TRANSCRIPTS
SALES PEOPLE AND SUPPORT
Step 3: Use a framework to make decisions
Test summary Test objective Hypothesis Opportunity size Time to test Likely scenarios Next steps What worked? What didn’t work? HTTP://BIT.LY/ABTEST-FRAMEWORK
The problem
Not so much Winner! Not so much Not so much Not so much Not so much Not so much Not so much Not so much Not so much
The problem opportunity
Not so much Winner! Not so much Not so much Not so much Not so much Not so much Not so much Not so much Not so much
Not so much Winner! Not so much Not so much Not so much Winner! Not so much Not so much Not so much Not so much
Not so much Not so much Not so much Winner! Not so much Not so much Winner! Not so much Not so much Winner!
Keynote Wheel of Persuasion - Bart Schutz of Online Dialogue on how to persua...
Chief Persuasion Officer Bart Schutz will be keynoting about his Wheel of Persuasion on marketing & optimization conferences throughout Europe in october & november 2014:
Conversion Jam - Stockhom, Sweden
Conversions@Google - Dublin, Ireland
iLive - Riga, Latvia
Conversion Conference - London, England
Conversion Conference - Berlin, Germany
Conversion Summit - Istanbul, Turkey
Conversion Hotel - Texel, the Netherlands
At these conferences he will present his Maxima (System 1) and Willem (System 2) story and inspire you how to persuade these two parts of your customers brains. This slideset is the main slideset for each conference and is extended with extra A/B-testcases.
More info:
http://wheel-of-persuasion.com (the knowledge source)
http://online-dialogue.com (hire our team)
http://testing.agency (fast and quality A/B-test development)
http://abtestguide.com (you A/B-test workflow tool)
and http://Persuasion.tips for an overview of Bart his recent work.
Auto aftermarket digital driver research studies
The needs of aftermarket shoppers haven’t changed. There are two types of behaviors when it comes to vehicle parts and accessories purchases: Proactive drivers buy for the season, enhancement and regular maintenance, while reactive ones purchase for repairs. But what has changed?
The anatomy of an A/B Test - JSConf Colombia Workshop
“In God we trust, all others must bring data”. Intuition, experience and well known patterns may give us good indications of successful ideas and features, but nothing gets closer to the truth than data analysis and A/B testing. In this workshop, we’ll show how we do experimentation at Booking: what we test, how to get data through templates and JavaScript, and how we analyse the resulting metrics. We’ll live-code examples, see all potential caveats of dealing with the user tracking on the client-side, and show existent tools you can use to test your own ideas.
How to Successfully Run Your First Website A/B Test
What is A/B testing? A SCIENTIFIC METHOD OF PROOF
WHAT IS A/B TESTING FOR MARKETING
Where do you start testing? THE DON’TS
WHERE DO YOU START TESTING?
DON’T JUST GUESS
SUB OPTIMIZE • Button colors • Small copy changes • Small layout changes • Fonts, font size
WATCH OUT FOR BUZZ • Don’t just test what the gurus say • What works for others may not work for you
PREMATURE TESTING • Testing without traffic • Before you know what and why you are testing
Where do you start testing? THE DOS
DO YOUR HOMEWORK You have to put in the work to get great results • Learn as much as you can about A/B testing • Study the great people out there • What’s their process and insights?
A framework for success The basis of a successful testing program
Research Know what to test and see the greatest improvements
DIVE INTO YOUR DATA
FIND YOUR BIGGEST OPPORTUNITIES
INVESTIGATE THE OPPORTUNITY TO UNDERSTAND IT
FORM A HYPOTHESIS By doing A, B will happen, Because of C
BUILD THE TEST
LAUNCH THE TEST VS. Control Variant
THE TEST VS. +24.01% increase in registrations!! 100% Significance
DOCUMENT AND SHARE YOUR FINDINGS Documenting all your tests and results • Increases company transparency • Helps others know where tests are going on • Makes it easier to call tests • Makes learnings available for everyone in company
REPEAT THE PROCESS AS OFTEN AS POSSIBLE
Control vs. Variant
“Only 1 out of 8 A/B tests have driven significant change.” Noah Kagan AppSumo*
“The goal of a test is to get a learning, not a lift. With enough learnings, you can get the real lift,” Dr. Flint McGlaughlin MECLABS
RULES OF THUMB FOR TESTING Things to remember when we are testing • Min. 2000 visitors • Min. a few hundred conversions • At least one full cycle > 2 week • >99% statistical significance • Keep a backlog of test hypothesis • Build next tests as the current one is running *More info at http://kiss.ly/1vF4wUc and http://kiss.ly/1Q4vTm0
Tooltips AND BURGERS
How I like my testing burger Tooltips for your testing framework
Tool Company Why do I like it? Analytics Kissmetrics Shows me my actual customers and their behavior Surveys Qualaroo and/or SurveyMonkey Easy to use/Deep qualitative insights Project Management Trello Manage my time + communicate with collaborators
Tool Company Why do I like it? Company Wiki Confluence Document initial thoughts for everyone Testing platform* Optimizely, Pardot, Adwords Easily build tests and get data Analytics Kissmetrics Let’s me confirm and verify down my funnel Company Wiki Confluence Documentation and learnings for everyone *Includes actual testing platform and tools that have testing capabilities
Not everyone likes their burger the same way How do you take yours?
Trust the process Share your leanings Stack your results A/B TESTING FOR SUCCESS
A/B Testing at Pinterest: Building a Culture of Experimentation
Presenter: Andrea Burbank, Pinterest
A successful experimentation program consists of much more than mere randomization and measurement. How do you help stakeholders understand the right things to measure, avoid common pitfalls, and learn to rely on A/B tests as the best way to measure a new system or feature? In this talk, Andrea will explain how building a culture of experimentation and the right tools to support it is just as important as the statistics behind the comparisons themselves - and potentially much trickier to get right.
Millward brown vermeer organizational design think brand 2014 snf
MB Vermeer partnered with Google for Organizing for Marketing in a Digital Age – a thought-leadership initiative that codified best practices and practical insights into how winning teams are organizing for the evolving digital landscape. CMO Marc de Swaan Arons presented the findings to +500 senior level marketers at the Google ThinkBrand conference this October.
A Crash Course on A/B Testing
A brief, high-level overview and introduction on A/B testing
- What can you test?
- Famous A/B Testing Case Studies from the 2008 Presidential Election
- The technology behind A/B testing including Javascript, jQuery
- Tools you can use including: Optimizely, Visual Website Optimizer, Unbounce, Google Analytics
- Pluses and minues to A/B testing
Google Automotive Think Insights - Digital Drives Car Researches and Auto Pur...
Google Automotive Think Insights - Digital Drives Car Researches and Auto Pur...SL Ecommerce and ReviewsReputation.com
Auto shoppers are open to influences. Today’s auto intenders are open-minded with 72% of search sessions involving cross-shopping. In-market shoppers are researching more than ever. While time in-market is roughly the same, these shoppers are turning to 24 research touch points on average. Connected devices are driving greater research activity. Mobile usage has increased 35% year over year, with a focus on research and comparison activities. Video influences auto brand discovery and consideration. Video research is on the rise and online video was the #1 format for encouraging brand consideration. Dealer interaction and post-purchase experiences matter. 62% of the vehicle owners said customer service could influence future purchases. The Operating Model That is Eating the World
Today's fastest-growing, most profoundly impactful companies are using a completely different operating model. We refer to this model as The Responsive Operating System, and we think it'll change the world.
Always Be Testing - Learn from Every A/B Test (Hiten Shah)
Session slides from Future Insights Live, Vegas 2015:
https://futureinsightslive.com/las-vegas-2015/
Hiten Shah, co-founder of KISSmetrics and Crazy Egg, talks you through his 4-step data-driven process for successful A/B testing.
[#500Distro] Measuring for Impact: Knowing When, What & How to A/B Test
[#500Distro] Measuring for Impact: Knowing When, What & How to A/B Test
How to A/B Test with WordPress: Conversions Aren’t Just for Landing Pages
This is not a marketing presentation on how to get more conversions. In this presentation we’ll walk through best practices for integrating A/B testing tools and plugins like Visual Web Optimizer and Optimizely for WordPress. We will also look at how to properly setup template pages, embed tracking codes and how to manage your content and media for testing across multiple devices.
Practical A/B Testing Statistics: 5 Tips To Help You Get Reliable Data
“How do I know when I can stop my test?” This is one of the most common questions asked by marketers learning about split testing.
In this webinar presentation, Michael Aagaard, Senior Conversion Optimizer at Unbounce, will help you answer that question by giving you 5 actionable tips that will help you run cleaner tests with more reliable results.
Growth hacking 101 - RET2082 POV
credit goes to Mattan Griffel
http://www.slideshare.net/mattangriffel/growth-hacking
There's a Customer Out There with a Bullet for You: Understanding Your Customers
My FailCon 2010 presentation on how not understanding your customers will kill your company faster than anything else.
Want to better understand your customers? Read this and then sign up for http://www.uservoice.com
How to Test Your Product Ideas by SoulCycle VP of Product
There are many ways to identify insights and validate ideas, though many product development teams stick to a small number of approaches. This talk walked through different ways to test ideas, from 1:1 user interviews to A/B testing at scale.
The Art and Science of Sales Forecasting: A Webinar for Sales Managers and Co...
Overview
Sales forecasting is a science and an art. It is the combination of information and metrics, intuition and best practices. However, sales forecasting is most commonly associated to the standard grading methodology of the particular customer relationship system that is being used (Salesforce.com, Oracle, Microsoft, etc.). In reality, how do key sales leaders become high performing accurate sales forecasters? In addition, how do companies effectively utilize sales forecasting information to increase overall organizational performance?
Here’s what we’ll discuss in this session:
State-of-the-art forecasting strategies, best practices, and key metrics
The interconnection between product complexity, company lifecycle stage, and accurate forecasting
Mitigating downside risk and triangulation strategies to determine the truth
Deal inspection and vetting sales rep forecasts
The different types of sales forecasters; exaggerators, sandbaggers, and Heavy Hitters
The difference between snapshot, intra-department, and inter-department sales forecasting
How to Use Customer Feedback on Your Product by UserVoice CEO
Increased competition and higher customer expectations are forcing modern product management teams to up their game to keep pace. In this talk Richard White, CEO of UserVoice, talked about how product leaders are leveraging customer feedback, collected across the organization, to inform how they build the best product possible in the shortest amount of time.
Palestra TDC POA - Seus clientes estão abandonando o seu produto? Aprenda com...
Palestra TDC POA - Trilha Gestão de Produto
Link: http://www.thedevelopersconference.com.br/tdc/2017/portoalegre/trilha-gestao-de-produto
A aquisição de um novo cliente custa de 5 a 10 vezes mais do que reter um cliente atual e um aumento em 5% de retenção pode refletir em ganhos de 25% até 95% no lucro da empresa.
Se retenção é algo tão importante, por que as empresas dedicam pouco investimento e tem muitas dificuldades em mudar seus números de retenção?
Atualmente, Churn Rate é a métrica mais famosa para retenção e tem uma correlação muito grande com 'growth' e lucro, porém ela nos diz pouco sobre qual é a deficiência de retenção do produto.
Para entender melhor, é necessário aprofundar o conhecimento, entender como funciona o ciclo de retenção e implementar táticas, no produto, que irão abrangir todas as fases.
More Related Content
Viewers also liked
Keynote Digital Data Tips Tuesday - Amsterdam - June 24th 2014 - A/B-testing ...
Keynote by @tonw / Ton Wesseling - CEO of http://testing.agency - he shares all the failures he saw and also made himself on analytics and A/B-testing.
Are you also questioning why your total website revenue is not exploding after you've put all those A/B-test winners live? Find the answers in these slides.
The Best A/B Test Idea You Haven’t Thought Of
The problem
Not so much Winner! Not so much Not so much Not so much Not so much Not so much Not so much Not so much Not so much
The real problem
One month Winner! Two months Three months Four months Five months Six months Seven months Eight months Nine months
1 winner per year
QUOTE FROM ELON MUSK BIOGRAPHY “ He would place this urgency that he expected the revenue in ten years to be ten million dollars a day and that every day we were slower to achieve our goals was a day of missing out on that money.
We’re missing out on this
But…why?
TOO MANY IDEAS!
170 ideas in 3 minutes
Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price
Er.
We need a process
Find out what’s stopping folks from converting…
…fix it.
Thanks
I’ll be here all night
Step 1: Take these ideas…
Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price
…and throw them away.
Step 2: Listen to your customers and prospects
Try new CTA Try new CTA location Test multiple CTAs Test different button colors Add an “About” section Try a different headline Add an image to the homepage Shorten my form Auto play the video Try modals for forms Test a free trial Try annual billing Try a high anchor price These ideas are good. They just might not be for you.
Gut Your gut is good. It just knows too much.
Curse of knowledge
USER TESTING
Send 3 users through your funnel
Send 3 users to your competition
Send 3 users to a HUGE company in your space
PEEK
QUALAROO
CHAT TRANSCRIPTS
SALES PEOPLE AND SUPPORT
Step 3: Use a framework to make decisions
Test summary Test objective Hypothesis Opportunity size Time to test Likely scenarios Next steps What worked? What didn’t work? HTTP://BIT.LY/ABTEST-FRAMEWORK
The problem
Not so much Winner! Not so much Not so much Not so much Not so much Not so much Not so much Not so much Not so much
The problem opportunity
Not so much Winner! Not so much Not so much Not so much Not so much Not so much Not so much Not so much Not so much
Not so much Winner! Not so much Not so much Not so much Winner! Not so much Not so much Not so much Not so much
Not so much Not so much Not so much Winner! Not so much Not so much Winner! Not so much Not so much Winner!
Keynote Wheel of Persuasion - Bart Schutz of Online Dialogue on how to persua...
Chief Persuasion Officer Bart Schutz will be keynoting about his Wheel of Persuasion on marketing & optimization conferences throughout Europe in october & november 2014:
Conversion Jam - Stockhom, Sweden
Conversions@Google - Dublin, Ireland
iLive - Riga, Latvia
Conversion Conference - London, England
Conversion Conference - Berlin, Germany
Conversion Summit - Istanbul, Turkey
Conversion Hotel - Texel, the Netherlands
At these conferences he will present his Maxima (System 1) and Willem (System 2) story and inspire you how to persuade these two parts of your customers brains. This slideset is the main slideset for each conference and is extended with extra A/B-testcases.
More info:
http://wheel-of-persuasion.com (the knowledge source)
http://online-dialogue.com (hire our team)
http://testing.agency (fast and quality A/B-test development)
http://abtestguide.com (you A/B-test workflow tool)
and http://Persuasion.tips for an overview of Bart his recent work.
Auto aftermarket digital driver research studies
The needs of aftermarket shoppers haven’t changed. There are two types of behaviors when it comes to vehicle parts and accessories purchases: Proactive drivers buy for the season, enhancement and regular maintenance, while reactive ones purchase for repairs. But what has changed?
The anatomy of an A/B Test - JSConf Colombia Workshop
“In God we trust, all others must bring data”. Intuition, experience and well known patterns may give us good indications of successful ideas and features, but nothing gets closer to the truth than data analysis and A/B testing. In this workshop, we’ll show how we do experimentation at Booking: what we test, how to get data through templates and JavaScript, and how we analyse the resulting metrics. We’ll live-code examples, see all potential caveats of dealing with the user tracking on the client-side, and show existent tools you can use to test your own ideas.
How to Successfully Run Your First Website A/B Test
What is A/B testing? A SCIENTIFIC METHOD OF PROOF
WHAT IS A/B TESTING FOR MARKETING
Where do you start testing? THE DON’TS
WHERE DO YOU START TESTING?
DON’T JUST GUESS
SUB OPTIMIZE • Button colors • Small copy changes • Small layout changes • Fonts, font size
WATCH OUT FOR BUZZ • Don’t just test what the gurus say • What works for others may not work for you
PREMATURE TESTING • Testing without traffic • Before you know what and why you are testing
Where do you start testing? THE DOS
DO YOUR HOMEWORK You have to put in the work to get great results • Learn as much as you can about A/B testing • Study the great people out there • What’s their process and insights?
A framework for success The basis of a successful testing program
Research Know what to test and see the greatest improvements
DIVE INTO YOUR DATA
FIND YOUR BIGGEST OPPORTUNITIES
INVESTIGATE THE OPPORTUNITY TO UNDERSTAND IT
FORM A HYPOTHESIS By doing A, B will happen, Because of C
BUILD THE TEST
LAUNCH THE TEST VS. Control Variant
THE TEST VS. +24.01% increase in registrations!! 100% Significance
DOCUMENT AND SHARE YOUR FINDINGS Documenting all your tests and results • Increases company transparency • Helps others know where tests are going on • Makes it easier to call tests • Makes learnings available for everyone in company
REPEAT THE PROCESS AS OFTEN AS POSSIBLE
Control vs. Variant
“Only 1 out of 8 A/B tests have driven significant change.” Noah Kagan AppSumo*
“The goal of a test is to get a learning, not a lift. With enough learnings, you can get the real lift,” Dr. Flint McGlaughlin MECLABS
RULES OF THUMB FOR TESTING Things to remember when we are testing • Min. 2000 visitors • Min. a few hundred conversions • At least one full cycle > 2 week • >99% statistical significance • Keep a backlog of test hypothesis • Build next tests as the current one is running *More info at http://kiss.ly/1vF4wUc and http://kiss.ly/1Q4vTm0
Tooltips AND BURGERS
How I like my testing burger Tooltips for your testing framework
Tool Company Why do I like it? Analytics Kissmetrics Shows me my actual customers and their behavior Surveys Qualaroo and/or SurveyMonkey Easy to use/Deep qualitative insights Project Management Trello Manage my time + communicate with collaborators
Tool Company Why do I like it? Company Wiki Confluence Document initial thoughts for everyone Testing platform* Optimizely, Pardot, Adwords Easily build tests and get data Analytics Kissmetrics Let’s me confirm and verify down my funnel Company Wiki Confluence Documentation and learnings for everyone *Includes actual testing platform and tools that have testing capabilities
Not everyone likes their burger the same way How do you take yours?
Trust the process Share your leanings Stack your results A/B TESTING FOR SUCCESS
A/B Testing at Pinterest: Building a Culture of Experimentation
Presenter: Andrea Burbank, Pinterest
A successful experimentation program consists of much more than mere randomization and measurement. How do you help stakeholders understand the right things to measure, avoid common pitfalls, and learn to rely on A/B tests as the best way to measure a new system or feature? In this talk, Andrea will explain how building a culture of experimentation and the right tools to support it is just as important as the statistics behind the comparisons themselves - and potentially much trickier to get right.
Millward brown vermeer organizational design think brand 2014 snf
MB Vermeer partnered with Google for Organizing for Marketing in a Digital Age – a thought-leadership initiative that codified best practices and practical insights into how winning teams are organizing for the evolving digital landscape. CMO Marc de Swaan Arons presented the findings to +500 senior level marketers at the Google ThinkBrand conference this October.
A Crash Course on A/B Testing
A brief, high-level overview and introduction on A/B testing
- What can you test?
- Famous A/B Testing Case Studies from the 2008 Presidential Election
- The technology behind A/B testing including Javascript, jQuery
- Tools you can use including: Optimizely, Visual Website Optimizer, Unbounce, Google Analytics
- Pluses and minues to A/B testing
Google Automotive Think Insights - Digital Drives Car Researches and Auto Pur...
Google Automotive Think Insights - Digital Drives Car Researches and Auto Pur...SL Ecommerce and ReviewsReputation.com
Auto shoppers are open to influences. Today’s auto intenders are open-minded with 72% of search sessions involving cross-shopping. In-market shoppers are researching more than ever. While time in-market is roughly the same, these shoppers are turning to 24 research touch points on average. Connected devices are driving greater research activity. Mobile usage has increased 35% year over year, with a focus on research and comparison activities. Video influences auto brand discovery and consideration. Video research is on the rise and online video was the #1 format for encouraging brand consideration. Dealer interaction and post-purchase experiences matter. 62% of the vehicle owners said customer service could influence future purchases. The Operating Model That is Eating the World
Today's fastest-growing, most profoundly impactful companies are using a completely different operating model. We refer to this model as The Responsive Operating System, and we think it'll change the world.
Always Be Testing - Learn from Every A/B Test (Hiten Shah)
Session slides from Future Insights Live, Vegas 2015:
https://futureinsightslive.com/las-vegas-2015/
Hiten Shah, co-founder of KISSmetrics and Crazy Egg, talks you through his 4-step data-driven process for successful A/B testing.
[#500Distro] Measuring for Impact: Knowing When, What & How to A/B Test
[#500Distro] Measuring for Impact: Knowing When, What & How to A/B Test
How to A/B Test with WordPress: Conversions Aren’t Just for Landing Pages
This is not a marketing presentation on how to get more conversions. In this presentation we’ll walk through best practices for integrating A/B testing tools and plugins like Visual Web Optimizer and Optimizely for WordPress. We will also look at how to properly setup template pages, embed tracking codes and how to manage your content and media for testing across multiple devices.
Viewers also liked (15)
Keynote Digital Data Tips Tuesday - Amsterdam - June 24th 2014 - A/B-testing ...
Keynote Digital Data Tips Tuesday - Amsterdam - June 24th 2014 - A/B-testing ...
Keynote Wheel of Persuasion - Bart Schutz of Online Dialogue on how to persua...
Keynote Wheel of Persuasion - Bart Schutz of Online Dialogue on how to persua...
The anatomy of an A/B Test - JSConf Colombia Workshop
The anatomy of an A/B Test - JSConf Colombia Workshop
How to Successfully Run Your First Website A/B Test
How to Successfully Run Your First Website A/B Test
A/B Testing at Pinterest: Building a Culture of Experimentation
A/B Testing at Pinterest: Building a Culture of Experimentation
Millward brown vermeer organizational design think brand 2014 snf
Millward brown vermeer organizational design think brand 2014 snf
Google Automotive Think Insights - Digital Drives Car Researches and Auto Pur...
Google Automotive Think Insights - Digital Drives Car Researches and Auto Pur...
Always Be Testing - Learn from Every A/B Test (Hiten Shah)
Always Be Testing - Learn from Every A/B Test (Hiten Shah)
[#500Distro] Measuring for Impact: Knowing When, What & How to A/B Test
[#500Distro] Measuring for Impact: Knowing When, What & How to A/B Test
How to A/B Test with WordPress: Conversions Aren’t Just for Landing Pages
How to A/B Test with WordPress: Conversions Aren’t Just for Landing Pages
Similar to Mobile A/B Test
Practical A/B Testing Statistics: 5 Tips To Help You Get Reliable Data
“How do I know when I can stop my test?” This is one of the most common questions asked by marketers learning about split testing.
In this webinar presentation, Michael Aagaard, Senior Conversion Optimizer at Unbounce, will help you answer that question by giving you 5 actionable tips that will help you run cleaner tests with more reliable results.
Growth hacking 101 - RET2082 POV
credit goes to Mattan Griffel
http://www.slideshare.net/mattangriffel/growth-hacking
There's a Customer Out There with a Bullet for You: Understanding Your Customers
My FailCon 2010 presentation on how not understanding your customers will kill your company faster than anything else.
Want to better understand your customers? Read this and then sign up for http://www.uservoice.com
How to Test Your Product Ideas by SoulCycle VP of Product
There are many ways to identify insights and validate ideas, though many product development teams stick to a small number of approaches. This talk walked through different ways to test ideas, from 1:1 user interviews to A/B testing at scale.
The Art and Science of Sales Forecasting: A Webinar for Sales Managers and Co...
Overview
Sales forecasting is a science and an art. It is the combination of information and metrics, intuition and best practices. However, sales forecasting is most commonly associated to the standard grading methodology of the particular customer relationship system that is being used (Salesforce.com, Oracle, Microsoft, etc.). In reality, how do key sales leaders become high performing accurate sales forecasters? In addition, how do companies effectively utilize sales forecasting information to increase overall organizational performance?
Here’s what we’ll discuss in this session:
State-of-the-art forecasting strategies, best practices, and key metrics
The interconnection between product complexity, company lifecycle stage, and accurate forecasting
Mitigating downside risk and triangulation strategies to determine the truth
Deal inspection and vetting sales rep forecasts
The different types of sales forecasters; exaggerators, sandbaggers, and Heavy Hitters
The difference between snapshot, intra-department, and inter-department sales forecasting
How to Use Customer Feedback on Your Product by UserVoice CEO
Increased competition and higher customer expectations are forcing modern product management teams to up their game to keep pace. In this talk Richard White, CEO of UserVoice, talked about how product leaders are leveraging customer feedback, collected across the organization, to inform how they build the best product possible in the shortest amount of time.
Palestra TDC POA - Seus clientes estão abandonando o seu produto? Aprenda com...
Palestra TDC POA - Trilha Gestão de Produto
Link: http://www.thedevelopersconference.com.br/tdc/2017/portoalegre/trilha-gestao-de-produto
A aquisição de um novo cliente custa de 5 a 10 vezes mais do que reter um cliente atual e um aumento em 5% de retenção pode refletir em ganhos de 25% até 95% no lucro da empresa.
Se retenção é algo tão importante, por que as empresas dedicam pouco investimento e tem muitas dificuldades em mudar seus números de retenção?
Atualmente, Churn Rate é a métrica mais famosa para retenção e tem uma correlação muito grande com 'growth' e lucro, porém ela nos diz pouco sobre qual é a deficiência de retenção do produto.
Para entender melhor, é necessário aprofundar o conhecimento, entender como funciona o ciclo de retenção e implementar táticas, no produto, que irão abrangir todas as fases.
Lean Startup Business Tactics - Identifying Your Minimal Viable Product
The minimum viable product (MVP) is that version of a product which allows a team to collect the maximum amount of validating insight about customers' needs with the least amount of product building. It's one of the most important principles of a lean startup.
This deck provides you with insight into the value behind building an MVP, the overall process of achieving the maximum amount of validating learning, why in-depth customer interviews (and not just user testing) are crucial to testing your initial hypotheses about your business or product, and how you might collect or analyze qualitative and quantitative metrics to iterate your MVP.
Josh Cyr, founder of Alpha Loft and web app developer, also shared real lessons learned from one startup while building their MVP.
Annya Presentation : Light Color Theme
Infographic Presentation Template
If you want to buy this presentation template, please visit http://punkl.com
Creating a presentation from scratch can be quite labour-intensive. Starting with a presentation template from Punkl is beneficial. It saves time, provides good visual design and means that you can primarily spend your time and attention on the content of your presentation.
Punkl Presentation Templates save you time, as they're a whole lot quicker than trying to design a deck from scratch. Also, starting with a template means that you can primarily spend your time and attention on the content of your presentation, while the visual style is already designed to be engaging.
Typically, the only elements that are changed while working with a presentation template are colors, typography, copy and any visual assets such as photos for example.
Annya Presentation : Dark Color Theme
Infographic Presentation Template
If you want to buy this presentation template, please visit http://punkl.com
Creating a presentation from scratch can be quite labour-intensive. Starting with a presentation template from Punkl is beneficial. It saves time, provides good visual design and means that you can primarily spend your time and attention on the content of your presentation.
Punkl Presentation Templates save you time, as they're a whole lot quicker than trying to design a deck from scratch. Also, starting with a template means that you can primarily spend your time and attention on the content of your presentation, while the visual style is already designed to be engaging.
Typically, the only elements that are changed while working with a presentation template are colors, typography, copy and any visual assets such as photos for example.
U certify earlybird sale
uCertify invites the first 100 customers to begin feasting early! Buy 3 or more Prepkits
and get 40% OFF! The best part of this sale is that you won’t regret feasting. You will
pass in your first attempt or your money back.
Build a Winning Conversion Optimization Strategy
By Srikant Kotapalli – VWO
AB Testing has traditionally been one of the most commonly used methods to boost conversion rates. Many marketers have since used it tactically, that gets them some early wins but are unable to convert it into repeatable success. Building an effective optimization strategy needs an in-depth understanding of user behaviour, adopting a structured framework and constantly measuring and improving upon the results. This session will walk you through everything you need to know to transform your AB testing into a winning optimization engine.
Stage Gate Product Innovation Process Complete Powerpoint Deck With Slides
"You can download this product from SlideTeam.net"
To help you conclude your next product and process innovation PowerPoint presentation on time, here we are showcasing complete PowerPoint slide deck that you can use for your next project. With help of this readymade PPT sample file you can motivate your employees to apply modifications in design of previous versions for new innovation and product development. Well motivation given in such a form of visual aid obviously gives a competitive advantage. Additionally, with our PPT model you can efficiently portray your innovation strategy so as to exert a pull on new potential partners or financers. Finally, to cover all related concepts our PPT presentation includes exclusive slides templates like of generate new product ideas, external sources of new product ideas, screening the ideas, competitor analysis etc. All in all, a complete PowerPoint show for product developers, product planners and innovators to depict different stages of innovation process. So why not download this complete stage gate product innovation process presentation deck to see its engaging impact. Express genuine gratitude with our Stage Gate Product Innovation Process Complete Powerpoint Deck With Slides. Be able to greet your guests heartily. https://bit.ly/3N8WbFA
Stage Gate Product Innovation Process Complete PowerPoint Deck With Slides
Every organization needs to adapt to the ever-changing business environment. Sensing this need, we have come up with these content-ready change management PowerPoint presentation slides. These change management PPT templates will help you deal with any kind of an organizational change. Be it with people, goals or processes. The business solutions incorporated here will help you identify the organizational structure, create vision for change, implement strategies, identify resistance and risk, manage cost of change, get feedback and evaluation, and much more. With the help of various change management tools and techniques illustrated in this presentation design, you can achieve the desired business outcomes. This business transition PowerPoint design also covers certain related topics such as change model, transformation strategy, change readiness, change control, project management and business process. By implementing the change control methods mentioned in the presentation, you will be able to have a smooth transition in an organization. So, without waiting much, download our extensively researched change management framework presentation. With our Change Management Presentation slides, understand the need for change and plan to go through it without any hassles.
Soroza Presentation : Light Color Version
Beauty and Cosmetics Marketing Presentation Template
If you want to buy this presentation template, please visit http://madlis.com
Good design gets out of the way of the content you are sharing. It helps your audience focus on the content itself instead of the design.
But, it's no secret that most people dislike giving presentations. The dread of public speaking consistently ranks among the greatest fears in public surveys.
This presentation slides can help you reduce the anxiety involved with giving a presentation. Well-designed slides not only build your own confidence, they make your key points clearer to the audience.
Soroza Presentation : Dark Color Version
Beauty and Cosmetics Marketing Presentation Template
If you want to buy this presentation template, please visit http://madlis.com
Good design gets out of the way of the content you are sharing. It helps your audience focus on the content itself instead of the design.
But, it's no secret that most people dislike giving presentations. The dread of public speaking consistently ranks among the greatest fears in public surveys.
This presentation slides can help you reduce the anxiety involved with giving a presentation. Well-designed slides not only build your own confidence, they make your key points clearer to the audience.
How Atlassian Broke Down the Walls Between Support & Development
At Atlassian, support is essential to a successful customer experience. And, because of it's customer-facing position, support is also a great resource for product teams to continually use customer feedback to improve their product or service. Creating strong customer feedback loops means you are building a better experience for your customers day by day.
In this talk, you'll learn 5 ways Atlassian tools facilitate the relationship between support and development and how you can establish these processes and metrics in your own organization.
This talk is a follow on from "How Atlassian Support & Development Team Up to Release Software" from Summit 2016.
How Can User Research Help PMs by Yelp Group Product Manager
Main Takeaways:
- Product Managers are the voice of the user
- User research can help Product Managers build the right features
- User research can also help Product Managers ensure great designs
Similar to Mobile A/B Test (20)
Practical A/B Testing Statistics: 5 Tips To Help You Get Reliable Data
Practical A/B Testing Statistics: 5 Tips To Help You Get Reliable Data
There's a Customer Out There with a Bullet for You: Understanding Your Customers
There's a Customer Out There with a Bullet for You: Understanding Your Customers
How to Test Your Product Ideas by SoulCycle VP of Product
How to Test Your Product Ideas by SoulCycle VP of Product
The Art and Science of Sales Forecasting: A Webinar for Sales Managers and Co...
The Art and Science of Sales Forecasting: A Webinar for Sales Managers and Co...
How to Use Customer Feedback on Your Product by UserVoice CEO
How to Use Customer Feedback on Your Product by UserVoice CEO
Palestra TDC POA - Seus clientes estão abandonando o seu produto? Aprenda com...
Palestra TDC POA - Seus clientes estão abandonando o seu produto? Aprenda com...
Lean Startup Business Tactics - Identifying Your Minimal Viable Product
Lean Startup Business Tactics - Identifying Your Minimal Viable Product
Stage Gate Product Innovation Process Complete Powerpoint Deck With Slides
Stage Gate Product Innovation Process Complete Powerpoint Deck With Slides
Stage Gate Product Innovation Process Complete PowerPoint Deck With Slides
Stage Gate Product Innovation Process Complete PowerPoint Deck With Slides
How Atlassian Broke Down the Walls Between Support & Development
How Atlassian Broke Down the Walls Between Support & Development
How Can User Research Help PMs by Yelp Group Product Manager
How Can User Research Help PMs by Yelp Group Product Manager
Mobile A/B Test
- 1. Inspired Dan Siroker & Wyatt Jenkins A/B Testing
- 2. GROWTH is simply a series of experiments Wyatt Jenkins VP Product at shutterstock
- 4. Idea Generation Qualitative Wyatt Jenkins VP Product at shutterstock Validation Quantitative
- 5. You can not test what you don't meusure Define quantifiable success metrics 50% Users 50% Users Avg. Session Duration: 00:00:58 Avg. Session Duration: 00:01:28
- 6. You can not test what you don't meusure Define quantifiable success metrics 100% Users Avg. Session Duration: 00:00:58 Avg. Session Duration: 00:01:28
- 7. Great tools to use Define quantifiable success metrics
- 8. You can not test what you don't meusure Define quantifiable success metrics
- 10. 151 View Signup Page 105 Enter Email 78 Enter Password 46 Sign Up 69.54% 74.29% 58.97% User flow Understand Bottleneck
- 11. User flow Understand Bottleneck 151 View Signup Page 105 Enter Email 78 Enter Password 46 Sign Up 69.54% 74.29% 58.97%
- 12. User flow Understand Bottleneck 50% Users Repeat Password 50% Users Hide Repeat Password
- 13. User flow Understand Bottleneck 151 View Signup Page 105 Enter Email 78 Enter Password 55 Sign Up 69.54% 74.29% 70.27%
- 15. User flow Understand Oportunities Download Content Revenue Bound
- 16. User flow Understand Oportunities Download Content Revenue Bound
- 17. User flow Understand Oportunities Download Content Revenue Bound 50% Users 50% Users
- 18. User flow Understand Oportunities Download Content Revenue +6%
- 19. Explore before you refine.
- 20. Explore Combining variants Download Content Revenue +9%
- 21. Words matter. Focus on your call to action.
- 22. Explore Words Matters Download Now Free Download Save to Later
- 23. Explore Words Matters Download Now Free Download Save to Later +9%
- 24. Brand Wyatt Jenkins VP Product at shutterstock Optimization -vs-
- 29. Tools Goals
- 31. Tools On the fly