SlideShare a Scribd company logo
1 of 98
Download to read offline
Karl Gilis - @AGConsult
@agconsult
Karl Gilis - @AGConsult
Since
2001
Some of our clients
@agconsult
How to create better A/B tests
based on user research
Karl Gilis
@agconsult
Welcome to my world
The world of AB-testing
@agconsult
It's not because you
own a typewriter,
that you'll become the
next best-selling author.
@agconsult
@agconsult
1. Don't test every idea that pops into your head
Because most of these ideas are stupid
2. Don't blindly follow so-called best practices
@agconsult
Green	
  check	
  marks	
  always	
  work!	
  
	
  
Really?	
  
@agconsult
No matter what the bullets said, the
green checkmark versions always
won.
And so the green checkmark myth was born
ü This product sucks
ü Burning your money is better than buying this sh*t
ü Read my lips: DO NOT BUY THIS!
	
  
@agconsult
Nothing. Zilch. Nada. -5,1% -5,9%
@agconsult
"AB-testing isn't a research tool.
Use it to validate your homework."
Karl Gilis - @AGConsult
AB-­‐tes7ng	
  without	
  user	
  research	
  =	
  gambling!	
  
@agconsult
You have to find out what works best for
your website
@agconsult
You have to find out what works best for
your audience
@agconsult
You have to find out what works best for
your product or service
@agconsult
Question
Why would you visit the website of a petrol station brand
such as Shell, Total, Esso, Avia or Texaco?
What is your goal?
Making a shitty website a bit less shitty:
that's not our goal, is it?
@agconsult
#greatmarketingstartswithnotsucking
Avinash Kaushik
What's the goal of my site
What's the goal of my visitors
Karl Gilis - @agconsult
Ask	
  your	
  visitors	
  &	
  (poten7al)	
  
clients	
  the	
  right	
  ques7ons	
  
	
  
Targeted	
  surveys	
  are	
  one	
  of	
  my	
  favourite	
  methods.	
  
	
  
.	
  
@agconsult
Some of my favorite questions
•  On website
•  What is the purpose of your visit to our website today?
•  What are the most important things when buying …?
•  What’s keeping you from buying this product right now?
•  What’s holding you back from completing your purchase today?
•  What convinced you the most to decide to ask a quote?
•  Was there something that made you hesitate?
•  Existing clients
•  What convinced you the most to buy this product from us?
•  What’s the one thing that nearly stopped you buying from us?
•  What would you miss most if your X broke down / if we took away X
•  What's the most important thing X helped you to achieve?
no destination in mind
43%
time frame in mind
51%
78%
no fixed dates
type of vacation (sun, culture,…)
84%
@agconsult
On	
  the	
  homepage	
  of	
  a	
  webshop,	
  
do	
  you	
  push	
  products	
  or	
  	
  
product	
  categories?	
  
What is the purpose of your visit to our website today?
+ 188% more clicks
+ 75% more sales from homepage visitors
Push	
  product	
  categories	
  instead	
  of	
  
individual	
  products	
  
	
  
This	
  depends	
  from	
  site	
  to	
  site.	
  But	
  most	
  of	
  the	
  7me	
  it	
  works.	
  Big	
  7me.	
  
.	
  
@agconsult
What is the purpose of your visit to our website today?
23 x more people use the
dealer locator
Give	
  people	
  what	
  they	
  want	
  
	
  
As	
  long	
  as	
  it	
  helps	
  your	
  business.	
  
.	
  
@agconsult
120,4% more dealer searches
Top	
  tasks	
  can	
  be	
  different	
  from	
  
device	
  to	
  device	
  
	
  
Once	
  again:	
  do	
  your	
  research!	
  
.	
  
@agconsult
14,3% more searches
Use	
  the	
  same	
  words	
  your	
  users	
  do	
  
	
  
Not	
  the	
  ones	
  you	
  use.	
  
.	
  
@agconsult
78% more clicks from
this landing page to a
product page.
Use	
  bullet	
  lists	
  
	
  
Especially	
  above	
  the	
  fold	
  on	
  product	
  and	
  landing	
  pages.	
  
@agconsult
What are the most important things when buying a
used car, besides price & how it looks?
26% more reservations
Put	
  what's	
  important	
  for	
  your	
  
visitors	
  on	
  the	
  leO	
  side	
  of	
  your	
  page	
  
	
  
This	
  can	
  some7mes	
  make	
  a	
  difference.	
  Some7mes	
  it	
  doesn't	
  do	
  sh*t.	
  
.	
  
@agconsult
What convinced you the most to decide to ask a
quote?
Was there something that made you hesitate?
77,1% more requests
for quote
Know	
  what	
  your	
  clients	
  &	
  visitors	
  want	
  
	
  
And	
  get	
  filthy	
  rich	
  J	
  
.	
  
@agconsult
What's holding you back from completing your purchase today?
No difference at all
5,9% more sales on desktop and tablets
61% more sales on
smartphones
If you don't care about words,
you're a decorator.
Not a designer.
Karl Gilis - @agconsult
Give	
  compliments.	
  Encourage	
  users.	
  
	
  
Usability	
  is	
  more	
  than	
  reducing	
  fric7on!	
  
.	
  
@agconsult
Stop selling the way you want to sell
Sell the way people want to buy
Karl Gilis - @agconsult
Wide range of tools & methods
@agconsult
• User testing
• Analytics
• Click heatmaps
• User sessions recordings
• Form analysis
• Screenshot testing
• 5 second tests
• …
Get insights on how to use these tools at
http://www.slideshare.net/agconsult
+ many cases as a source of inspiration.
Tools are very helpful
@agconsult
But to connect the dots …
@agconsult
You need to use the most important tool you have
@agconsult
One more thing about
#notsucking
It will probably work on short term.
But is this the kind of relationship
you want?
Karl Gilis - @agconsult
@agconsult
Our job?
#makingvisitorshappy
Karl Gilis - @agconsult
That's it!
Thx
@agconsult
karl@agconsult.com
www.agconsult.com
Get my free ebook now
ü 10 conversion tips that work on every website
ü 15 cases from the real world
ü 6 best practices from leading websites
è  www.agconsult.com/ebook.html
è  www.slideshare.net/agconsult
Already more than 6.865 downloads

More Related Content

What's hot

[Elite Camp 2016] Craig Sullivan - Elite Camp Summary Session
[Elite Camp 2016] Craig Sullivan - Elite Camp Summary Session[Elite Camp 2016] Craig Sullivan - Elite Camp Summary Session
[Elite Camp 2016] Craig Sullivan - Elite Camp Summary SessionCXL
 
Keith hopper-product-market-fit
Keith hopper-product-market-fitKeith hopper-product-market-fit
Keith hopper-product-market-fithopperomatic
 
Kano analysis review and discussion with agile austin product sig 2014
Kano analysis review and discussion with agile austin product sig 2014Kano analysis review and discussion with agile austin product sig 2014
Kano analysis review and discussion with agile austin product sig 2014Scott Sehlhorst
 
Is Your Website Visually Distracting?
Is Your Website Visually Distracting? Is Your Website Visually Distracting?
Is Your Website Visually Distracting? Tommyismyname
 
2 Ecommerce Product Page Reviews
2 Ecommerce Product Page Reviews2 Ecommerce Product Page Reviews
2 Ecommerce Product Page ReviewsCXL
 
Iteration & Feedback: Lessons From Homer Simpson by fmr CNN Sr PM
Iteration & Feedback: Lessons From Homer Simpson by fmr CNN Sr PMIteration & Feedback: Lessons From Homer Simpson by fmr CNN Sr PM
Iteration & Feedback: Lessons From Homer Simpson by fmr CNN Sr PMProduct School
 
Opticon 2015-Early Lessons in Personalization Strategy
Opticon 2015-Early Lessons in Personalization StrategyOpticon 2015-Early Lessons in Personalization Strategy
Opticon 2015-Early Lessons in Personalization StrategyOptimizely
 
Opticon 2015-The Power of Empathy in Driving Conversion
Opticon 2015-The Power of Empathy in Driving ConversionOpticon 2015-The Power of Empathy in Driving Conversion
Opticon 2015-The Power of Empathy in Driving ConversionOptimizely
 
How to avoid losing money on site search - "cat edition" - World Usability Da...
How to avoid losing money on site search - "cat edition" - World Usability Da...How to avoid losing money on site search - "cat edition" - World Usability Da...
How to avoid losing money on site search - "cat edition" - World Usability Da...Jens Hofman Hansen
 
Opticon 2015-Optimization at Optimizely
Opticon 2015-Optimization at OptimizelyOpticon 2015-Optimization at Optimizely
Opticon 2015-Optimization at OptimizelyOptimizely
 
Product Executive Roundtable hosted by Sandhya Hegde, Director of Product, Am...
Product Executive Roundtable hosted by Sandhya Hegde, Director of Product, Am...Product Executive Roundtable hosted by Sandhya Hegde, Director of Product, Am...
Product Executive Roundtable hosted by Sandhya Hegde, Director of Product, Am...Amplitude
 
Opticon 2015-Statistics in 40 minutes
Opticon 2015-Statistics in 40 minutesOpticon 2015-Statistics in 40 minutes
Opticon 2015-Statistics in 40 minutesOptimizely
 
Looking to massively improve conversions in 2022 two words— product pages
Looking to massively improve conversions in 2022  two words— product pagesLooking to massively improve conversions in 2022  two words— product pages
Looking to massively improve conversions in 2022 two words— product pagesVWO
 
Optimize your web & mobile sites with Analytics & A/B Testing
Optimize your web & mobile sites with Analytics & A/B TestingOptimize your web & mobile sites with Analytics & A/B Testing
Optimize your web & mobile sites with Analytics & A/B TestingOptimizely
 
Opticon 2015-UX That Doesn’t Make You Think: Removing Friction and Cognitive ...
Opticon 2015-UX That Doesn’t Make You Think: Removing Friction and Cognitive ...Opticon 2015-UX That Doesn’t Make You Think: Removing Friction and Cognitive ...
Opticon 2015-UX That Doesn’t Make You Think: Removing Friction and Cognitive ...Optimizely
 
Product Era is Here
Product Era is HereProduct Era is Here
Product Era is HereAmplitude
 
How to win in the product led era - SF Product Analytics Summit 10/12/17
How to win in the product led era - SF Product Analytics Summit 10/12/17How to win in the product led era - SF Product Analytics Summit 10/12/17
How to win in the product led era - SF Product Analytics Summit 10/12/17Amplitude
 
The 1 Week Minimum Viable Product (MVP)
The 1 Week Minimum Viable Product (MVP)The 1 Week Minimum Viable Product (MVP)
The 1 Week Minimum Viable Product (MVP)Alexis Roqué
 
Driving Conversions and Revenue With A/B Testing
Driving Conversions and Revenue With A/B TestingDriving Conversions and Revenue With A/B Testing
Driving Conversions and Revenue With A/B TestingBlue Acorn
 

What's hot (20)

[Elite Camp 2016] Craig Sullivan - Elite Camp Summary Session
[Elite Camp 2016] Craig Sullivan - Elite Camp Summary Session[Elite Camp 2016] Craig Sullivan - Elite Camp Summary Session
[Elite Camp 2016] Craig Sullivan - Elite Camp Summary Session
 
Keith hopper-product-market-fit
Keith hopper-product-market-fitKeith hopper-product-market-fit
Keith hopper-product-market-fit
 
Kano analysis review and discussion with agile austin product sig 2014
Kano analysis review and discussion with agile austin product sig 2014Kano analysis review and discussion with agile austin product sig 2014
Kano analysis review and discussion with agile austin product sig 2014
 
Is Your Website Visually Distracting?
Is Your Website Visually Distracting? Is Your Website Visually Distracting?
Is Your Website Visually Distracting?
 
2 Ecommerce Product Page Reviews
2 Ecommerce Product Page Reviews2 Ecommerce Product Page Reviews
2 Ecommerce Product Page Reviews
 
Iteration & Feedback: Lessons From Homer Simpson by fmr CNN Sr PM
Iteration & Feedback: Lessons From Homer Simpson by fmr CNN Sr PMIteration & Feedback: Lessons From Homer Simpson by fmr CNN Sr PM
Iteration & Feedback: Lessons From Homer Simpson by fmr CNN Sr PM
 
Opticon 2015-Early Lessons in Personalization Strategy
Opticon 2015-Early Lessons in Personalization StrategyOpticon 2015-Early Lessons in Personalization Strategy
Opticon 2015-Early Lessons in Personalization Strategy
 
Opticon 2015-The Power of Empathy in Driving Conversion
Opticon 2015-The Power of Empathy in Driving ConversionOpticon 2015-The Power of Empathy in Driving Conversion
Opticon 2015-The Power of Empathy in Driving Conversion
 
How to avoid losing money on site search - "cat edition" - World Usability Da...
How to avoid losing money on site search - "cat edition" - World Usability Da...How to avoid losing money on site search - "cat edition" - World Usability Da...
How to avoid losing money on site search - "cat edition" - World Usability Da...
 
Opticon 2015-Optimization at Optimizely
Opticon 2015-Optimization at OptimizelyOpticon 2015-Optimization at Optimizely
Opticon 2015-Optimization at Optimizely
 
Product Executive Roundtable hosted by Sandhya Hegde, Director of Product, Am...
Product Executive Roundtable hosted by Sandhya Hegde, Director of Product, Am...Product Executive Roundtable hosted by Sandhya Hegde, Director of Product, Am...
Product Executive Roundtable hosted by Sandhya Hegde, Director of Product, Am...
 
Opticon 2015-Statistics in 40 minutes
Opticon 2015-Statistics in 40 minutesOpticon 2015-Statistics in 40 minutes
Opticon 2015-Statistics in 40 minutes
 
Looking to massively improve conversions in 2022 two words— product pages
Looking to massively improve conversions in 2022  two words— product pagesLooking to massively improve conversions in 2022  two words— product pages
Looking to massively improve conversions in 2022 two words— product pages
 
Optimize your web & mobile sites with Analytics & A/B Testing
Optimize your web & mobile sites with Analytics & A/B TestingOptimize your web & mobile sites with Analytics & A/B Testing
Optimize your web & mobile sites with Analytics & A/B Testing
 
Opticon 2015-UX That Doesn’t Make You Think: Removing Friction and Cognitive ...
Opticon 2015-UX That Doesn’t Make You Think: Removing Friction and Cognitive ...Opticon 2015-UX That Doesn’t Make You Think: Removing Friction and Cognitive ...
Opticon 2015-UX That Doesn’t Make You Think: Removing Friction and Cognitive ...
 
Product Era is Here
Product Era is HereProduct Era is Here
Product Era is Here
 
How to win in the product led era - SF Product Analytics Summit 10/12/17
How to win in the product led era - SF Product Analytics Summit 10/12/17How to win in the product led era - SF Product Analytics Summit 10/12/17
How to win in the product led era - SF Product Analytics Summit 10/12/17
 
The 1 Week Minimum Viable Product (MVP)
The 1 Week Minimum Viable Product (MVP)The 1 Week Minimum Viable Product (MVP)
The 1 Week Minimum Viable Product (MVP)
 
Driving Conversions and Revenue With A/B Testing
Driving Conversions and Revenue With A/B TestingDriving Conversions and Revenue With A/B Testing
Driving Conversions and Revenue With A/B Testing
 
AIA2018 - Alar Kolk - Prototyping & Experiments
AIA2018 - Alar Kolk - Prototyping & ExperimentsAIA2018 - Alar Kolk - Prototyping & Experiments
AIA2018 - Alar Kolk - Prototyping & Experiments
 

Similar to How to create better A/B tests based on user research

THe Ultimate PPC Hack? Optimize Your Landing Page
THe Ultimate PPC Hack? Optimize Your Landing PageTHe Ultimate PPC Hack? Optimize Your Landing Page
THe Ultimate PPC Hack? Optimize Your Landing PageHanapin Marketing
 
[Elite Camp 2016] Karl Gilis - How to Make Sure Your New Website Won’t Be a F...
[Elite Camp 2016] Karl Gilis - How to Make Sure Your New Website Won’t Be a F...[Elite Camp 2016] Karl Gilis - How to Make Sure Your New Website Won’t Be a F...
[Elite Camp 2016] Karl Gilis - How to Make Sure Your New Website Won’t Be a F...CXL
 
Conversion Hotel 2018 Keynote: Karl Gilis
Conversion Hotel 2018 Keynote: Karl GilisConversion Hotel 2018 Keynote: Karl Gilis
Conversion Hotel 2018 Keynote: Karl GilisWebanalisten .nl
 
Crafting High-Converting eCommerce Landing Pages
Crafting High-Converting eCommerce Landing PagesCrafting High-Converting eCommerce Landing Pages
Crafting High-Converting eCommerce Landing PagesVWO
 
So you think you know your business model?
So you think you know your business model?So you think you know your business model?
So you think you know your business model?Guillaume Decugis
 
7 Inspiring Tests to Create High-Converting eCommerce Product Pages
7 Inspiring Tests to Create  High-Converting eCommerce Product Pages7 Inspiring Tests to Create  High-Converting eCommerce Product Pages
7 Inspiring Tests to Create High-Converting eCommerce Product PagesVWO
 
How Well Do You Know Your Customers
How Well Do You Know Your CustomersHow Well Do You Know Your Customers
How Well Do You Know Your CustomersJames Cracknell
 
Customer experience and product instructions
Customer experience and product instructionsCustomer experience and product instructions
Customer experience and product instructionsSharon Burton
 
Driving Online Sales - Craig Sullivan, The future of the online marketplace 2...
Driving Online Sales - Craig Sullivan, The future of the online marketplace 2...Driving Online Sales - Craig Sullivan, The future of the online marketplace 2...
Driving Online Sales - Craig Sullivan, The future of the online marketplace 2...Invest Northern Ireland
 
12 reasons your site sucks - InvestNI
12 reasons your site sucks - InvestNI12 reasons your site sucks - InvestNI
12 reasons your site sucks - InvestNICraig Sullivan
 
Product Instructions: The Missing Piece of the Customer Experience
Product Instructions: The Missing Piece of the Customer ExperienceProduct Instructions: The Missing Piece of the Customer Experience
Product Instructions: The Missing Piece of the Customer Experiencedclsocialmedia
 
GA - Building your business for digital success
GA - Building your business for digital successGA - Building your business for digital success
GA - Building your business for digital successFern Yit Lim
 
Understanding What Your Customers Really Want
Understanding What Your Customers Really WantUnderstanding What Your Customers Really Want
Understanding What Your Customers Really WantLane Goldstone
 
Leverage The Power of Small Data
Leverage The Power of Small DataLeverage The Power of Small Data
Leverage The Power of Small DataKaryn Zuidinga
 
How Ecommerce Companies Can Do More with Less Shopping Ad Budget in 2020
How Ecommerce Companies Can Do More with Less Shopping Ad Budget in 2020How Ecommerce Companies Can Do More with Less Shopping Ad Budget in 2020
How Ecommerce Companies Can Do More with Less Shopping Ad Budget in 2020Search Engine Journal
 
Webinar yahoo webinar
Webinar yahoo webinarWebinar yahoo webinar
Webinar yahoo webinarDHAVER0313
 
Conversion Hotel 2014: Karl Gilis (BE) keynote
Conversion Hotel 2014: Karl Gilis (BE) keynoteConversion Hotel 2014: Karl Gilis (BE) keynote
Conversion Hotel 2014: Karl Gilis (BE) keynoteWebanalisten .nl
 

Similar to How to create better A/B tests based on user research (20)

THe Ultimate PPC Hack? Optimize Your Landing Page
THe Ultimate PPC Hack? Optimize Your Landing PageTHe Ultimate PPC Hack? Optimize Your Landing Page
THe Ultimate PPC Hack? Optimize Your Landing Page
 
[Elite Camp 2016] Karl Gilis - How to Make Sure Your New Website Won’t Be a F...
[Elite Camp 2016] Karl Gilis - How to Make Sure Your New Website Won’t Be a F...[Elite Camp 2016] Karl Gilis - How to Make Sure Your New Website Won’t Be a F...
[Elite Camp 2016] Karl Gilis - How to Make Sure Your New Website Won’t Be a F...
 
Conversion Hotel 2018 Keynote: Karl Gilis
Conversion Hotel 2018 Keynote: Karl GilisConversion Hotel 2018 Keynote: Karl Gilis
Conversion Hotel 2018 Keynote: Karl Gilis
 
Crafting High-Converting eCommerce Landing Pages
Crafting High-Converting eCommerce Landing PagesCrafting High-Converting eCommerce Landing Pages
Crafting High-Converting eCommerce Landing Pages
 
So you think you know your business model?
So you think you know your business model?So you think you know your business model?
So you think you know your business model?
 
7 Inspiring Tests to Create High-Converting eCommerce Product Pages
7 Inspiring Tests to Create  High-Converting eCommerce Product Pages7 Inspiring Tests to Create  High-Converting eCommerce Product Pages
7 Inspiring Tests to Create High-Converting eCommerce Product Pages
 
Growth. Marketing. Distribution. MASTERCLASS by 500 Startups
Growth. Marketing. Distribution. MASTERCLASS by 500 StartupsGrowth. Marketing. Distribution. MASTERCLASS by 500 Startups
Growth. Marketing. Distribution. MASTERCLASS by 500 Startups
 
irmc2014-v7
irmc2014-v7irmc2014-v7
irmc2014-v7
 
How Well Do You Know Your Customers
How Well Do You Know Your CustomersHow Well Do You Know Your Customers
How Well Do You Know Your Customers
 
Customer experience and product instructions
Customer experience and product instructionsCustomer experience and product instructions
Customer experience and product instructions
 
Driving Online Sales - Craig Sullivan, The future of the online marketplace 2...
Driving Online Sales - Craig Sullivan, The future of the online marketplace 2...Driving Online Sales - Craig Sullivan, The future of the online marketplace 2...
Driving Online Sales - Craig Sullivan, The future of the online marketplace 2...
 
12 reasons your site sucks - InvestNI
12 reasons your site sucks - InvestNI12 reasons your site sucks - InvestNI
12 reasons your site sucks - InvestNI
 
Product Instructions: The Missing Piece of the Customer Experience
Product Instructions: The Missing Piece of the Customer ExperienceProduct Instructions: The Missing Piece of the Customer Experience
Product Instructions: The Missing Piece of the Customer Experience
 
GA - Building your business for digital success
GA - Building your business for digital successGA - Building your business for digital success
GA - Building your business for digital success
 
Understanding What Your Customers Really Want
Understanding What Your Customers Really WantUnderstanding What Your Customers Really Want
Understanding What Your Customers Really Want
 
Leverage The Power of Small Data
Leverage The Power of Small DataLeverage The Power of Small Data
Leverage The Power of Small Data
 
How Ecommerce Companies Can Do More with Less Shopping Ad Budget in 2020
How Ecommerce Companies Can Do More with Less Shopping Ad Budget in 2020How Ecommerce Companies Can Do More with Less Shopping Ad Budget in 2020
How Ecommerce Companies Can Do More with Less Shopping Ad Budget in 2020
 
Webinar yahoo webinar
Webinar yahoo webinarWebinar yahoo webinar
Webinar yahoo webinar
 
3. research(1)
3. research(1)3. research(1)
3. research(1)
 
Conversion Hotel 2014: Karl Gilis (BE) keynote
Conversion Hotel 2014: Karl Gilis (BE) keynoteConversion Hotel 2014: Karl Gilis (BE) keynote
Conversion Hotel 2014: Karl Gilis (BE) keynote
 

Recently uploaded

Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAndikSusilo4
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 

Recently uploaded (20)

Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & Application
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 

How to create better A/B tests based on user research

  • 1. Karl Gilis - @AGConsult
  • 3. Karl Gilis - @AGConsult Since 2001
  • 4. Some of our clients @agconsult
  • 5. How to create better A/B tests based on user research Karl Gilis @agconsult
  • 7. The world of AB-testing
  • 9. It's not because you own a typewriter, that you'll become the next best-selling author. @agconsult
  • 11. 1. Don't test every idea that pops into your head
  • 12. Because most of these ideas are stupid
  • 13. 2. Don't blindly follow so-called best practices @agconsult
  • 14. Green  check  marks  always  work!     Really?   @agconsult
  • 15. No matter what the bullets said, the green checkmark versions always won.
  • 16. And so the green checkmark myth was born ü This product sucks ü Burning your money is better than buying this sh*t ü Read my lips: DO NOT BUY THIS!   @agconsult
  • 17. Nothing. Zilch. Nada. -5,1% -5,9%
  • 19. "AB-testing isn't a research tool. Use it to validate your homework." Karl Gilis - @AGConsult
  • 20. AB-­‐tes7ng  without  user  research  =  gambling!   @agconsult
  • 21. You have to find out what works best for your website @agconsult
  • 22. You have to find out what works best for your audience @agconsult
  • 23. You have to find out what works best for your product or service @agconsult
  • 24. Question Why would you visit the website of a petrol station brand such as Shell, Total, Esso, Avia or Texaco? What is your goal?
  • 25.
  • 26.
  • 27.
  • 28.
  • 29.
  • 30.
  • 31.
  • 32.
  • 33.
  • 34.
  • 35.
  • 36.
  • 37.
  • 38.
  • 39. Making a shitty website a bit less shitty: that's not our goal, is it? @agconsult
  • 41.
  • 42.
  • 43. What's the goal of my site What's the goal of my visitors Karl Gilis - @agconsult
  • 44. Ask  your  visitors  &  (poten7al)   clients  the  right  ques7ons     Targeted  surveys  are  one  of  my  favourite  methods.     .   @agconsult
  • 45. Some of my favorite questions •  On website •  What is the purpose of your visit to our website today? •  What are the most important things when buying …? •  What’s keeping you from buying this product right now? •  What’s holding you back from completing your purchase today? •  What convinced you the most to decide to ask a quote? •  Was there something that made you hesitate? •  Existing clients •  What convinced you the most to buy this product from us? •  What’s the one thing that nearly stopped you buying from us? •  What would you miss most if your X broke down / if we took away X •  What's the most important thing X helped you to achieve?
  • 46.
  • 47.
  • 48. no destination in mind 43% time frame in mind 51% 78% no fixed dates type of vacation (sun, culture,…) 84% @agconsult
  • 49.
  • 50. On  the  homepage  of  a  webshop,   do  you  push  products  or     product  categories?  
  • 51. What is the purpose of your visit to our website today?
  • 52. + 188% more clicks + 75% more sales from homepage visitors
  • 53. Push  product  categories  instead  of   individual  products     This  depends  from  site  to  site.  But  most  of  the  7me  it  works.  Big  7me.   .   @agconsult
  • 54. What is the purpose of your visit to our website today?
  • 55.
  • 56. 23 x more people use the dealer locator
  • 57. Give  people  what  they  want     As  long  as  it  helps  your  business.   .   @agconsult
  • 58.
  • 59. 120,4% more dealer searches
  • 60. Top  tasks  can  be  different  from   device  to  device     Once  again:  do  your  research!   .   @agconsult
  • 61.
  • 63. Use  the  same  words  your  users  do     Not  the  ones  you  use.   .   @agconsult
  • 64.
  • 65.
  • 66.
  • 67. 78% more clicks from this landing page to a product page.
  • 68. Use  bullet  lists     Especially  above  the  fold  on  product  and  landing  pages.   @agconsult
  • 69. What are the most important things when buying a used car, besides price & how it looks?
  • 71. Put  what's  important  for  your   visitors  on  the  leO  side  of  your  page     This  can  some7mes  make  a  difference.  Some7mes  it  doesn't  do  sh*t.   .   @agconsult
  • 72. What convinced you the most to decide to ask a quote? Was there something that made you hesitate? 77,1% more requests for quote
  • 73. Know  what  your  clients  &  visitors  want     And  get  filthy  rich  J   .   @agconsult
  • 74. What's holding you back from completing your purchase today?
  • 75.
  • 77. 5,9% more sales on desktop and tablets
  • 78. 61% more sales on smartphones
  • 79. If you don't care about words, you're a decorator. Not a designer. Karl Gilis - @agconsult
  • 80. Give  compliments.  Encourage  users.     Usability  is  more  than  reducing  fric7on!   .   @agconsult
  • 81. Stop selling the way you want to sell Sell the way people want to buy Karl Gilis - @agconsult
  • 82. Wide range of tools & methods @agconsult • User testing • Analytics • Click heatmaps • User sessions recordings • Form analysis • Screenshot testing • 5 second tests • …
  • 83. Get insights on how to use these tools at http://www.slideshare.net/agconsult + many cases as a source of inspiration.
  • 84. Tools are very helpful @agconsult
  • 85. But to connect the dots … @agconsult
  • 86. You need to use the most important tool you have @agconsult
  • 87. One more thing about #notsucking
  • 88.
  • 89.
  • 90.
  • 91.
  • 92.
  • 93.
  • 94. It will probably work on short term. But is this the kind of relationship you want? Karl Gilis - @agconsult
  • 98. Get my free ebook now ü 10 conversion tips that work on every website ü 15 cases from the real world ü 6 best practices from leading websites è  www.agconsult.com/ebook.html è  www.slideshare.net/agconsult Already more than 6.865 downloads