Mobile A/B Testing: Best Practices,
Pretotyping and Why It's a Good
Alternative to App Prototyping
Lina Danilchik
Marketing Manager Senior ASO consultant
Maggie Ngai
Pretotyping. What is it?
Pretotype is an image that conveys the idea of a product.
Mobile app title, icon, description and screenshots designed to reflect its
setting and features together make up an app’s pretotype.
What can serve as app pretotypes?
How publishers
validate app ideas
via pretotyping
Once you’re ready with your app’s
pretotypes – several versions of app
title, description, icon & screenshots –
proceed to validating your app idea with
the help of a third-party A/B testing
platform.
How mobile A/B
testing works together
with pretotyping
A/B Testing Capabilities for Mobile
App Idea Validation
Test your mobile
app idea
Test mobile game
setting
Compare a few mobile
app concepts
Validate or
prioritize app
features
Decide on targeting
& positioning
Test your app idea
and decide if you
should build it
Compare a few app concepts & select the best
one
Decide on targeting
and positioning
Decide on localization
Feature validation: prioritize your app features
Test mobile game setting
Test mobile game styles and characters
Main metrics to rely
on when running A/B
tests on SplitMetrics
7 Biggest Mistakes in Mobile A/B Testing
Mistake №2
Finishing an experiment before
7 days have passed
Mistake №1
Finishing an experiment before you
get the right amount of traffic
7 Biggest Mistakes in Mobile A/B Testing
Mistake №4
Your banner ads have the same design
as one of the app store visual assets
Mistake №3
Testing too small changes
in design
7 Biggest Mistakes in Mobile A/B Testing
Mistake №5
Testing several hypotheses at once
7 Biggest Mistakes in Mobile A/B Testing
Mistake №6
Misinterpreting the situation when two
variations are the same but you get a
winner
Mistake №7
Getting upset when a new variation
loses to the current one
Thank you!
If you have any questions, feel free to reach out to us on LinkedIn or via email:
lina.d@splitmetrics.com & maggie.ngai@phiture.com

Mobile A/B Testing Best Practices for App Idea Validation by SplitMetrics and Phiture

  • 1.
    Mobile A/B Testing:Best Practices, Pretotyping and Why It's a Good Alternative to App Prototyping Lina Danilchik Marketing Manager Senior ASO consultant Maggie Ngai
  • 2.
    Pretotyping. What isit? Pretotype is an image that conveys the idea of a product.
  • 3.
    Mobile app title,icon, description and screenshots designed to reflect its setting and features together make up an app’s pretotype. What can serve as app pretotypes?
  • 4.
    How publishers validate appideas via pretotyping Once you’re ready with your app’s pretotypes – several versions of app title, description, icon & screenshots – proceed to validating your app idea with the help of a third-party A/B testing platform.
  • 5.
    How mobile A/B testingworks together with pretotyping
  • 6.
    A/B Testing Capabilitiesfor Mobile App Idea Validation Test your mobile app idea Test mobile game setting Compare a few mobile app concepts Validate or prioritize app features Decide on targeting & positioning
  • 7.
    Test your appidea and decide if you should build it
  • 8.
    Compare a fewapp concepts & select the best one
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
    Test mobile gamestyles and characters
  • 14.
    Main metrics torely on when running A/B tests on SplitMetrics
  • 15.
    7 Biggest Mistakesin Mobile A/B Testing Mistake №2 Finishing an experiment before 7 days have passed Mistake №1 Finishing an experiment before you get the right amount of traffic
  • 16.
    7 Biggest Mistakesin Mobile A/B Testing Mistake №4 Your banner ads have the same design as one of the app store visual assets Mistake №3 Testing too small changes in design
  • 17.
    7 Biggest Mistakesin Mobile A/B Testing Mistake №5 Testing several hypotheses at once
  • 18.
    7 Biggest Mistakesin Mobile A/B Testing Mistake №6 Misinterpreting the situation when two variations are the same but you get a winner Mistake №7 Getting upset when a new variation loses to the current one
  • 19.
    Thank you! If youhave any questions, feel free to reach out to us on LinkedIn or via email: lina.d@splitmetrics.com & maggie.ngai@phiture.com