Build Your Mobile Testing Knowledge

869 views

Published on

Are you overwhelmed by the number of mobile devices you need to test? The device market is large and new devices become available almost weekly. Karen Johnson discusses three key challenges to mobile testing—device selection, user interface, and device and application settings—and leads you through each. Learn how to select which devices to test and how to keep up-to-date in the ever-changing mobile market. Need to learn about user interface testing on mobile? Karen reviews mobile UX concepts and design. Wonder what device settings can impact your mobile app testing? Karen reviews common settings you need to consider. In addition to these mobile testing challenges, Karen guides you on how to conduct a competitive analysis of mobile apps. Learning how to conduct a survey of mobile apps and becoming aware of your competitors’ offerings are important to grow your own mobile knowledge.

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

Build Your Mobile Testing Knowledge

  1. 1. TL PM Tutorial 4/30/13 1:00PM Build Your Mobile Testing Knowledge Presented by: Karen Johnson Software Test Management, Inc. Brought to you by: 340 Corporate Way, Suite 300, Orange Park, FL 32073 888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com
  2. 2. Karen Johnson Karen N. Johnson is a software test consultant, working on-site and remotely to help her clients build testing teams and strengthen their testing practice. Karen is considered an expert in software testing and has been part of the context-driven software testing community for a number of years. She is a frequent speaker at testing conferences; a contributing author to the book, Beautiful Testing; and co-founder of WREST, the Workshop on Regulated Software Testing. Karen has published numerous articles and blogs about her experiences with software testing. Visit Karen’s website at karennjohnson.com.
  3. 3. 4/16/2013 Build Your Mobile Knowledge section 1 Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 1 Mobile manufacturers • Manufacturers change continually. • Manufacturers vary by country. • Understand the market your app is in vs. the overall global market. • Expect to update your strategy frequently. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 2 1
  4. 4. 4/16/2013 Device models • Device models change frequently as well. • Devices also vary by country. • Device detection: do you know what your users have? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 3 Operating systems • • • • Android from Google, Inc. BlackBerry OS from RIM iOS from Apple Symbian OS from the Symbian Foundation • WebOS from HP • Microsoft Windows Mobile Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 4 2
  5. 5. 4/16/2013 Are you testing with mobile browsers or testing a mobile app? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 5 Mobile apps iPhone App Store Build Your Mobile Testing Knowledge v6 Android Market © Karen N. Johnson, 2013 6 3
  6. 6. 4/16/2013 Mobile browsers • • • • • • • • Android browser BlackBerry browser Safari Internet Explorer Firefox Opera Dolphin And more - Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 7 Network carriers and settings • Connection is based on country, carrier, signal and the device. • Network carriers can impact SMS texting and access to websites. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 8 4
  7. 7. 4/16/2013 Network Carriers • • • • • • • • • • • China Mobile Vodafone AT&T O2 Orange Sprint T-Mobile Tracfone U.S. Cellular Verizon Virgin Mobile “ A mobile network operator (MNO), also known as mobile phone operator (or simply mobile operator or mobo ), carrier service provider (CSP), wireless service provider, wireless carrier, or cellular company, is a telephone company that provides services for mobile phone subscribers.” - Source: Wikipedia Sources: Mobile Forum: http://www.mobileforum.com/ And Wikipedia Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 9 GSM vs. CDMA • • Global System for Mobile Communications (GSM, around 80–85 % market) share) GSM is used everywhere but the US, India and China • • Code division multiple access (CDMA) is a channel access method CDMA is used in the US, India and China Source: http://en.wikipedia.org/wiki/List_of_mobile_networ k_operators Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 10 5
  8. 8. 4/16/2013 Connectivity We are not stationary when we use mobile. So why are we testing from the inside of our quiet well-connected offices with fully charged batteries? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 11 Mobile interruptions • • • • Forced updates Incoming calls & texts Battery issues Connectivity issues Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 12 6
  9. 9. 4/16/2013 Installation Application install & updates. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 13 UX: User interface considerations on mobile are radically different than on the desktop. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 14 7
  10. 10. 4/16/2013 User scenarios Navigational paths on mobile are not the same as on the desktop. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 15 OS & firmware updates Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 16 8
  11. 11. 4/16/2013 App Permissions Your app asks for what? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 17 Device settings Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 18 9
  12. 12. 4/16/2013 Functional testing We still have functional testing. The UPS example: – Track packages – Ship packages – Locate a store – Get a quote – Give feedback Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 19 Search testing: classic testing with a new twist: search with barcodes or where device location is factored into the results. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 20 10
  13. 13. 4/16/2013 Security: New testing considerations M-Commerce: the shopping cart with barcodes, location-based (NFC) coupons, card scanning/swiping and Google wallet. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 21 Cookies • • • • Remember me? Forgotten password Auto-login Third party login access (i.e. Use Facebook account to login) • Password changed on the desktop. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 22 11
  14. 14. 4/16/2013 Location aware • Testing while moving or traveling. • Testing with connectivity switching, dropped and intermittent. • Testing with mobile interruptions such as incoming calls. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 23 Mobile statistics • Source: Which source do you trust? • Country: Usage statistics vary greatly by country. • Analytics: Are you capturing device usage for your own application? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 24 12
  15. 15. 4/16/2013 OS market share What source do you use to gather information? • StatCounter http://gs.statcounter.com/#mobile_os-ww-monthly-201012-201112 • ComScore http://www.comscore.com/Press_Events/Press_Releases/2011/12/comScore _Reports_November_2011_U.S._Mobile_Subscriber_Market_Share • MobiThinking http://mobithinking.com/mobile-marketing-tools/latest-mobile-stats Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 25 Device Matrix source: Mobile Design and Development, by Brian Fling Class Markup CSS Javascript Class A Class B Class C Class D Class F Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 26 13
  16. 16. 4/16/2013 What devices do I need to test? • Brad Frost - blog post:http://bradfrostweb.com/blog/mobile/test-on-realmobile-devices-without-breaking-the-bank/ • My comment on his post is that his view is somewhat North American focused. • While the iPhone and Android dominate the market, those two options are not the only players in the market. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 27 Device Selection How will you decide which devices to test on? Build Your Mobile Testing Knowledge v6 • User statistics • Country statistics – based on user population • Budget • What the team owns © Karen N. Johnson, 2013 28 14
  17. 17. 4/16/2013 Mobile User Interface, Design & User Experience section 2 Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 29 MENUS, FORMS & NAVIGATION Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 30 15
  18. 18. 4/16/2013 Menu Styles • • • • • • • Springboard or Grid Menu List menu Tab menu Gallery Dashboard Metaphor Page Carousel Source: Theresa Neil. http://www.mobiledesignpatterngallery.com/mobile-patterns.php?colid=65438029-72157627607680275 http://www.slideshare.net/theresaneil/navigation-patterns-for-mobile-apps Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 31 Menu Styles Springboard Build Your Mobile Testing Knowledge v6 List © Karen N. Johnson, 2013 32 16
  19. 19. 4/16/2013 Menu Styles Tab Build Your Mobile Testing Knowledge v6 Gallery © Karen N. Johnson, 2013 33 Menu Styles Carousel Build Your Mobile Testing Knowledge v6 Metaphor © Karen N. Johnson, 2013 34 17
  20. 20. 4/16/2013 Navigating Giving the user a unique way to move forward & back. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 35 Navigating • Paging • Forward & backward • Cookie crumb trail (websites) Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 36 18
  21. 21. 4/16/2013 Navigating • Rotate • Pinch/zoom • Accelerometer • Vertical/horizontal • Paging forward & backward Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 37 Input Selector/Navigation • • • • • • • • • • Rotate Touchscreen Click wheel Rollerball Pinch & zoom Typing/keyboard inputs Accelerometer Paging backwards/forwards Cookie crumb trail Gestures Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 38 19
  22. 22. 4/16/2013 UI controls • Entry fields • Lookup buttons • Radio buttons • Drop downs Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 39 Custom Controls • The slider bar on AA’s mobile app is an unusual custom UI control. • Does your app have any custom controls? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 40 20
  23. 23. 4/16/2013 Links • Do links work? • Does your site have links to other sites? • What about the sitemap links? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 41 Lists • Alignment • Consistency • Disruptions from ads or 3rd party feeds Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 42 21
  24. 24. 4/16/2013 Color-alternating lists • Grouped rows • Zebra stripping lists • Text Alignment • User Accessibility Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 43 Colors & Symbols • • • • Symbols Spacing Rotating Columns Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 44 22
  25. 25. 4/16/2013 Barcodes and Scanning • Visibility • Image tolerance • Connecting to a service Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 45 Currency User interface considerations with multiple currencies: is the correct symbol for the currency shown? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 46 23
  26. 26. 4/16/2013 Images • Where’s the image? • You might use your desktop to see if the issue occurs outside of the mobile environment. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 47 Images • • • • • • • • • Size of files Cache Refresh rate Full screen Wi-Fi drops connection Rotate Pinch/zoom Accelerometer Vertical or horizontal Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 48 24
  27. 27. 4/16/2013 Video & Streaming • Flash? • Videos • Connection speed • Availability Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 49 © Karen N. Johnson, 2013 50 Completing Forms At some point, a user needs to enter information. Minimizing input – such as offering smart fill fields on location awareness helps to cut down on the amount of information a user has to enter. Build Your Mobile Testing Knowledge v6 25
  28. 28. 4/16/2013 Completing Forms • Sign-in and search are two of the most common forms on mobile devices. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 51 Login Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 52 26
  29. 29. 4/16/2013 Passwords • Case sensitive • Changing the case • Seeing the text entry • Staying logged in (cookies) Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 53 SEARCH, SORT, FILTER Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 54 27
  30. 30. 4/16/2013 Search • Wildcards • Text entry • Case sensitivity • Alpha and numeric entry • Dropdowns • Location based searching Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 55 Search & Filter • Location-based filtering • UX considerations on filters, applying & clearing • UX considerations – scrolling through many search results Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 56 28
  31. 31. 4/16/2013 Search & Sort When results are pages long on a mobile device, offer the user a means to sort or refine the result set. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 57 Search • Are there fields that are prefilled based on date, location or time? • OpenTable is an example of time and location. • Are there fields that are not offered on mobile but are offered on the desktop version? • Is there a search button? Is there another method to start or run the search? • Is there a way to refine the results? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 58 29
  32. 32. 4/16/2013 LOCATION AWARENESS Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 59 Find location Consider appdependencies on phone settings - like locationbased searching. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 60 30
  33. 33. 4/16/2013 Search: filtering results Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 61 M-Commerce: restaurants • Find a restaurant (localbased search or otherwise), book a reservation, order for pickup service, and booking via mobile. • From a testing perspective, what information does the app have? Credit cards and personal information attached to an account on a mobile device open a new security concern. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 62 31
  34. 34. 4/16/2013 RESPONSIVE DESIGN Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 63 What is “responsive?” Menus or other pages whose presentation or behavior is altered on different devices and screen widths. Flexible grids, flexible images and the ability to “ebb and flow” a design based on screen size. Ethan Marcotte in 2010 coined the term in a landmark article called: A List Apart. See: http://alistapart.com/article/responsiveweb-design Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 64 32
  35. 35. 4/16/2013 A short lesson on responsive design http://blog.creativemagma.com/featur ed/2209/ Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 65 Media queries • Definition: “A media query consists of a media type and zero or more expressions that check for the conditions of particular media features. Among the media features that can be used in media queries are ‘width’, ‘height’, and ‘color’. By using media queries, presentations can be tailored to a specific range of output devices without changing the content itself. “ - Source: W3C, http://www.w3.org/TR/css3-mediaqueries/#media0 Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 66 33
  36. 36. 4/16/2013 PHONE VS. TABLET Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 67 © Karen N. Johnson, 2013 68 Phone vs. tablet People often use both at the same time. Testing by planning user scenarios is a good way to uncover and identify situations to test. Build Your Mobile Testing Knowledge v6 34
  37. 37. 4/16/2013 Phone vs. tablet • • • • App versions Apps adapted for tablets What about phablets? Functionality and form factor – does the tablet app work the same as the mobile phone app? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 69 App Version • A version page is an opportunity to once again show the app icon and/or company logo. • What about other maintenance pages? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 70 35
  38. 38. 4/16/2013 App Version Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 71 Tablet Version View • Does your app have a version number? • Does your app have unique tablet or device settings? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 72 36
  39. 39. 4/16/2013 Sitemaps “They visually represent the relationship of content to other content and provide a map for how the user will travel through the informational space.” Brian Fling, author Mobile Design and Development Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 73 Uniquely mobile TOUCH, PINCH, ZOOM, ONE THUMB, GESTURES Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 74 37
  40. 40. 4/16/2013 Touch Touch Gesture Icons http://www.mobiletuxedo.com/t ouch-gesture-icons/ Input Guidelines http://uxdesign.smashingmagazin e.com/2011/10/06/not-yourparents-mobile-phone-ux-designguidelines-smartphones/ Touch Gesture Reference Cards http://www.lukew.com/ff/entry.a sp?1370 Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 75 © Karen N. Johnson, 2013 76 One thumb design Fat Thumb: A One-Handed Alternative To Pinch-ToZoom http://www.fastcodesign.c om/1671741/fat-thumb-aone-handed-alternative-topinch-to-zoom#1 Testing One Thumb, One Eyeball Mobile Use http://www.lukew.com/ff/ entry.asp?1664 Build Your Mobile Testing Knowledge v6 38
  41. 41. 4/16/2013 Mobile App & Device Settings section 3 Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 77 app, device & browser settings • • • • • • • • • • • • • Overall app permissions Specific app permissions App permission-dependencies Device settings Browser settings Cookies Wireless & network settings Data Roaming SD card settings Swype Display settings Battery Settings/Status Task Killers Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 78 39
  42. 42. 4/16/2013 Overall App Permissions Know the app permissions your mobile app requires. Consider what the user may or may not have enabled on the device for all applications. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 79 Specific App permissions What permissions does your application require? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 80 40
  43. 43. 4/16/2013 App permission-dependencies If your app interfaces with 3rd party data such as location finding, what happens when that access is off, down or unavailable? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 81 Device settings • Consider the environment of the device: what has been enabled or not. • Consider the ability or restrictions to downloading and installing applications. • Consider upgrade scenarios and whether permissions have been changed or reset. • Install testing has returned. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 82 41
  44. 44. 4/16/2013 Browser settings Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 83 Language settings • Finding what languages are available on the device • Choosing a different language • Accessing and using a site or an app that’s multilingual • Using different keyboards on devices Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 84 42
  45. 45. 4/16/2013 Cookies • Does your site use cookies? • Check the login process with cookies on/off. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 85 Wireless & Network Settings Have you ever tested your website when connectivity is down or disrupted? This scenario is more likely with mobile devices. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 86 43
  46. 46. 4/16/2013 Network Mode CDMA is used in the US (also in China and India) but everywhere else uses GSM or other modes of connection. It can be challenging to test like a user when you live in a different country and some options are not available on devices where you are located. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 87 Network search Users can switch from and to an application or browser session while other activities are taking place (including incoming phone calls) does your app handle that disruption? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 88 44
  47. 47. 4/16/2013 Connecting to a network A user could switch to your app or website when they’re not connected. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 89 Connection errors If your app uses the SD card for storage – what if the card is already full or another app writes to the card? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 90 45
  48. 48. 4/16/2013 Data roaming Would you enable your testing team to leave the office and experience mobile as they travel around the office? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 91 SD card settings • Does your app store data on a card? • What if the card is removed? • What if a different card is inserted? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 92 46
  49. 49. 4/16/2013 SIM cards • A SIM card or Subscriber Identity Module is a chip. • SIM holds personal identity information, cell number, phone book, text messages and other data. • Again, what happens if the card is full? Changed? Removed? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 93 Swype settings • Does your app work with swyping or voice input? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 94 47
  50. 50. 4/16/2013 Display settings Consider whether a user has made device settings that can impact how your application appears. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 95 Battery conditions • Have you tested your app under low battery conditions? • Is your application responsible for battery drainage? - See Julian Harty’s work See Android Forum Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 96 48
  51. 51. 4/16/2013 Battery conditions: power save Is this a variable you need to consider in testing? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 97 Task Killers • • • What background tasks are running? What data is being synced? Does a Task Killer help or not? Android http://www.pcworld.com/article/24 4067/taskkiller_apps_will_they_help _or_hurt_your_battery_life.html IOS http://www.youtube.com/watch?v= nEJA1yUgR80 Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 98 49
  52. 52. 4/16/2013 The Competitive Mobile Marketplace section 4 Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 99 What do mobile apps compete on? According to uTest’s white paper from the product Applause, there are intuitive metrics such as: • content • elegance • pricing • usability • and satisfaction Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 100 50
  53. 53. 4/16/2013 How steep is the competition? • • • • Apple Store: 700,00+ apps Google Play: 700,000+ apps Blackberry App World: 100,000+ apps By 2015, the International Data Corporation (IDC) predicts 182.7 billion mobile apps will be downloaded • In 2010, 10.7 billion apps were downloaded - source: uTest Applause white paper Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 101 MARKET RANKING Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 102 51
  54. 54. 4/16/2013 Market Rankings Applyzer is a product that watches market rankings. Notice how they segregate data by country and mobile app category. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 103 © Karen N. Johnson, 2013 104 Market Rankings Distimo is another market watching application. Build Your Mobile Testing Knowledge v6 52
  55. 55. 4/16/2013 Market Rankings Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 105 © Karen N. Johnson, 2013 106 Market Rankings RankedNow is another product tracking the competitive market. Build Your Mobile Testing Knowledge v6 53
  56. 56. 4/16/2013 MOBILE COMPETITORS Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 107 Competitive Analysis – Vertical Competition mobile app to app AccuWeather Build Your Mobile Testing Knowledge v6 The Weather Channel © Karen N. Johnson, 2013 108 54
  57. 57. 4/16/2013 Competitive Analysis – Vertical Competition tablet app to app Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 109 Competitive Analysis – Mobile Competition the app Shazam vs. other ways to spend time Notice how competitors might not be offering the same product but compete equally well for a user’s time, purchase and use. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 110 55
  58. 58. 4/16/2013 Mobile competition: Shazam’s “competitors” See how this “competitor” isn’t offering the same product but is vying for the user’s time. Build Your Mobile Testing Knowledge v6 This competitor is a more typical “competitor.” © Karen N. Johnson, 2013 111 Mobile competition: a sample of differences by store Competitors vary from store to store. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 112 56
  59. 59. 4/16/2013 MARKET COMMENTS Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 113 Charmin – Sit or Squat This Charmin app was liked until the app was tied to Facebook and requires a FB Account in order to login or comment. Users have scathing comments about the change. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 114 57
  60. 60. 4/16/2013 Tide Stain Brain The Tide app made a change when the company removed user comments on how to Remove stains and in turn infuriated the user community. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 115 Chlorex myStain The app gains respect and ratings by now being solely focused on pushing their product. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 116 58
  61. 61. 4/16/2013 Out of Milk Note the number of users for the free version. And also note the overall ratings by users. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 117 Spotify Note how users comment on updates that cause issues or comment on missing functionality. Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 118 59
  62. 62. 4/16/2013 Competitive Analysis Exercise: 1. 2. 3. 4. 5. Select two mobile applications that would seem to be competitors such as AccuWeather and the Weather Channel. Review each app for the “intuitive metrics” listed as factors. Make notations on each of the factors for both apps. For satisfaction, you can use either your satisfaction with the app, app store comments or a combination of both. If you were to apply a scoring to each app, which app would you choose over the other app? Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 119 Build Your Mobile Testing Knowledge v6 © Karen N. Johnson, 2013 120 60

×