MOBILE TESTING –
FOCUS AREAS
Sathyan SethuMadhavan
Thoughtworks
APPS
  Browser Apps
      Applications runs on the browser

  Pre-Installed Apps
      ROM’s , OEM apps, SDK apps

  Installable Apps
      Custom developed apps available in the market
NEXT GEN DEVICES
  GPS
  (Assisted) GPS
  4G/3G/Wi-Fi Internet Access
  Touch screen interface
  Camera
  Compass
  Accelerometer
CHALLENGES
  Minimal support with test automation tools
  Application are starting to be location aware
  Integration of live apps
  Competition between similar apps
  Address Time – To – Market
  Maintain state of the apps – Random interactions
  Device limitations and ‘N’ configurations
FOCUS AREAS

                                      Local awareness and
Content Rendering     Navigation                            Haptic Feedback
                                        live integration



     Resource           Behavior,
consumptions(CPU,   Performance and      Interruptions      Install / Upgrade
 Memory, Battery)       Stability
SPECIFICS
 Content
Rendering     Alignment and Corners
              Content display during flip and rotate
              Multi-touch gestures (Zoom, Pinch, Long Pinch etc)
              Rendering of plugins in browser
              Streaming of videos
              Target common user base (short fingers, long fingers etc)
SPECIFICS
Navigation
               Take advantage of learned behaviors
               Avoid interaction inconsistencies
               Provide clear conceptual links across widgets
               Plan for accidental incidents
               Don’t relay completely on multi-touch
               Provide interaction affordances
SPECIFICS
    Location
Awareness and
Live Integration
                     Integration with maps
                     Integration with GPS and AGPS
                     Integration with social networking apps (Facebook, Twitter
                     etc)
                     Ensure proper data sync mechanism between integrated
                     applications
                     More+++ of exploratory testing - User Interactions
SPECIFICS
Feedback /
  Haptic
 Feedback      Provide visual / physical feedback
               Help to avoid repeated actions
               Add haptic feedback for accidental taps
SPECIFICS
Resource
Utilization     Battery - Run in background, run in foreground, run app for
                long time.
                Memory - Run in background, run in foreground, run app for
                long time.
                Battery- Run in background, run in foreground, run app for
                long time
SPECIFICS
  Behavior,
Performance
and Stability     Network strength - No network to high
                  Network speed - Low to high (wifi, 3g)
                  Network Switching – Wifi to 3G
                  Battery strength - low to high , during charging
                  Random shutdown
SPECIFICS
Interruptions
                  Screen Lock
                  New Installation
                  Receive voice call
                  Receive SMS, MMS, Email or Notification
                  Take a photo
                  USB connection
                  SD card removal
SPECIFICS
 Install/
Upgrade       Receive via Wireless (OTA)
              USB cable upgrade
              Existing data/user preferences
ADDITIONAL HAT

       SME            BA

                 UX

       QA             DEV
CONSIDER
Requirements   * Screen, User and Input Based

               * Natural Interactions

               * Easy to remember and perform

               * Socially acceptable

               * Not activated by casual actions

               * Richly connected apps

               * Navigation requirements
CONSIDER
Development   * Design non-expert actions
              * Separate Presentation and Business
              * More of unit tests -Validate Algorithms
              * Unit tests - Apps integrations
              * Consider possible interactions
              * Conduct frequent user-experience bash
              * Unit tests for continuous events
              * Unit tests for multi-user , parallel interactions
CONSIDER
          * More of Exploratory
Testing   * Possible Interactions
          * Haptic Feedback
          * Measure Responsiveness
          * Typical and accidental issues
          * Unintended Gestures
          * Each app is different
          * Resource Consumption
          * Less support - Emulator based testing
          * Clear Boundary between SDK and apps functionalities
AVAILABLE TOOLS
                   Iphone                                Andriod

    •  Fonemonkey                        •  Robotium
    •  Frank                             •  Dalvik Debug Monitoring Server
    •  Egg Plant – Image Compare            (DDMS)
    •  Memory Sweep – Memory Snapshot       •  Port Forwarding Service
    •  Screenshots – Home and Lock key      •  Screen capture on device
                                            •  Thread and heap information
                                            •  Logcat
                                            •  Process and radio state information
                                            •  Incoming call and SMS spoofing
                                            •  Location data spoofing and more
                                         •  Monkey Tool and Runner
                                         •  Hierarchy Viewer
Q &A

SATNAIR@THOUGHTWORKS.COM

Mobile testing

  • 1.
    MOBILE TESTING – FOCUSAREAS Sathyan SethuMadhavan Thoughtworks
  • 2.
    APPS   Browser Apps   Applications runs on the browser   Pre-Installed Apps   ROM’s , OEM apps, SDK apps   Installable Apps   Custom developed apps available in the market
  • 3.
    NEXT GEN DEVICES  GPS   (Assisted) GPS   4G/3G/Wi-Fi Internet Access   Touch screen interface   Camera   Compass   Accelerometer
  • 4.
    CHALLENGES   Minimal supportwith test automation tools   Application are starting to be location aware   Integration of live apps   Competition between similar apps   Address Time – To – Market   Maintain state of the apps – Random interactions   Device limitations and ‘N’ configurations
  • 5.
    FOCUS AREAS Local awareness and Content Rendering Navigation Haptic Feedback live integration Resource Behavior, consumptions(CPU, Performance and Interruptions Install / Upgrade Memory, Battery) Stability
  • 6.
    SPECIFICS Content Rendering   Alignment and Corners   Content display during flip and rotate   Multi-touch gestures (Zoom, Pinch, Long Pinch etc)   Rendering of plugins in browser   Streaming of videos   Target common user base (short fingers, long fingers etc)
  • 7.
    SPECIFICS Navigation   Take advantage of learned behaviors   Avoid interaction inconsistencies   Provide clear conceptual links across widgets   Plan for accidental incidents   Don’t relay completely on multi-touch   Provide interaction affordances
  • 8.
    SPECIFICS Location Awareness and Live Integration   Integration with maps   Integration with GPS and AGPS   Integration with social networking apps (Facebook, Twitter etc)   Ensure proper data sync mechanism between integrated applications   More+++ of exploratory testing - User Interactions
  • 9.
    SPECIFICS Feedback / Haptic Feedback   Provide visual / physical feedback   Help to avoid repeated actions   Add haptic feedback for accidental taps
  • 10.
    SPECIFICS Resource Utilization   Battery - Run in background, run in foreground, run app for long time.   Memory - Run in background, run in foreground, run app for long time.   Battery- Run in background, run in foreground, run app for long time
  • 11.
    SPECIFICS Behavior, Performance andStability   Network strength - No network to high   Network speed - Low to high (wifi, 3g)   Network Switching – Wifi to 3G   Battery strength - low to high , during charging   Random shutdown
  • 12.
    SPECIFICS Interruptions   Screen Lock   New Installation   Receive voice call   Receive SMS, MMS, Email or Notification   Take a photo   USB connection   SD card removal
  • 13.
    SPECIFICS Install/ Upgrade   Receive via Wireless (OTA)   USB cable upgrade   Existing data/user preferences
  • 14.
    ADDITIONAL HAT SME BA UX QA DEV
  • 15.
    CONSIDER Requirements * Screen, User and Input Based * Natural Interactions * Easy to remember and perform * Socially acceptable * Not activated by casual actions * Richly connected apps * Navigation requirements
  • 16.
    CONSIDER Development * Design non-expert actions * Separate Presentation and Business * More of unit tests -Validate Algorithms * Unit tests - Apps integrations * Consider possible interactions * Conduct frequent user-experience bash * Unit tests for continuous events * Unit tests for multi-user , parallel interactions
  • 17.
    CONSIDER * More of Exploratory Testing * Possible Interactions * Haptic Feedback * Measure Responsiveness * Typical and accidental issues * Unintended Gestures * Each app is different * Resource Consumption * Less support - Emulator based testing * Clear Boundary between SDK and apps functionalities
  • 18.
    AVAILABLE TOOLS Iphone Andriod •  Fonemonkey •  Robotium •  Frank •  Dalvik Debug Monitoring Server •  Egg Plant – Image Compare (DDMS) •  Memory Sweep – Memory Snapshot •  Port Forwarding Service •  Screenshots – Home and Lock key •  Screen capture on device •  Thread and heap information •  Logcat •  Process and radio state information •  Incoming call and SMS spoofing •  Location data spoofing and more •  Monkey Tool and Runner •  Hierarchy Viewer
  • 19.