• Save
Mobile Test Automation: Best practices- Impetus Webinar
Upcoming SlideShare
Loading in...5
×
 

Mobile Test Automation: Best practices- Impetus Webinar

on

  • 1,052 views

Testing Automation of Mobile Apps –Best Practices- Impetus Webinar

Testing Automation of Mobile Apps –Best Practices- Impetus Webinar

Register at http://bit.ly/H9GI3V

Statistics

Views

Total Views
1,052
Views on SlideShare
1,052
Embed Views
0

Actions

Likes
0
Downloads
0
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • Environmental Testing:Application testing should be performed on the real target devices, no emulatorsIn typical end-user like environment, i.e. both in wifi and expected target Mobile Operator Networks/geographiesApplication installation through OTAHandling incoming call/SMS/Notifications services including suspend resume functionality.Application testing of application related features which uses device native capabilities like Camera, GPS, Accelerometer etc.
  • Behavioral Testing:UI testing for screen orientation cases. Frequently changing the orientations (portrait to landscape and vice versa) may produce UI Issues specifically for Alert dialogs cases.Not just happy flows – expect the end-user to do any unexpected things which he can try – all extreme & boundary conditionsVerification of the functionality in OFFLINE / ONLINE environment, check how application behaves in “No Network” condition
  • Performance Testing: All practical environmental conditions like – low battery, low network signals, low/no connectivity scenarios should be tested on real devices Application responsiveness should be tested to insure that no action is taking more than few micro-seconds – without a wait notification on the screenPerformance parameters – like memory used, CPU cycles used, impact on battery life etc should be captured with each test-case execution resultsQuick and repetitive back and forth navigation of heavy screens or repetitive changing orientation of a heavy screen can produce memory issues. By heavy screen I mean screens showing heavy (memory consuming) content like high resolution Image or Image gallery. Activity leak is a common Issue on Android which occurs in mentioned scenarios.
  • General Best Practices:On test case failure – one should properly communicate with Reason of Failure + Screen shot of failure with logs for debugging furtherComplete device management, test case management and result reporting.
  • This approach is based on our MTA library, where we create hooks within the client application under test to insert/capture all events and their impact on all displayable objects on the mobile screen.Steps:Mobile Client Application is re-build with platform specific MTA library enveloping the main displayable container to create a deployable test app.The test app is executed on the mobile device in record mode, all user events and their impact in the normal flow of the app are recorded by MTA library and send to the test engineers system in form a XML data.This XML data is send to IDE, where test scripts are created around it and placed in the test script repo on a server.A push Message is send to the device which launches the test app, and MTA fetches these test scripts from the server and executes them.The all events and impacts of the same are again recorded and send back to the test engineers systems, where they are processed by server to produce the test results.
  • This approach is based on our MTA library, where we create hooks within the client application under test to insert/capture all events and their impact on all displayable objects on the mobile screen.Steps:Mobile Client Application is re-build with platform specific MTA library enveloping the main displayable container to create a deployable test app.The test app is executed on the mobile device in record mode, all user events and their impact in the normal flow of the app are recorded by MTA library and send to the test engineers system in form a XML data.This XML data is send to IDE, where test scripts are created around it and placed in the test script repo on a server.A push Message is send to the device which launches the test app, and MTA fetches these test scripts from the server and executes them.The all events and impacts of the same are again recorded and send back to the test engineers systems, where they are processed by server to produce the test results.
  • Solution Initially developed native builds for – iOS, Android, Blackberry & J2me based SmartphonesChallenge: High cost of development due to 4 code bases UX needed to re-designed/re-codded for tablets like ipad & Galaxy
  • Solution Initially developed native builds for – iOS, Android, Blackberry & J2me based SmartphonesChallenge: High cost of development due to 4 code bases UX needed to re-designed/re-codded for tablets like ipad & Galaxy

Mobile Test Automation: Best practices- Impetus Webinar Mobile Test Automation: Best practices- Impetus Webinar Presentation Transcript

  • Testing Automation of Mobile Apps - The Best Practices April 13 10:00 am PT/ 1:00 pm ET @ impetustech Recorded version available at http://www.impetus.com/webinar_registration?event=archived&eid=57
  • Outline  Mobile Test Automation  Possibilities and Challenges  Best Practices  Environmental Testing  Behavioral Testing  Performance Testing  Complete Ecosystem testing  Impetus Recommended Approach  Case Studies  mAutomate Demo Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 2
  • Mobile Test Automation Using best practices, tools and artifacts that reduces the need of human involvement on repetitive testing tasks Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 3
  • Possibilities..  Cloud-model helps manage the cost of device acquisition  Facilitates offshore model - Reduces cost  High speed of automation testing - Saves time  Enhanced productivity  Maximizes test coverage Test Automation of Mobile Apps enables faster time to market! Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 4
  • Generic Challenges  Diversity of device / platforms  Hardware complexity  Application complexity  Carrier network issues Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 5
  • Technical Challenges  Large number of test cases  API Level test execution  Object comparison transparency  Device specific features Recorded version available at http://www.impetus.com/webinar_registration?event=archived&eid=57 6Impetus Proprietary
  • Best Practices – Testing Automation of Mobile Apps Our Mantra Test plan early, Test always, Test on the devices Best Practices of Mobile Application Testing • Environmental Testing • Behavioral Testing • Performance Testing • Ideal Test Ecosystem Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 7
  • Environmental Testing • Using devices for automation testing - not emulators • Automatic network switching • Auto application installation through OTA • Manage notification services Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 8
  • Behavioral Testing • Screen orientation - Test for frequent switches • Automatic simulation of • No network • Hardware capabilities • Location attributes • System v/s user events • Not just happy flows  Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 9
  • Performance Testing • Memory, CPU and Battery analytics • Retrieving application responsiveness • UI navigation performance • Usage of performance analytics tools Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 10
  • Ideal Testing Ecosystem • Defined test & result protocol • Device management • Test case management • Result reporting Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 11
  • Market Scenario Available approaches to enable automation  White Box QA  Image comparison based tools  Object comparison based tools Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 12
  • Bridging the Gap  Record once, execute on multiple devices  Leveraging web-based infrastructure for test suite management  Using push-based mechanism  Executing test cases on remote devices  Running tests in multiple geographic via cloud  Complete test execution reports  Shares performance numbers and screen shots Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 13
  • mAutomate Cloud-enabled Mobile Automation Testing Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 14
  • Case Study: Financial Services Our Client  A leading company providing financial and banking services Key Requirement  A mobile banking solution for Android devices & tablets Impetus Solution  Recorded 175 automation test cases on 1 target device  Simultaneously executed recorded test cases on 15 Android devices and 1 tablet, across multiple geographies  Complete web driven test management Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 15
  • Case Study: Work Force Management Our Client  Leaders in work force management solutions Key Requirement  Extending successful enterprise app to mobile Impetus Solution  Complete functional testing solution provided  With testing automation, framework recorded all test cases in a few days  Simultaneously execute on multiple devices on each iterations  Retrieved test results with reason of failure and performance Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 16
  • Summing Up.. Don’t forget -  Auto application installation through OTA  Network switching  Location simulation Well thought of strategy for test and device management Leverage Cloud-enabled infrastructure for automated testing Recorded version available at http://www.impetus.com/webinar_registration?event=archived&eid=57
  • mAutomate Demo mAutomate Video Demo Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 18
  • About Us  Strategic partners for software product engineering and R&D  Thought leaders in cutting-edge technologies  Mature processes and practices that are methodical, yet flexible  Diverse domain expertise Our Mobile R&D Labs offers end-to-end implementation of mobile solutions for all players in the wireless value chain Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 19
  • Questions Please send in your questions using the chat panel Recorded version available atImpetus Proprietary http://www.impetus.com/webinar_registration?event=archived&eid=57 20
  • Thank you For more information, write to us at inquiry@impetus.com @ impetustech Recorded version available athttp://www.impetus.com/webinar_registration?event=archived&eid=57