Mdc2010 Automated Mobile Testing


Published on

  • Be the first to comment

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Mdc2010 Automated Mobile Testing

  1. 1. Automated Mobile Testing Nilesh Maheshwari Business Head – Mobile & Wireless
  2. 2. Agenda <ul><li>Challenges </li></ul><ul><li>Test Automation </li></ul><ul><li>Unit Testing Tools </li></ul><ul><li>Benefits of Test Automation </li></ul><ul><li>Criteria for Test Automation </li></ul><ul><li>Limitation of Test Automation </li></ul><ul><li>Mobile Test Automation tools- Comparison </li></ul>
  3. 3. Where do we stand now….
  4. 4. Smartphone Software Development Scenario Features Time Cost Quality is compromised Compromise Balance with Features and Time-to-market Balance with Time-to-market and Cost
  5. 5. Generic Challenges <ul><li>Diversity of device / Platforms </li></ul><ul><li>Hardware configuration </li></ul><ul><li>Mounting application complexity </li></ul><ul><li>Network related challenges </li></ul><ul><li>Accelerating software development schedules </li></ul>
  6. 6. Technical Challenges <ul><li>Large amount of Tests in all testing scope </li></ul><ul><li>API Level test execution in target devices or emulator </li></ul><ul><li>Verification and UI Control in testing phases of application </li></ul><ul><li>System’s special feature requires flexible tools and customization </li></ul>
  7. 7. What is the solution for this?
  8. 8. Test Automation <ul><li>Test Automation is the use of strategies, tools </li></ul><ul><li>and artifacts that reduce the need of human </li></ul><ul><li>involvement on repetitive tasks. </li></ul><ul><li>Supports – Unit, Functional & Navigation </li></ul><ul><li>testing. </li></ul>
  9. 9. How test automation works? <ul><li>Application specific Test case writing </li></ul><ul><li>Conversion of test cases into scripts </li></ul><ul><li>(Write / Record) </li></ul><ul><li>Execution of Test Scripts on devices </li></ul><ul><li>Unattended test cycles </li></ul>
  10. 10. Benefits : Test Automation <ul><li>Reliable </li></ul><ul><li>Repeatable </li></ul><ul><li>Programmable </li></ul><ul><li>Comprehensive </li></ul><ul><li>Reusable </li></ul><ul><li>Increased productivity. </li></ul><ul><li>Superior application quality. </li></ul><ul><li>Cost Reduction </li></ul>
  11. 11. What about Unit Testing?
  12. 12. Unit Testing <ul><li>JMUnit / B-Unit is a member of the xUnit family suitable for testing Java ME / BlackBery applications. JMUnit test-cases can directly run on device or Emulator. </li></ul><ul><li>CppUnit is a unit testing framework module for C++, described as a C++ port of JUnit. The library is released under the GNU Lesser General Public License. </li></ul><ul><li>OCUnit is a testing framework for Objective C in the Mac OS X. With OCUnit, testing becomes integrated with development.   </li></ul>
  13. 13. Can we test all mobile applications through test automation?
  14. 14. Selection Criteria
  15. 15. Major Constraints <ul><li>Increasing Complexity of mobile application </li></ul><ul><li>In-Depth functional testing </li></ul><ul><li>Testing device features used in app i.e. Camera , accelerometer </li></ul><ul><li>LBS & Bluetooth </li></ul><ul><li>Call & VoiceMail scenario </li></ul><ul><li>Multimedia, Barcode, NFC Apps </li></ul><ul><li>Games, AI applications </li></ul>
  16. 16. nanoVNC Demo
  17. 17. Available Tools <ul><li>TestQuest </li></ul><ul><li>DeviceAnywhere </li></ul><ul><li>Perfecto mobile </li></ul><ul><li>Eggplant </li></ul><ul><li>NanoVNC </li></ul>
  18. 18. Comparison Matrix
  19. 19. Comparison Matrix Factors Sub-Category TestQuest DeviceAnywhere Perfecto mobile Eggplant nanoVNC Performance # Real Time device experience # Network problem, requires massive bandwidth to support smooth flow of testing and script recording on a remote device through the internet # Network problem, requires massive bandwidth to support smooth flow of testing and script recording on a remote device through the internet. # Real Time device experience # Performance VNC Server and bandwidth connectivity dependent # Real Time device experience # Minor latency issues # Performance Wi-Fi connectivity dependent Other Comments # TestQuest Pro verifies the system under test’s (SUT) operation in a manner 100% identical to that of manual tester by becoming a “virtual user.” # It interacts with the SUT through the system’s human interfaces such as the screen, pointing devices, keyboard, etc. # It work on Direct-To-Device™, DeviceAnywhere Test Center enables developers around the world to connect to and control mobile devices – over the Internet – for all application and content testing needs # The Perfecto Mobile system is a hardware and software solution. Mobile handsets are mounted on cradles and they connect to the Perfecto Mobile system through their data ports. # Users access the handsets via a web-based UI. # eggPlant is a low-overhead, non-invasive black-box test and process automation tool. Since it does not reside on the system-under-test and is technology agnostic, it can test in many situations that other tools cannot. By using image capture and advanced search techniques, most ui changes are not a problem. # This method involves using the open source VNC Robot and a VNC server running on a mobile device.VNC robot is used to connect to the VNC server running on the device and can then be applied to record scripts. # nanoVNC works in conjunction with a VNC client, it displays the phone’s screen in a window on the PC, and forwards keystrokes and mouse movements from the PC to the phone.
  20. 20. Thank You Nilesh Maheshwari [email_address] +91-9826384858 Mobile Developer Conference by MoMoB