Downloaded 63 times
Uploaded byPerfecto Mobile
Hp perfecto webinar - UFT Mobile
The document discusses building an enterprise-grade mobile testing strategy. It recommends starting with tools that fit your current workflow and then transforming your strategy over time to improve coverage, reliability, and governance. A balanced strategy considers factors like time to market, device and network coverage, and existing tools and processes. The document describes using HP UFT Mobile for test automation across real mobile devices and emulators at scale.
More Related Content
Similar to Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
- 1. A How to Buildan Enterprise Grade Mobile Testing Strategy Eran Kinsbruner Product Marketing @Perfecto Mobile Antoine Aymer Product Marketing @HP © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 2. A How different isMobile? 2 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 3. Tap & Multitap Double / long tap Drag Swipe Pinch & zoom Click Double click Right click Drag Snapshot Type Rotate / Tilt Locate Authenticate Type 3 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Speak Communicate A
- 4. CES 2014, SmartInnovation BYOD Inflight Contactless Entertainment payment 4 Smart e-bike Smart gardener Smart clothes © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Smart nappy Smart appliance A Augmented reality
- 5. A Starbucks’ app Features: • • • • • • • Improvein-store customer experience Generate customers loyalty Increase sales 5 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Pay for your purchases Track and redeem rewards Reload Starbucks Card’s balance Get directions to the nearest store Explore coffees, beverages, food and nutritional information Send eGifts instantly to your contacts Stay informed by being the first to hear of special offers
- 6. But this isnot enough… 6 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. A
- 7. A Use case #1 SportApp connected with smartwatch • Data transfer via Bluetooth • 100% manual/human testing • Unit test • 100% emulation Unit test Interoperability Industrialisation • Functional testing on major devices • 80% automated testing SaaS-based applications are expected to generate a growth rate of 17.4%. 7 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 8. Why Mobile Testing looksso difficult? 8 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 9. It is thejungle! Development platform versus versus Various OS types, versions, device/tablet, OEMs Evolving 9 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Browsers
- 10. DEVICE MARKET Fragmented landscape Performance Network (>400operators) Contextual issues Peripherals Impact on back-end 10 (OS, version, input, screen, style) USER Know the user Users’ feedback © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Time to market TESTING Emulator vs real mobile Automation vs manual Device management What Devices to test on? Bug-fix latency Unavailable services Off-shore
- 11. A 48% lack expertise 38% lack tools Why MobileTesting looks so difficult 11 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 12. Mobile testing disciplines Functional NonFunctional Interoperability (IOP) • • • • • Network Strength / Outage / Recovery • Different NW Types • Peripheral Testing • Services • Voice / SMS interrupts • Notifications • Battery /Cable Removal Memory Leak Installation Testing Language Testing • Memory Usage • Memory Leaks • Garbage Collection • New App Install • Uninstall and Reinstall • Upgrade testing • • • • Validation of Functionality Smoke / Regressions Testing Offline access testing Negative Testing Validation for Locales Images and Text Currencies, time zones etc. Context Performance Testing Security Testing Usability Testing • CPU Usage testing • Network Usage • Page Render time or activity Render time • • • • • User Experience • Competitive Analysis • Expert Review 12 OWASP Vulnerabilities Dynamic Testing Static Code Analysis Data Encryption © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 13. Definition of FullyTested 13 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 14. A The Truth IsOut There! Which of the following statements reflect your development team's approach to testing mobile apps? 60% We test our app across multiple device orientations We test across multiple OS versions 55% We test across multiple devices that run the same version operating system We do a quick test on an emulator/simulator or on a single device We test devices that are deployed on multiple cellular carriers We use a cloud-based service to test multiple devices We automate our testing process as part of a continuous integration process We integrate crash reporting/analytics into our deployed application to monitor and fix problems We don't formally test or instrument our apps before deploying them; we fix changes as needed 55% 55% 34% 31% 27% 21% 4% Source: Forrester, Q1 2013 Base: 765 Software developers developing mobile applications 14 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 15. A Mobile is Agileon Steroids 15 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 16. Cumulative business value Theideal Mobile testing picture Sprint 1 Sprint 2 Sprint 3 Sprint 4 CI CI CI CI Release, Iteration, Nightly, Continuous End-to-End test cycle On any device, by any team, from any location Time V1.0 V1.1 Longevity testing (independent of sprint cycles) 16 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. V1.2
- 17. Agile and Testing-- 5 o’clock on Friday the 30th, do you know if your code is “done”? © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 18. A The Truth IsOut There! 49% of developers spend more than an hour a day testing new code 52% spend only 15% more than an hour debugging/fixing code spend that much time writing test automation code Source: Forrester, Q1 2013 Base: 765 Software developers developing mobile applications 18 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 19. Agile mandates automation 19 ©Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 20. Use case #2 TopUS Bank SaaS-based applications are expected to generate a growth rate of 17.4%. 20 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 21. A Use case #3 Mobilebanking, 12 Millions unique users native application and mobile enabled website manual 3 weeks In-house Type of Testing Deployment Impact SaaS-based applications are expected to generate a growth rate of 17.4%. 21 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 22. A Use case #3 Mobilebanking, 12 Millions unique users native application and mobile enabled website 86% time savings 60% cost savings Automated 3 weeks Cloud 48 hours Type of Testing Deployment Impact SaaS-based applications are expected to generate a growth rate of 17.4%. 22 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 23. Automation requirements 23 © Copyright2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 24. What can getin the way? store Silos 24 web App Style Cross-Platform Differences © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Use cases
- 25. Cross-platform differences Name position Menupanel Labels Text colours Images Button images 25 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 26. Building an EnterpriseGrade Mobile Testing Strategy 26 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 27. Transform Predictability, scalability Grow Coverage, Reliability& Governance Start What fits my workflow? Sprint 1 Sprint 3 Sprint 4 CI 27 Sprint 2 CI CI CI © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 28. A Finding the rightbalance Time to Market Locations & Networks Coverage Governance Devices Existing Tools 28 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Service Level
- 29. HP UFT Mobile 29 ©Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 30. #2 Deployment native #1 HPUFT Add-in 30 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. #3 Devices
- 31. Real mobile devices HPUFT Extension (and emulators) Perform almost any operations Integrated with HP ALM Scalable Device agnostic From single, small project to hundreds of simultaneous users Develop, run and schedule one test across multiple platform Visual & Object analysis Secured Full tractability of actions. Device cleanups and encryption abilities Continuous testing Support fast, agile delivery Global Accessible from any location (VPN mandatory with MCE) Manageable Full IT control on authentication, access permission and activities Predictable availability 31 Complex scenario #1 HP UFT Add-in © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. advanced built-in functionalities such voice injection and recognition, NFC, location based
- 32. #2 Deployment Public Cloud VirtualPrivate Cloud MobileCloud Express 32 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
- 33. Virgin Media CorporateNetwork Use case #4: Virgin Media Off-shore Team members Virgin Media UK Offices Virtual Private Cloud Dedicated devices in various geographies Core team On-premise lab 33 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Public Cloud Multiple devices in various geographies
- 34. #3 Devices Wide devicespectrum HTC, Apple, Nokia, Motorola, Samsung, SonyEricsson, LG, BlackBerry, Palm, Kindle Scalable Additional handsets are added ondemand Powerful replay all tests are video recorded to allow easy recreation of defects List of supported devices: http://www.perfectomobile.com/portal/cms/services/handsets.html 34 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Full device control Fast charging cycle, audio injection, reboot, clean/wipes Deploy your app Testers can deploy their application on the device, test it as if you were holding the handset in your hands. Global The handsets resides in various datacenters in the world: US, Canada, UK, France, Germany, Spain, South Africa, India.
- 35. 35 5 Gain mobile objects experience 2 Beintimate with manual testing 6 Always sanity test your previous version 3 Define relevant tests across all target devices 7 Implement continuous (before the demo) integration 4 SCOPE AUTOMATION 1 Traditional non-mobile automation rules still apply Choose the right devices 8 Think about future maintenance © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.