Your SlideShare is downloading. ×
0
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Hp perfecto webinar - UFT Mobile
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Hp perfecto webinar - UFT Mobile

562

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
562
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
37
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. A How to Build an Enterprise Grade Mobile Testing Strategy Eran Kinsbruner Product Marketing @Perfecto Mobile Antoine Aymer Product Marketing @HP © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 2. A How different is Mobile? 2 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 3. Tap & Multi tap Double / long tap Drag Swipe Pinch & zoom Click Double click Right click Drag Snapshot Type Rotate / Tilt Locate Authenticate Type 3 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Speak Communicate A
  • 4. CES 2014, Smart Innovation BYOD Inflight Contactless Entertainment payment 4 Smart e-bike Smart gardener Smart clothes © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Smart nappy Smart appliance A Augmented reality
  • 5. A Starbucks’ app Features: • • • • • • •  Improve in-store customer experience  Generate customers loyalty  Increase sales 5 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Pay for your purchases Track and redeem rewards Reload Starbucks Card’s balance Get directions to the nearest store Explore coffees, beverages, food and nutritional information Send eGifts instantly to your contacts Stay informed by being the first to hear of special offers
  • 6. But this is not enough… 6 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. A
  • 7. A Use case #1 Sport App connected with smartwatch • Data transfer via Bluetooth • 100% manual/human testing • Unit test • 100% emulation Unit test Interoperability Industrialisation • Functional testing on major devices • 80% automated testing SaaS-based applications are expected to generate a growth rate of 17.4%. 7 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 8. Why Mobile Testing looks so difficult? 8 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 9. It is the jungle! Development platform versus versus Various OS types, versions, device/tablet, OEMs Evolving 9 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Browsers
  • 10. DEVICE MARKET Fragmented landscape Performance Network (>400 operators) Contextual issues Peripherals Impact on back-end 10 (OS, version, input, screen, style) USER Know the user Users’ feedback © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Time to market TESTING Emulator vs real mobile Automation vs manual Device management What Devices to test on? Bug-fix latency Unavailable services Off-shore
  • 11. A 48% lack expertise 38% lack tools Why Mobile Testing looks so difficult 11 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 12. Mobile testing disciplines Functional Non Functional Interoperability (IOP) • • • • • Network Strength / Outage / Recovery • Different NW Types • Peripheral Testing • Services • Voice / SMS interrupts • Notifications • Battery /Cable Removal Memory Leak Installation Testing Language Testing • Memory Usage • Memory Leaks • Garbage Collection • New App Install • Uninstall and Reinstall • Upgrade testing • • • • Validation of Functionality Smoke / Regressions Testing Offline access testing Negative Testing Validation for Locales Images and Text Currencies, time zones etc. Context Performance Testing Security Testing Usability Testing • CPU Usage testing • Network Usage • Page Render time or activity Render time • • • • • User Experience • Competitive Analysis • Expert Review 12 OWASP Vulnerabilities Dynamic Testing Static Code Analysis Data Encryption © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 13. Definition of Fully Tested 13 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 14. A The Truth Is Out There! Which of the following statements reflect your development team's approach to testing mobile apps? 60% We test our app across multiple device orientations We test across multiple OS versions 55% We test across multiple devices that run the same version operating system We do a quick test on an emulator/simulator or on a single device We test devices that are deployed on multiple cellular carriers We use a cloud-based service to test multiple devices We automate our testing process as part of a continuous integration process We integrate crash reporting/analytics into our deployed application to monitor and fix problems We don't formally test or instrument our apps before deploying them; we fix changes as needed 55% 55% 34% 31% 27% 21% 4% Source: Forrester, Q1 2013 Base: 765 Software developers developing mobile applications 14 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 15. A Mobile is Agile on Steroids 15 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 16. Cumulative business value The ideal Mobile testing picture Sprint 1 Sprint 2 Sprint 3 Sprint 4 CI CI CI CI Release, Iteration, Nightly, Continuous End-to-End test cycle On any device, by any team, from any location Time V1.0 V1.1 Longevity testing (independent of sprint cycles) 16 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. V1.2
  • 17. Agile and Testing -- 5 o’clock on Friday the 30th, do you know if your code is “done”? © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 18. A The Truth Is Out There! 49% of developers spend more than an hour a day testing new code 52% spend only 15% more than an hour debugging/fixing code spend that much time writing test automation code Source: Forrester, Q1 2013 Base: 765 Software developers developing mobile applications 18 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 19. Agile mandates automation 19 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 20. Use case #2 Top US Bank SaaS-based applications are expected to generate a growth rate of 17.4%. 20 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 21. A Use case #3 Mobile banking, 12 Millions unique users native application and mobile enabled website manual 3 weeks In-house Type of Testing Deployment Impact SaaS-based applications are expected to generate a growth rate of 17.4%. 21 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 22. A Use case #3 Mobile banking, 12 Millions unique users native application and mobile enabled website 86% time savings 60% cost savings Automated 3 weeks Cloud 48 hours Type of Testing Deployment Impact SaaS-based applications are expected to generate a growth rate of 17.4%. 22 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 23. Automation requirements 23 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 24. What can get in the way? store Silos 24 web App Style Cross-Platform Differences © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Use cases
  • 25. Cross-platform differences Name position Menu panel Labels Text colours Images Button images 25 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 26. Building an Enterprise Grade Mobile Testing Strategy 26 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 27. Transform Predictability, scalability Grow Coverage, Reliability & Governance Start What fits my workflow? Sprint 1 Sprint 3 Sprint 4 CI 27 Sprint 2 CI CI CI © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 28. A Finding the right balance Time to Market Locations & Networks Coverage Governance Devices Existing Tools 28 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Service Level
  • 29. HP UFT Mobile 29 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 30. #2 Deployment native #1 HP UFT Add-in 30 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. #3 Devices
  • 31. Real mobile devices HP UFT Extension (and emulators) Perform almost any operations Integrated with HP ALM Scalable Device agnostic From single, small project to hundreds of simultaneous users Develop, run and schedule one test across multiple platform Visual & Object analysis Secured Full tractability of actions. Device cleanups and encryption abilities Continuous testing Support fast, agile delivery Global Accessible from any location (VPN mandatory with MCE) Manageable Full IT control on authentication, access permission and activities Predictable availability 31 Complex scenario #1 HP UFT Add-in © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. advanced built-in functionalities such voice injection and recognition, NFC, location based
  • 32. #2 Deployment Public Cloud Virtual Private Cloud MobileCloud Express 32 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
  • 33. Virgin Media Corporate Network Use case #4: Virgin Media Off-shore Team members Virgin Media UK Offices Virtual Private Cloud Dedicated devices in various geographies Core team On-premise lab 33 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Public Cloud Multiple devices in various geographies
  • 34. #3 Devices Wide device spectrum HTC, Apple, Nokia, Motorola, Samsung, SonyEricsson, LG, BlackBerry, Palm, Kindle Scalable Additional handsets are added ondemand Powerful replay all tests are video recorded to allow easy recreation of defects List of supported devices: http://www.perfectomobile.com/portal/cms/services/handsets.html 34 © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Full device control Fast charging cycle, audio injection, reboot, clean/wipes Deploy your app Testers can deploy their application on the device, test it as if you were holding the handset in your hands. Global The handsets resides in various datacenters in the world: US, Canada, UK, France, Germany, Spain, South Africa, India.
  • 35. 35 5 Gain mobile objects experience 2 Be intimate with manual testing 6 Always sanity test your previous version 3 Define relevant tests across all target devices 7 Implement continuous (before the demo) integration 4 SCOPE AUTOMATION 1 Traditional non-mobile automation rules still apply Choose the right devices 8 Think about future maintenance © Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

×