Testing a new mobile world - Eddy Bruin

1. Testing a new (mobile) world Testing ubiquitous computing, mobile applications & devicesMadrid, 4th-7th of June 2012

2. •Teaser: Plaatje evolutie (zonder ubiquitous) The informationMadrid, 4th-7th of contained in this June 2012 1

3. Who am I?Madrid, 4th-7th of June 2012

4. The web is dead! Long live the internetMadrid, 4th-7th of June 2012

5. Source: Morgan Stanley ResearchMadrid, 4th-7th of June 2012

6. Madrid, 4th-7th of June 2012

8. •Teaser: Plaatje evolutie (zonder ubiquitous)Madrid, 4th-7th of June 2012

9. What is ubiquitous computing? Ubiquitous computing is a post-desktop model of human-computer interaction in which information processing has been thoroughly integrated into everyday objects and activities. In the course of ordinary activities, someone "using" ubiquitous computing engages many computational devices and systems simultaneously, and may not necessarily even be aware that they are doing so. This model is usually considered an advancement from the desktop paradigm.Madrid, 4th-7th of June 2012

10. What’s in it for software testing?Madrid, 4th-7th of June 2012

11. What’s in it for software testing? Error 3200Madrid, 4th-7th of June 2012

12. What’s in it for software testing?Madrid, 4th-7th of June 2012

13. What is so different about mobile applications?Madrid, 4th-7th of June 2012

14. Apps & New possibilitiesMadrid, 4th-7th of June 2012

15. We use mobile devices anywhere and anytimeMadrid, 4th-7th of June 2012

16. Mobile OS development is fastAug Sep Mar Apr Sept Oct Jan May Dec May Oct 0.9 1.0 1.1 1.5 1.6 2.0 2.1 2.2 2.3 3.0 4.0 2008 2009 2010 2011Nov 2006 Oct Madrid, 4th-7th of June 2012

17. What is so different about mobile applications? Interoperability Functionality Compliance Reliability UsabilityISO 9126 Efficiency Adaptability (Hardware) Aug 08 Sep 08 Mar 09 Apr 09 Sept 09 Oct 09 Jan 10 May 10 Dec 10 May 11 Oct 11 Maintainability 0.9 1.0 1.1 1.5 1.6 2.0 2.1 2.2 2.3 3.0 4.0 Portability Adaptability (Software)Madrid, 4th-7th of June 2012

18. How is testing mobile applications different?Madrid, 4th-7th of June 2012

19. How is testing mobile applications different? • What devices to test? • What skills do I need to be a mobile tester? • Is the process in a mobile project special? • When is an app approved in a app store? • What tools can I use? • Use simulators or not? • How do I test Usability? • Is the cloud involved somewhere?Madrid, 4th-7th of June 2012

20. How is testing mobile applications different? Source: OurMobilePlanet.comMadrid, 4th-7th of June 2012

21. What devices to test?Madrid, 4th-7th of June 2012

22. What devices to test? • Device Marketshare • Pixel density • OS VersionMadrid, 4th-7th of June 2012

27. What skills do I test mobile applications?• New (technical) skills • Get to know different platforms • Dev Center (test tools) • Android development kit • Get to know (different) devices • Portrait/landscape • 2G/3G/WiFi - Roaming • GPS • Gestures • Check memory warnings • Multi task • Telephone functions Madrid, 4th-7th of June 2012

28. How is testing mobile applications different?• Execute app store tests • Extra requirements • Release management • Test in pre-production Madrid, 4th-7th of June 2012

29. How is testing mobile applications different? “If the user can’t use it. It doesn’t work” Usability testing is a must!Madrid, 4th-7th of June 2012

30. Using agile methods to develop mobile apps Short Regression Expensive Automate and time what can beiterations testing consuming repeated Amount of test workMadrid, 4th-7th of June 2012

31. How is testing mobile applications different?• New test (automation) tools • White, Grey or black box testing • Real devices, simulator or cloud …And more Madrid, 4th-7th of June 2012

32. iOS – UI AutomationMadrid, 4th-7th of June 2012

33. iOS – UI Automation• Set up test automation – Join iOS Developer Program – Get xCode dev tools pkg – Includes UI Automation• UI Automation – Executes test cases on device(s) – Test scripts written in JavaScript – Record and playback possibleMadrid, 4th-7th of June 2012

37. Android – Testdroid / Robotium• Testing using robotium • Test with source code or APK • Learn to script in Java or… • Execute on simulator and real devices• Record tests using Testdroid – Record a lot of features Object Recognition – Resource ID’s –Indexes – Object recognition – Names – Executes test cases on one device… – …or execute in the cloud Madrid, 4th-7th of June 2012

38. Android – RobotiumMadrid, 4th-7th of June 2012

39. Android – TestdroidMadrid, 4th-7th of June 2012

40. Android – TestdroidMadrid, 4th-7th of June 2012

41. iOS & Android – Calabash• Write tests using Calabash • Tests iOS and Android devices • Source is needed • Learn to script in ruby and…• Use BDD scripting in Madrid, 4th-7th of June 2012

42. How is testing mobile applications different?Madrid, 4th-7th of June 2012

43. The way forward Plan for the PC to be overtaken as the primary computing device used by customers and employees. Redesign websites and portals for access from mobile devices. – GartnerMadrid, 4th-7th of June 2012

44. The way forward Plan for the PC to be overtaken as the primary computing device used by customers and employees. Redesign websites and portals for access from mobile devices. – GartnerMadrid, 4th-7th of June 2012

45. The way forwardMadrid, 4th-7th of June 2012

47. Eddy Bruin Senior Test Consultant Financial services Mobile +31 6 4520 6779 eddy.bruin@capgemini.comMadrid, 4th-7th of June 2012

48. Spread the word! For the full license check this linkMadrid, 4th-7th of June 2012