0
Mobile Application Testing
Frederik Carlier
ww Technology Strategist
11th September 2013
Agenda
•

The Mobile Market
• Testing for Desktop and Mobile Apps: Now and Then
• Methods for Test Automation
• Functional...
Agenda
•

The Mobile Market
• Testing for Desktop and Mobile Apps: Now and Then
• Methods for Test Automation
• Functional...
2013 Gartner CIO Priorities
Ranking

2013

2012

2011

2010

2009

2008

Analytics and Business Intelligence

1

1

5

5

...
2013 Gartner Strategic Technology
Trends

Source: http://www.gartner.com/technology/research/top-10-technology-trends/
Mobile Market Share
Tablets

Smartphone
Windows
Phone
4%

Windows
Phone
4%

iOS
32%

BlackBerry
3%

Linux
1%

iOS
13%

And...
Agenda
•

The Mobile Market
• Testing for Desktop and Mobile Apps: Now and Then
• Methods for Test Automation
• Functional...
Waterfall approach for testing
•

•
•
•

•
•

Party
Project Definition
Project Realization
Testing (used a project buffer)...
Test Case Implementation & Execution –
ROI?
•

Reusablity across
•
•
•
•
•

•

Independent of
•
•
•

•

Different mobile O...
Agenda
•

The Mobile Market
• Testing for Desktop and Mobile Apps: Now and Then
• Methods for Test Automation
• Functional...
Manual Testing
•

Not reproducible
• Time consuming
• On Premise?
• Test Coverage
Jamo Solutions - Mission
The mission of Jamo Solutions is to provide
technology and expertise that enables
successful test...
Object Attributes & Identification
•

Objects are identified by a unique
combination of attributes
• This combination can ...
A typical UI
Consider the differences between testing
this application using OCR (screen
scraping/bitmap recognition) and ...
Portrait view vs. landscape view
Native, Web & Hybrid Applications
•
•
•

Native app: packaged application
deployed to the phone
Web app: accessed through ...
Agenda
•

The Mobile Market
• Testing for Desktop and Mobile Apps: Now and Then
• Methods for Test Automation
• Functional...
Functional Testing - Overview
Mobile Test Automation
• M-eux Test allows you to automate your mobile testing
scenarios
• B...
Demo
Functional Testing - Overview
Integration with exiting tools & processes
• Integration with industry-standard development ...
Browser-Based Functional Testing
What?
• Allows you to automate the testing of web applications on
mobile platforms
• Base...
Demo
Browser-Based Functional Testing
Cross Browser Script
Agenda
•

The Mobile Market
• Testing for Desktop and Mobile Apps: Now and Then
• Methods for Test Automation
• Functional...
Performance/Capacity Management
Aspects of performance/capacity management
• Performance Testing
•
•

•

Load Generation
R...
Performance/Capacity Management
Load Generation
• M-eux Test allows you to create automated test cases
• You can replay th...
Performance/Capacity Management
Response Time Measurement
• M-eux Test allows you to create scripts that execute an action...
Performance/Capacity Management
Performance Monitoring
• M-eux Test allows you to create scripts that execute an action
an...
Agenda
•

The Mobile Market
• Testing for Desktop and Mobile Apps: Now and Then
• Methods for Test Automation
• Functional...
Best Practices Management
•

Re-use scripting best practice from PC world:
•
•
•
•

•

Descriptive programming
Exception h...
Agenda
•

The Mobile Market
• Testing for Desktop and Mobile Apps: Now and Then
• Methods for Test Automation
• Functional...
Conclusion
•

•
•
•

•
•

Let your test be reproducable
Manage frequent test cycles
Create re-usable tests
Object recognit...
Questions?
frederik.carlier@jamosolutions.com
+32 485 869 861
www.jamosolutions.com
Thank You!
frederik.carlier@jamosolutions.com
+32 485 869 861
www.jamosolutions.com
Mobile Application Testing af Frederik Carlier, Jamo Solutions
Upcoming SlideShare
Loading in...5
×

Mobile Application Testing af Frederik Carlier, Jamo Solutions

468

Published on

Oplægget blev holdt ved et seminar i InfinIT-interessegruppen Softwaretest den 11. september 2013. Læs mere om interessegruppen her: http://infinit.dk/dk/interessegrupper/softwaretest/softwaretest.htm

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
468
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
12
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Mobile Application Testing af Frederik Carlier, Jamo Solutions"

  1. 1. Mobile Application Testing Frederik Carlier ww Technology Strategist 11th September 2013
  2. 2. Agenda • The Mobile Market • Testing for Desktop and Mobile Apps: Now and Then • Methods for Test Automation • Functional Testing • Performance Testing • Frameworks • Conclusion
  3. 3. Agenda • The Mobile Market • Testing for Desktop and Mobile Apps: Now and Then • Methods for Test Automation • Functional Testing • Performance Testing • Frameworks • Conclusion
  4. 4. 2013 Gartner CIO Priorities Ranking 2013 2012 2011 2010 2009 2008 Analytics and Business Intelligence 1 1 5 5 1 1 Mobile Technologies 2 2 3 6 12 12 Cloud Computing 3 3 1 2 16 * Collaboration Technologies (workflow) 4 4 8 11 5 8 Legacy Modernization 5 6 7 15 4 4 IT Management 6 7 4 10 * * Customer Relastionship Management 7 8 18 * * * Virtualization 8 5 2 1 3 3 Security 9 10 12 9 8 8 ERP Applications 10 9 13 14 2 2 * Not an option this year Source: http://www.gartner.com/imagesrv/cio/pdf/cio_agenda_insights2013.pdf
  5. 5. 2013 Gartner Strategic Technology Trends Source: http://www.gartner.com/technology/research/top-10-technology-trends/
  6. 6. Mobile Market Share Tablets Smartphone Windows Phone 4% Windows Phone 4% iOS 32% BlackBerry 3% Linux 1% iOS 13% Android 63% Android 79% Android iOS Windows Phone Windows RT Source: http://www.idc.com/getdoc.jsp?containerId=prUS24253413 Others Windows Phone BlackBerry Android iOS Linux Symbian Others Source: http://www.idc.com/getdoc.jsp?containerId=prUS24257413
  7. 7. Agenda • The Mobile Market • Testing for Desktop and Mobile Apps: Now and Then • Methods for Test Automation • Functional Testing • Performance Testing • Frameworks • Conclusion
  8. 8. Waterfall approach for testing • • • • • • Party Project Definition Project Realization Testing (used a project buffer) Deployment to production Party Result: low return on investment on testing effort
  9. 9. Test Case Implementation & Execution – ROI? • Reusablity across • • • • • • Independent of • • • • Different mobile OS versions (new) Different mobile OS vendors (new) Different hardware (new) Different versions of the app under test Different browser Screen resolution Keyboards Localization Re-use of existing • • • Testing tools Automation expertise Scripting / Programming language
  10. 10. Agenda • The Mobile Market • Testing for Desktop and Mobile Apps: Now and Then • Methods for Test Automation • Functional Testing • Performance Testing • Frameworks • Conclusion
  11. 11. Manual Testing • Not reproducible • Time consuming • On Premise? • Test Coverage
  12. 12. Jamo Solutions - Mission The mission of Jamo Solutions is to provide technology and expertise that enables successful testing and monitoring solutions around the mobile end user experience.
  13. 13. Object Attributes & Identification • Objects are identified by a unique combination of attributes • This combination can be set seperately for every object or globaly for all objects of the same type • Access to all attributes of an object • Key advantage of object recognition based approach • Depending on the types of application you are creating — mobile browser, native, hybrid and the level of interactivity (use of gesture sets, access to platform features), this lower-level access will be the stronger path. Gartner, Magic Quadrant for Integrated Software Suites, 11 July 2013
  14. 14. A typical UI Consider the differences between testing this application using OCR (screen scraping/bitmap recognition) and object recognition based approach • • All buttons share the same label All buttons share the same form All buttons share the same size • Object recognition: direct access • • • • Reliable Reusable OCR: Need for more intelligence • • Error prone Reduced reusability
  15. 15. Portrait view vs. landscape view
  16. 16. Native, Web & Hybrid Applications • • • Native app: packaged application deployed to the phone Web app: accessed through the browser Hybrid app: native app with embedded web views Native App • • • • • Java C# C++ Objective C .... Hybrid App Web App • • • • HTML CSS Java Script Runs inside a browser
  17. 17. Agenda • The Mobile Market • Testing for Desktop and Mobile Apps: Now and Then • Methods for Test Automation • Functional Testing • Performance Testing • Frameworks • Conclusion
  18. 18. Functional Testing - Overview Mobile Test Automation • M-eux Test allows you to automate your mobile testing scenarios • Based on future-proof, object recognition based technology (no jail breaking / rooting, no OCR, iOS7 compatible) • Wide range of support across mobile platforms (iOS, Android, Windows, BlackBerry)
  19. 19. Demo
  20. 20. Functional Testing - Overview Integration with exiting tools & processes • Integration with industry-standard development tools (HP UTP/QTP, Microsoft,...) • Integration with application life cycle management tools (HP ALM/QC, Microsoft, IBM RQM, ...) • Allows effective re-use of and integration with your existing testing processes and tools • Minimizes the total investment, increases the ROI
  21. 21. Browser-Based Functional Testing What? • Allows you to automate the testing of web applications on mobile platforms • Based on our proven object recognition based technology • Allows for seamless cross-browser, cross-platform, crossdevice scripting • You test the real app; on real devices or simulators/emulators
  22. 22. Demo
  23. 23. Browser-Based Functional Testing Cross Browser Script
  24. 24. Agenda • The Mobile Market • Testing for Desktop and Mobile Apps: Now and Then • Methods for Test Automation • Functional Testing • Performance Testing • Frameworks • Conclusion
  25. 25. Performance/Capacity Management Aspects of performance/capacity management • Performance Testing • • • Load Generation Response Time Measurement Performance Monitoring 10/30/2013 © Jamo Solutions 26
  26. 26. Performance/Capacity Management Load Generation • M-eux Test allows you to create automated test cases • You can replay these devices on multiple devices simultaneously (physical or virtual) • We integrate with load generation tools (LoadRunner, VS,…) through UFT/VS integration 10/30/2013 © Jamo Solutions 27
  27. 27. Performance/Capacity Management Response Time Measurement • M-eux Test allows you to create scripts that execute an action and wait for the operation to complete , and report timing data • You can integrate this data with ALM tools (HP, Microsoft,…) to track performance over time 10/30/2013 © Jamo Solutions 28
  28. 28. Performance/Capacity Management Performance Monitoring • M-eux Test allows you to create scripts that execute an action and wait for the operation to complete or fail, and report timing data • You can integrate this data feed with your NOC operational tools (HP, Microsoft,…) 10/30/2013 © Jamo Solutions 29
  29. 29. Agenda • The Mobile Market • Testing for Desktop and Mobile Apps: Now and Then • Methods for Test Automation • Functional Testing • Performance Testing • Frameworks • Conclusion
  30. 30. Best Practices Management • Re-use scripting best practice from PC world: • • • • • Descriptive programming Exception handling Object reconfiguration Frameworks ( Linear framework, function decomposion framework, keyword-driven framework, data-driven framework, etc.) Best pracitices on setup • • Lab setup Scripting setup 31
  31. 31. Agenda • The Mobile Market • Testing for Desktop and Mobile Apps: Now and Then • Methods for Test Automation • Functional Testing • Performance Testing • Frameworks • Conclusion
  32. 32. Conclusion • • • • • • Let your test be reproducable Manage frequent test cycles Create re-usable tests Object recognition is the way to go Change your system and app as less as possbile by instrumentation Note that the app is not the only thing to test
  33. 33. Questions? frederik.carlier@jamosolutions.com +32 485 869 861 www.jamosolutions.com
  34. 34. Thank You! frederik.carlier@jamosolutions.com +32 485 869 861 www.jamosolutions.com
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×