Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Yvonne and others - Mobile test automation the ING mobile app

108 views

Published on

A tale about mobile test automation

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Yvonne and others - Mobile test automation the ING mobile app

  1. 1. @eddybruin @smaljaars #yvonne
  2. 2. 22 mei 2013 2
  3. 3. 22 mei 2013 3
  4. 4. 22 mei 2013 6
  5. 5. 22 mei 2013 7
  6. 6. iOS Mobile App @ ING Netherlands • Developed in-house • Working on 11th major release since v1.0 November 2011 • Customized User Interface • Native application • Customer feedback is pivotal in release planning 8
  7. 7. 22 mei 2013 9
  8. 8. Challenges in mobile testing 10
  9. 9. 11
  10. 10. 22 mei 2013 12
  11. 11. 13
  12. 12. 13 Top 6 Android users by February 2013 User analytics based testing
  13. 13. 14 Device Marketshare Source: http://developer.android.com/about/dashboards/index.html Usage of Android versions – March 2013 User analytics based testing
  14. 14. 14 Device Marketshare Source: http://chitika.com/ios-version-distribution / Usage of iOS versions – March 2013 User analytics based testing
  15. 15. 15 1 Full force manual testing
  16. 16. 22 mei 2013 17 2 There is no silver bullet (yet) • 1 Tool • Test all device, OS combinations • 100% tested • Low cost • Quick results • Easy maintainable • Easy to learn What does management want?
  17. 17. Mobile Test Automation Eco-system 22 mei 2013 18 Technique Framework Infrastructure
  18. 18. Mobile Test Automation Eco-system 22 mei 2013 52 • Technique to interact with the (web) app • OCR vs. Code elements Technique
  19. 19. Mobile Test Automation Eco-system 22 mei 2013 53 • Maintainability • ATDD Framework
  20. 20. Mobile Test Automation Eco-system 22 mei 2013 54 • Deal with fragmentation • Test management • Cloud vs. private • Automation vs. manual • Extra test coverage Infrastructure
  21. 21. Mobile Test Automation Eco-system 22 mei 2013 18 Technique Framework Infrastructure 3 Mobile test automation eco-system = Technique, Framework and Infrastructure tools
  22. 22. 22 mei 2013 19 Technique InfrastructureFramework Device coverage
  23. 23. 22 mei 2013 20 Technique InfrastructureFramework Platform coverage
  24. 24. 22 mei 2013 21
  25. 25. 22 mei 2013 22 Technique Framework Infra.
  26. 26. Robotium & UIautomator
  27. 27. Experitest / Silk mobile
  28. 28. Experitest / Silk mobile
  29. 29. 22 mei 2013 26
  30. 30. 22 mei 2013 26 4 Onion structure of UIA code enables maintainability, accessability and readability
  31. 31. Test case: should make payment Test steps: Actions: tap, fill Elements: amount input field Test data 1 2 3 4 Amount Creditor name Account number Description 1 2 3 4 fill fields & send payment
  32. 32. • Enforced consistency coding • Test data central location • Pixel perfect testing • Exporting logging 22 mei 2013 29 Cooking the onion
  33. 33. 22 mei 2013 30 Technique Framework Infra. KIF Frank
  34. 34. 22 mei 2013 32
  35. 35. 22 mei 2013 33 5
  36. 36. 22 mei 2013 34
  37. 37. 22 mei 2013 35 OPSPM DEV QA
  38. 38. 22 mei 2013 36 6 Yvonne guarantees test coverage over multiple iOS devices and OS versions
  39. 39. 22 mei 2013 37
  40. 40. 22 mei 2013 38 Technique Framework Infra. KIF Frank
  41. 41. 39 Use the cloud
  42. 42. 42 Use the crowd
  43. 43. 22 mei 2013 43 Technique Framework Infra. KIF Frank
  44. 44. 22 mei 2013 44 Technique Framework Infra.
  45. 45. 22 mei 2013 45 Picture creativity 7
  46. 46. Yvonne half a year later…. 22 mei 2013 46
  47. 47. Tweet aways Mobile testing 22 mei 2013 47 1 2 3 4 5 6 7 Exhaustive manual testing is impossible There is no silver bullet (yet) Mobile test automation eco-system = Technique, Framework and Infrastructure tools Structure your UIA code Continuous integration powerful enabler Test automation = team effort Yvonne guarantees test coverage over multiple iOS devices and OS versions
  48. 48. 22 mei 2013 48 @eddybruin @smaljaars #yvonne http://goo.gl/95Tvp Yvonne’s tale continues…

×