2013 Automated Mobile Testing on Android and iOS. How to save money in your QA department. Use CI for mobile!

1. Automated Mobile Testing

2. Over Tjerk
●
●
○
●
●
●

3. Inhoud
●
●
●
●
●

4. Het doel

5. Het doel

6. Het doel

7. Het doel

8. Testen in het
algemeen

9. The Testing Cloud
Usability
A/B Testing
Performance
Functional
Regression
Acceptance
Testing
Unit Testing
Compatibility
BlackBox
Testing
UI Testing
Automated
Beta Testing
Manual
Integration Testing
System
Testing
Whitebox
Testing
Security
Crowd
Testing

10. Usability
A/B Testing
Performance
Functional
Regression
Acceptance
Testing
Unit Testing
Compatibility
BlackBox
Testing
UI Testing
Automated
Beta Testing
Manual
Integration Testing
System
Testing
Whitebox
Testing
Security
Crowd
Testing
Niveaus van testen

11. Usability
A/B Testing
Performance
Functional
Regression
Acceptance
Testing
Unit Testing
Compatibility
BlackBox
Testing
UI Testing
Automated
Beta Testing
Manual
Integration Testing
System
Testing
Whitebox
Testing
Security
Crowd
Testing
Testmethodes

12. Usability
A/B Testing
Performance
Functional
Regression
Acceptance
Testing
Unit Testing
Compatibility
BlackBox
Testing
UI Testing
Automated
Beta Testing
Manual
Integration Testing
System
Testing
Whitebox
Testing
Security
Crowd
Testing
Doelen van testen

13. Usability
A/B Testing
Performance
Regression
Acceptance
Testing
Unit Testing
Compatibility
UI Testing
Beta Testing
Manual
Integration Testing
System
Testing
Whitebox
Testing
Security
Crowd
Testing
Automated
BlackBox
Testing
Functional
Deze presentatie

14. Automated Testing is niet genoeg!
●
●
●
●
●
●
●

15. Automated Testing

16. Handmatig testen
Test
Scenario
Tester Test
Result
Requirements
DeviceAppSource
Code

17. Automated Testing
Test Code
Test
Result
Requirements
DeviceAppSource
Code
TestApp
Tools /
Instrumentation
Test
Scenario

18. Automated Testing
Scenario's (BDD)
Given I did not enter any credentials
When I click login
Then an error should be shown
Given I did enter an email as "aabb.com"
When I click login
Then an error should be shown

19. Testing & Continous Integration
Of:
Hudson
Travis
Buildbot
etc...

20. Parrallel testing

21. Battle fragmentation

22. Let's take this to the next level

23. Testen in de Cloud
Automatic scaling using IaaS
(Infrastructure as a Service)

24. Testen op Android

25. Android versies

26. Android Screens
● Verschillende resoluties
● Verschillende schermgrootten

27. Android Screens

28. Android Developer Tools
●
○
●
○
●
○
○
●
○

29. Voorbeeld App

30. Monkey Testing
●
adb shell monkey -p <app-package> -v <number-of-events>

31. Android Testing Overview
●
○
●
○
○
○
○
adb shell am instrument-w
<app-package>/android.test.InstrumentationTestRunner

32. Robotium Library
●
●
●
●
●
https://code.google.com/p/robotium/

33. Test Scenarios 1/2
●
Given I did not enter any credentials
When I click login
Then An error should be shown on the email address field

34. Test Scenarios 2/2
●
Given I enter an email addres of "aabb.com"
When I click login
Then An error should be shown on the email address field

35. Live Demo
●

36. Robolectric
●
●
○
●
http://pivotal.github.com/robolectric/

37. Online Testing Grids
●
●

38. Testdroid

39. Testen op iOS

40. iOS Developer Tools
●
●
○
●

41. Apple's Framework: UI Automation
●
●
●
●

42. Andere Testing Frameworks
●
○
○
●
○
○
○
■
●
○
○
Gebruikt ongedocumenteerde Apple APIs!

43. Testen met Frank
Scenario: prompted to log in
Given I am on the home screne
But I am not logged in
When I tap the Friends button
Then I should be on the login screen

44. Testen met Frank
When /^I tap the Friends button$/ do
touch("button marked:'Friends'")
end

45. Samengevat
●
●
●
●
●
●

46. 100 devices * 6 scenario's
* 2 talen * 20 minuten =
400 uur!

47. Vragen?