I presented this at CocoaConf on 10.26.12. The Trifecta provides an easy-to-use framework for scripting your test cases and organizing your functions and test suites using XCode Instruments. http://cocoaconf.com/speaker/viewDetails/59 Questions and feedback are welcomed. @blackstonefinn

1. iOS Automation:
The Trifecta
Elizabeth Taylor
Staff QA Engineer, Digimarc Corp.
@blackstonefinn

2. Agenda
• Introduction
• Why automate
• What to automate
• How to automate using Xcode Instruments
• The Trifecta
• Sample Code examples
• Demo

4. Why Automate?
• Integration testing
• Catches bugs manual testing can miss
• Exploratory Testing
• Automation <3 Stress Tests!
• Tie it to build system for check-in
• Regression testing
• Fast < 10 min per functional area
• And most of all … it’s FUN J

5. What to automate?
• Ask…. is it BBB?
• Basic App Functionality
• Boring stuff – copy & legal
• “Break it” stuff – stress tests & bugs

6. Automation Framework
• Xcode > Developer Tool > Instruments
• Java Script API
• UI Automation Java Script Reference

7. Script Framework - Trifecta
1. Navigate Functions
2. Validate Functions
3. Test Suite

8. Script Framework - Trifecta
1. Navigate functions
• Identify UI Elements
• common navigation paths
• wrap functions
2. Validate functions
• UI element validation
• functional tests
• stress tests
3. Test Suite
• import libraries – navigate and validate
• list validate functions

9. Digimarc Discover UI

10. Digimarc Discover UI

11. Navigation Functions

12. Navigation Functions - Purpose
• Frequently used paths, actions
• Separate test setup v. feature test
• Contain iPhone v. iPad UI differences

13. Creating Nav Functions
1. ID App UI elements
2. Write functions - code, debug, code
3. Wrap functions

14. Creating Nav Functions
1. Identify UI elements
logElementTree();

15. ID UI Elements

16. Listen – UI Elements

17. Navigate Function - goToTab
• Frequently used paths, actions

18. Navigate Function - Back

19. ID UI Elements

20. Help UI Elements

21. Navigate Function – Tap Cell
• Separate test setup v. test logic

22. Logging
UIAlogger.logMessage(“Song Selected”);

23. Navigate Function – History List
• Contain iPhone v. iPad differences

24. Wrapping Functions
1. Readability of test script
2. Fix or change in one place

25. Target.delay(#)

26. Navigate Functions ctd.
1. Rotation
2. Set App state at end of test

27. Script Framework - Trifecta
ü Navigate functions
• Identify UI Elements
• common navigation paths
• wrap functions
2. Validate functions
• UI element validation
• functional tests
• stress tests
3. Test Suite
• import libraries – navigate and validate
• list validate functions

28. Validation Functions

29. Validation Functions - Purpose
1. Validate UI elements are correct
• Buttons, Headers
• Copy / Strings
• Images
2. Validate functionality
3. Stress tests

30. Validate – UI Elements

31. Validate - Listen UI Elements

32. Listen UI

33. Validate – Help UI Elements

34. Help UI

35. Logging
1. Make results easy to view
• Test name w/in each function
2. Create using Log Message
3. Pass fail logging
4. Screen shots
5. Output name of test

36. Validate – Feedback UI Elements

37. Submit Feedback

38. Validate – UI Elements
>

39. Validate Functions ctd.
1. Help –
• Submitting Feedback email
2. History –
• Payoff rendering in-app browser
• Sharing functionality
• Deleting history list items
3. Stress Tests

40. Stress Test Candidates
1. Repeated navigation across the app
2. Drilling down into nested views
3. Adding Rotation into the mix
4. Exit and returning to the application
5. Repeated item selection - history list*

41. Script Framework - Trifecta
ü Navigate functions
• Identify UI Elements
• common navigation paths
• wrap functions
ü Validate functions
• UI element validation
• functional tests
• stress tests
3. Test Suite
• import libraries – navigate and validate
• list validate functions

42. Test Suites

43. Test Suites
1. Import Navigation lib
2. Import Validation lib for area
3. Organize by functional areas*
4. Simple list of validation functions
5. Logging for output readability

44. Help - Test Suite

45. Help Test Suite Results

46. Script Framework - Trifecta
ü Navigate functions
• Identify UI Elements
• common navigation paths
• wrap functions
ü Validate functions
• UI element validation
• functional tests
• stress tests
ü Test Suite
• import libraries – navigate and validate
• list validate functions

47. Demo

48. Questions &
Feedback

49. Thank you!
@blackstonefinn