The document summarizes a presentation on patterns of automation for simplifying test code. It discusses reasons to automate testing like allowing exploration of different browsers, devices and security aspects. It presents patterns like specification by example, acceptance test driven development, and using page objects. It emphasizes keeping test code clean and not automating more than needed.

1. T3
Test Automation
5/8/2014 9:45:00 AM
Patterns of Automation: Simplify
Your Test Code
Presented by:
Jeff Morgan
LeanDog
Brought to you by:
340 Corporate Way, Suite 300, Orange Park, FL 32073
888-268-8770 ∙ 904-278-0524 ∙ sqeinfo@sqe.com ∙ www.sqe.com

2. Jeff Morgan
LeanDog
Chief technology officer and a cofounder of LeanDog, Jeff “Cheezy” Morgan has been teaching
classes and coaching teams on agile and lean techniques since early 2004. Most of his work
has focused on the engineering practices used by developers and testers. For the past few
years Cheezy has experienced great success and recognition for his work focused on helping
teams adopt Acceptance Test Driven Development using Cucumber. He has authored several
popular Ruby gems used by software testers and the book Cucumber & Cheese-A Testers
Workshop.

3. Patterns of Automation
Jeff “Cheezy” Morgan
@chzy
cheezy@leandog.com

4. Copyright 2012 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Life is good

5. Why Automate?

11. Manual Testing (not ET)
1

12. Manual Testing (not ET)
1
1.5

13. Manual Testing (not ET)
1
1.5
2.2

14. Manual Testing (not ET)
1
1.5
2.2
3.0
4.0
5.3
6.4

15. Test What?

16. Test What?
• Functionality

17. Test What?
• Functionality
• Cross-Browser

18. Test What?
• Functionality
• Cross-Browser
• Responsive Design

19. Test What?
• Functionality
• Cross-Browser
• Responsive Design
• Mobile Devices

20. Test What?
• Functionality
• Cross-Browser
• Responsive Design
• Mobile Devices
• Security

21. Test What?
• Functionality
• Cross-Browser
• Responsive Design
• Mobile Devices
• Security
• Accessibility

22. Test What?
• Functionality
• Cross-Browser
• Responsive Design
• Mobile Devices
• Security
• Accessibility
• Load and Performance

23. Allows time to Explore
• Functionality
• Cross-Browser
• Responsive Design
• Mobile Devices
• Security
• Accessibility
• Load and Performance

24. What are Patterns?

25. Pattern
A pattern, apart from the term's use to mean
"Template"[a], is a discernible regularity in the world or
in a manmade design. As such, the elements of a
pattern repeat in a predictable manner.!
- Wikipedia

26. Specification by
Example

27. Development Artifacts
User Story
with
Acceptance
Criteria
Code
with
Unit
Tests
Automated
Tests
Specification Implementation Verification

28. Development Artifacts
User Story
with
Acceptance
Criteria
Code
with
Unit
Tests
Automated
Tests
Specification Implementation Verification
Duplication

30. Difference between
requirement and test
is data!

31. Addition Function

32. Addition Function
Requirement: Addition
equals
sum of numbers

33. Addition Function
Requirement: Addition
equals
sum of numbers
Examples:
3 + 4 = 7
3 + -1 = 2
etc.

34. Let’s see it!

35. Did you notice I never
said click or enter text?

36. Acceptance Test
Driven Development

37. Rework
Code Test
Story 1

38. Rework
Code Test
Code Test
Story 1
Story 2

39. Rework
Code Test
Story 1
Story 2
C
Story 1
Test
Code Test
Story 2
C

40. Rework
Code Test
Story 1
Story 2
C
Story 1
Test
Story 2
C
C
Story 1
Test
Code Test
Story 2
C

42. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Test Review Done
Product
Owner
Developer Tester

43. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Test Review Done
Product
Owner
Developer Tester

44. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Test Review Done
Product
Owner
Developer Tester

45. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Test Review Done
Product
Owner
Developer Tester

46. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Test Review Done
Product
Owner
Developer Tester

47. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Review Done
Product
Owner
Developer Tester

48. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Review Done
Product
Owner
Developer Tester

49. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Review Done
Product
Owner
Developer Tester

50. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Review Done
Product
Owner
Developer Tester

51. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Review Done
Product
Owner
Developer Tester

52. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Review Done
Product
Owner
Developer Tester
?

53. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Review Done
Product
Owner
Developer Tester

54. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Review Done
Product
Owner
Developer Tester

55. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Review Done
Product
Owner
Developer Tester

56. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Review Done
Product
Owner
Developer Tester
Done

57. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Review Done
Product
Owner
Developer Tester
Done

58. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Ready Development Review Done
Product
Owner
Developer Tester
Done Done

59. Code Test

60. Code
Test

61. Code
Test
Developer
Tester

62. Test Drive Code With Pair
Code
Test
Developer
Tester

63. Test Drive Code With Pair
Code
Test
Developer
Tester

64. Test Drive Code With Pair
Automate Acceptance Tests
Code
Test
Developer
Tester

65. Test Drive Code With Pair
Automate Acceptance Tests
Code
Test
Developer
Tester

66. Make Acceptance Tests Pass
Test Drive Code With Pair
Automate Acceptance Tests
Code
Test
Developer
Tester

67. Make Acceptance Tests Pass
Test Drive Code With Pair
Automate Acceptance Tests
Code
Test
Developer
Tester

68. Make Acceptance Tests Pass
Test Drive Code With Pair
Automate Acceptance Tests
Code
Test
Developer
Tester
Exploratory Testing

69. Make Acceptance Tests Pass
Test Drive Code With Pair
Automate Acceptance Tests
Code
Test
Developer
Tester
Exploratory Testing

70. Make Acceptance Tests Pass
Talk
Test Drive Code With Pair
Automate Acceptance Tests
Code
Test
Developer
Tester
Exploratory Testing

71. Make Acceptance Tests Pass
Talk
Test Drive Code With Pair
Automate Acceptance Tests
Code
Test
Developer
Tester
Exploratory Testing

72. Make Acceptance Tests Pass
Talk
Prevent Defects
Test Drive Code With Pair
Automate Acceptance Tests
Code
Test
Developer
Tester
Exploratory Testing

73. Make Acceptance Tests Pass
Talk Prevent Defects
Test Drive Code With Pair
Automate Acceptance Tests
Code
Test
Developer
Tester
Exploratory Testing

74. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Creation Elaboration Validation WIP
Product
Owner

75. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Creation Elaboration Validation WIP
Product
Owner
Tester

76. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Creation Elaboration Validation WIP
Product
Owner
Tester
Developer

77. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Creation Elaboration Validation WIP
Product
Owner
Tester
Developer

78. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
Creation Elaboration Validation WIP
Product
Owner
Tester
Developer
Progressive
Elaboration

79. Page Object

81. Tests break when
application changes
!
How easy to fix?

82. Learn from the
development community

83. Learn from the
development community

84. Let’s see it!

85. Default Data

86. A lot of Data

87. A lot of Data
Sorry Data, I don’t care
about most of you!

88. Let’s see it!

89. Test Data
Management

90. Why did you tests fail?
Did somebody mess with your data?

91. Test begins
Insert data
needed for
this test
Test
executes
Test removes
data
Best
Repeat for
next test

92. Test begins
Insert data
needed for
this test
Test
executes
Test removes
data
Best
Repeat for
next test
Another option
Insert all
data
necessary
for all tests
Execute all
tests
Remove all
data

93. Test begins
Insert data
needed for
this test
Test
executes
Test removes
data
Best
Repeat for
next test
Another option
Insert all
data
necessary
for all tests
Execute all
tests
Remove all
data
Yet another option
Recondition
data from
last test
execution
Execute all
tests

94. Do not repeat data
Do not repeat data
Do not repeat data
Do not repeat data
Do not repeat data
Do not repeat data
Do not repeat data

95. Route Navigation

96. Navigating routes is something
we do all the time

97. Let’s see it!

98. Above All
Keep the
code clean

99. And

100. Do not Automate
too much!

101. Copyright 2013 LeanDog, Inc. All Rights Reserved. Do not copy or distribute without permission.
cheezy@leandog.com
@chzy
Thank You