The document discusses test automation as a reliable and repeatable process for verifying application functionality without human intervention. It highlights the importance of building testable systems and the use of code to manage test automation effectively. It also emphasizes collaboration among team members in engineering roles to maintain a high-quality system that meets customer requirements.

1. Test Automation
By Tomas Riha

2. Tomas Riha
Delivery Engine Architect @ VGT/WirelessCar
Continuous Delivery as a Service
10 years+ Automating Everything

3. What is Test Automation
Automatically executed code that verifies an application in a
reliable, resilient, repeatable and fully automated way.

4. Reliable Test Automation
Always the same result.

5. Resilient Test Automation
Refactoring the Application does not break the Tests.

6. Repeatable Test Automation
The Test Automation can execute any number of times.

7. Automatically Executed Test Automation
No human interaction to prepare and start the Test Automation

8. Test Automation is Code
Any Automation is Code.

9. Test Automation is Verification
Test Automation verifies requirements or predefined behaviours.
Test Automation does not ensure that the requirements improve
the application.

10. What is Test Automation
Automatically executed code that verifies an application in a
reliable, resilient and repeatable way without any human
intervention.

11. How we used to Verify Systems
SYSTEM
Database
GUI/API
1. Do this
2. Verify GUI
3. Verify using
hook
4. Verify data
1 2
3
4

12. How many Test Automations go wrong
SYSTEM
Database
GUI/API
1. Do this
2. Verify GUI
3. Verify using
hook
4. Verify data
1 2
3
4
????????????????
????????????????
?????????????

13. Build Testable Systems
Internal
Service
GUI
Internal
Service
Internal
Service
API API API
System API

14. Build Testable Systems
Internal
Service
Internal
Service
Internal
Service
API API API

15. Service Test Automation
Internal
Service
Internal
Service
Internal
Service
API
API
API
API
Mock
API
Mock

16. System Integration Test Automation
Internal
Service
Internal
Service
Internal
Service
API API API
System API

17. GUI Test Automation
GUI
System API Mock

18. Test Pyramid
Service & GUI Tests
System Integration Tests
Unit Tests
Monitoring

19. Re-architect Legacy
SYSTEM
Database
GUI/API
Internal
Service
API

20. Test Automation Architecture
Internal
Service
API
API
Mock
API
Mock
DSL
Glue Code
Specification

21. Test Automation Implementation
API
DSL
Glue Code
Specification
Internal
Service
Given a vehicle with 10 trips that belongs to a fleet
When fleet manager requests trips.
Then 10 trips are returned
//Given glue code
Fleet fleet = Create.fleet();
Vehicle vehicle = Create.vehicle().withFleet(fleet);
for (int i = 0; i < 10; i++){
Create.trip().withDate(today).withVehicle(vehicle);
}
class Create {
public Trip trip() {
Trip trip;
//Implementation of REST call to internal service
return trip;
}
}

22. Setup Test Data
API
DSL
Glue Code
Specification
Internal
Service
Setup DSL
Service DSL
Teardown DSL
Generate Test Data with unique ids
on each execution through Setup
DSL and Service API.

23. Repeatable
API
DSL
Glue Code
Specification
Internal
Service
Given a vehicle with 10 trips that belongs to a fleet
When fleet manager requests trips.
Then 10 trips are returned
Given a vehicle with 10 trips that belongs to a fleet
When fleet manager requests trips.
Then 10 trips are returned
Given a vehicle with 10 trips that belongs to a fleet
When fleet manager requests trips.
Then 10 trips are returned
Given a vehicle with 10 trips that belongs to a fleet
When fleet manager requests trips.
Then 10 trips are returned
Given a vehicle with 10 trips that belongs to a fleet
When fleet manager requests trips.
Then 10 trips are returned
With Unique Generated Test Data any
number of tests can be executed in parallel.

24. Resilient
API
DSL
Glue Code
Specification
Internal
Service
Oracle
Given a vehicle with 10 trips that belongs to a fleet
When fleet manager requests trips.
Then 10 trips are returned
//Given glue code
Fleet fleet = Create.fleet();
Vehicle vehicle = Create.vehicle().withFleet(fleet);
for (int i = 0; i < 10; i++){
Create.trip().withDate(today).withVehicle(vehicle);
}
class Create {
public Trip trip() {
Trip trip;
//Implementation of REST call to internal service
return trip;
}
}
DynamoDB

25. Test Automation Architecture
Internal
Service
API
API
Mock
API
Mock
DSL
Glue Code
Specification
Executor
Trigger

26. Tools?
All Test Automation tools are bad some worse than others.
Test Automation is Code, code is best written in a IDE.

27. Test Suite Management
Refactor your tests often.
Optimize your Test Suites.
The Test Suite is either evolving or regressing.

28. Test Automation Everyone Does it or Don't do it!.
Architecture
Testability of System

29. Test Automation Everyone Does it or Don't do it!.
Test Architecture
Test Automation Application First Class Citizen

30. Test Automation Everyone Does it or Don't do it!.
Test Implementation
Is Code!

31. Test Automation Everyone Does it or Don't do it!.
Everyone Tests!
No more separation of duties!

32. The Team and the Individuals
Engineer in Test - Test Spec, Glue Code, DSL, Bug fixes, Backend Code
Engineer in Backend - Backend Code, Bug Fixes, Glue Code, DSL, Test Spec
Engineer in GUI Test - Test Spec, Glue Code, DSL, Bug fixes, GUI Code
Engineer in Frontend - GUI Code, Bug Fixes, Glue Code, DSL, Test Spec
Engineer in Infrastructure - Infrastructure Code, Bug Fixes, Glue Code, DSL, Test
Spec

33. Questions?
Just one more slide then please ask questions.

34. The Team and the Individuals
The Team delivers and maintains a high quality system that
fulfills the customer's requirements in a cost efficient and
responsible manner.

35. Questions?
Now please ask away!