UP2IT 2017, DEV&QA Stream 1 Денис Литвиненко, QA Lead, MindK (Суми) "Піраміда автоматизації в Continuous Integration"

1. Automation pyramid
within CI process

2. Denys Lytvynenko
● 5+ years of experience in QA
● 4+ years in Test Automation
from scripts to test automation frameworks development
● QA Lead in MindK company

3. Nice to meet you!
Now it's your turn!

4. Why do we need test automation?
● “We should reduce testing time!”
● “There are a lot of bugs, autotests
will find all of them.”
● “Please, automate this scope for me
and I will run it next release by
myself.” © Client

5. When test automation is needed?
Routine tasks
○ Test data preparation
○ Stability testing (continuous monitoring)
○ Migration testing
Only automation can do this job
○ Performance testing
○ Penetration testing
○ Too many combination of input
parameters in complicated logic
Functional testing
○ No time for regression testing when
small changes are made to the system
○ More efficient testing
That's when automated testing can be
introduced, given that robots don't get
bored!

6. Basic principles
● The test cases have to be easily
maintainable, if not, the accumulation
cannot be carried out efficiently.
● The best tests to automate are the ones
which are quite repetitive
● The value of tests comes from the
information that it provides
ROI = Net Profit / Total Investment * 100

7. Ideal test automation pyramid
WHEN MOST OF OUR EFFORTS ARE FOCUSED ON AUTOMATION AT THE UI LEVEL, THE FOCUS IS ON
FINDING BUGS, WHEREAS, WITH THE AGILE PYRAMID, THE IDEA IS TO PREVENT THEM.

8. Automation pyramid in CI process

9. CRM System (SaaS):
- User management
- Customer management
- Structures management
- Billing management
- Event management
- Communication managements
Case
Example

10. Case Example

11. Case example
Hours for Testing Hours for Automation Hours for Manual
Testing
ROI Found bugs
Regression During
Release 2
1000 150 100
5%66%

12. Questions?