The document discusses continuous testing and the role of a tech lead in implementing it. It explains that continuous testing involves testing software continuously throughout development. To be a continuous testing expert, a tech lead should master different testing techniques, identify what code needs testing, set a testing culture, collect and analyze testing metrics, and use insights to improve processes. The document demonstrates continuous testing in action through an automated CI/CD workflow that runs unit, integration and other tests at different stages.

1. Continuous Testing
The new must-have skill of
tomorrow's tech leaders

2. Nadav Yeheskel
Agents Team Lead @ SeaLights
AT&T (Senior Developer, Instructor, Web Expert)
Any Technologies (Founder)
John Bryce (Instructor)
SRL & CV Trust (Developer, Tech Lead)

3. Agenda
The transition to Agile and Devops
Understand the changes that QA department is facing
What’s Continuous Testing and how tech leaders can
implement it
Learn about new metrics that you can use
Demo

4. The State of QA & DevOps
Continuous Delivery is becoming the de-facto standard

5. The Industry’s Reaction
Organizational People Skills Tools Practices Communication
Now that the hysteria has passed

6. The Future of QA
Continuous Integration
How we build software
Continuous Deployment
How we deploy software
Continuous Testing
How we test software
Continuous Delivery

7. Continuous Testing to The Rescue
“Testing is a cross functional activity that involves the
whole team, and should be done continuously from the
beginning of the project”
- Continuous Delivery, Jez Humble & Dave Farley

8. Continuous Delivery
Increase quality while increasing speed
CI + CT + CD

9. The Long: Leading a development team is no easy task.
An effective Tech Lead establishes a technical vision with
the development team and works with developers to
turn it into reality.
Tech Leader - Definition
The Short: A Tech Lead is a developer who is
responsible for leading a development team.

10. Becoming a Continuous Testing Expert
● Master testing types and techniques
● Identify which sections of the code should be tested and how
● Set the culture of the team and train them (Ongoing)
● Have tools and supporting processes
○ Collect & aggregate meaningful data
○ Analyze the data and create insights
○ Use the insights (internal processes)
○‫פ‬R
In order for a Tech Lead to become a Continuous Testing
Expert, one should:

11. Automated Unit Tests
Automated Component Tests
Automated Integration Tests
Automated API Tests
Automated
GUI Tests
Manual
Based Testing
Testing Techniques and the Test Pyramid
Where you are
today
What you think
you need
Where you
should be

12. "When you can measure what you are speaking about,
and can express it in numbers, you know something
about it."
- Lord Kelvin

13. Understand what is causing quality to
decrease when speed is increased
Data Collection

14. Understanding Your Test Quality
How do you measure end-
to-end test quality?

15. Green is Not Enough
How do you know if tests
were skipped or missed?

16. Quality Risks
How do you stop untested code
changes from reaching production?

17. Centralized Quality Dashboard
How do you collect quality
metrics across environments and
tools?

18. Find / develop a solution for the
identified root cause problems

19. Real Code Coverage
Unit Integration Functional UI API Exploratory

20. Our Technical Stack
1. Node.js, Java, .NET, JavaScript, and Python
2. Microservices architecture, Mongo DB
3. CI: Jenkins
4. SCM: Github
5. Test automation frameworks: Mocha, TestNG, JUnit, NUnit and Py.test
6. Infrastructure: AWS
7. CD: homegrown

21. Let’s see some Continuous
Testing in Action...
Demo

22. Our Process
Our CI/CD Workflow
1. Pull request
2. Build + unit test
3. Verify that all tests passed, no decrease in coverage, and no quality risks
4. Integration build
5. Setup and deploy build to integration lab (AWS)
6. Run integration tests
7. Verify that all tests passed, no decrease in coverage, and no quality risks
8. Ready for production » Deploy

23. Q&A

24. Contact Me
Nadav Yeheskel
nadavye
nadav@sealights.io
www.sealights.io/blog

25. References
The Day the QA Department Died
https://www.infoq.com/articles/day-qa-dept-died
The Definition of a Tech Lead
https://www.thekua.com/atwork/2014/11/the-definition-of-a-tech-lead/
Technical Leadership: The Often Overlooked Skills and Responsibilities of a Technical
Team Leader
https://www.infoq.com/articles/technical-leadership-overseen
Diffy (Twitter’s API testing tool)
https://blog.twitter.com/engineering/en_us/a/2015/diffy-testing-services-without-
writing-tests.html
How Solid Are Your Tests - Mutation Testing by the awesome Dror Arazi
https://www.sealights.io/resources/solid-tests-mutation-testing-action-recording/