The document discusses the impact of DevOps on performance engineering, highlighting the need for a balance between delivering features quickly and addressing non-functional constraints. It emphasizes the importance of risk assessments over traditional performance testing while advocating for a shift towards automated testing frameworks that allow for better mentoring and long-term solutions. The author questions if modern methodologies have diminished focus on critical aspects like solution architecture, performance, and security engineering.

1. Performance Test
Automation Beyond
Frontier
Stijn SCHEPERS

2. SYMBOL OF MODERN ANXIETY

3. Dutch saying “Tomop withthetapopen”
Me

4. DevOps has not closed thetap

5. DevOps has not closed the tap
• With DevOps a Performance Engineer can achieve more & add more value:
Shift Left
Shift Right
Improved tooling (APM)
Silos broken down
Feedback loops
• Finally we can do our work!
Yeay!

6. DevOps has not closed thetap
• Issue of Self-Managing Scrum Teams
Delivering features with high velocity
With a focus on functionality
Non Functional Constraints are often secundary
• Performance Engineering is a specialised skill
How much knowledge can be transferred to the Scrum teams?
But !

7. So … How can we close thetap?
• We need to do LESS Performance Testing
& MORE Risk Assessments
Until MORE people know!
• If there is no WHY …
the HOW and the WHAT do not matter!

8. Agile TestingPyramid

9. FULLY AUTOMATED PERFORMANCE
TESTING INCLUDING RESULT ANALYSIS
Time & Effort
Time&Effort
RISK MITIGATION OF A
SOLUTION MUST BE
HOLISTICMentoring
and
coaching

10. Robotical AnaliticalFramework
My name is RAF.
I am an experiment.
My name is derived from
Robitical
Analytical
Framework.

11. Robotical AnaliticalFramework: GOAL
• Fully automated regression test (API)
• PASS / FAIL of a build
• Be more efficient so there is more time to do
Mentoring & Coaching
Build up a long term solution for engineering

12. R>A>F

13. R>A>F

22. Time for Reflection
• Do you feel that a performance engineer is
«mopping the floor with the tap open? »
• Has DevOps and Agile Methodologies reduced
the focus on Solution Architecture, Performance
and Security Engineering?
• What can we do to improve this?

23. RIGHT
THE SECRET OF CHANGE
IS TO FOCUS
ALL OF YOUR ENERGY,
NOT ON FIGHTING THE OLD,
BUT ON BUILDING THE NEW.
Socrates

25. Thank you