The document discusses the importance of quality assurance (QA) in production environments. It notes that most production defects are surprises that result from assumptions being wrong. To address this, it advocates adopting practices like test-driven development, refactoring, continuous integration, automated deployment, and infrastructure as code to help prevent defects. It also stresses the importance of monitoring metrics and logs in production to detect issues and being able to quickly fix any problems that arise.

1. Fail be(er.
Learn from the real world with
QA in Production
Rouan Wilsenach
@rouanw
rouanw.github.io
. . .. . . . .

2. Zero produc1on
defects.

3. Most produc1on
defects are surprises.

4. What you thought you
knew was wrong.

5. http://wiki.c2.com/?ExponentialCostCurve

6. Fla(en the curve.
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯

7. TDD
Refactoring
Continuous
integration
Pairing
Automated
deployment
Infrastructure
as code
Phoenix
servers
QA in
production
Agile engineering (XP) DevOps
https://techbeacon.com/devops/5-ways-cheat-software-change-curve-devops

8. Flaccid scrum.
https://martinfowler.com/bliki/FlaccidScrum.html
⇣

9. Try again. Fail again. Fail
be(er.
Samuel Beckett, 1983

10. https://martinfowler.com/articles/qa-in-production.html

11. Pay a(en1on to your
cri1cal success factors.
$$$

12. Talk to your humans.

13. Track metrics.
. . .. . . . .

14. Dashboards.

15. Alerts.

17. If you liked it, then you
should have put a
metric on it.
#BeyonceMonitoring
Dan Abel, 2016
@twicezer0

18. Simple start.
4s 500 0

19. Something a li(le
unexpected.

22. Playing detec1ve.

23. Logs.

24. Empty logs.
.

25. Audi1ng.
——————————>

27. Are your tests slowing
you down?

28. User interface tests.
....................................

29. Performance tests.
. . . . . ………..

30. Are you ready for QA in
Produc1on?

31. Yes, but…

32. How fast can you ship a
fix?
....................................

33. How fast do you need
to ship a fix?
.$$$$$$$$$$$$$$$$$$$$$$$$$$$$$$.....

34. Finding the right
balance.
....................................

35. No1ce.
Diagnose.
Respond.
↯
↯

36. TDD
Refactoring
Continuous
integration
Pairing
Automated
deployment
Infrastructure
as code
Phoenix
servers
QA in
production
Agile engineering (XP) DevOps
https://techbeacon.com/devops/5-ways-cheat-software-change-curve-devops

37. Fail be(er.
Learn from the real world with
QA in Production
Rouan Wilsenach
@rouanw
rouanw.github.io
. . .. . . . .