Session at Advanced Developers Conference 2017

1. Veranstalter:
DevOps by examples
Part II – Feedback loop
Giulio Vian

2. This Session
100/200-level
Grasp the essentials of the DevOps approach.
(well …, some essentials)
Consider
Part I recording
“DevOps mit .NET Core” seminar
2

3. What we will talk about?
DevOps intro
Demos
Releasing Features
Monitoring
Understanding
Quality
Feedback
Wrap-up
3
OpsDev

4. About me
4

5. Most recent
project
2M users
40,000 RPS
2Gbps
5
© 2016 IMG Universe, LLC.
All Rights Reserved

6. Your turn
Azure
Visual Studio Team
Services (VSTS)
ASP.NET
Linux (Ubuntu)
Developers
Infra Engineers
Architects
Managers
6

7. «Appetizer»
7

8. DevOps is a product
8

9. DevOps is a job
9

10. Except for DevOps Leads…

11. DevOps is a culture, movement or practice
DevOps is a term used to refer to a set of practices that
emphasizes the collaboration and communication of
both software developers and other information-
technology (IT) professionals while automating the
process of software delivery and infrastructure changes.
DevOps represents a change in IT culture, focusing on rapid IT service delivery through the
adoption of agile, lean practices in the context of a system-oriented approach. DevOps
emphasizes people (and culture), and seeks to improve collaboration between operations and
development teams. DevOps implementations utilize technology — especially automation tools
that can leverage an increasingly programmable and dynamic infrastructure from a life cycle
perspective.
DevOps is the union of people, process, and products to
enable continuous delivery of value to our end users.
Wikipedia (2017)
Gartner
Microsoft (Donovan Brown)
11

12. The Handbook says
DevOps is the result of
applying Lean principles to
the technology value
stream

13. Illustration © David Schmidt 1992
Experiment
Learn
Dev
Flow
Feedback
Ops

14. It’s all about Value
14
Source: Felice Pescatore
Value
Collaboration
Agile Development
Continous Integration
Continous Delivery
DevOps

15. «Main course»
What? Features
Where? Monitoring
How? Improving
15

16. Deploy – Comments
Category
Dev / QA / Prod
Target-bound
Release cadence
Feature toggles
16

17. Feature Toggles
Basic Feature Toggle
17

18. Feature Toggles – Comments
Release Toggles
Business owned
Transitionary
Experiment Toggles
Business / dev owned
Transitionary
Ops Toggles
Dev / Ops owned
Short / long-lived
Permissioning Toggles
Business / dev owned
Long-lived
Source: Pete Hodgson

19. Feature Toggles
Management using Launch Darkly
19

20. …keep track

21. Application Monitoring
Errors
Performance
Availability
Scalability
Analytics
App Insight
HockeyApp
ELK
ElasticSearch+LogStash+Kibana
Splunk
BugSense
Fabric
Firebase
New Relic
…
21

22. Monitoring
Application Insight
22

23. Monitoring – Comments
All layers and tiers
Business metrics
Business metrics
Business metrics
23

24. Alerting
Transients
e.g. cold caches
Trends

25. Understanding
AppInsight Analytics
25

26. Troubleshooting & Feedback loop
Access to production
Read-only
Debug
Sensitive production data
Design/architecture
Quality of data
Those Precious PDBs
26

27. Quality Control
Static Code Analysis
Penetration tests
Compliance checks
Performance tests
SonarQube
WhiteSource
Gauntlt
OWASP Zed Attack Proxy (ZAP)
HPE Security Fortify
FOSSology
Black Duck
VSTS Cloud Load Testing
BlazeMeter
27

28. Information Radiance
Link Business to Ops
Features to Releases
Releases to Metrics
Visible places
AppInsight
Kibana
Grafana
28

29. Visualisations

30. Visualisations (cont’d)

31. CD pipeline Metrics
Work in Progress
Throughput
Lead Time
𝐿 = 𝜆𝑊

32. «Dessert»
32

33. Teamwork
33

34. Automation
(Photo: Alexander Dummer)
34

35. Resources
35
(Photo: Elya)

36. Bibliografy & References
https://github.com/giuliov/DevOps-by-examples
http://www.slideshare.net/giuliov/presentations
http://martinfowler.com/articles/feature-toggles.html
https://leanpub.com/build
https://launchdarkly.com/
http://agilemanifesto.org/
https://azure.microsoft.com/en-us/services/application-insights/
https://github.com/tfsaggregator/tfsaggregator
https://github.com/aspnet
https://azure.microsoft.com/en-us/services/key-vault/
https://aws.amazon.com/kms/
https://blogs.msdn.microsoft.com/buckh/2016/09/30/controlling-exposure-through-feature-flags-in-vs-
team-services/
36

37. To know more
Continuous Delivery: Reliable Software
Releases through Build, Test, and
Deployment Automation — J.Humble,
D.Farley (Addison-Wesley)
https://www.amazon.com/Continuous-
Delivery/dp/0321601912/
The Phoenix Project — G.Kim, K.Behr,
G.Spafford (IT Revolution Press)
https://www.amazon.com/Phoenix-Project-
DevOps-Helping-Business/dp/0988262509/
37

38. To know more (cont’d)
The DevOps Handbook — G.Kim,
P.Debois, J.Willis, J.Humble (IT
Revolution Press)
https://www.amazon.com/DevOps-
Handbook-World-Class-Reliability-
Organizations/dp/1942788002/
DevOps on the Microsoft Stack —
Wouter de Kort (Apress)
https://www.amazon.com/DevOps-
Microsoft-Stack-Wouter-
Kort/dp/1484214471/
38

39. Call to action
39
(Photo: Francesco Canu)

40. Contacts
giulio@nolbej.com
@giulio_vian
http://blog.casavian.eu/

41. Veranstalter:
FRAGEN?

42. Veranstalter:
Vielen Dank!
Giulio Vian
Ich freue mich auf Ihr Feedback!