Using ES-Logger to retrieve pipeline data from Jenkins

1. Jon-Paul Sullivan
Interrogating Jenkins
Pipeline Analytics
April 2018

2. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
• What does this mean?
• Data in Jenkins
• Extracting Data
• Storing Data
• Analysing Data
• Dashboards!
Pipeline Analytics

3. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
• Jenkins is running Jobs
• Single deploy job to multiple environments
• Running tests against an environment
• Running tests against code
• Coverage
• All of the above create data
• Can you answer the following questions
• What test fails most in your pipeline
• What version last deployed to production
• The version before that?
What Are Pipeline Analytics

4. Jenkins is a Data Black Hole
https://commons.wikimedia.org/wiki/File:Black_Holes_-_Monsters_in_Space.jpg

8. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Steven Pinker, Psychologist
Cognitive psychology tells us that the unaided
human mind is vulnerable to many fallacies and
illusions because of its reliance on its memory
for vivid anecdotes rather than systematic
statistics.

9. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
• Direct Data
• Commit Data
• Build Data
• Test Data
• Deploy Data
• Indirect Data
• External Logs
• Infrastructure Data
• Reliability of Docker registry
• Reliability of Cloud service
Data in Jenkins

10. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
• Direct Data
• Use the Jenkins REST API
• Parse the console log
• Download artefacts from builds
• Indirect Data
• Download logs from servers pointed at by builds/tests
• Identify infrastructure touch points & failures
Extracting Data

11. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
• Put it into ElasticSearch
• Use Logstash
• Process the data as little as possible
• Create many events for a single job
• Events should mean something interesting
• A single test result
• A single failure to pull a docker image
Storing Data

12. https://netflixoss.ci.cloudbees.com/job/Lipstick-pull-requests/

13. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
• Search the Data
• Create Visualisations
• Create Dashboards
• Empirical evidence for service reliability
Analysing Data

14. © 2017 Cisco and/or its affiliates. All rights reserved. Cisco Confidential
Albert Einstein
If I can't picture it, I can't
understand it.

15. Dashboards!

21. https://github.com/CiscoDevNet/es-logger