This document discusses using a tool called "git ratchet" to automatically track and enforce performance metrics over time in continuous integration (CI) builds. It notes that static analysis is underused, introduces are hard, and regressions can be hard to detect. It then describes how git ratchet would measure performance metrics during CI builds, store the data in git notes, and fail builds if metrics increase over baseline values, helping to "ratchet up" performance and catch regressions early. Examples shown include tracking JSHint warnings and page weight over time. The document encourages providing feedback on git ratchet to further improve continuous integration and monitoring of performance measures.

1. Ratchet up your CI
IAN GRUNERT • SENIOR DEVELOPER • ATLASSIAN • @IANGRUNERT

2. GIT RATCHET
PROBLEMS
Ratchet up your CI
EXAMPLES

3. Static analysis is
criminally
underused

5. Introducing static
analysis is hard

6. JSHint warnings Any warnings?
Success!
Fail!

7. Confluence currently has
948JSHint warnings in the editor
alone

8. Chip away at the
problem

9. Team inadvertently
works against you

10. "Syzyfki (Sisyphers) Wroclaw dwarf 01" by Pnapora - Own work. Licensed under CC BY-SA 3.0 via Wikimedia Commons
http://commons.wikimedia.org/wiki/File:Syzyfki_(Sisyphers)_Wroclaw_dwarf_01.JPG#/media/File:Syzyfki_(Sisyphers)_Wroclaw_dwarf_01.JPG

11. Performance
regressions are
often small

12. 7%
9%
22%
Page Weight By Plugin

13. Regressions get lost
in the error bars

14. 0
6
12
18
24
Q1 Q2 Q3 Q4
(Example) Performance over time

15. Performance
baselining is too
manual

16. GIT RATCHET
PROBLEMS
Ratchet up your CI
EXAMPLES

18. A tool to ratchet
measures

19. Measure input git ratchet
Success!
git repo
Fail!

20. No need for a
storage server

21. Data with your
code in git-notes

23. /refs/heads/master
README.md
# git-ratchet
git-ratchet is a tool for building ratcheted
builds. Ratcheted builds are builds that go
*red* when a given measure increases.
Tree

24. /refs/heads/master /refs/notes/git-ratchet
/2c/58802de…
Note

25. Full history of data
over time

27. GIT RATCHET
PROBLEMS
Ratchet up your CI
EXAMPLES

28. JSHint warnings git ratchet
Success!
git repo
Fail!

30. Convert CSV git ratchet
Success!
git repo
Fail!
Page Weight

31. Excuses!

32. Lots of possibilities!

33. gitratchet.org
IAN GRUNERT • SENIOR DEVELOPER • ATLASSIAN • @IANGRUNERT

34. Ratchet up your CI
Submit your feedback:
go.atlassian.com/acratchetci