Here are the slides from Michael Stahnke's PuppetConf 2016 presentation called Testing and Delivering Puppet. Watch the videos at https://www.youtube.com/playlist?list=PLV86BgbREluVjwwt-9UL8u2Uy8xnzpIqa

1. @stahnma
Testing and Delivering Puppet
Michael Stahnke | Director of Engineering | @stahnma

2. @stahnma
Drawn Title Slide

3. Michael Stahnke
Puppet, Inc
Director of Engineering
@stahnma

4. @stahnma
Building and Testing Puppet
What are we doing and Why are we doing it?
@stahnma

5. @stahnma
We have a CI system
@stahnma

6. @stahnma@stahnma

7. @stahnma

8. @stahnma

9. @stahnma

10. @stahnma
Definition of history
@stahnma

11. @stahnma

12. @stahnma
How is Pe formed?
@stahnma

13. @stahnma@stahnma

14. @stahnma@stahnma

15. @stahnma
We were excited about
500 builds a week
shipping 3 times a week
new platforms
@stahnma

16. @stahnma
Composition
@stahnma

17. @stahnma
Growing jenkins

18. @stahnma

19. @stahnma
30-40% failure rate
@stahnma

20. @stahnma
Digging into failures
@stahnma

21. @stahnma
v

22. @stahnma
Failures are still valid
@stahnma

23. @stahnma
Errors are not
@stahnma

24. @stahnma

25. @stahnma@stahnma

26. @stahnma@stahnma

27. @stahnma@stahnma

28. @stahnma
Build our own tools
@stahnma

29. @stahnma
List of tools we’ve built

30. @stahnma

31. @stahnma
Dont’ forget JJB
@stahnma

32. @stahnma

33. @stahnma
Study through observation and
experiment
What are we doing?
@stahnma

34. @stahnma
The scientific method
@stahnma

35. @stahnma
The hypothesis
@stahnma

36. @stahnma
The experiment
@stahnma

37. @stahnma

38. @stahnma
The Goal
Developer must be able to make a small change and
measure it without intervention

39. @stahnma
A commit
@stahnma

40. @stahnma
What’s the required path?
@stahnma

41. @stahnma@stahnma

42. @stahnma
Review a change

43. @stahnma

44. @stahnma

45. @stahnma
The build Process
@stahnma

46. @stahnma
Fetch Sources
@stahnma

47. @stahnma
Patch thing if applicable
@stahnma

48. @stahnma
Build all components
@stahnma

49. @stahnma
Place components into an All in
One Package
@stahnma

50. @stahnma

52. @stahnma

53. @stahnma

54. @stahnma@stahnma

55. @stahnma@stahnma

56. @stahnma@stahnma

57. @stahnma

59. @stahnma
The Component Process
@stahnma

60. @stahnma
The Composite Process

61. @stahnma@stahnma

62. @stahnma
The Control
@stahnma

63. @stahnma
The variables
@stahnma

64. @stahnma
Small variable illustration
@stahnma

65. @stahnma@stahnma

66. @stahnma
Challenges of on premise
delivery
Cost of being wrong
user’s ability to update
multiple stream
upgrade matrix

67. @stahnma
Error rate vs Failure
@stahnma

68. @stahnma
Today’s constraints
@stahnma

69. @stahnma
2% error rate story
@stahnma

70. @stahnma
Capacity problems
@stahnma

71. @stahnma
Entry point onto the system

72. @stahnma@stahnma

73. @stahnma@stahnma

74. @stahnma
What’s next
@stahnma

75. @stahnma
Mesos
@stahnma

76. @stahnma
ABS

77. @stahnma
Run me maybe
@stahnma

78. @stahnma
Dont’ forget JJB
@stahnma

79. @stahnma
Job DSL
@stahnma

80. @stahnma
People organization
@stahnma

81. @stahnma
Goals for our Team
@stahnma

82. @stahnma
Sidebar
@stahnma

83. @stahnma
Tools and Sources Slide
@stahnma

84. @stahnma
New platform

85. @stahnma
Start building
@stahnma

86. @stahnma
Facter/ T&P
@stahnma

87. @stahnma
Workflow for shipment
@stahnma

88. @stahnma
https://gist.github.com/stahnma/5d07b2a61387ab81e1f66e8ea4a32ab4

89. Final Thoughts
● Puppet is difficult to build and test, but that’s what makes it fun
● We’ve learned a ton along the way, we’re still going
● New mistakes and lessons are indications of forward progress
● We build our own tools when we see fit, but prefer not to
● The system is our factory floor
● The system performs science
● The people make the system

90. @stahnma
`