The Guardian publishes around 350 articles of content a day. Hardly 'big data'. We deal with barely 150 million users a month. Facebook (with it's 600 million users on mobile alone), we ain't. But we do have to serve the news, and we do have to serve it fast, accurately, and on time, across multiple platforms and devices. For a company that's 192 years old, we like to think we're pretty Agile. So what do our development teams care about? What kind of qualities are we optimising for in our software and processes? How do we make sure that when the news is breaking, our software isn't broken? Or if it is, how do we fix it fast?

1. Breaking
NEWS
Breaking
SOFTWARE
Andy Hume
SyncConf, 2013

2. Breaking
NEWS
Breaking
SOFTWARE
Andy Hume
SyncConf, 2013

3. Breaking
PLANES?
http://www.youtube.com/watch?v=Ai2HmvAXcU0

4. Breaking
PLANES?
http://www.youtube.com/watch?v=Ai2HmvAXcU0

5. Why so happy?
http://www.youtube.com/watch?v=Ai2HmvAXcU0

6. Breaking
WEBSITES

7. Breaking
WEBSITES

8. Process
http://www.flickr.com/photos/disinfeqt/7908154990/

9. Text

11. THE ARCHITECTURE
Guardian APIs
EC2 / ELB / S3 / Cloudformation
Scala / Play 2
AMD JavaScript / requirejs / LESS

12. THE TEAM
6 Developers (2 client-side)
1 QA
1 Product Manager
(me)

13. CONTINUOUS DEPLOYMENT
METRICS MONITORING
FAILING

14. Continuous deployment
http://www.flickr.com/photos/spacemanbob/1084139169/

15. Continuous deployment
http://www.flickr.com/photos/spacemanbob/1084139169/

16. I think somethings awry ... the graph is
implying that there have been about 100
deploys in 17 days.
Michael, Operations Manager
Those graphs don't lie.
Matt, Development Lead

17. WORKFLOW
Github
http://github.com/guardian/frontend

18. Pull request
https://github.com/guardian/frontend/pull/388

19. Pull request
https://github.com/guardian/frontend/pull/388

20. Pull request
https://github.com/guardian/frontend/pull/388

21. Pull request
https://github.com/guardian/frontend/pull/388

22. Pull request
https://github.com/guardian/frontend/pull/388

23. Pull request
https://github.com/guardian/frontend/pull/388

24. CONTINUOUS
INTEGRATION
RUNS THE BUILD
RUNS UNIT TESTS
RUNS INTEGRATION TESTS
DEPLOYS TO STAGE

25. CONTINUOUS
INTEGRATION
RUNS THE BUILD
RUNS UNIT TESTS
RUNS INTEGRATION TESTS
DEPLOYS TO STAGE

26. CONTINUOUS
INTEGRATION
RUNS THE BUILD
RUNS UNIT TESTS
RUNS INTEGRATION TESTS
DEPLOYS TO STAGE

27. CONTINUOUS
INTEGRATION
RUNS THE BUILD
RUNS UNIT TESTS
RUNS INTEGRATION TESTS
DEPLOYS TO STAGE

28. CONTINUOUS
INTEGRATION
RUNS THE BUILD
RUNS UNIT TESTS
RUNS INTEGRATION TESTS
DEPLOYS TO STAGE

29. CONTINUOUS
INTEGRATION
RUNS THE BUILD
RUNS UNIT TESTS
RUNS INTEGRATION TESTS
DEPLOYS TO STAGE

30. DEPLOY TO
PRODUCTION
SANITY CHECK
SOME QA REGRESSION TESTS
PERFORMANCE TESTS
DEPLOY TO PROD

31. DEPLOY TO
PRODUCTION
SANITY CHECK
SOME QA REGRESSION TESTS ?
PERFORMANCE TESTS
DEPLOY TO PROD

32. DEPLOY TO
PRODUCTION
SANITY CHECK
SOME QA REGRESSION TESTS ?
PERFORMANCE TESTS?
TESTS
DEPLOY TO PROD

33. DEPLOY TO
PRODUCTION
SANITY CHECK
SOME QA REGRESSION TESTS ?
PERFORMANCE TESTS?
TESTS
DEPLOY TO PROD

34. EMPOWERMENT
ADD VALUE
TAKE OWNERSHIP
Continuous deployment
http://www.flickr.com/photos/spacemanbob/1084139169/

35. Metrics monitoring
http://www.flickr.com/photos/kayaker1204/4319542459/

36. Metrics monitoring
http://www.flickr.com/photos/kayaker1204/4319542459/

37. “If it moves, graph it”
http://www.flickr.com/photos/kayaker1204/4319542459/

38. Real time performance

39. Real time performance

40. Real time performance

41. Real time performance

42. FIREFOX LOAD
CHROME LOAD

43. GANGLIA METRICS

45. REAL USER METRICS
(RUM)

46. Metrics monitoring
http://www.flickr.com/photos/kayaker1204/4319542459/

47. Failing
http://www.flickr.com/photos/spacemanbob/1084139169/

48. Failing
http://www.flickr.com/photos/spacemanbob/1084139169/

49. RESILIENCE
VS
RELIABILITY

51. Uptime is not binary
Mike Brittain, Etsy

56. USER READING NEWS
SCALA WEB APP
SOULMATES API CONTENT API ZEITGEIST

57. USER READING NEWS
SCALA WEB APP
SOULMATES API CONTENT API ZEITGEIST

59. USER READING NEWS
SCALA WEB APP
SOULMATES API CONTENT API ZEITGEIST

60. USER READING NEWS
SCALA WEB APP
SOULMATES API CONTENT API ZEITGEIST

62. USER READING NEWS
SCALA WEB APP
SOULMATES API CONTENT API ZEITGEIST

63. USER READING NEWS
SCALA WEB APP
SOULMATES API CONTENT API ZEITGEIST

64. USER READING NEWS
CACHE
SCALA WEB APP
SOULMATES API CONTENT API ZEITGEIST

65. GOOGLE PAGE SPEED

66. GOOGLE PAGE SPEED

67. GOOGLE PAGE SPEED
DOMContentReady event

68. GOOGLE PAGE SPEED
DOMContentReady event Load event

69. GOOGLE PAGE SPEED
DOMContentReady event Load event
P1

70. GOOGLE PAGE SPEED
DOMContentReady event Load event
P1 P2

71. GOOGLE PAGE SPEED
DOMContentReady event Load event
P1 P2 P3

72. CONTINUOUS DEPLOYMENT
METRICS MONITORING
FAILING

73. CONTINUOUS DEPLOYMENT
METRICS MONITORING
FAILING

74. CONTINUOUS DEPLOYMENT
METRICS MONITORING
FAILING

75. CONTINUOUS DEPLOYMENT
METRICS MONITORING
FAILING

76. Thank-you!
http://lanyrd.com/sccxwy
@andyhume
Creative Commons Licensed
cc Attribution, Non-Commercial, Share Alike

77. STUFF
AWS AWS Cloudformation
Scala/Play Framework
Github
Hudson
Jenkins
Ganglia
Graphite
Alerta
Google Page Speed Insights
Webpagetest
Varnish