This document discusses the challenges and lessons learned from running the same infrastructure platform across multiple enterprise environments. Some challenges included organizational structure differences, technical choices, and technology dependencies between enterprises. Solutions involved using Ansible for abstraction, user-configurable machine images and environments, feature flags, and a modular codebase. The goal is to scale the solutions to more projects and resolve infrastructure issues for multiple enterprises.

1. Lessons from the Trenches
HOWTOFITANINFRASTRUCTUREPLATFORM
INTOMULTIPLEENTERPRISEENVIRONMENTS
CLIFFANO SUBAGIO - SHINE SOLUTIONS

2. ABOUTME
- Started working with cloud infrastructure in 2014
- Started working with a particular enterprise CMS in 2014
- Started drinking coffee in 2014

3. TODAY’SAGENDA
1. What’s with the beavers?
2. The challenges with multiple enterprises
3. Solving the problems, learning the lessons
4. Scaling for the future

4. 1.
BEAVERSAREAWESOMEENGINEERS!

5. IMAGINEBUILDING850METERSOFBEAVERSDAM

6. GRANDTETON
ALPINEMEADOWS
JÄMTLAND

7. IMAGINE
BUILDING
THIS
PLATFORM
(AOC)

8. CANWERUNTHESAMEPLATFORM
ATMULTIPLEENTERPRISES?

9. ONEDOESNOTSIMPLYENTERPRISE…

10. SPOILERALERT:YES!
SAMEPLATFORM,RUNNINGATMULTIPLEENTERPRISES
2014 2015 20202019201820182017
MULTI-REGION
AOC

11. 2.
KEEPCALM
ANDSOLVETHECHALLENGES

12. TYPESOFCHALLENGES
B.TECHNICALCHOICES
C.TECHNOLOGYDEPENDENCIES
A.ORGANISATIONALSTRUCTURE

13. TYPESOFCHALLENGES
B.TECHNICALCHOICES
C.TECHNOLOGYDEPENDENCIES
A.ORGANISATIONALSTRUCTURE

14. PRODUCTIONSUPPORT
TRADITIONALOPS >> SRE
OUTSOURCEDDEVOPS
IN-HOUSEDEVOPS

15. DISASTERRECOVERYTESTING
ANNUAL-TRADITIONALDRTEST
EVERY6MONTHS-AUTOMATION
AUTOMATIONFOCUSED

16. TYPESOFCHALLENGES
B.TECHNICALCHOICES
C.TECHNOLOGYDEPENDENCIES
A.ORGANISATIONALSTRUCTURE

17. CLOUDSETUP
MINIMALPUBLICSUBNET-CDN
MINIMALPUBLICSUBNET-CENTRALACCT
NOPUBLICSUBNET

18. TOOLSOFCHOICE

19. TYPESOFCHALLENGES
B.TECHNICALCHOICES
C.TECHNOLOGYDEPENDENCIES
A.ORGANISATIONALSTRUCTURE

20. OPERATINGSYSTEMS
RHEL6.5 >> RHEL7
AMZ1 >> AMZ2
RHEL6 >> RHEL7 >> RHEL8

21. MAJORUPGRADESWITHBREAKINGCHANGES
PUPPET4 >> PUPPET5
PYTHON2.7 >> PYTHON3.0
RUBY1.8 >> RUBY2.0

22. ONEDOESNOTSIMPLYENTERPRISE…

23. 3.
LESSONSANDSOLUTIONSFROMTHETRENCHES

24. ANSIBLETOTHERESCUE
TECHSTACKABSTRACTIONLAYER
OPS-FRIENDLY,PYTHONBASED
DECENTCONFIGURATIONSUPPORT

25. TECHSTACKABSTRACTIONLAYER?
PUPPETMODULEDEPRECATION
BOTO >> PACKER
CLOUDFORMATION >> CDK

26. USERCONFIGURATIONS
DEFAULT
PLATFORM +
CONFIG
USER
CONFIG
USER
CONFIG
USER
CONFIG
RHEL7+CMS6.3
RHEL7+CMS6.4
AMZ2+CMS6.5

27. FEATUREFLAGS
USERWHITELIST:SECRETSMANAGER,IAM
COMMONAWSAGENTS:CWLOGS,CWMETRIC,SSM

28. MACHINEIMAGEPLUGINS
INTERNALRHEL7SOEAMI
PRE-STEP:DONOTHING
INSTALLCMS
POST-STEP:PROVISIONSCRIPTS
CMSAMIREADY
MARKETPLACEAMZ2AMI
PRE-STEP:INSTALLNEWRELIC
INSTALLCMS
POST-STEP:DONOTHING
CMSAMIREADY

29. ENVIRONMENTPLUGINS
CMSAMI
PRE-STEP:DONOTHING
CONFIGUREANDSTARTCMS
POST-STEP:PROVISIONSCRIPTS
ENVIRONMENTREADY
CMSAMI
PRE-STEP:CONFIGURENEWRELIC
CONFIGUREANDSTARTCMS
POST-STEP:DONOTHING
ENVIRONMENTREADY

30. UPGRADEPATH
AOC1 AOC2 AOC3 AOC4
USER
CONFIG
USER
PLUGINS
USER
CONFIG
USER
PLUGINS

31. MODULARCODEBASE

32. CONVINCETHEUSERSBYPROVIDINGVALUE
COSTSAVINGMEASURES
CISBENCHMARK
PLATFORMTESTAUTOMATIONPIPELINES

33. SOMETIMESYOUHAVETOSAYNO
LET’SUSEDOCKERINSTEAD!
CANYOURUNITONKUBERNETES?
WHYDON’TYOUREPLACEPUPPETWITHANSIBLE?

34. MISSIONACCOMPLISHED
2014 2015 20202019201820182017

35. 4.
WHAT’SNEXTAFTERTHEBEAVERSDAM?

36. TIMETOSCALE
BUILDMORESOLUTIONSTHATSCALETOMULTIPLEENTERPRISES
NEXTUP:THESHINEWORKS
APPLYTHELESSONSTOMOREPROJECTS

37. THANKYOU
ANYQUESTION?

38. - https://www.flickr.com/photos/
glaciernps/47593489151/
- https://www.dkfindout.com/us/animals-
and-nature/rodents/beavers/
- https://www.flickr.com/photos/
grandtetonnps/40351397350/
- https://en.wikipedia.org/wiki/
File:BeaverDam_8409.jpg
- https://en.wikipedia.org/wiki/
File:Beaver_dam_J%C3%A4mtland.JPG
- https://www.meme-arsenal.com/
memes/
78e9f6c8f38c6259098ade30b37de351
.jpg
RESOURCES