How our team went from editing the configuration files "live" to full automation with Chef and how Terraform helped solve the same problems at the servers and services level Presentation given by Oleg Iasinovskyi at Wise TechTalks

1. Transition to
Infrastructure as Code
Oleg Iasinovskyi • 20.10.2018

2. Project
Marketplace for original
educational resources
● 5M active users
● 3M resources

3. Infrastructure
Cloud based on AWS
● 150+ self-managed servers
● 100+ servers as a service
● 20+ AWS services in use

4. Example case
+
API
SEARCH

5. Setup process
● Launch an EC2 instance
● Configure needed cloud parameters
● Install needed software
● Configure it
● Deploy application(s)

6. Setup process
● Configure application(s)
● Verify all(?) works fine
● Enable instance to serve traffic
● Hope you didn’t forget anything

7. Housekeeping
problem
● Deep understanding is required
● Mistakes may and will happen
● Setup takes 2 hours - 2 days

8. Housekeeping
problem
● How to get a server
------------------------
● How to configure it

9. Configuration management

10. Tool selection

11. Tool selection
● Popular tool
● Big community
● Available libs
● Centralized solution

12. Chef Example - Basics

13. Chef Example - Version parameter

14. Chef Example - Template

15. The command
$ knife bootstrap 59.10.20.30
--run-list 'role[api]'
--environment prod

16. The command
Starting Chef Client
* yum_package[vim] action install (up to date)
* yum_package[git] action install (up to date)
* yum_package[nginx] action install (up to date)
* template[/etc/php-fpm.conf] action create (up to date)
Chef Client finished, 30/30 resources updated in 18 seconds

17. Resources management

18. Tool selection

19. Tool selection
● Import feature
● Multi-cloud
● Multi-API

20. Terraform Example - EC2

21. The change
$ terraform apply

22. Modules

23. Terraform Example - Module λ
Product
Lambda
CloudWatch
Service
Lambda
SumoLogic
Subscription Configuration

24. Terraform Example - Module λ

25. Terraform Example - Module λ

26. Terraform Example - Module λ

27. Terraform Example - Module S3
Video Reports
App
Video Reports
App
S3
Apps

28. Terraform Example - Module S3

29. Terraform Example - Module S3

30. Responsibilities
EC2
RDS R53 S3 ...

31. Test all the things!

32. Chef testing
● Unit testing
○ Regular Ruby frameworks
● Integrational testing
○ VM (VirtulBox)
○ Docker

33. Terraform planning

34. So what
we got
✓ Declarative definitions
✓ Version history
✓ Automation
✓ Speed up
✓ Encapsulation

35. Q & A

36. Thanks
Wise Engineering