Slides from the talk given to the Startup Berlin Slack Group that demonstrates how TruckIN is implementing its continuous delivery workflow using technologies and open-source tools. Topics that are covered: Automated Cloud Provisioning (Network, Subnets, VMs, Kubernetes Cluster, Firewall, Disks, Credentials, Private Docker Registry); Configuration Management (Salt Stack), Continuous Integration (Jenkins CI), Continuous Delivery/Deployment (Salt API/Reactor + Kubernetes) to a Google Cloud Kubernetes Cluster, Remote Application Debugging, Managing Google Cloud Kubernetes Cluster, Logging, Monitoring and ChatOps (Slack and operable.io)

1. From Code to Kubernetes

2. About Us
Art Richards
CTO - truckin.io

3. About Me
Daniel Oliveira
Devops Engineer
danieloliv79
danieloliveira079
daniel@truckin.io

4. Agenda

5. ● Scenario and Architecture
● Technologies
● Challenges
● Results
● Foundations
● Infrastructure as Code
● Configuration Management
● Building and Deployments
● Application Debugging using Weavescope
● Demo - From code to Kubernetes
● Future
● QA

6. git push

7. Scenario and Architecture

8. Distributed
Teams

9. Early stages products

10. Greenfield projects

11. One man's operations team
Priorities vs Resources

12. Deployments Lifecycle

13. 10+
Non-production deployments per day

14. 8 Projects
Frontend, Backend API, Android
Development, Test, Staging, Demo and Production

15. Weekly
Production deployments
(mobile, frontend and backend)

16. Technologies

17. Applications

18. Infrastructure

19. Challenges

20. ● CI/CD Pipeline
● Infrastructure as Code
● Isolated Environments (Dev, Test, Demo, Staging, Production)
● Unified orchestrator for builds and deployments processes
● Integrations
● Easy application debugging
● Automation

21. Results

23. Foundations

24. IaaS
Cloud Provider
Resources
Network, Instances, IAM, Disk, Registry,
Kubernetes Cluster
Software, Packages and Configs
Salt Master, Salt Minion, Docker, Postgresql
and Elasticsearch
ProvisioningOrder
Desired State
Minions, API, Reactor, Integrations

25. Let's talk about
provisioning

26. Google Cloud Platform
https://cloud.google.com

27. Infrastructure as Code

28. IaaS
Cloud Provider
Resources
Network, Instances, IAM, Disk, Registry,
Kubernetes Cluster
Software, Packages and Configs
Salt Master, Salt Minion, Docker, Postgresql
and Elasticsearch
ProvisioningOrder
Desired State
Minions, API, Reactor, Integrations

29. Terraform by Hashicorp
https://www.terraform.io

30. Basic network resources configuration file
variable
● Command line tool (apply, plan, destroy)
● Multiples Providers
● Config based resources
● Usage of Variables
● Dependencies Graph
● Execution Plan
● Resource Creation in Parallel
● Multiples Provisioners
● Detailed Output
dependency
Terraform output

31. Configure 'Em All
Network, Firewall, Subnetworks, Instances,
Buckets, Disks, Kubernetes Cluster, Services
Accounts and IAM

32. Configuration Management

33. IaaS
Cloud Provider
Resources
Network, Instances, IAM, Disk, Registry,
Kubernetes Cluster
Software, Packages and Configs
Salt Master, Salt Minion, Docker, Postgresql
and Elasticsearch
ProvisioningOrder
Desired State
Minions, API, Reactor, Integrations

34. https://saltstack.com

35. SaltStack Open Source
https://docs.saltstack.com/en/latest/
Master
MinionOperator
Minion
Postgresql
Minion
Builder
MinionElastic
G@roles:builder and G@environment:test

36. Selectors
Master
Minion
Builder
Executed imperatively via command line or reactively via Salt Reactor.
salt cli selector command

37. Salt Pillars
"Offer global values that can be distributed to minions"

40. Salt States
"The SLS is a representation of the state in which a system should be in, and is
set up to contain this data in a simple format."

41. state ID
modulename.command
arguments

43. Using defined pillars within states
● Introducing the map.jinja file
● Passing pillars values when compiling states

45. Output to MinionParse + Merge
SaltStack Compilation Process
+ =Pillars
dictionaries
States
jinja2
Low Data
Parse

46. Gitfs
"The gitfs backend allows Salt to serve files from git repositories."

47. push 15s
Master
Gitfs

48. Putting all together

49. Desired State
● 8 VMs
○ Salt Master
○ Operator
○ Builder
○ Postgresql
○ Elasticsearch
○ 3 Kubernetes nodes
● 2 Persistent Data Disks: 500GB attached to PG and ELS
● 1 Kubernetes Cluster
● Network
○ Required Firewall Rules
○ 2 Subnets
● 2 IAM/Service Accounts: Pull/Push Docker Registry

50. Complete Cloud Provision Flow
Network
Firewall, Subnets, Static IPs,
...
Instances
Salt Master, Salt Minion,
Postgresql, Elasticsearch, Builder,
Operator
Kubernetes
Cluster
Nodes, Firewall Rules,
K8S Master and Workers
● $ terraform apply
Salt states are applied just after an
instance is created, based on its
"role" specified in the grains config
Core resources are
created during this
phase
Creates the initial
cluster state based on
the number of nodes
specified

52. Work is done!

53. Google Cloud Admin Panel

56. http://kubernetes.io/

57. Kubernetes Dashboard

60. Show me the flow!

61. Salt API
https
https
ssh
Builder
Operator
runners
reactor
Event Hub
https

62. Building and Deploying

63. Kubernetes Objects
"Kubernetes Objects are persistent entities in the Kubernetes system.
Kubernetes uses these entities to represent the state of your cluster."

64. Kubernetes objects
● Abstracts: deployments, services, replica sets, ingress, ...
● Generated on the fly by Salt using templates
● Final .yaml file compiled including pillars and arguments
● $ kubectl apply -f mysite-development.yaml
● Garbage collector

65. deploymentV1.yaml

66. Builder
1 2
3
4
5
6
7
8
Code to Image Flow
Registry
Reactor
push
state.apply
notify
notify
notify
push notify

67. Operator
Kubernetes Deployment Flow
Registry
Reactor
(Post Build)
Pullkubectlstate.apply1
2 4
notify
3
5
notify
6

68. https://operable.io/
ChatOps

69. Build
Build

70. Rollback

71. Application Debugging
https://www.weave.works/products/weave-scope/

76. Demo
Live from code to Kubernetes!

77. Future
What must be improved?
● Error Handling
● Credentials Management
● Logging and Monitoring
● On Demand Environments
● Terraform File Refactoring
● Implement Production
● Rollout Deployments
● Postgresql Cluster
● Elasticsearch Cluster
● ...

78. Wrap up
What I've seen so far?
● Automated provision
● Infrastructure as Code
● Event driven environment
● Fast delivery cycle
● Isolated environments
● Application Debugging
● ChatOps

79. Final Words

80. Doesn't have to be perfect from day 0!

81. Pick up the right people
"When you get into one of these groups,
there's only a couple of ways you can
get out: one is death, the other is mental
institutions..." - Devops Engineer testimonial

82. Links
Saltstack - https://saltstack.com
Salt States - https://docs.saltstack.com/en/latest/topics/tutorials/starting_states.html
Salt Pillars - https://docs.saltstack.com/en/latest/topics/pillar/
Terraform - https://www.terraform.io/intro/index.html
Weavescope - https://www.weave.works/products/weave-scope
Kubernetesio - http://kubernetes.io
Jenkins CI - https://jenkins.io
Docker - https://docker.com
Google Cloud Platform - cloud.google.com
GCP Calculator - https://cloud.google.com/products/calculator/

83. Danke Schön!

84. Questions?