AWS User Group Presentation. Hosted by PolarSeven - http://polarseven.com 5th October 2016 Session 1: Presentation Jason Umiker: Art of PaaS - Lessons learned from running Micros, a platform for hundreds of microservices on AWS

1. Micros
Atlassian’s Internal PaaS on AWS
JASON UMIKER • @JASONUMIKER

2. PaaS Overview
•‿•> <

3. PaaS Overview
CloudFormation RDS S3 DynamoDB
EC2

4. Over
services running right now
500

5. • Big cool statistic
• 2,56
9
• Add-Ons in Marketplace
Todo: better image
Why do we need a Platform?

6. Data Centre
JIRA & Confluence Cloud Architecture
Rack
Cloud instance in
OpenVZ container
(approx. 1500 per rack)

7. Breaking up the Monoliths
* *
Data Centre
Rack
BlobStore service
PaaS

8. Breaking up the Monoliths
> <
Data Centre
Rack
PaaS
_ _ - - /oo
o o
. .

9. Todo: better image
What does the platform do?

10. + SD{ }
Artifact Descriptor
Deploying a Service

11. Deploying a Service
name: Micros Workshop
description: A sample app
links:
binary:
type: npm
artifactId: '@atlassian/micros-workshop'
version: 0.0.1
healthcheck:
uri: /healthcheck
source:
url: 'ssh://git@stash.atlassian.com/x.git'
owners:
- rfernandes@atlassian.com
organization: Cloud Platform Engineering

12. + SD{ }
Artifact Descriptor
https://<service>.atlassian.io
Deploying a Service
Compute:
CloudFormation stack with:
• Route 53 DNS record
• Elastic Load Balancer
• EC2 instances in Autoscaling
group
Resources:
• S3, RDS, DynamoDB
• Redis, Memcached, SQS…

13. Logging & Monitoring
AWS
CloudWatch
https://<service>.atlassian.io

14. . .
cloudymccloudface.atlassian.io
> micros service:deploy
my-service
-f service-descriptor.yml
Deploying a Service

15. • Big cool statistic
• 2,56
9
• Add-Ons in Marketplace
Lessons learned:
Balancing consistency & flexibility

16. Where to favor rules & consistency?
Enforce: Common logging &
monitoring infra
Encourage: Structured log
data

17. Structured Log Data

18. Where to favor rules & consistency?
Enforce: Common logging &
monitoring infra
Encourage: Structured log
data
Enforce: Standard
upgrade flow

19. https://<service>.atlassian.io
Common Upgrade flow
v1 v2

20. Where to favor rules & consistency?
Enforce: Common logging &
monitoring infra
Encourage: Structured log
data
Enforce: Standard
upgrade flow
Enforce: Limited set of
persistent data stores

23. Where to favor rules & consistency?
Enforce: Common logging &
monitoring infra
Encourage: Structured log
data
Enforce: Standard
upgrade flow
Enforce: Limited set of
persistent data stores
Encourage:
Resource isolation

24. Resource Isolation
ServiceB.atlassian.io
Datastores
ServiceA.atlassian.io
Datastores

25. Where to favor rules & consistency?
Enforce: Common logging &
monitoring infra
Encourage: Structured log
data
Enforce: Standard
upgrade flow
Enforce: Limited set of
persistent data stores
Enforce: Common service metadata
& cost allocation
Encourage:
Resource isolation

26. Where to favor rules & consistency?
Enforce: Common logging &
monitoring infra
Encourage: Structured log
data
Enforce: Standard
upgrade flow
Enforce: Limited set of
persistent data stores
Enforce: Restricted ssh
access
Enforce: Common service metadata
& cost allocation
Encourage:
Resource isolation

27. Where to favor rules & consistency?
Enforce: Common logging &
monitoring infra
Encourage: Structured log
data
Enforce: Standard
upgrade flow
Enforce: Limited set of
persistent data stores
Enforce: Statelessness &
disposable compute nodes
Enforce: Restricted ssh
access
Encourage:
Resource isolation
Enforce: Common service metadata
& cost allocation

28. 12 Factor
(not pets)
Nodes as cattle
(not pets)

29. Where to bend the rules / favor flexibility?
Enable: Service-level
technology stack flexibility

30. Services
by
Runtime
Dock
er
55%
JVM
25%
Node.js
15%
Python
5%

31. Where to bend the rules / favor flexibility?
Enable: Service-level
technology stack flexibility
Enable: Integration with
3rd party services

32. Where to bend the rules / favor flexibility?
Enable: Service-level
technology stack flexibility
Adapt to underlying
platform limitations
Enable: Integration with
3rd party services

33. Where to bend the rules / favor flexibility?
Enable: Service-level
technology stack flexibility
Adapt: Education
& on-boarding
Adapt to underlying
platform limitations
Enable: Integration with
3rd party services

34. Where to bend the rules / favor flexibility?
Enable: Service-level
technology stack flexibility
Adapt: Education
& on-boarding
Adapt to underlying
platform limitations
Enable: Integration with
3rd party services
Open the platform for
contributions

35. Contributions
&
Self-hosted
PaaS
components
Bootstrapping
Service
Deployment
orchestration
service
Chaos
Monkey
Log Analysis
Service
PaaS
PaaS
PaaS
PaaS
PaaS
Simple
Workflow
integration
Service cost
estimation
Data Pipelines
Integration
Service-to-
service auth
…

36. Where to bend the rules / favor flexibility?
Enable: Service-level
technology stack flexibility
Adapt to underlying
platform limitations
Enable: Integration with
3rd party services
Adapt: roadmap to inbound
requests & technology trends
Open the platform for
contributions
Adapt: Education
& on-boarding

37. Organisation wide:
Disaster Recovery
Compliance
Infra improvements:
Container Clusters
Serverless

38. Promises of Service Decomposition
Choice of
tech stacks
Scalability Independent
deployments
Resilience End-to-end
ownership
Your platform should enable them – with heart and balance.
PaaS

39. Healthy PaaS —> Happy Microservices!
Balance consistency
with flexibility
Encourage / enforce
“12 factor” & “nodes as
cattle”
Keep the barrier to
entry low
Tips for a healthy, balanced PaaS & a happy microservice ecosystem.

40. Questions?

41. Reuters. Chickens perch on the roof of a hennery
to escape rising floodwaters after Typhoon Utor hit
Maoming, Guangzhou province August 15, 2013.
Typhoon Utor hit China's southern Guangdong and
Guangxi provinces before easing to a tropical
storm.
Image Credits
https://design.atlassian.com/
Courtesy of Scott Monday:
- https://au.pinterest.com/pin/146085581635905884/
- http://scottmonday.com/
Copyright: velvetocean / 123RF Stock Photo –
http://www.123rf.com/profile_velvetocean
Copyright: feedough / 123RF Stock Photo –
http://www.123rf.com/profile_feedough'
Copyright: iimages / 123RF Stock Photo –
http://www.123rf.com/iimages_feedough