How do you deal with infrastructure resiliency when your modern apps are mostly stateless? Do you care at all if your infrastructure goes down? Of course you do! In this session we will demonstrate several concepts: stateless vs stateful applications and how to build proper Cloud Native Infrastructure for them; data persistence in distributed environments; service discovery; and orchestration layers.

1. 1© Copyright 2016 EMC Corporation. All rights reserved. 1© Copyright 2016 EMC Corporation. All rights reserved.
RESILIENCY AND AVAILABILITY OF A
CLOUD NATIVE INFRASTRUCTURE
JONAS ROSLAND, EMC {code}
DEVELOPER ADVOCATE & COMMUNITY MANAGER

2. 4© Copyright 2016 EMC Corporation. All rights reserved.
• High Availability solutions
• Mostly Primary-Secondary, Master-Slave
• Provides redundancy
FIRST, SOME HISTORY

3. 5© Copyright 2016 EMC Corporation. All rights reserved.
• Resiliency is a quality in objects to hold or recover
their shape
• Example: If you bend a spoon and it bends right
back — that's resiliency
SO WHAT IS RESILIENCY?

4. 6© Copyright 2016 EMC Corporation. All rights reserved.
• Create services that withstand pressure
• Foster a modern mindset in operations
• Treat failures as normal occurrences, not fires
HOW DOES SPOON BENDING APPLY TO IT?

5. 7© Copyright 2016 EMC Corporation. All rights reserved.
• Service failures are treated as non-critical issues
• Applications and services self-heal
• The infrastructure supports this with modern tools
FAILURE HANDLING

6. 8© Copyright 2016 EMC Corporation. All rights reserved.
• Focused but not necessarily fully dedicated
• Not limited to a single master-slave relationship
• Example 1: 20 nodes with resources to run services
such as Hadoop, web servers and databases
• Example 2: VMware clusters
MODERN INFRASTRUCTURE

7. 9© Copyright 2016 EMC Corporation. All rights reserved.
• Not just server-side clustering tools
• Many layers
• Schedulers, service discovery, logging, monitoring
and much more
MANAGING THIS INFRASTRUCTURE

8. 10© Copyright 2016 EMC Corporation. All rights reserved.
• Collection of compute resources
• Spread out horizontally
• Brings scale to your
deployments
– Docker Swarm
– Mesos
– Kubernetes
– Cloud Foundry
RESOURCE MANAGERS AND SCHEDULERS

9. 11© Copyright 2016 EMC Corporation. All rights reserved.
EXAMPLE

10. 12© Copyright 2016 EMC Corporation. All rights reserved.
• Enables apps and infra
to automatically find
parts of each other
– Consul
– etcd
– SkyDNS
– Zookeeper
SERVICE DISCOVERY

11. 13© Copyright 2016 EMC Corporation. All rights reserved.
EXAMPLE
Service Discovery

12. 14© Copyright 2016 EMC Corporation. All rights reserved.
EXAMPLE
Service Discovery

13. 15© Copyright 2016 EMC Corporation. All rights reserved.
• All logs in one place
• Everything searchable
LOGGING

14. 16© Copyright 2016 EMC Corporation. All rights reserved.
EXAMPLE

15. 17© Copyright 2016 EMC Corporation. All rights reserved.
• Sensu
• Datadog
• Prometheus
• New Relic
• Ruxit
MONITORING AND ANALYTICS

16. 18© Copyright 2016 EMC Corporation. All rights reserved.
EXAMPLE

17. 19© Copyright 2016 EMC Corporation. All rights reserved.
• Everything is managed through smart tools
• The tools have integrations to understand hardware
• By changing the processes you’re more prepared
• Being more prepared is crucial to deal with failures
when they happen
And they will happen
LOOK OF PHYSICAL INFRASTRUCTURE

18. 20© Copyright 2016 EMC Corporation. All rights reserved.
But what about my
super special app?

19. 21© Copyright 2016 EMC Corporation. All rights reserved.
Applications have
to store data, right?

20. 22© Copyright 2016 EMC Corporation. All rights reserved.
• Storing data (state) is a critical component of any
application
• Where they store this state defines their class
– Connected database
– In memory
– Local disk
APPLICATION STATE DIFFERENCES

21. 23© Copyright 2016 EMC Corporation. All rights reserved.
• Store no critical data locally
• Can be scaled as needed
• Recovers quickly
STATELESS APPLICATIONS

22. 24© Copyright 2016 EMC Corporation. All rights reserved.
• Services that store state
• Have usually been treated as HA apps
• Can be scale-out or scale-up
STATEFUL SERVICES

23. 25© Copyright 2016 EMC Corporation. All rights reserved. 25© Copyright 2016 EMC Corporation. All rights reserved.
APPLICATIONS BUILT FROM SERVICES
Front End or Non-Persistent
Data Services (Persistent)
Scale-Up
Scale-Out
Cassandra
Postgres
Redis
CouchDB
Elastic Search
Hadoop
MariaDB
Mysql
Nginx
HAProxy
MongoDB
RabbitMQ
Tomcat
Memcached
ScaleIO ECS
ApacheRails
Language Specific HTTP

24. 26© Copyright 2016 EMC Corporation. All rights reserved.
Demo of resiliency

25. 27© Copyright 2016 EMC Corporation. All rights reserved.
• Several applications, stateful and stateless, are
running and working together
• Cascading server failures occurs
• Applications are restarted and automatically heal
themselves
• The servers are back online and automatically join
the cluster of resources again
DEMO OF FAILURE HAPPENING

26. 28© Copyright 2016 EMC Corporation. All rights reserved.
• Being prepared is crucial, surprises shouldn’t happen
• Use smart tools to deal with issue quickly
• Leverage smart infrastructure that allows your apps
to self-heal
• Manage your datacenter as an entity, not silos
SUMMARY

27. 29© Copyright 2016 EMC Corporation. All rights reserved.
Before opening up for questions

28. 30© Copyright 2016 EMC Corporation. All rights reserved.
• Hands-on lab with Docker, Mesos and REX-Ray
• Free stickers at our booth
• Join our community at community.emccode.com
• See all our projects at emccode.com
• And follow us on Twitter @EMCcode
CONTINUE THE DISCUSSION

29. 31© Copyright 2016 EMC Corporation. All rights reserved.
@EMCcode
@jonasrosland
emccode.com
community.emccode.com
Come visit us at
Booth #1044
or in the vLab
Questions?

30. 33© Copyright 2016 EMC Corporation. All rights reserved. 33© Copyright 2016 EMC Corporation. All rights reserved.