This document summarizes a presentation about using Spot instances on AWS to significantly reduce costs for running mission critical applications. The key points are: - Spotinst allows running applications on AWS Spot instances which are unused EC2 capacity available at steep discounts (up to 90% less than On-Demand prices) - Spotinst provides solutions to overcome barriers to using Spot such as lack of capacity guarantees and need for safe application draining in case capacity is reclaimed - The presentation includes demos of Spotinst capabilities like floating IPs, integration with AWS services like Beanstalk and CloudFormation, and a new integration with EMR autoscaling of task nodes. - Case studies are presented from companies like Inner

1. Saving Thousands By Running Mission
Critical Applications on Spot
January 20th, 2016
© 2016 Spotinst, LTD. #spotinstmeetup

2. Welcome!
To our 1st online
• Questions are always welcome
• There are no bad questions
• We’ll demo as much as we can
• Things will break, be patient

3. Amiram Shachar
Founder & CEO / Spotinst
Gal Aviv
R&D Group Manager /
Inneractive
Shannon Williams
Co-Founder & VP Marketing /
Rancher Labs
Shimon Tolts
Head of Infrastructure /
ironSource
@AmiramShachar @galaviv @shimtolts @smw355

4. Agenda
• The Basics: Spotinst on AWS
• Can I run my application on Spot?
• Demo: Spotinst floating IPs, Beanstalk, CloudFormation
• Use-case: Inneractive & Spotinst, Gal Aviv
• Use-case: ironSource & Spotinst, Shimon Tolts
• Using Rancher for Docker production workloads, Shannon
• Demo: NEW! Spotinst & EMR autoscaling

5. The ultimate platform for
running and managing
clusters in the cloud.

6. Spot = Idle On Demand
Spot is a market where the price of compute changes based on
supply and demand
The Basics

7. Spot Strategy #1
Significantly reduce your EC2 costs
cloud expenses graph of one of Spotinst’s customers. Before and after using Spotinst

8. Budget EC2 Capacity Purchased
Spot Strategy #2
Grow your compute capacity and throughput 10x
for the same budget.

9. Spot Barriers
SLA
Capacity is not guaranteed.
Safe application draining
What happens if AWS pulls the plug?

10. The Spotinst Way

11. ul August September Octber November Dece
Running Hours of Spotinst Managed Cloud Se
Spotinst traffic usage
Increased 100% MoM
1,000,000

12. What can run on Spot?
Everything.
except single point of failures.

13. Spot Ready
Hadoop / Spark
ELB / HA-Proxy Docker / ECS Autoscaling
MicroservicesWeb Application

14. Demo: Safe Draining

15. Demo:
Floating IPs, Beanstalk, CloudFormation

16. © 2015 Rancher Labs, Inc.© 2015 Rancher Labs, Inc .
Rancher Labs Overview
Shannon Williams
January 2016

17. © 2015 Rancher Labs, Inc.
Public container services are becoming popular
18
Google Container Engine

18. © 2015 Rancher Labs, Inc.
New private cloud: private container service
19
Private Container Service
Linux Linux Linux Linux Linux Linux

19. © 2015 Rancher Labs, Inc.
How to build a private container service
20
Private Container Service
Linux Linux Linux Linux Linux Linux
Docker Machine
Swarm, Kubernetes, Mesos
Compose, Kubernetes, Marathon, TOSCA
Rancher
LDAP, AD, GitHub
Stats, Health checks, Sysdig, Datadog, …
Notary, Kubernetes, Vault
VXLAN, IPSEC
iptables
HAProxy, iptables, ngnix
Ceph, EBS, SAN, ...
Gluster, EFS, NAS, ...
Swift, S3, ...
etcd, consul, mongo, DynamoDB, ...
Resource Mgmt
Scheduling
Orchestration
App Catalog
Access Control
Monitoring
Security
Overlay network
Firewall
Load Balancer
Block Storage
File Storage
Object Storage
Distributed DB

20. © 2015 Rancher Labs, Inc.
Opensourcecontainermanagement
platformforbuildingaPrivate
ContainerService
21
A containerized Linuxdistribution
for running Docker

21. © 2015 Rancher Labs, Inc.
Rancher Overview
22
Rancher Catalog
AD/LDAP
Alerts/Events
Environment 1 Environment N
…
Network Services Storage Services
Container Orchestration and Scheduling
User Mgmt Ops Mgmt
Environment 2

22. © 2015 Rancher Labs, Inc.23
• Leveragespotinstancestoreduceinfrastructurecosts
• Identifyupcomingchangesandorchestratereaction
• Workingonlivemigrationfor2016

23. G a l A v i v
R & D G r o u p M a n a g e r
Spotinst Case Study

24. What we do…
• Real time trading and optimizing campaigns over ad spaces
• Real time analytics
• Machine learning and recommendations
• Trading data and insights
• Our tech stack: Java, Scala, AKKA, Spray, Kafka
Spark, Spark Streaming and Cassandra

25. Scale and numbers…
• Billions of daily incoming requests
• Tens of Billions of daily transactions
• 150ms average response time
• Hundreds of servers in dozens of elastic clusters
• Extreme scaling (up/down)

26. Scaling challenges
• Different cluster behavior (latency, CPU, load, QPS…)
• Tight back-pressure management (Scala/AKKA/Spray
stack)
• Critical serving core (99.99% uptime)
• Service cost efficiency is crucial

27. Spotinst integration
• Less than 1 day for initial setup
• Cluster by cluster partial migration
• Extreme costs reduce
• Cost vs. risk…
0%
25%
50%
75%
100%
Reserved Spotinst OnDemand

28. Nice to meet you!
Shimon Tolts
Head of infrastructure @ ironSource

29. ironBeast
Data Flow
Management Solution
SpotInst case study
Shimon Tolts
http://www.ironsrc.com/ironbeast/

30. PEOPLE REACHED EACH MONTH
APPS INSTALLED EVERY MINUTE
WITH THE IRONSOURCE PLATFORM
REGISTERED & ANALYZED DATA EVENTS
EVERY MONTH
600M 4,200 100B+
70K+
PARTNERED APPS
SEP. 2010
ESTABLISHED
3.5B+
INSTALLATIONS TO DATE
700
TOTAL EMPLOYEES
400
R&D EMPLOYEES
IRONSOURCE IN NUMBERS
TEL AVIV ISRAEL SAN FRANCISCO UNITED STATES NEW YORK UNITED STATES LONDON UNITED KINGDOM BEIJING CHINA

31. ironBeast
Simplifying Big Data Flow
Management
Learn more >

32. ● Our deployment - micro-services with Docker
● Implement it yourself?
● 4 Availability Zones
● 5 Auto Scaling groups? (1 on demand)
● c4.large, c3.large, r3.large, m4.large
● 4x4=16 ASG + 1 On demand
SPOT INSTANCES

34. Spotinst
● One place to configure it all
● Multi instance type support
● Deep visibility into cost
● High savings
● Easy Risk/Reward mitigation (% of spot)
● Spot clean up mechanism

35. Thank you
See you in our next webinar!
@Spotinst /spotinstance/spotinst

36. NEW! EMR Task Nodes AutoScale

37. can run applications on Amazon’s and Google’s cloud for 1/10th of the regular
price
It is a fact