Amazon EC2 Spot Instances enable you to use spare EC2 computing capacity— capacity that is often 90% less than On-Demand prices. In this session, learn how to effectively harness Spot Instances for production workloads. We explore application requirements for using Spot Instances, best practices learned from thousands of customers, and the services that make it easy to use. Finally, we run through practical examples of how to use Spot for the most common production workloads, the common pitfalls customers run into, and how to avoid them.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Run Production Workloads on Spot,
Save up to 90%
Scott Donovan
Senior Cloud Engineer
Citadel
C M P 3 0 6 - R 1
Gabriel Eisbruch
Sr Manager of Infrastructure
MercadoLibre
Boyd McGeachie
Senior Product Manager
AWS EC2 Spot Instances

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Breakout repeat
Thursday, 29th
Run Production Workloads on Spot, Save up to 90%
2:30 PM – 3:30 PM | MGM, Level 1, Grand Ballroom, 119, T1

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Related breakouts
Wednesday (today), NOV 28th
Better, Faster, Cheaper – Cost Optimizing Compute with EC2 Fleet #savinglikeaboss
6:15 PM – 7:15 PM | Aria West, Level 3, Juniper 4, T2
TBC, TBC
Boom for Your Buck: Rendering with Spot and Deadline on AWS TBC |
TBC
Day of Week, Month Day
Session Title
Time – Time | Location

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Elastic Compute Cloud (Amazon EC2)
purchasing options
?

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 Spot Instances

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Spare capacity at scale

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
c4.2xlarge c3.8xlarge c4.8xlarge i3.4xlarge m4.4xlarge c4.4xlarge
r4.4xlarge m4.2xlarge m3.2xlarge r4.8xlarge m4.16xlarge x1.16xlarge
Million core
clusters are
not entirely
new, but its still
a lot of cores

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The simple rules of Spot Instances

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What about interruptions?

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Lean on Spot for these workloads!
Or containerized workloads

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“Bursty” workloads

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Citadel’s Docker Orchestration System

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
P
J

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
P
J

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
P
J

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
P
J

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
P
J

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
P
J

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Queued work

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Running workers

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Requested/current

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Queued work

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Running workers

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Requested/current

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Orc Provisioner API

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Orc Provisioner API
# Resizing a Cluster
{
“size”: 30000
}
> curl –u “sdonovan:mypasswd” –XPUT –T request.json
https://orc-prod-provisioner/cluster/my-cluster
# Deleting a Cluster
curl –u “sdonovan:mypasswd” –XDELETE
https://orc-prod-provisioner/cluster/my-cluster

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Spot markets

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Spot Fleets at large scale
Standard
(38 different instance types)
Standard
(304 distinct Spot markets)
Compute
(12 different instance types)
Highmem
(13 different instance types)
Compute
(96 distinct Spot markets)
Highmem
(104 distinct Spot markets)

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Lessons learned

36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Requested/current

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Requested/current

38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• This presentation reflects the analysis and views of Scott Donovan. No recipient should
interpret this presentation to represent the general views of Citadel LLC or its
personnel. Facts, analysis, and views presented in this presentation have not been
reviewed by, and may not reflect information known to, other Citadel professionals.
• Assumptions, opinions, views, and estimates constitute Mr. Donovan’s judgment as of the
date given and are subject to change without notice and without any duty to update.
Citadel is not responsible for any errors or omissions contained in this presentation
and accepts no liability whatsoever for any direct or consequential loss arising from
your use of this presentation or its contents.
• Nothing in this presentation constitutes investment, legal, accounting, or tax advice.
• All trademarks, service marks and logos used in this document are trademarks or service
marks or registered trademarks or service marks of Citadel.
Endnotes
HIGHLY CONFIDENTIAL—CITADEL PROPRIETARY
INFORMATION—FOR INTERNAL USE ONLY

39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is MercadoLibre?

42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is MercadoLibre in IT?

43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What is MercadoLibre in IT?

44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
We are a healthy growing
company
Costs are related to
our growth and they
are not a problem

47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Mmmm,
we should check
if we
can spend
our money
better

48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
OK, we must do something
But ... we need to keep growing
We shouldn’t impact development cycles

51. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Different options
to hit the costs

52. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Different options
to hit the costs

53. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

55. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Spots are great!

56. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
But …

57. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
So …

58. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
A little about MercadoLibre’s infrastructure

59. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
A little about MercadoLibre’s infrastructure

60. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
A little about MercadoLibre’s infrastructure

61. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
A little about MercadoLibre’s infrastructure

62. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Great, but this strategy has a few problems

63. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

64. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

65. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

66. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

67. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

68. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

69. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

70. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

71. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Some learned lessons

72. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

73. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Different options
to hit the costs

74. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
options
to hit the costs

75. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Boyd McGeachie
boydm@amazon.com

76. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.