Revving Up Your ApplicationsDeepak Singh, Principal Product Manager - Amazon EC2#reinvent
Via butteryflysha under a CC-BYlicense
ec2-run-instances
instances
Unit of computeImage: St. Stev
CPU
Disk
Memory
Network
Instance families
1
Things change
Standard                         High-CPU                       High-Memory                           Micro               ...
Most                                               Standard                                                               ...
Standard instances
Sweet spot
Common applications
Databases
Caches
Data processing
The next generation
Need more CPU?
M3 Standard Instances
50% more CPU/core   8-core option
Batch Processing   Encoding
Web servers  CMS
Lower costM1     Low entry point
FastM3     More cores
The Micro instance
Low cost instance
Free tier
Low, consistent, baseline Burst of CPU capacity
So what can you run?
Request-based applications
Profiles to avoid
High CPU instances
Low $/coreLow $/ECU
Scale out
TasksQueueInstancesResultsStore
Even more performance
Scale out
Tightly coupled
Network bound
Cluster Compute instances
Intel Xeon E5-2670
2 processors  16 cores 32 threads  88 ECU
Placement  Group
Cores   17024Rmax    240.09Rpeak   354.12
November 2011
“The Beast”
330 instances76.9 TeraFlops  < $800/hr
... or less on the Spot Market
< $90/hr**Spot Price of $0.27/hr on 11/17/2012
AVX
2x Flops/cycle
Druid: 26 billion rows/second
...new features
Intel Turbo
NUMA
Cluster GPU instances
2*Intel Xeon 5570      22 GiB RAM1.7 TB instance storage2*NVidia Tesla M2050
CUDA
AMBER
High Memory instances
Higher memory/core
$/GB of RAM
Databases
Memcached
In-memory computing
...what else could we do?
Cluster High Memory
2 * Intel Xeon E5-2670     240 GiB RAM    2 * 120 GB SSD  10 Gigabit Ethernet         NUMA      Intel Turbo
In-memory databases
HPC
$3.50/hr (On Demand)$0.90/hr (3-yr Heavy Utilization RI)
What about disk I/O?
Lots of IOPS
Low-latency IOPS
High I/O Instances
SSD-backed
Lots of CPU
Lots of networking
120,000 4K random read IOPS              85,000 4K random write IOPS**Depends on active LBA SPAN
Replicated databases
NoSQL
Testing on EC2 hi1.4xlarge for mongoDB 2.2 rc0 via mongoperfSettings:  nThreads:64,w:true,mmf:true,syncDelay:60,fileSizeMB...
EBS-optimized instances
Optimized forEBS Provisioned IOPS
Dedicated network   throughput
1000 Mbps 500 Mbps
Provision IOPS    20K IOPS       +         ManageabilityEBS-optimized                  Flexibility
> 20K IOPSHigh I/Oinstances     Low latency            High bandwidth
...one more thing
High Storage instances
16 virtual cores      35 ECU 117 GiB memory10 Gigabit ethernet    hs1.8xlarge
24 HDD
48 TB
2.6 GB/s
Hadoop
Data Warehousing
Petabytes
$4.60/hr (On Demand)$1.40/hr (3-yr Heavy Utilization RI)
1
17
In summary
Amazon EC2 instances
Unit of computeImage: St. Stev
Most Apps              Low Cost                                  M1 Standard                                  M3 Standard ...
Choose wisely
Tell us your requirementsAmazon Confidential
We are sincerely eager to hear your feedback on thispresentation and on re:Invent. Please fill out an evaluation   form wh...
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012
Upcoming SlideShare
Loading in...5
×

CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012

1,007

Published on

Amazon EC2 offers a broad array of instance types that provide customers with a varying set of resources for their applications. From the diminutive Micro instance to the powerful Cluster Compute Eight Extra Large instance, AKA "The Beast", customers are presented with a number of options for deploying their applications. This talk dives into the various Amazon EC2 instance families and walks through a variety of use cases that demonstrate the capabilities and ideal use cases for different instance types. You should leave with enough information to understand how to choose the instance type most appropriate to meet the requirements of your applications.

0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,007
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

Transcript of "CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012"

  1. 1. Revving Up Your ApplicationsDeepak Singh, Principal Product Manager - Amazon EC2#reinvent
  2. 2. Via butteryflysha under a CC-BYlicense
  3. 3. ec2-run-instances
  4. 4. instances
  5. 5. Unit of computeImage: St. Stev
  6. 6. CPU
  7. 7. Disk
  8. 8. Memory
  9. 9. Network
  10. 10. Instance families
  11. 11. 1
  12. 12. Things change
  13. 13. Standard High-CPU High-Memory Micro Cluster Compute Cluster GPU High I/OAmazon Confidential
  14. 14. Most Standard apps Scale-out compute High-CPU Memory-intensive apps High-Memory Compute + network throughput Micro Inexpensive Cluster Compute Cluster GPU Parallel GPGPU computing Lots of low-latency IOPS High I/OAmazon Confidential
  15. 15. Standard instances
  16. 16. Sweet spot
  17. 17. Common applications
  18. 18. Databases
  19. 19. Caches
  20. 20. Data processing
  21. 21. The next generation
  22. 22. Need more CPU?
  23. 23. M3 Standard Instances
  24. 24. 50% more CPU/core 8-core option
  25. 25. Batch Processing Encoding
  26. 26. Web servers CMS
  27. 27. Lower costM1 Low entry point
  28. 28. FastM3 More cores
  29. 29. The Micro instance
  30. 30. Low cost instance
  31. 31. Free tier
  32. 32. Low, consistent, baseline Burst of CPU capacity
  33. 33. So what can you run?
  34. 34. Request-based applications
  35. 35. Profiles to avoid
  36. 36. High CPU instances
  37. 37. Low $/coreLow $/ECU
  38. 38. Scale out
  39. 39. TasksQueueInstancesResultsStore
  40. 40. Even more performance
  41. 41. Scale out
  42. 42. Tightly coupled
  43. 43. Network bound
  44. 44. Cluster Compute instances
  45. 45. Intel Xeon E5-2670
  46. 46. 2 processors 16 cores 32 threads 88 ECU
  47. 47. Placement Group
  48. 48. Cores 17024Rmax 240.09Rpeak 354.12
  49. 49. November 2011
  50. 50. “The Beast”
  51. 51. 330 instances76.9 TeraFlops < $800/hr
  52. 52. ... or less on the Spot Market
  53. 53. < $90/hr**Spot Price of $0.27/hr on 11/17/2012
  54. 54. AVX
  55. 55. 2x Flops/cycle
  56. 56. Druid: 26 billion rows/second
  57. 57. ...new features
  58. 58. Intel Turbo
  59. 59. NUMA
  60. 60. Cluster GPU instances
  61. 61. 2*Intel Xeon 5570 22 GiB RAM1.7 TB instance storage2*NVidia Tesla M2050
  62. 62. CUDA
  63. 63. AMBER
  64. 64. High Memory instances
  65. 65. Higher memory/core
  66. 66. $/GB of RAM
  67. 67. Databases
  68. 68. Memcached
  69. 69. In-memory computing
  70. 70. ...what else could we do?
  71. 71. Cluster High Memory
  72. 72. 2 * Intel Xeon E5-2670 240 GiB RAM 2 * 120 GB SSD 10 Gigabit Ethernet NUMA Intel Turbo
  73. 73. In-memory databases
  74. 74. HPC
  75. 75. $3.50/hr (On Demand)$0.90/hr (3-yr Heavy Utilization RI)
  76. 76. What about disk I/O?
  77. 77. Lots of IOPS
  78. 78. Low-latency IOPS
  79. 79. High I/O Instances
  80. 80. SSD-backed
  81. 81. Lots of CPU
  82. 82. Lots of networking
  83. 83. 120,000 4K random read IOPS 85,000 4K random write IOPS**Depends on active LBA SPAN
  84. 84. Replicated databases
  85. 85. NoSQL
  86. 86. Testing on EC2 hi1.4xlarge for mongoDB 2.2 rc0 via mongoperfSettings: nThreads:64,w:true,mmf:true,syncDelay:60,fileSizeMB:100000All file systems ext4, mdadm raid0 on the hi1 ephemeral disks
  87. 87. EBS-optimized instances
  88. 88. Optimized forEBS Provisioned IOPS
  89. 89. Dedicated network throughput
  90. 90. 1000 Mbps 500 Mbps
  91. 91. Provision IOPS 20K IOPS + ManageabilityEBS-optimized Flexibility
  92. 92. > 20K IOPSHigh I/Oinstances Low latency High bandwidth
  93. 93. ...one more thing
  94. 94. High Storage instances
  95. 95. 16 virtual cores 35 ECU 117 GiB memory10 Gigabit ethernet hs1.8xlarge
  96. 96. 24 HDD
  97. 97. 48 TB
  98. 98. 2.6 GB/s
  99. 99. Hadoop
  100. 100. Data Warehousing
  101. 101. Petabytes
  102. 102. $4.60/hr (On Demand)$1.40/hr (3-yr Heavy Utilization RI)
  103. 103. 1
  104. 104. 17
  105. 105. In summary
  106. 106. Amazon EC2 instances
  107. 107. Unit of computeImage: St. Stev
  108. 108. Most Apps Low Cost M1 Standard M3 Standard Most Apps Fast High CPU Scale-out Compute Memory-intensive High Memory AppsCompute + Network Througput Micro Inexpensive Cluster Compute Memory-intensive Cluster Computing Cluster High Memory Lots of low-latency Cluster GPU Parallel GPGPU Computing IOPS High I/O Petabyte Scale Lots of Throughput High Storage
  109. 109. Choose wisely
  110. 110. Tell us your requirementsAmazon Confidential
  111. 111. We are sincerely eager to hear your feedback on thispresentation and on re:Invent. Please fill out an evaluation form when you have a chance.#reinvent

×