Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012

1,320 views

Published on

Amazon EC2 offers a broad array of instance types that provide customers with a varying set of resources for their applications. From the diminutive Micro instance to the powerful Cluster Compute Eight Extra Large instance, AKA "The Beast", customers are presented with a number of options for deploying their applications. This talk dives into the various Amazon EC2 instance families and walks through a variety of use cases that demonstrate the capabilities and ideal use cases for different instance types. You should leave with enough information to understand how to choose the instance type most appropriate to meet the requirements of your applications.

  • Be the first to comment

CPN101 Revving up Your Applications - Compute - AWS re: Invent 2012

  1. 1. Revving Up Your ApplicationsDeepak Singh, Principal Product Manager - Amazon EC2#reinvent
  2. 2. Via butteryflysha under a CC-BYlicense
  3. 3. ec2-run-instances
  4. 4. instances
  5. 5. Unit of computeImage: St. Stev
  6. 6. CPU
  7. 7. Disk
  8. 8. Memory
  9. 9. Network
  10. 10. Instance families
  11. 11. 1
  12. 12. Things change
  13. 13. Standard High-CPU High-Memory Micro Cluster Compute Cluster GPU High I/OAmazon Confidential
  14. 14. Most Standard apps Scale-out compute High-CPU Memory-intensive apps High-Memory Compute + network throughput Micro Inexpensive Cluster Compute Cluster GPU Parallel GPGPU computing Lots of low-latency IOPS High I/OAmazon Confidential
  15. 15. Standard instances
  16. 16. Sweet spot
  17. 17. Common applications
  18. 18. Databases
  19. 19. Caches
  20. 20. Data processing
  21. 21. The next generation
  22. 22. Need more CPU?
  23. 23. M3 Standard Instances
  24. 24. 50% more CPU/core 8-core option
  25. 25. Batch Processing Encoding
  26. 26. Web servers CMS
  27. 27. Lower costM1 Low entry point
  28. 28. FastM3 More cores
  29. 29. The Micro instance
  30. 30. Low cost instance
  31. 31. Free tier
  32. 32. Low, consistent, baseline Burst of CPU capacity
  33. 33. So what can you run?
  34. 34. Request-based applications
  35. 35. Profiles to avoid
  36. 36. High CPU instances
  37. 37. Low $/coreLow $/ECU
  38. 38. Scale out
  39. 39. TasksQueueInstancesResultsStore
  40. 40. Even more performance
  41. 41. Scale out
  42. 42. Tightly coupled
  43. 43. Network bound
  44. 44. Cluster Compute instances
  45. 45. Intel Xeon E5-2670
  46. 46. 2 processors 16 cores 32 threads 88 ECU
  47. 47. Placement Group
  48. 48. Cores 17024Rmax 240.09Rpeak 354.12
  49. 49. November 2011
  50. 50. “The Beast”
  51. 51. 330 instances76.9 TeraFlops < $800/hr
  52. 52. ... or less on the Spot Market
  53. 53. < $90/hr**Spot Price of $0.27/hr on 11/17/2012
  54. 54. AVX
  55. 55. 2x Flops/cycle
  56. 56. Druid: 26 billion rows/second
  57. 57. ...new features
  58. 58. Intel Turbo
  59. 59. NUMA
  60. 60. Cluster GPU instances
  61. 61. 2*Intel Xeon 5570 22 GiB RAM1.7 TB instance storage2*NVidia Tesla M2050
  62. 62. CUDA
  63. 63. AMBER
  64. 64. High Memory instances
  65. 65. Higher memory/core
  66. 66. $/GB of RAM
  67. 67. Databases
  68. 68. Memcached
  69. 69. In-memory computing
  70. 70. ...what else could we do?
  71. 71. Cluster High Memory
  72. 72. 2 * Intel Xeon E5-2670 240 GiB RAM 2 * 120 GB SSD 10 Gigabit Ethernet NUMA Intel Turbo
  73. 73. In-memory databases
  74. 74. HPC
  75. 75. $3.50/hr (On Demand)$0.90/hr (3-yr Heavy Utilization RI)
  76. 76. What about disk I/O?
  77. 77. Lots of IOPS
  78. 78. Low-latency IOPS
  79. 79. High I/O Instances
  80. 80. SSD-backed
  81. 81. Lots of CPU
  82. 82. Lots of networking
  83. 83. 120,000 4K random read IOPS 85,000 4K random write IOPS**Depends on active LBA SPAN
  84. 84. Replicated databases
  85. 85. NoSQL
  86. 86. Testing on EC2 hi1.4xlarge for mongoDB 2.2 rc0 via mongoperfSettings: nThreads:64,w:true,mmf:true,syncDelay:60,fileSizeMB:100000All file systems ext4, mdadm raid0 on the hi1 ephemeral disks
  87. 87. EBS-optimized instances
  88. 88. Optimized forEBS Provisioned IOPS
  89. 89. Dedicated network throughput
  90. 90. 1000 Mbps 500 Mbps
  91. 91. Provision IOPS 20K IOPS + ManageabilityEBS-optimized Flexibility
  92. 92. > 20K IOPSHigh I/Oinstances Low latency High bandwidth
  93. 93. ...one more thing
  94. 94. High Storage instances
  95. 95. 16 virtual cores 35 ECU 117 GiB memory10 Gigabit ethernet hs1.8xlarge
  96. 96. 24 HDD
  97. 97. 48 TB
  98. 98. 2.6 GB/s
  99. 99. Hadoop
  100. 100. Data Warehousing
  101. 101. Petabytes
  102. 102. $4.60/hr (On Demand)$1.40/hr (3-yr Heavy Utilization RI)
  103. 103. 1
  104. 104. 17
  105. 105. In summary
  106. 106. Amazon EC2 instances
  107. 107. Unit of computeImage: St. Stev
  108. 108. Most Apps Low Cost M1 Standard M3 Standard Most Apps Fast High CPU Scale-out Compute Memory-intensive High Memory AppsCompute + Network Througput Micro Inexpensive Cluster Compute Memory-intensive Cluster Computing Cluster High Memory Lots of low-latency Cluster GPU Parallel GPGPU Computing IOPS High I/O Petabyte Scale Lots of Throughput High Storage
  109. 109. Choose wisely
  110. 110. Tell us your requirementsAmazon Confidential
  111. 111. We are sincerely eager to hear your feedback on thispresentation and on re:Invent. Please fill out an evaluation form when you have a chance.#reinvent

×