Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS re:INVENT
HPC Performance with Amazon EC2 C5...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AGENDA
 I n t e l : P o w e r i n g H P C i n t...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
LEGAL NOTICE
Intel technologies’ features and be...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Intel: Powering HPC in the cloud
Bill Magro, Int...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
HPC-TARGETED SEGMENTS FOR INTEL
XEON SCALABLE PR...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
HPC WORKLOADS IN THE CLOUD
C l u s t e r H P C
T...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
HPC CUSTOMERS ARE LOOKING TO THE
CLOUD
R&D
colla...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
INTEL XEON PROCESSOR FAMILY
POWERS HPC IN CLOUD
...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
INTEL XEON PROCESSOR SCALABLE
FAMILY
S o f t w a...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AVX 512
72 vCPUs
“Skylake”
144 GiB memory
C5
12 ...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A CONSISTENT HPC PLATFORM
Applications
Platform
...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RESCALE: DELIVERING HPC IN THE
CLOUD
M a t t M c...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Many customers have
moved from ‘why’ cloud
to ‘h...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
How to do HPC in
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CHALLENGE: AVAILABILITY OF
APPLICATIONS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CHALLENGE: RUN ON THE BEST-SUITED
ARCHITECTURE
2...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CHALLENGE: RELIABILITY AND SECURITY
CSA register...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CHALLENGE: SIMPLE USER INTERFACE
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
CHALLENGE: ACCESSING DIVERSE DATA
CENTERS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SCALEX PLATFORM: SEAMLESS HPC
DEPLOYMENT
A u t o...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
GLOBAL INTEGRATION
I n t e g r a t i o n w i t h...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SIMPLIFYING THE AWS HPC DEPLOYMENT
A W S
r e s p...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
HPC ON RESCALE with AWS
• I n s t a n t a c c e ...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RCR: WINNING WITH HPC IN THE
CLOUD
Seth Morris, ...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ABOUT RICHARD CHILDRESS RACING
Humble beginnings...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
ENGINEERING A CULTURE OF INNOVATION
In the world...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RCR & CFD
Idea CAD Full Car CFD
CFD Subsystem
Wi...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RCR & CFD
For full-car runs, our CFD models are ...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RCR & CFD
Run times typically 16 hours long for ...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RCR & CFD
Drafting cases, for super-speedway (dr...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RESCALE & FLUENT
RCR uses ANSYS Fluent on Rescal...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
RESCALE & FLUENT
Scalability important for RCR:
...
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!
Upcoming SlideShare
Loading in …5
×

How to Get the HPC Best-in-class Performance via Intel Xeon Skylake Processors and AWS C5 Instances with Ease of Deployment Through Rescale - CMP333 - re:Invent 2017

691 views

Published on

HPC Cloud services built on the latest Intel architecture, Skylake Xeon processor, are now powering the C5 compute intensive instance at AWS and can serve as your next-generation HPC platform. Hear how customers are starting to consider hybrid strategies to increase productivity and lower their capital expenditure and maintenance costs. Also learn how to adapt this model to meet the increasing HPC and data analytics needs for your applications with the new technologies incorporated into the platform. Also find out how high performance computing via Rescale's cloud platform using Intel's latest technology seamlessly brings these advantages to HPC management and users. To access team management and throughput, all can benefit from cloud platform adoption as demand increases. Learn how customers are already benefiting. Richard Childress Racing (RCR) discusses its use of AWS C5 via the Rescale platform and how the combination is giving it an edge in the highly competitive field of motorsport.

Session sponsored by Intel

  • Be the first to comment

How to Get the HPC Best-in-class Performance via Intel Xeon Skylake Processors and AWS C5 Instances with Ease of Deployment Through Rescale - CMP333 - re:Invent 2017

  1. 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS re:INVENT HPC Performance with Amazon EC2 C5 D E P L O Y M E N T W I T H R E S C A L E O N I N T E L X E O N S C A L A B L E P R O C E S S O R S N o v e m b e r 2 9 , 2 0 1 7
  2. 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  3. 3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AGENDA  I n t e l : P o w e r i n g H P C i n t h e c l o u d  R e s c a l e : D e l i v e r i n g H P C i n t h e c l o u d  R C R : W i n n i n g w i t h H P C i n t h e c l o u d Seth Morris, Aerodynamicist Matt McKee, Director, North America Bill Magro, Chief Technologist, HPC
  4. 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. LEGAL NOTICE Intel technologies’ features and benefits depend on system configuration and may require enabled hardware, software or service activation. Performance varies depending on system configuration. Check with your system manufacturer or retailer or learn more at intel.com. No computer system can be absolutely secure. Tests document performance of components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. Consult other sources of information to evaluate performance as you consider your purchase. For more complete information about performance and benchmark results, visit intel.com/performance. Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For more complete information visit intel.com/performance. Intel's compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reserved for Intel microprocessors. Please refer to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice. Cost reduction scenarios described are intended as examples of how a given Intel-based product, in the specified circumstances and configurations, may affect future costs and provide cost savings. Circumstances will vary. Intel does not guarantee any costs or cost reduction. Intel does not control or audit third-party benchmark data or the web sites referenced in this document. You should visit the referenced web site and confirm whether referenced data are accurate. © 2017 Intel Corporation. 3D XPoint, Arria, the Arria logo, Intel, the Intel logo, Intel Nervana, Intel Optane, Intel RealSense, Intel Xeon Phi, Stratix and Xeon are trademarks of Intel Corporation in the U.S. and/or other countries. *Other names and brands may be claimed as property of others.
  5. 5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Intel: Powering HPC in the cloud Bill Magro, Intel Fellow and Chief Technologist, HPC W h a t i s H P C i n t h e c l o u d ? A n d w h y ?
  6. 6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. HPC-TARGETED SEGMENTS FOR INTEL XEON SCALABLE PROCESSORS Financial—risk Weather Scientific visualization/ professional rendering Simulation, CAE & CFD Defense/security Energy—seismic reservoir Data analytics and machine learning Life sciences— genomics/sequencing
  7. 7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. HPC WORKLOADS IN THE CLOUD C l u s t e r H P C Tightly coupled, latency sensitive applications Use larger EC2 compute instances, placement groups, enhanced networking G r i d H T C Loosely coupled, pleasingly parallel Use a variety of EC2 instances, multiple AZs, Spot, Auto Scaling, SQS
  8. 8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. HPC CUSTOMERS ARE LOOKING TO THE CLOUD R&D collaboration Manage demand surges Easy maintenance Capital/investme nt Access to scale Upgrading current capabilities Top reasons
  9. 9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. INTEL XEON PROCESSOR FAMILY POWERS HPC IN CLOUD P e r f o r m a n c e Provides seamless HPC application performance for dedicated and cloud infrastructure S e c u r i t y High reliability and enhanced security features reduce risk without compromising performance A g i l i t y Enables fully virtualized, software-defined datacenter that dynamically self-provisions resources based on demand
  10. 10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. INTEL XEON PROCESSOR SCALABLE FAMILY S o f t w a r e p e r f o r m a n c e p r o o f p o i n t s — H P C ( c o m m e r c i a l ) Potential customer benefits: • Faster time to completion for improved TCO • Higher resolution simulations for greater accuracy • More sophisticated analysis for higher confidence in outcomes hpc Intel AVX-512 Up to2X FLOPs/clock-cycle peak performance capability 1.74X to 4.66X Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations, and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For more complete information, visit intel.com/performance. *Other names and brands may be claimed as the property of others. 1.74x performance improvement on HOMME-WACCM app workload and 4.66x performance improvement on LAMMPS-Polyethylene app workload running on AWS C4.8xlarge to AWS C5 18xlarge on operating system RHEL 7.4 3.10.0- 693.el7.x86_64. Source Performance improvements
  11. 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AVX 512 72 vCPUs “Skylake” 144 GiB memory C5 12 Gbps to EBS 2X vCPUs 3X throughput 2.4X memory C4 36 vCPUs “Haswell” 4 Gbps to EBS 60 GiB memory Amazon EC2 C5: Next generation compute-optimized instances with Intel Xeon Scalable Processor AWS Compute optimized instances support the new Intel AVX-512 advanced instruction set, enabling you to more efficiently run vector processing workloads with single and double floating point precision, such as AI/machine learning or video processing. AMAZON EC2 C5 WITH INTEL XEON SCALABLE PROCESSOR
  12. 12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. A CONSISTENT HPC PLATFORM Applications Platform Provisioning, messaging, runtimes, system management, resource management Infrastructure High Performance Components Server Storage SSDs Switch Fabric Infrastructure Applications Platform Messaging, runtimes, system management, resource management IAAS Standard or High Performance Components Server Storage SSDs Network Infrastructure HPC Provisioning Layer H P C c l u s t e r H P C i n t h e c l o u d
  13. 13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RESCALE: DELIVERING HPC IN THE CLOUD M a t t M c K e e , D i r e c t o r , N o r t h A m e r i c a , R e s c a l e M o v i n g H P C t o t h e A W S c l o u d
  14. 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Many customers have moved from ‘why’ cloud to ‘how’ cloud. T i m C r a w f o r d @ t c r a w f o r d “ ”
  15. 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  16. 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. How to do HPC in
  17. 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CHALLENGE: AVAILABILITY OF APPLICATIONS
  18. 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CHALLENGE: RUN ON THE BEST-SUITED ARCHITECTURE 20 Intel Haswell CPUs 160 GB Memory 1.6GB Storage 25 GigE Networking Abaqus/Standard SERVERTUNING 640 GB Memory 640 GB NVMe Storage 25 GigE Networking 36 Intel Skylake CPUs CFD/LS-DYNA SERVERTUNING COMSOL 2 TB Memory 3.6 TB Storage 25 GigE Networking 64 Intel Haswell CPUs SERVERTUNING ON-DEMAND CLUSTER PROVISIONING M4 C5 X1
  19. 19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CHALLENGE: RELIABILITY AND SECURITY CSA registered ITAR compliant HIPAA certifiedSOC 2 Type 2 attested
  20. 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CHALLENGE: SIMPLE USER INTERFACE
  21. 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. CHALLENGE: ACCESSING DIVERSE DATA CENTERS
  22. 22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. SCALEX PLATFORM: SEAMLESS HPC DEPLOYMENT A u t o m a t i o n o f s e r v i c e s a n d t o o l s r e q u i r e d i n A W S H P C d e p l o y m e n t Multiple complex systems, services, and tools required for AWS HPC deployment... …transformed into one seamless, automated enterprise SaaS deployment
  23. 23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. GLOBAL INTEGRATION I n t e g r a t i o n w i t h a l l A W S d a t a c e n t e r s . . . a n d H P C i n s t a n c e t y p e s
  24. 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. SIMPLIFYING THE AWS HPC DEPLOYMENT A W S r e s p o n s i b i l i t y Compute Storage M y o r g a n i z a t i o n ’ s r e s p o n s i b i l i t y Shared security and compliance Systems administration Management and monitoring Productivity and workflow tools Deployment and user experience
  25. 25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. HPC ON RESCALE with AWS • I n s t a n t a c c e s s t o u n l i m i t e d r e s o u r c e s • C h o i c e o f a r c h i t e c t u r e s • A p p l i c a t i o n s a v a i l a b l e a n d t u n e d • A p p l i c a t i o n r u n s o n b e s t - s u i t e d a r c h i t e c t u r e • J o b s r u n w i t h n o w a i t • E n g i n e e r s n o t c o n s t r a i n e d b y t h e s i z e o f a s y s t e m • F a s t e r i n n o v a t i o n , s h o r t e r c y c l e s , i m p r o v e d t i m e t o m a r k e t • I m m e d i a t e p r o v i s i o n , v a r i a b l e s i z e , n o c a p i t a l i n v e s t m e n t • S y s t e m u t i l i z a t i o n , j o b q u e u e s , d o w n t i m e s a r e a t h i n g o f t h e p a s t
  26. 26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RCR: WINNING WITH HPC IN THE CLOUD Seth Morris, Aerodynamicist, Richard Childress Racing
  27. 27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ABOUT RICHARD CHILDRESS RACING Humble beginnings in a home garage Powerhouse duo makes history A racing legacy built on a $20 taxicab An evolution over five decades 15 championships 200+ NASCAR victories 1st organization to win titles in NASCAR’s three main series Richard Childress was inducted into the NASCAR Hall of Fame as part of the Class of 2017. A H a l l o f F a m e c a r e e r A d e t e r m i n e d d r i v e f o r e x c e l l e n c e
  28. 28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. ENGINEERING A CULTURE OF INNOVATION In the world of stock-car racing, small advantages can make the difference between winning and losing. We engineer, design, and manufacture our cars from the ground up on our 40-acre campus, using 75 engineers. • Engine blocks and heads supplied by GM, but we machine to our spec • Chassis, suspension, and steering all designed, machined, and fabricated in-house • Body panels supplied by GM but shaped to RCR aerodynamics specifications • CFD an important part of the aerodynamic development process Infusion of technology 1 million parts manufactured by RCR every season 3,500 types of engine and car parts & components manufactured by RCR
  29. 29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RCR & CFD Idea CAD Full Car CFD CFD Subsystem Wind Tunnel Full car adjoint CFD model Race Car RCR uses CFD at the front- end of the aerodynamic development process Legend Major development path Minor development path
  30. 30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RCR & CFD For full-car runs, our CFD models are typically around 200-240 MM elements. • Solve to the wall • Very small mesh in many high-gradient regions around the car • 95% of the car is modeled—highly detailed to capture even small flow details • Still not detailed enough—mesh continues to grow • Mesh also will grow as we create a model that captures flow phenomenon at varying vehicle attitudes • Example: the area under the RR floor pan is low energy & stagnant at 3.5° yaw, but higher energy at 0° yaw • Must capture varying splitter gaps, rear ride heights, yaws, and rolls
  31. 31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RCR & CFD Run times typically 16 hours long for 200 MM element model on 512 cores • Fluent linearly scales for this mesh/processor ratio, run times approximately 9 hours for the same model on 1024 cores (reading and writing not scalable to processor count, but Fluent has updated read/write speed for latest code version). • Scale-up of the code has been vastly improved over the years • Expect linear scaling much past our ability to generate ideas and create models. Case Read Data Read Case Write Data Write No compression 288 98 129 165 17.x compression 349 245 757 1177 18.0 compression 346 288 54 89 0 200 400 600 800 1000 1200 1400 Timeinseconds RBT_400M t1024 0 200 400 600 800 1000 1200 1400 1600 0 1024 2048 3072 4096 RATING NUMCORES F1_RACECAR_140M 170 NBG 180 NBG 180 NBG Opt Linear
  32. 32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RCR & CFD Drafting cases, for super-speedway (drag limited tracks), typically on the order of 200 MM elements • Reduced detail geometry Traffic cases for 1.5-mile oval configuration (grip limited tracks), typically on the order of 400 -500 MM elements • Must model the complete car due to underbody effects
  33. 33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RESCALE & FLUENT RCR uses ANSYS Fluent on Rescale. Fluent is a robust, commercially-available CFD solver with the capability to solve problems of many different flow regimes. We use Fluent for more than just external aerodynamics: • Adjoint solutions to produce sensitivity field of a cost function, such as downforce, to the geometry of the car • Fuel flow • Heat exchanger analysis • Cooling analysis RCR uses Rescale for several notable reasons: • Ever-increasing performance of computers • No existing infrastructure for HPC cluster • Scalability
  34. 34. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. RESCALE & FLUENT Scalability important for RCR: • Example: Traffic and drafting analyses consume a large amount of resources and take a long time to converge. • A CFD analyst’s time preparing and analyzing solution is minimal compared to compute time • Run traffic and downforce cases in parallel to normal development cases Inconsistent usage: • Per-run cost of hardware in-house is higher if utilization isn’t 100 percent • Pricing is compatible for our needs 0 5 10 15 20 25 30 35 40 Dec Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec NumberofCases Month Cases By Month 2015 Season 2 new analysists, steady increase in productivity. Tire jet stability issues, SS runs. drafting DF traffic runs New model build, December is partial month, tire stability issues, vacation
  35. 35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Thank you!

×