15h00 intel - intel big data for aws summits rev3Presentation Transcript
The Disruption of Big Data Speaker Name Date
Agenda• Big Data – what is it?• Hardware Economics & Big Data Implications• Benefits of Intel® Inside• Customer Case Studies
Data is getting big,but what is Big Data?
Data Growth Phenomenon Photos uploaded to750M Facebook over 2011 new year’s weekend Data stored In Tweets sent 966PB Manufacturing as of 2009 200M every day in August 2011 Video generated every6.7PB day in a Smart City project in China Potential annual value $20B+ Spent on $60B from Big Data to US health care acquisition of data storage, management, and analysis companies in Value for service last 12 months provider from global$100B+ personal location data Decrease in product 50% development, assembly costs for manufacturing Source: McKinsey Global Institute Analysis
What is Big Data? Traditional Data Big DataVolume Gigabytes to Terabytes Petabytes and beyondVelocity Occasional Batch – Complex Event Processing Real-Time Data AnalyticsVariety Centralized, Structured i.e. Database Distributed, Unstructured Multi-format
Why is Big Data Important? Smart City Project: Up to 50% Decrease Improve Public in Product Safety, Boost Development and Economic Growth Assembly Costs1 Online Retailer Generate Revenue Generated 30% of from Data Analytics Sales Due to of B2B Sales Analytics Driven Recomendations1 Data is the Raw Material of the Information Age1::McKinsey Global Institute Analysis *Other brands and names are the property of their respective owners.
Hardware Economics& Big Data Implications
Changing Economics for Big Data Challenges Annual Server Unit Shipments Supercomputing in 2010 1997 >500 TFLOPS ~$55K/GFLOP ~1 TFLOP <$100/GFlop1990 2000 2000 2010 Performanc $/GFLOP e
The Heart of a Next Generation Cloud Intel® Xeon® E5: The Cloud’s primary building block • Up to 80% performance boost vs.. prior gen1 at consistent power level • Dramatically reduce compute time with Intel® Advanced Vector Extensions • Performance when you need it with Intel® Turbo Boost Tech 2.0 • Up to 66% reduction in total cost of ownership1 Delivers 100X Performance Boost since 2000 Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. 1 Over previous generation Intel® processors. Intel internal estimate. For more legal information on performance forecasts go to http://www.intel.com/performance 2 Intel measurements of average time for an I/O device read to local system memory under idle conditions. Improvement compares Xeon E5-2600 family vs.. Xeon 5600 series 3 Source: Intel internal analysis (backup); 2008 of 3 yr TCO. 4X power efficiency of 4 year old servers. See www.intelsalestraining.com/xeonestimator9 4 Intel. As reported at Q1’12 Intel earnings call.
Benefits of Intel® Inside
Intel® Xeon® Processors:Solve the Most Important Problems of Any Scale 373 of Top500* supercomputers are powered by Intel® Architecture
Enabling a Vibrant EcosystemIntel Software and Services Intel Software Network: Engaging 7,000 ISVs via Providing resources Software Partner Program to > 8.3M developers Provisioning >2800 academic institutions with curricula, tools, training and research Support Open SourceEnabling AWS to run your choice of OS, Applications & Programming Languages
Amazon Web Services powered byIntel® Xeon® processor E5-2670 Access to Supercomputing On-demand Latest Intel® Xeon® performance enhancements without disruption Business Agility to Efficiently Perform Data Intensive Tasks in Less Time
Intel® Powered Supercomputer at AWS AWS built the 42nd fastest supercomputer in the world 1,064 Amazon EC2 CC2 instances with17,024 cores 240 teraflops cluster (240 trillion calculations per second) Less than $1,000 per hour Based on Intel® Xeon® processor E5-2670 Supercomputers by the Hour … for Everyone
Intel® & AWS deliver scale that lowers your cost AWS Scale & Innovation… … Drives Customer’s Costs Down Attract More Invest in Customers Capital Reduce Invest in Prices Technology 19 AWS Price Reductions Improve Efficiency Fueling Innovation in the Cloud
Business AgilityExperiment Often & Fail Quickly with AWS on Intel Cost of failure falls dramatically People are free to try out new ideas More risk taking, more innovation
Customer Case Studies
Example use cases: Life Science Log analytics Social Networking
With Nimbus Discovery, looking at a cancer drugtarget: • Completed 12.55 Compute Years of Work • Analyzed ~21 Million Ligands • In only 3 hours, at a cost of $4828.85 / hour • Instead of $20+ Million in infrastructureIntel & AWS make impossible Big Science, possible
Weblog Analysis Suggests What You Are Searching For Better consumer experience through Big Data analysis20
Power and Simplicity of AWS on Intel® Xeon® Processors:Speeds your Time to Market
Tick-Tock Development ModelSustained Xeon® Microprocessor LeadershipTick Tock Tick Tock Tick Tock Tick Tock 65nm 45nm 32nm 22nm Intel® Core™ Nehalem Sandy Bridge Microarchitecture Microarchitecture Microarchitecture First high-volume Up to 6 cores Up to 8 cores server Quad-Core and 12MB Cache and 20MB Cache CPUs Integrated memory controller Integrated PCI Express Dedicated high-speed with DDR3 support bus per CPU Turbo Boost 2.0 Turbo Boost, Intel HT, AES- HW-assisted NI1 Intel Advanced Vector virtualization (VT-x) Extensions (AVX) End-to-end HW-assisted virtualization (VT-x, -d, -c)
APPROVED FOR PUBLIC USE Intel® Xeon® Processor E5-2600 Product Family Historical 2S Integer Throughput Performance Integer Throughput Performance Single Core 100X Dual Core Quad Core Six Core Eight Core Baseline Score Higher is better Xeon 1.00Xeon 1.26Xeon 2.20 512KB 3.06Xeon 3.20Xeon 3.60Xeon 3.80 2M 3.00Xeon 3.00 8M L2 QCXeon 2.93 8ML3 QC (2009) GT/s QPI GT/s QP 256KB L2 512KB L2 (2001) L2 (2002) (2003) L3 (2004) L2 (2004) L2 (2005) DC (2006) 12M L2 QC (2008) 2.9 20ML3 8C 8.0 (2010) (2000) Xeon 1M L3 2M 1M Xeon 4M L2 Xeon 3.33 (2007) 3.46 Xeon 6C 6.4 Xeon 12ML3 Intel® Xeon® Delivers 100X Boost in 2S Integer Throughput Performance since 2000 Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. Source: Intel Internal Assessment and Estimates. For more information go to http://www.intel.com/performance25