Hadoop Slides 1.1 - What is big data?

What is big data? IBM Information ManagementCloud Computing Center of Competence IBM Canada Labs

Agenda • The world is changing… • What is big data? • The IBM big data platform • Examples of big data solutions • Big data solutions and the cloud 22

The world is changing and becoming more… 2 Billion internet users 4.6 Billion mobile phones 44

The world is changing and becoming more… Is it really? 5

What is big data? Big data are datasets that grow so large that they become awkward to work with using on-hand database management tools. Difficulties include capture, storage, search, sharing, analytics, and visualizing. Source: Wikipedia 77

Big data characteristics44x as much data and content over coming decade 2020 35 zettabytes 2009800,000 petabytesInformation is growing at a phenomenal rate Source: IDC, The Digital Universe Decade – Are You Ready?, May 2010 8

Big data characteristics• About 80% of the world’s data is unstructured• It may be data we’ve been collecting before, but could notprocess 9

Two types of big data • Data in movement - streams • Twitter / Facebook comments • Stock market data • Sensors: Vital signs of a newly-born • Data at rest - oceans • Collection of what has streamed • Web logs, emails, social media • Unstructured documents: forms, claims • Structured data from disparate systems 10

The IBM Big Data Platform Data IBM Big Data Solutions Client and Partner Solutions Warehouse InfoSphere Warehouse Warehouse Appliances Big Data User Environments Netezza Developers End Users Administrators Master Data Mgmt InfoSphere MDM INTEGRATIONAGENTS Database Big Data Enterprise Engines DB2 Content Analytics ECM Information Server Business Analytics InfoSphere Streams InfoSphere BigInsights Cognos & SPSS Marketing Open Source Foundational Components Unica Hadoop HBase Pig Lucene Jaql Data Growth Management InfoSphere Optim 12

The IBM Big Data Platform Data Warehouse Big Data Platform Enterprise Integration Traditional Sources New Sources 13

Traditional vs. big data business approaches Traditional Approach Big Data Approach Structured & Repeatable Analysis Iterative & Exploratory Analysis IT Business Users Delivers a platform to Determine what enable creative question to ask discovery IT Business Structures the Explores what data to answer questions could be that question asked Monthly sales reports Brand sentiment Profitability analysis Product strategy Customer surveys Maximum asset utilization 14

Examples of big data solutions Multi-channel customer sentiment and experience analysis Detect life-threatening conditions at hospitals in time to intervene Make risk decisions based on real-time transactional data Identify criminals and threats from disparate video, audio, and data feeds Predict weather patterns to plan optimal wind turbine usage, and optimize capital expenditure on asset placement 16

Examples – IBM Watson 1717

Big data solutions and the cloud • Big Data solutions and the Cloud are a good fit. • The Cloud provides • On-demand access to resources • Elasticity • Utility-like billing • Big Data solutions on the Cloud are mainly appropriate for test/development • Eg: Hadoop was not designed for virtualized environments 1919

INSTRUMENTEDINTERCONNECTEDINTELLIGENTThe resulting explosion of information creates a need fora new kind of intelligence …to help build a Smarter Planet 20

Thank you! 21

Hadoop Slides 1.1 - What is big data?

by Leons Petražickis on Nov 08, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

Statistics

Hadoop Slides 1.1 - What is big data? — Presentation Transcript