Big data i_za_male_sprint_2012

Uploaded on


More in: Technology , Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads


Total Views
On Slideshare
From Embeds
Number of Embeds



Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

    No notes for slide


  • 1. IBM Big Data Platform Mladen Jovanovski Client Technical Professional - Big Data i za male - Information Management Software IBM Software Group Information Management © 2012 IBM Corporation
  • 2. Information ManagementWhat is the connection? © 2012 IBM Corporation
  • 3. Information ManagementWhat is the connection? David Wallerstein © 2012 IBM Corporation
  • 4. Information ManagementImagine the Possibilities of Harnessing your Data Resources Big data challenges exist in every business today Government cuts acoustic Utility avoids power Hospital analyzes streaming analysis from hours to 70 failures by analyzing 10 vitals to intervene 24 Milliseconds PB of data in minutes hours earlier Retailer reduces time to Stock Exchange cuts Telco analyses streaming run queries by 80% to queries from 26 hours to network data to reduce optimize inventory 2 minutes on 2 PB hardware costs by 90%5 © 2012 IBM Corporation
  • 5. Information ManagementThe characteristics of big data Cost efficiently Responding to the Collectively processing the increasing Velocity Analyzing the growing Volume broadening Variety 30 50x 35 Billion ZB RFID 80% of the sensors and worlds data is counting unstructured 2010 2020 Establishing the 1 in 3 business leaders don’t trust Veracity of big the information they use to make data sources decisions6 © 2012 IBM Corporation
  • 6. Information ManagementChallenge: Study a large Volume and Variety of data atincreasing Velocity to find New Insights of a certain Veracity Multi-channel customer sentiment and experience a analysis Detect life-threatening conditions at hospitals in time to intervene Predict weather patterns to plan optimal wind turbine usage, and optimize capital expenditure on asset placement Make risk decisions based on real-time transactional data Identify criminals and threats from disparate video, audio, and data feeds7 September 12, 2012 © 2012 IBM Corporation
  • 7. Information ManagementIn Order to Realize New Opportunities, You Need to ThinkBeyond Traditional Sources of DataTransactional and Machine Data Social Data Enterprise Application Data Content  Volume  Velocity  Variety  Variety  Structured  Semi-structured  Highly  Highly unstructured unstructured  Throughput  Ingestion  Volume  Veracity © 2012 IBM Corporation
  • 8. Information Management Big Data is a Hot Topic Because Technology Makes it Possible to Analyze ALL Available Data Cost effectively manage and analyze all available data in its native form unstructured, structured, streaming Website Social Media Billing ERP Network Switches CRM RFID © 2012 IBM Corporation
  • 9. Information ManagementTraditional Analytics: Business Requirements Drive Solution Design Business Defines Requirements – What Questions Should we Ask? New requirements IT Designs a Solution require redesign with a set structure and rebuild and functionality Business executes queries to answer questions over and over10 September 12, 2012 © 2012 IBM Corporation
  • 10. Information ManagementBig Data Analytics: Information Sources Drive Creative Discovery Business and IT Identify Information Sources Available New insights drive IT Delivers a Platform integration to that enables creative traditional exploration of all technology available data and content Business determines what questions to ask by exploring the data and relationships11 September 12, 2012 © 2012 IBM Corporation
  • 11. Information ManagementMerging the Traditional and Big Data Approaches Traditional Approach Big Data Approach Structured & Repeatable Analysis Iterative & Exploratory Analysis IT Business Users Delivers a platform to Determine what enable creative question to ask discovery IT Business Structures the Explores what data to answer questions could be that question asked Monthly sales reports Brand sentiment Profitability analysis Product strategy Customer surveys Maximum asset utilization12 September 12, 2012 © 2012 IBM Corporation
  • 12. Information ManagementLeveraging Big Data Requires Multiple Platform Capabilities Understand and navigate Federated Discovery and Navigation federated big data sources Manage & store huge Hadoop File System volume of any data MapReduce Structure and control data Data Warehousing Manage streaming data Stream Computing Analyze unstructured data Text Analytics Engine Integrate and govern all Integration, Data Quality, Security, data sources Lifecycle Management, MDM © 2012 IBM Corporation
  • 13. Information ManagementBig Data will impact every aspect of your business Know Everything about your Customer Analyze all sources of data to know your customers as individuals, from channel interactions to social media. Run Zero-latency Operations Analyze all available operational data and react in real-time to optimize processes. Reduce the cost of IT with new cost-effective technologies. Innovate New Products at Speed and Scale Capture all sources of feedback and analyze vast amounts of market and research data to drive innovation. Instant Awareness of Fraud and Risk Develop better fraud/risk models by analyzing all available data, and detect fraud in real-time with streaming transaction analysis. Exploit Instrumented Assets Monitor assets from real-time data feeds to predict and prevent maintenance issues and develop new products & services. 1414 © 2012 IBM Corporation
  • 14. Information ManagementAchieve Breakthrough Outcomes with Big Data capabilities Achieve Breakthrough With Unique To Analyze Any Outcomes Capabilities Big Data Type Know Everything Visualization about your & Discovery Transactional Customers / Application Data Hadoop Run Zero-latency Operations Data Machine Data warehousing Innovate new products at Speed and Scale Stream Computing Social Media Data Instant Awareness of Fraud and Risk Text Analytics Exploit Content Integration & Instrumented governance Assets15 © 2012 IBM Corporation
  • 15. Information ManagementThere are Many Use Cases for a Big Data Platform Know Everything about your Customer Social media customer sentiment analysis Innovate New Products Promotion optimization at Speed and Scale Segmentation Social Media - Product/brand Sentiment Customer profitability analysis Click-stream analysis Brand strategy CDR processing Market analysis Multi-channel interaction analysis RFID tracking & analysis Loyalty program analytics Transaction analysis to create insight- Churn prediction based product/service offeringsRun Zero Latency Instant Awareness of Risk and FraudOperations Multimodal surveillanceSmart Grid/meter management Cyber securityDistribution load forecasting Fraud modeling & detectionSales reporting Risk modeling & managementInventory & merchandising optimization Regulatory reportingOptions tradingICU patient monitoringDisease surveillanceTransportation network optimizationStore performance Exploit Instrumented AssetsEnvironmental analysisExperimental research Network analytics Asset management and predictive issue resolution Website analytics IT log analysis © 2012 IBM Corporation
  • 16. Information ManagementBusiness-centric Big Data enables you to start with a criticalbusiness pain and expand the foundation for future requirements17 © 2012 IBM Corporation
  • 17. Information ManagementEntry points are accelerated by products within the big data platform1 – Unlock Big Data Analytic Applications BI / Exploration / Functional Industry Predictive Content Reporting Visualization App App BI / Analytics AnalyticsIBM Vivisimo Reporting IBM Big Data Platform 3 – Simplify your Visualization Application Systems warehouse & Discovery Development Management2 – Analyze Raw Rata NetezzaInfoSphereBigInsights Accelerators Hadoop Stream Data System Computing Warehouse 5 – Analyze Streaming4 – Reduce costs with DataHadoop InfoSphere StreamsInfoSphere Information Integration & GovernanceBigInsights18 © 2012 IBM Corporation
  • 18. Information ManagementThe platform advantage• The platform provides benefit as you Analytic Applications move from an entry point to a second BI / Exploration / Functional Industry Predictive Content BI / Reporting Visualization App App Analytics Analytics and third project Reporting IBM Big Data Platform• Shared components and integration between systems lowers deployment Visualization Application Systems & Discovery Development Management costs• Key points of leverage Accelerators • Reuse text analytics across streams and Hadoop Hadoop Stream Data System Computing Warehouse • HDFS connectors between Streams and Information Integration • Common integration, meta data and governance across all engines • Accelerators built across multiple Information Integration & Governance engines – common analytics, models, and visualization19 © 2012 IBM Corporation
  • 19. Information ManagementBuilding with the Open Source Community Big Data Platform Leveraging …and Open Source Giving Innovation … Back …Contributing… jaql PIG ZooKeeper20 September 12, 2012 © 2012 IBM Corporation
  • 20. Information ManagementEnterprise Class Software High availability architecture Failure to support hardware or Tolerance application failure.Big Data Platform Runs on scalable hardware Scale with the ability to Economically dynamically add additional nodes. Security protection for Security & granular data access Privacy control.21 September 12, 2012 © 2012 IBM Corporation
  • 21. Information ManagementPutting it all together …end-to-end big data solution IBM Vivisimo IBM SPSS Netezza Appliance Model Visualize Discover & Publish & Navigate InfoSphere Warehouse InfoSphere InfoSphere Streams BigInsights IBM Cognos Measure Score Streaming Data Sources © 2012 IBM Corporation
  • 22. Information ManagementClients achieve breakthrough outcomes with IBM’s big data platform Imperative Primary Capability Business Value Streamlined support and Run Zero Latency IBM Vivisimo operations by providing visibility Operations Velocity to over 30 data repositories Reduce maintenance Run Zero Latency InfoSphere costs and differentiate by Operations BigInsights optimal turbine placement Know Everything Analyzed call records to InfoSphere about your drive real-time promotions Streams Customers & reduce churn Exploit Increased network Instrumented Netezza availability by identifying Assets and fixing holes Analysis time on 2 PB of Instant Awareness Netezza data cut from 26 hours to of Risk and Fraud 2 minutes23 © 2012 IBM Corporation
  • 23. Information Management THINK24 © 2012 IBM Corporation