20120522 Gain Value from Big Data, Mark Brennan


Published on

Mark Brennan, VP Development, SAP Business Objects, Gain Value from Big Data, Run like never before

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

20120522 Gain Value from Big Data, Mark Brennan

  1. 1. Run like never before Mark Brennan, VP Development, SAP Business Objects Roland Krijnen, HANA Pre Sales, SAP Business Objects 24th May 2012
  2. 2. Gain Value from Big Data Mark Brennan, VP Development, SAP Business Objects Roland Krijnen, HANA Pre Sales, SAP Business Objects 24th May 2012
  3. 3. © 2011 SAP AG. All rights reserved. 4 © SAP 2007 / Page 4© SAP 2007 / Page 4© SAP 2007 / Page 4 SAP Group Ireland SAP Business One  Multilingual Support SAP Cloud Support  ByDesign  SuccessFactors  Sales On-Demand Customer Interaction Center  Inbound/outbound support planning Global License Auditing SLS Translations Knowledge Management Partner Services Delivery Knowledge Productisation Services (KPS) Active Global Support (AGS)  Primary Support  Remote Service Delivery  Solution Support (CoE)  Support Advisory Centre IT Shared Service  IT services and support to internal SAP employees Production Unit Product Integration Testing Inside Sales  UKI Pre-Sales (POC)  HANA  Mobile Business Objects  Research & Development  Maintenance Sales  Inside Sales  Financial Shared Services Languages covered by Galway operation include: English German Russian French Spanish Czech Portuguese Dutch Polish Italian Danish Hungarian Swedish Finnish Greek Norwegian Flemish Swiss Philippino Chinese Arabic
  4. 4. © 2011 SAP AG. All rights reserved. 5 SAP Ireland: Development Activities AppHaus  Next generation "office‖ created for SAP Business Objects designers, solutions architects and developers to create technologies that are desirable to users  Inspired by best practices in Silicon Valley with a Design Thinking mind-set  Promotes collaboration, fosters creativity and provides the flexibility to adjust to changing needs Activities  On demand analytic applications, mobile apps, built on HANA delivered in 90-day cycles  Operational BI – provides real time insight into your business, management by exception, real time updates to dashboards, reports and alerts e.g. Fraud detection  Research & Development is focused on accelerating the business impact of SAP Group’s Research Portfolio e.g BI for SAP Precision Retailing
  5. 5. Mastering Big Data to Gain Insight Never Seen Before in Real-Time
  6. 6. © 2011 SAP AG. All rights reserved. 7 Your Business Environment is Constantly Changing… Major trends are elevating the strategic importance of data Dynamic market is driving business  Businesses need information now  Customers expect answers immediately  New business opportunities are needed to compete  Global pressure on margins New interactions are driving a data explosion  Facebook > 800M users with 30B piece of content  YouTube > 48 hours of video uploaded / minute  Mobile phones  5B mobile phones in use  30M network sensors with 30% yearly growth Technical innovation is driving IT  Store large volumes of data on low cost storage  Mine large data volumes with new programming models  Process data faster with low-cost MEM and CPU (In memory computing)
  7. 7. © 2011 SAP AG. All rights reserved. 8 … And Big Data is Driving Analytics Opportunity to gain insight never seen before Verticals Banking, Capital Markets Telecom Consumer Product Goods Retail Government Healthcare Information Providers Functional • Marketing Analytics Digital channels Track visits, discover best channel mix: email, social media, search • Sales Analytics Deep correlations Predict risks based on deal DNA (emails, meetings) pattern match • Operational Analytics Atomic machine data Analyze RFIDs, weblogs, SMS, sensors — continuous operational inefficiency • Predictive Analytics Detailed simulations Liquidity, portfolio simulations — Stress tests, error margins BIG DATA ANALYTICS
  8. 8. What is Big Data? How is impacting your business?
  9. 9. © 2011 SAP AG. All rights reserved. 10 Big Data Offers New Opportunities Gain real-time insight from large volumes of a variety of data DataVolume Customer Data Automobiles Machine Data Smart Meter 7.9 Zettabytes ! Point of Sale Mobile Structured Data Click Stream Social Network Location- based Data Text Data IMHO, it’s great! RFID  1 Terabyte = 1024 Gigabytes  1 Petabyte = 1024 Terabytes  1 Exabyte = 1024 Petabytes  1 Zettabyte = 1024 ExabytesFuture20152011 Large volumes (petabyte is normal) Fast collection, processing and consumption Multiple data formats Competitive differentiator for business 1.8 Zettabytes
  10. 10. © 2011 SAP AG. All rights reserved. 11 The Data Warehouse Institute ―...prediction provides the most business value‖
  11. 11. SAP Real-Time Data Platform Store and process large volumes of a variety of data for real-time business
  12. 12. © 2011 SAP AG. All rights reserved. 13 SAP HANA High-Performance Application Appliance (aka High Performance Analytical Appliance) SAP’s strategic high-performance platform for all analytical and transactional applications (including but not limited to SAP BW and SAP Business Suite)
  13. 13. © 2011 SAP AG. All rights reserved. 14Public RDBMS limits  Performance drops off with larger and larger data – Disk bound – Not designed for massive parallelism – Scaling brings complexity – Maintenance  Database vs Application server – Mismatch – Movement of data
  14. 14. © 2011 SAP AG. All rights reserved. 15Public Combination of Five Fundamental Principles • Everything is “in-memory” • Full leverage of hardware through appliance approach • Massive parallel processing • Columnar store • Push down of business logic close to the data
  15. 15. © 2011 SAP AG. All rights reserved. 16 SAP HANA In-memory platform for real-time business  Analyze data in memory at unprecedented speed  Run multiple queries in parallel at lighting speed  Accelerate business processes with rapid analysis  Develop predictive models to anticipate business needs  Reduce TCO with less hardware, maintenance, and testing SAP HANA SAP BusinessObjects Other Reporting Tools SAP Applications Non SAP Data Sources SAP HANA Studio SAP HANA Database Calculation and Planning Engine Row & Column Storage Real-Time Data Replication (SLT) SAP Data Services
  16. 16. © 2011 SAP AG. All rights reserved. 17 SAP Big Data Processing Framework Architectural View SAP BusinessObjects BI solutions SAP Mobile Applications, Sybase Unwired Platform(Cloud) Transaction Processing DB Engine In-memory Computing Engine DB Engine Analytic Grid DB Engine MapReduce Batch Compute Framework IngestStoreProcessPresent Sybase Replication Server, SAP BusinessObjects Data Services (Integrate / synchronize data across deployment options) Sybase ESP Stream & event processing SAP Big Data Processing Framework SAP HANA Sybase IQ Sybase ESP Monitor / filter streaming events Semi-structured Data Structured Data Unstructured Data HadoopSybase ASE Hive/HDFS SAP Business Suite, SAP BW, SAP Applications (Premise/Cloud)
  17. 17. © 2011 SAP AG. All rights reserved. 18 SAP HANA In-Memory Predictive Analytics Predictive Analysis Library (PAL)  Native predictive algorithms  In-database processing for powerful and fast results  Quicker implementations  Support for K-Means, K-Nearest Neighbor, C4.5 Decision Tree, Multiple Linear Regression, Apriori, ABC Classification, Weighted Score Tables R Integration for SAP HANA  Enables the use of the R open source environment (> 3,500 packages) in the context of the SAP HANA in- memory database  R integration enabled via high performing parallelized connection  R script is embedded within SAP HANA SQL Script Combine the depth and power of in-memory analytics within SAP HANA with the breadth of R to support a variety of advanced analytic and predictive scenarios Y X Z
  18. 18. © 2011 SAP AG. All rights reserved. 19 SAP HANA Sample query performance Before SAP HANA With SAP HANA 13 seconds 77 minutes Please refer to the latest HANA Hardware sizing for the latest certified hardware sizes for maximum storage size on HANA 1.0. Above tests were done in the SAP Lab with customer data-sets. Runs 355x faster 0.04 seconds analysis response time 70 retailers 460 billion records 50 terabytes of data
  19. 19. © 2011 SAP AG. All rights reserved. 20 SAP HANA SAP NetWeaver BW Powered by SAP HANA Supercharged BW Applications SAP NetWeaver BW SAP ERP RDBMS ETL Non SAP Data sources SAP Applications  In-Memory database used as primary persistence data layer for BW  BW manages the analytic metadata and the EDW data provisioning processes  Detailed transactional data replicated from applications for all processes SAP BusinessObjects BI
  20. 20. © 2011 SAP AG. All rights reserved. 21 SAP NetWeaver BW Powered by SAP HANA Feedback from early customers 100x Faster Reporting 15x Faster Data Loading 20% Reduction in Admin & Maintenance FTE Estimated by customer. Customer plans on re-deploying FTEs to BI projects
  21. 21. Why SAP?
  22. 22. © 2011 SAP AG. All rights reserved. 23 Why SAP? The best choice for mastering big data Flexible, open real-time data platform that enables to transact and analyze data simultaneously to enable real-time business Exceptional operational and analytical processing performance with SAP HANA, SAP NetWeaver on HANA, or SAP Sybase IQ Real-time operational insight of changing events with SAP BusinessObjects Event Insight Processor Integrated with Hadoop via SAP Data Services, enabling extraction, text analysis, and data quality rapid bulk loading of unstructured data Powerful predictive analysis with support for R language & SAP BusinessObjects Predictive Analysis Seamless user experience of Big Data analysis with SAP BusinessObjects Business Intelligence tools
  23. 23. © 2011 SAP AG. All rights reserved. 24 THANK YOU Mark.Brennan@sap.com Roland.Krijnen@sap.com
  24. 24. © 2011 SAP AG. All rights reserved. 25 No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice. Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors. Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation. IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System z10, System z9, z10, z9, iSeries, pSeries, xSeries, zSeries, eServer, z/VM, z/OS, i5/OS, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server, PowerVM, Power Architecture, POWER6+, POWER6, POWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered trademarks of IBM Corporation. Linux is the registered trademark of Linus Torvalds in the U.S. and other countries. Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries. Oracle is a registered trademark of Oracle Corporation. UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group. Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc. HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C®, World Wide Web Consortium, Massachusetts Institute of Technology. Java is a registered trademark of Sun Microsystems, Inc. JavaScript is a registered trademark of Sun Microsystems, Inc., used under license for technology invented and implemented by Netscape. SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer, StreamWork, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries. © 2011 SAP AG. All rights reserved Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects Software Ltd. Business Objects is an SAP company. Sybase and Adaptive Server, iAnywhere, Sybase 365, SQL Anywhere, and other Sybase products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Sybase, Inc. Sybase is an SAP company. All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary. The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express prior written permission of SAP AG. This document is a preliminary version and not subject to your license agreement or any other agreement with SAP. This document contains only intended strategies, developments, and functionalities of the SAP® product and is not intended to be binding upon SAP to any particular course of business, product strategy, and/or development. Please note that this document is subject to change and may be changed by SAP at any time without notice. SAP assumes no responsibility for errors or omissions in this document. SAP does not warrant the accuracy or completeness of the information, text, graphics, links, or other items contained within this material. This document is provided without a warranty of any kind, either express or implied, including but not limited to the implied warranties of merchantability, fitness for a particular purpose, or non-infringement. SAP shall have no liability for damages of any kind including without limitation direct, special, indirect, or consequential damages that may result from the use of these materials. This limitation shall not apply in cases of intent or gross negligence. The statutory liability for personal injury and defective products is not affected. SAP has no control over the information that you may access through the use of hot links contained in these materials and does not endorse your use of third-party Web pages nor provide any warranty whatsoever relating to third-party Web pages.