SAP Real-Time Data Platform
 

SAP Real-Time Data Platform

on

  • 786 views

Contains interesting data points regarding the information sources driving the data explosion; a comparison of the historical trend for memory and disk prices; and performs a deeper dive into a few of ...

Contains interesting data points regarding the information sources driving the data explosion; a comparison of the historical trend for memory and disk prices; and performs a deeper dive into a few of the software components which are part of RTDP.

Statistics

Views

Total Views
786
Views on SlideShare
786
Embed Views
0

Actions

Likes
0
Downloads
9
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    SAP Real-Time Data Platform SAP Real-Time Data Platform Presentation Transcript

    • SAP Real-time Data Platform – nová strategická platforma SAP preoblasť dátového manažmentuDušan KachaňákDatabase&Technology Business Development, SAP CEESAP Innovation Day, 18.10. 2012
    • SAP Real-time Data PlatformReplication ServerPower DesignerSybase IQSummary
    • SAP Real-time Data PlatformReplication ServerPower DesignerSybase IQSummary
    • New information sources driving data explosion 30M networked sensors nodes growing 30% y/y 5B Mobile Phones Smart phones in Use growing 20% y/y Facebook 800M active users Population of 7B 30B pieces of in 2011 content shared/month 48 hours of video uploaded/minute© 2012 SAP AG. All rights reserved. 4
    • Today’s complex IT environment EDW DM DM DM DM DM DM DM DM ERP EDW CRM EDW Planning EDW Other Apps DB DB DB DB DB DB DB© 2012 SAP AG. All rights reserved. 5
    • Complex IT environment and Trends Big Data Analytics Cloud Mobile Social EDW DM DM DM DM DM DM DM DM ERP EDW CRM EDW Planning EDW Other Apps DB DB DB DB DB DB DB© 2012 SAP AG. All rights reserved. 6
    • SAP data management visionProtect current and extend customers’ future needs Big Data Analytics Cloud Mobile Social SAP Real-time Data Platform Extreme capabilities to transact | move | store | process | analyze© 2012 SAP AG. All rights reserved. 7
    • The future of database technology 1990 – Cost per Terabyte Traditional Database Adoption Disk $9,000,000 Memory $106,000,000 In-memory Computing Adoption 2012 – Cost per Terabyte Disk $60 Memory $4,900 Typical access speeds Disk (13ms) 13,000,000 ns Memory 10 ns Speed 1,300,000 Falling prices move processing Time from Disk/SSD to In-Memory© 2012 SAP AG. All rights reserved. 8
    • Guiding principlesSAP’s current innovative data assets Sybase ESP, SAP Sybase Replication Server, SAP Sybase ASE SAP Sybase IQ SQL Anywhere PowerDesigner, + SAP EIM #1 Transactional #1 Analytics #1 Mobile #1 Unified Database with Database with and Embedded EIM platform for Best TCO Best TCO Database Real-Time SAP HANA Open for Partners SAP Real-time Data Platform© 2012 SAP AG. All rights reserved. 9
    • SAP Real-Time Data Platform – Conceptual View SAP Business SAP Big Data SAP SAP Custom Suite Applications Analytics Mobile 3rd Party Apps BI Clients SAP NetWeaver (On Premise / Cloud) SAP Real-time Data Platform Open Developer API’s and Protocols Sybase PowerDesigner Admin & Management Common Landscape Common Modeling HADOOP Scale-Out Distributed NoSQL MPP Transactional Big Data SAP HANA Platform Streaming Data Replication SAP MDG, MDM, DQ Services SAP Smart Data Services© 2012 SAP AG. All rights reserved. 10
    • SAP Real-Time Data PlatformArchitected by SAP Sybase PowerDesigner SAP SAP Business SAP Big Data SAP SAP Custom Business Warehouse Applications Analytics Mobile Apps Suite 3rd Party BI Clients SAP NetWeaver (On Premise / Cloud) SAP Real-time Data Platform Open Developer API’s and Protocols Common Landscape Management SAP Sybase SQLA Sybase PowerDesigner HADOOP Scale-Out NoSQL Common Modeling MPP SAP Sybase SAP Sybase IQ ASE SAP HANA Platform SAP Sybase ESP SAP Sybase SAP Data SAP MDG and MDM Replication Server Services SAP Solutions for EIM© 2012 SAP AG. All rights reserved. 11
    • SAP Real-time Data PlatformReplication ServerPower DesignerSybase IQSummary
    • SAP Real-Time Data PlatformArchitected by SAP Sybase PowerDesigner SAP SAP Business SAP Big Data SAP SAP Custom Business Warehouse Applications Analytics Mobile Apps Suite 3rd Party BI Clients SAP NetWeaver (On Premise / Cloud) SAP Real-time Data Platform Open Developer API’s and Protocols Common Landscape Management SAP Sybase SQLA Sybase PowerDesigner HADOOP Scale-Out NoSQL Common Modeling MPP SAP Sybase SAP Sybase IQ ASE SAP HANA Platform SAP Sybase ESP SAP Sybase SAP Data SAP MDG and MDM Replication Server Services SAP Solutions for EIM© 2012 SAP AG. All rights reserved. 13
    • Replication: What are we talking about? Storage Database Array  Making replicas (copies) of data  Two types of data replication:  Storage (disk block) Replication  Database (transaction) Replication  Sybase sells database replication, based on changes  Sybase Replication is widely considered to be “best- in-breed”© 2012 SAP AG. All rights reserved. 14
    • SYBASE REPLICATION ARCHITECTURE 1. Client application updates data on primary DBMS server Remote/ 2. Primary DBMS server records updates in transaction log Secondary Sites 3. Rep Agent reads primary log; delivers updates to Rep Server 4. Rep Server propagates committed transactions to other sites Sybase Products 5. Rep Server manages database connections/network routes • ASE 6. Direct Connect component needed for heterogeneous targets • SQL Anywhere • Sybase IQ • HANA NOTE: Rep Agent & Direct Connect Primary Site not required when connecting to Direct Connect for Sybase sources/targets Heterogeneous Targets 1 2 6 • Oracle Replication Agent for 5 • Microsoft Heterogeneous Sources • DB2 3 WAN Access data sources Real-time Events for • Sybase ASE Message Buses • Sybase SQL Anywhere 4 • IBM MQ • Oracle • TIBCO RV Sybase • Microsoft SQL Server • JMS Replication • IBM UDB DB2 and DB2 mainframe© 2012 SAP AG. All rights reserved. 15
    • Sybase ReplicationUse case Scenarios Real-Time Data Movement Data Distribution Real Time Decision Support Disaster Recovery and HA© 2012 SAP AG. All rights reserved. 16
    • Sybase ReplicationReplication and Live Decision Support Application Database ODS or Data Mart DB Rep Server Rep Server DBPlatform and Vendor Independent *HANA Support on RoadmapNo Performance Penalty Target Database Fully UsableReal Time© 2012 SAP AG. All rights reserved. 17
    • Sybase Replication - Data DistributionOne example, many permutations Zagreb (sales department)London (order processing) WAN Rep Option Sales Support for Microsoft Application Order Entry ASE Rep Server Application LAN London (finance department) Continuous replication of changed data One source to many targets Rep Option Financial WAN for Oracle Reporting Application Guaranteed delivery. Publish and subscribe architecture Propagate order info to related Chennai (manufacturing department) downstream applications Can also have bi-directional scenarios Rep Option Manufacturing Can also have many – one and for IBM Planning Application many – many topologies© 2012 SAP AG. All rights reserved. 18
    • Sybase Replication - High Availability, Disaster RecoveryMinimize/eliminate user impact Philadelphia Operations OFFProtect against unplanned outages Replication LINE ASE Server Software, hardware, application failure Unforeseen circumstances like data corruptionProtect against planned outages PRIMARY DATACENTER Software, hardware, application upgrades Denver Operations Enable ops to perform maintenance Replication activities ASE ServerRecover from natural disaster Without geographic restrictions SECONDARY DATACENTER Warm Standby © 2012 SAP AG. All rights reserved. 19
    • Replication Server Fast Facts Leading Recognized as a leading replication product by major product industry analyst firms: Gartner and Forrester Widely 3,000+ customers worldwide including ASE replication proven and heterogeneous database replication Strength in Innovative and patented techniques to dramatically performance improve replication performance and reduce latency Adoption strength More than 170 new customers added in 2011 Recognized as innovation leader with 10+ issued and Innovation pending patents and some key releases in the last 18 months© 2012 SAP AG. All rights reserved. 20
    • SAP Real-time Data PlatformReplication ServerPower DesignerSybase IQSummary
    • SAP Real-Time Data PlatformArchitected by SAP Sybase PowerDesigner SAP SAP Business SAP Big Data SAP SAP Custom Business Warehouse Applications Analytics Mobile Apps Suite 3rd Party BI Clients SAP NetWeaver (On Premise / Cloud) SAP Real-time Data Platform Open Developer API’s and Protocols Common Landscape Management SAP Sybase SQLA Sybase PowerDesigner HADOOP Scale-Out NoSQL Common Modeling MPP SAP Sybase SAP Sybase IQ ASE SAP HANA Platform SAP Sybase ESP SAP Sybase SAP Data SAP MDG and MDM Replication Server Services SAP Solutions for EIM© 2012 SAP AG. All rights reserved. 22
    • SAP Sybase PowerDesigner Capture Design CommunicateDefine current Design & plan for Realize impact ofenvironment future changeDocument Existing Systems “As-is” and “to-be” modeling Graphical, bi-directional understanding from architecture to executionDescribe the Streamlineinteraction implementation CollaborateModel business & technical Generate Change Central repository toartifacts with related metadata communicate, report and share Integrate all aspects Tie business & technical viewpoints across the enterprise© 2012 SAP AG. All rights reserved. 23
    • SAP Sybase PowerDesignerDesign, manage and build the enterprise through architecture Glossary: Unified Business Architecture Language Impact Analysis Fully Application & Integrated TechnologyBusiness and Modeling Technology Models Aligned Business & Technical Enterprise Modeling Modeling © 2012 SAP AG. All rights reserved. 24
    • Modeling and Design SolutionsKey Use CasesOrganizations SolvingInformation Problems MDM, Analytics/BI, Data Quality, IntegrationOrganizations Preparingfor BusinessTransformationDifferentiatorsFull Spectrum SolutionLink & Sync technologyOpen & HeterogeneousEnterprise Scalability © 2012 SAP AG. All rights reserved. 25
    • Modeling Tools Market Competitive Landscape Competitive Positioning of PowerDesigner Against DM, IA and EA tools Types of Modelers Traditional EA Tools Business Analysts BusinessArchitecture PowerDesigner Enterprise Architects Technical Information ArchitectsArchitecture Data Analysts CA Technical ERwin Design Data Architects DBAs EmbarcaderoDevelopment IBM (IDA)Maintenance Oracle Designer RDMS Developers Open Source © 2012 SAP AG. All rights reserved. 26
    • SAP Sybase PowerDesignerProduct road map overview – key themes and capabilities TODAY MID-TERM FUTURE INNOVATIONEnterprise Architecture Streamline Workflow SAP Modeling Framework  Role-based User Interface  Workflow Management  Modeling Framework for All  Repository-based Impact  SAP Solution Manager SAP Modelers (Design & Dev.) Analysis & Library Models (Lifecycle Management)  Full Web Interface (HTML 5)  Project Branch Management  BPMN XML Serialization  Eclipse-based Developer UI  New Quick Search (Modeling Workflow & Process)  Windows/Mobile/Other UIInformation as an Asset  SAP NetWeaver BPM Unified SAP EIM & RTDP  Central Business Glossary SAP RTDP Integration  All Data Movement (Gen/Rev)  Repository Portal Composer  SAP-BO Universe Support  All BI Reporting (Gen/Rev)  Extended “Link and Sync”  SAP HANA API Integration  SAP Data Services IntegrationSAP RTDP Support  SAP Data Services Support  SAP Information Steward  SAP HANA Support Planning for Analytics  SAP MDM & MDG Integration  SAP Sybase IQ Reference  XML Modeling Renovation Transformation Planning Architecture Wizard (Messaging, Canonical)  SAP NetWeaver BPM  SAP Sybase Replication  WYSIWYG Reporting (Charts)  Business & IT planning Server Architecture Support  Open XML Import (ANY XML) focused modeling & reporting Current Planned Innovations Future Direction This is the current state of planning and may be changed by SAP at any time.© 2012 SAP AG. All rights reserved. 27
    • SAP Real-time Data PlatformReplication ServerPower DesignerSybase IQSummary
    • SAP Real-Time Data PlatformArchitected by SAP Sybase PowerDesigner SAP SAP Business SAP Big Data SAP SAP Custom Business Warehouse Applications Analytics Mobile Apps Suite 3rd Party BI Clients SAP NetWeaver (On Premise / Cloud) SAP Real-time Data Platform Open Developer API’s and Protocols Common Landscape Management SAP Sybase SQLA Sybase PowerDesigner HADOOP Scale-Out NoSQL Common Modeling MPP SAP Sybase SAP Sybase IQ ASE SAP HANA Platform SAP Sybase ESP SAP Sybase SAP Data SAP MDG and MDM Replication Server Services SAP Solutions for EIM© 2012 SAP AG. All rights reserved. 29
    • What is Sybase IQ?Sybase IQ is a market leading, high-speed columnar analytics server and data warehousewhich is designed specifically for Data Analytics Designed for Analytics Unsurpassed Performance Lowest TCO• Columnar Database designed for • Up to 1,000X faster than row-based • Reduce the need for aggregates and high speed analytics systems indexes• Eliminates the problems caused by • Enables high speed performance of • Greatly decreased ongoing traditional row-based systems complex queries against large maintenance costs when compared datasets with row-based systems All Data Sources Large Data Volumes Single Data Warehouse Rapid Analytics© 2012 SAP AG. All rights reserved. 30
    • Column-Based Architecture Dramatically Reduced Disk ‘Hits’= Faster Query Results Query: How many MALES buy INSURANCE in OH? Row-based RDBMS 10M Rows x 800 Bytes Gender State Insurance 4KB Page = 2,000,000 I/Os M NY Y M TX Y 10M F CT N  Process large amounts of unused dataROWS M OH Y M IL N  Often requires full table scan or space- - VA intensive indexes and materialized views 800 Bytes/RowColumn-based Sybase IQ 10M Bits x 3 column 512KB Page = 63 I/Os Gender Insured State M Y VA 1 1 0 10M M N OH 10M 1 1 1ROWS F Y NY Bits 0 + 0 + 0 M N OH 1 1 1 © 2012 SAP AG. All rights reserved. 31
    • SAP Sybase IQ Compression Managing large amounts of detailed data Conventional DBMS Summaries Aggregates 1 - 2 TB Same INPUT Data: “Conventional DW” is 3x-6x larger than Sybase IQ DW Indexes 2.4-6 TB This image cannot currently be displayed. 0.5 - 3 TB LOAD INPUT DATA: 1 TB Base table Aggr/Summ: 0 - 0.1 TB “RAW data” 0.25 - Source: flat files, 0.9 TB no indexes LOAD Indexes: 0.05 - 0.3 TB ETL, replication,ODS 0.9 - 1.1 TB Base table: 0.2 - 0.5 TB© 2012 SAP AG. All rights reserved. 32
    • SAP Sybase IQ is the leader in deploymentsSybase has more customers than all of the other specialty EDW leaderscombined 2 000 EMC Greenplum Number of customers IBM Netezza 1 500 Oracle Exadata 1 000 500 Teradata - Others Sybase* Based on industry analyst and vendor statements about number of customers* Vendors selected for ‘Others’ category based on i) ‘leadership’ position in Gartner MQ, ii) havinga specialty Data Warehousing offering (i.e. General purpose databases are excluded)© 2012 SAP AG. All rights reserved. 33
    • But now also part of best of breed stack... Now — A Complete Best of Breed Stack (after acquisition) Operational© 2012 SAP AG. All rights reserved. 34
    • Coinstar/Redbox Information Management Architecture Data Sources Data Analytics DW SQl Server SAP Business Objects 4.0 Source 2 BICS MDX SQL SQL Data Modeling Source 3 SAP Data Services SAP Sybase IQ Enterprise Data Real Time Warehouse Source 4 Replication SAP HANA Near-Line storage of historical data 3 TB  TB Compressed data (2-3 Raw data) 1 (6-7 TB of raw “Near”-real time data storage  Accessible any time from HANA platform as Ad-hoc analytics neededRedbox .com Data structure modeling Modeling analytical views Kiosh© 2012 SAP AG. All rights reserved. 35
    • SAP Sybase IQStrong, established, fast-growing customer base Patented data compression dramatically reduces data storage requirement; cuts TCO Only column-based solution to full text search, in-database analytics, and federated analytics Leader, Gartner Magic Quadrant for Data Warehouse DBMS Provides answers 10 – 1000X faster© 2012 SAP AG. All rights reserved. 36
    • SAP Real-time Data PlatformReplication ServerPower DesignerSybase IQSummary
    • SAP guiding principlesData innovation without customer disruption 1 Innovation and expertise to benefit our customers and leapfrog the market 2 Protect and extend customer investments 3 Massive investment in data management technology Customer Benefit: Increased results and lower risks© 2012 SAP AG. All rights reserved. 38
    • Innovation Pillars – SAP’s Market Categories solutions analytics LoBs applications RDS industries cloud© 2012 SAP AG. All rights reserved. 39
    • Ďakujem za pozornosť!Kontakt:Dušan Kachaňákdusan.kachanak@sap.com