The future of Information Management in the next 10 years Cüneyt Göksu, DB2 SME, IBM Gold Consultant [email_address]
Agenda 1. Big Data 3. How existing Data Management Architectures and platforms meet this data growth? 2. Absolute Musts of Data Management 4. DB2 10 for z/OS : More with Less 5. From Big Data to Smart Data
Data Flow becoming... Instrumented Interconnected Intelligent
The situation at a glance “ The industrial revolution of data” Joe Hellerstein, a computer scientist , University of California in Berkeley Time Growth of Computing Power New Information All Digital Data Sensemaking Algorithms Growing Amnesia Index?
How Big is Big Data? Enterprise data doubling every 3 years Storage capacity continue to increase dramatically - access speeds have not kept up At avg. transfer speed of 500 MB/sec - 1 TB of data will require ~30 mins to read from single drive
How Big is Big Data? Wal-Mart : 1M customer txs/hour, feeding 2.5 PB databases Facebook : 40Billion photos and increasing... Big Turkish Bank : 200 M txs/day, 0.06 second/tx UK Land Registery : The world’s largest known OLTP database – 71 TB at UK Land Registry
Existing Platforms and BIG DATA Decentral Central versus
Absolute Musts of Data Management Scalability Availability and DR Security Productivity , Utilization and Performance System Management Labor, Skills and Resources Green IT
Scalability i s the ability of a system to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth Scale-out or Horizontally Scale-up or Vertically
Availability and Disaster Recovery ... measures are classified by either the time interval of interest or the mechanisms for the system downtime Financial Impact of Downtime Per Hour What’s yours?? $704K Chemicals $669K Transportation $786K Consumer Products $997K Banking $1,082K Pharmaceuticals $1,107K Retail $1,202K Insurance $1,345K Information Technology $1,495K Financial $1,611K Manufacturing $2,066K Telecommunications $2,818K Energy Cost Industry segment 2h 11m 15h 20m Annual outage $3.3M $22.9M Cost of Downtime 99.975% 99.825% Availability % Central Decentral
Security protecting information from unauthorized access, use, disclosure, disruption, modification, perusal, inspection, recording or destruction . Last Year , Oracle issued 45 security patches Decentral Central 25 + Years of Secure Operation! In 20 years , DB2 for z/OS has had less than 5 security patches
Productivity , Utilization and Performance Utilization is the proportion of the system's resources which is used by the traffic which arrives at it Specific/Single Workload Mixed Workload Shared Nothing Shared Everything %15-20 Utilization %85-90 Utilization Decentral Central
System Management and Labor System Management is enterprise-wide administration of systems Is it true ? >:::> More Data needs More DBAs and System Management efforts! it highly depends!!! Running on Decentral or Central.
Green IT is environmentally sustainable computing . More Servers Less Servers More Power Less Power More Cooling Less Cooling Decentral Central More Space Less Space
BIG DATA management with DB2 for z/OS “ DB2 for z/OS” is IBM’s 25+ years old flagship database Used by; 62 of the top 62 WW banks 2 4 of the top 25 US retailers Over 100 of the largest Government ’ s in the world 9 of the top 10 global life/ health insurance provider s
BIG DATA management with DB2 10 for z/OS 20,000 thread/subsystem (2,000 for V9) Industry-leading Active/Active Clustering arch. <ul><li>T op 3 IT issues today according to the 2010 IBM CIO St udy </li></ul><ul><ul><li>Reduce Cost </li></ul></ul><ul><ul><li>Improve Service </li></ul></ul><ul><ul><li>Manage Risk </li></ul></ul>Up to 20% reductions in CPU Time Travel Query – IBM is 1 st in the Industry to provide integrated bi-temporal capabilities that is essential for Financial Services customers
BIG DATA management with DB2 10 for z/OS Native XML Processing DB2 10 for z/OS e nables SAP applications to have 6X the number of users and activities on a single system. Virtual storage improvements deliver 10X more scalability Workload Consolidation (OLTP, Batch, DW, BI) Industry leading Hardware Compression since V3 Complete SQL Portability between platforms
BIG DATA management with DB2 10 for z/OS Performance, Performance, Performance Delivered the largest banking benchmark ever at the Kookmin Bank in Korea , a record 15,353 transactions per second Supports the world’s largest known peak database workload - 1.1 Billion SQL statements per hour at UPS The world’s largest known OLTP database – 71 TB at UK Land Registry
* SOURCE : TEMENOS BENCHMARKS; http://h71028.www7.hp.com/enterprise/downloads/TemenosBenchmark.pdf ** SOURCE :http://www.enterprisenetworksandservers.com/monthly/art.php?2976 Source : InfoSizing FNS BANCS Scalability on IBM System z – Report Date: September 20, 2006 *** Standard benchmark configuration reached 8,024 tps, a modified prototype reached 9,445 tps <ul><li>Bank of China ** </li></ul><ul><ul><li>IBM System z9 and DB2 </li></ul></ul><ul><ul><li>TCS BaNCS (Cobol) </li></ul></ul><ul><ul><li>9,445*** Transactions/second </li></ul></ul><ul><ul><li>380 Million Accounts </li></ul></ul><ul><ul><li>IBM benchmark for customer </li></ul></ul><ul><li>HP/Temenos * </li></ul><ul><ul><li>HP Itanium </li></ul></ul><ul><ul><li>Temenos T24 (Java) </li></ul></ul><ul><ul><li>2,153 Transactions/second </li></ul></ul><ul><ul><li>13 Million Accounts </li></ul></ul><ul><ul><li>Largest banking benchmark performance claimed by HP </li></ul></ul><ul><li>Asian Bank *** </li></ul><ul><ul><li>IBM System z9 and DB2 </li></ul></ul><ul><ul><li>TCS BaNCS (Cobol) </li></ul></ul><ul><ul><li>15,353 Transactions/second </li></ul></ul><ul><ul><li>50 Million Accounts </li></ul></ul><ul><ul><li>IBM benchmark for customer </li></ul></ul>System z With DB2 Scales Further Than Best HP Superdome Banking Benchmark System z and BaNCS Online Banking Benchmarks 1589 3120 4665 5723 8024 2603 4360 6622 7443 8983 14252 15353 0 4,000 8,000 12,000 16,000 0 10,000 20,000 30,000 40,000 50,000 MIPS Transactions Per Second (TPS) Linear Scaling HP/Temenos maximum benchmark 2,153 TPS 9445
BIG DATA management with DB2 10 for z/OS Larry Ellison, Oracle's Founder and CEO “ I make fun of a lot of other databases – all other databases in fact, except the mainframe version of DB2. It's a first-rate piece of technology .”
Future: From BIG DATA to SMART Data 2009 800,000 petabytes 2020 35 zettabytes as much Data and Content Over Coming Decade Volume Variety Velocity 44x Organization leaders frequently make decisions based on information they don’t trust, or don’t have 1 in 3 83% of CIOs cited “ Business intelligence and analytics ” as part of their visionary plans to enhance competitiveness Organization leaders say they don ’t have access to the information they need to do their jobs 1 in 2 of CEOs need to do a better job capturing and understanding information rapidly in order to make swift business decisions 60 %
Future: From BIG DATA to SMART Data IBM InfoSphere Warehouse IBM Smart Analytics System Netezza Flexibility Simplicity The right mix of simplicity and flexibility Flexible Integrated System True Appliance Custom Solution Information Management Portfolio (Information Server, MDM, Streams, etc) Warehouse Accelerators
Thank you The future of Information Management in the next 10 years Cüneyt Göksu, DB2 SME, IBM Gold Consultant [email_address]
A particular slide catching your eye?
Clipping is a handy way to collect important slides you want to go back to later.