• Like

Data Warehousing: What's Available on System z Today

  • 1,089 views
Uploaded on

This presentation is "as is" as of September 2010. Things have changed and presentation will be updated or replaced in the future.

This presentation is "as is" as of September 2010. Things have changed and presentation will be updated or replaced in the future.

More in: Technology
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
1,089
On Slideshare
0
From Embeds
0
Number of Embeds
1

Actions

Shares
Downloads
19
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Total Solution Event for System z: Brussels 2010Session IM03: Data Warehousing: Whats Available on System z TodayWillie Favero – Data Warehouse on System z Swat Team (DB2 SME)09 September 2010 © 2010 IBM Corporation
  • 2. NoticesThis information was developed for products and services offered in the U.S.A.Note to U.S. Government Users Restricted Rights — Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the users responsibility to evaluate and verify the operation of any non-IBM product, program, or service.IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to: IBM Director of Licensing, IBM Corporation, North Castle Drive Armonk, NY 10504-1785 U.S.A.The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice.Any references in this information to non-IBM Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk.IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products.This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental.COPYRIGHT LICENSE:This information contains sample application programs in source language, which illustrates programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs. You may copy, modify, and distribute these sample programs in any form without payment to IBM for the purposes of developing, using, marketing, or distributing application programs conforming to IBMs application programming interfaces. Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 2 of 63 All rights reserved
  • 3. Trademarks This presentation contains trade-marked IBM products and technologies. Refer to the following Web site: http://www.ibm.com/legal/copytrade.shtml Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 3 of 63 All rights reserved
  • 4. Agenda Why Data Warehouse and Business Intelligence on System z? – Industry Trends – Changing Business Requirements – System z Features An Introduction to Data Warehousing on System z IBM Smart Analytics System 9600 IBM Smart Analytics Optimizer Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 4 of 63 All rights reserved
  • 5. Why System z and zEnterprise 196 for Data Warehousing and BI? zEnterprise 196 processor chip Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 5 of 63 All rights reserved
  • 6. Applications are Moving to Optimized Business ProcessesCreating a New Set of Requirements Customer Service/ Care Online Sales Customer Self Service Marketing/Sales Interactions The focus is on having the right information at the right time To enable the right business Financial decision Trading Fraud Financial Avoidance Planning Supply Chain Optimization Regulatory Compliance Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 6 of 63 All rights reserved
  • 7. Providing the Right Information ..... To the right person, at the right time – ... Changes the Way We Do Business Delivering Information When it Has the Most Impact Traditional Operational Business Intelligence Warehousing Identifying seats for rerouted passengers due to flight delays Caring for high value before the flight arrives customers --------------- Travel and Transportation Identifying related incidents and potential suspects prior to Crime statistics arriving at the crime scene and reporting --------------- Transforms law enforcement Understanding relevant customer info to identify cross sell and up Customer sell opportunities and improve value of sale at the point of sale Analysis --------------- Transforms sales effectiveness Identifying potentially fraudulent claims prior to approval and Insurance fraud payment rather than after the fact analysis & reporting --------------- Transforms insurance fraud Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 7 of 63 All rights reserved
  • 8. Industry Trends that Favor the System z Platform Cost efficiencies of a consolidated, virtual environment – Reduced: labor costs, energy consumption, data center footprint – Improved: ability to manage operations, upgrades, performance Mixed workload environments and operational business intelligence – When warehouse and analytics become more operational, System z platform qualities of service become more critical: • Availability, Reliability, Security Compliance pressures – Centralized data can dramatically improve ease of data governance by reducing the number of servers and copies of data to be managed – Single version of the truth Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 8 of 63 All rights reserved
  • 9. The Changing Data Warehouse Market The data warehouse is a mission-critical system, with data warehouses serving in an increasingly mixed workload capacity, including as a data source for online applications. "Deep mining“ analysts and business analysts are running less-structured but equally complex queries and fast running tactical queries, each with differing service-level expectations. These differing workloads are all competing for CPU, memory and disk access. At the same time, data latency continues to progress from batch to continuous loading demands.Publication Date: 23 December 2008/ID Number: G00163473; © 2008 Gartner, Inc. and/or its Affiliates. All Rights Reserved. Copyright © 2010 IBM Corporation IM03 - Data Warehousing: Whats available on System z today Slide 9 of 63 All rights reserved
  • 10. Data Warehouse/BI Basics - 4 stages between Data and Information Present Transform/ Optimize Excel Store Cubing Warehouse Acquire Operational ETL Applications Data Quality ELT Replication EAI* EII** Where does your System z fit? Operational Source Systems Structured/ Unstructured Data * Enterprise Application Integration ** Enterprise Information Integration Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 10 of 63 All rights reserved
  • 11. Cost effective alternative to masses of commodity servers – Management/Administration costs are already exceeding new server spending – Power and energy costs growing dramatically Spending Installed Base (US$B) W orldw ide IT Spending Trend (M Units) 2000 – $300 Power and cooling costs 50 Raw processing Server m gm t and adm in costs 45 “horsepower” is the primary $250 New server spending 40 goal, while the infrastructure 35 to support it is assumed $200 30 ready $150 25 2010 – 20 $100 Raw processing 15 “horsepower” is a given, 10 $50 but the infrastructure to 5 support deployment can $0 0 be a limiting factor 00 03 98 04 08 10 97 01 05 07 09 96 99 02 06 20 20 19 20 20 20 19 20 20 20 20 19 19 20 20 Source: IDC, Virtualization 2.0: The Next Phase in Customer Adoption, Doc #204904, Dec 2006 Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 11 of 63 All rights reserved
  • 12. Processor Performance and Scalability System z is no longer your father’s mainframe system!!! Additional Capacity using hybrid Technologies zEnterprise z10Customer Engines z9 + Compute Intensive z990 Decimal FP z900 IFL + + Capacity + Crypto zAAP zIIP Accelerators Copyright © 2010 IBM Corporation IM03 - Data Warehousing: Whats available on System z today Slide 12 of 63 All rights reserved
  • 13. IBM zEnterprise System – Best in Class Systems & Software Technologies A system of systems that unifies IT for predictable service delivery Unified management for a smarter system: Unified management for a smarter system: zEnterprise Unified Resource Manager zEnterprise Unified Resource Manager Part of the IBM System Director family, provides platform, hardware and workload Scale out to a trillion Scale out to a trillion The world’s fastest and The world’s fastest and instructions per second: instructions per second: management most scalable system: most scalable system: Unifies management of resources, IBM zEnterprise IBM zEnterprise IBM zEnterprise™ 196 IBM zEnterprise™ 196 extending IBM System z® qualities of BladeCenter® Extension BladeCenter® Extension (z196) (z196) service across the infrastructure (zBX) (zBX) Ideal for large scale Selected IBM POWER7™ data and transaction blades and IBM x86 serving and mission Blades1 for tens of critical applications thousands of AIX® and Most efficient platform Linux applications for Large-scale Linux® consolidation High performance Leveraging a large optimizers and portfolio of z/OS® and appliances to accelerate Linux on System z time to insight and applications reduce cost Capable of massive Dedicated high scale up, over 50 Billion HMC performance private Instructions per Second network (BIPS) 1 All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represents goals and objectives only. Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 13 of 63 All rights reserved
  • 14. Proven Ability to Handle Mixed Workloads The z/OS Workload Manager (WLM) is the most mature and sophisticated workload manager available today Granular WLM policies provide improved performance for mixed workloads Throughput Effects Response Time Effects 900 180 Queries Completed / minute 800 160 700 3x 140 88% + Avg Response Times 600 500 120 faster 100 400 80 300 60 200 100 40 0 20 Triv. Mod Med Large 0 Triv small mod l Large Triv.Mod/ Med Large Moderate/ Med /Large Policy: WLM Policy in Policy: WLM Policy in effect Equal Priority effect Equal Priority Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 14 of 63 All rights reserved
  • 15. 50TB System z Data Warehouse Benchmark Poughkeepsie Lab / Silicon Valley Lab joint effort Deliver proof points of System z scalability in Business Intelligence environment Establish capability of System z to scale to larger volumes Develop best practices of managing large data warehouses Drive unique value of System z – Workload Manager: capabilities to manage mixed workloads – Operational BI: large volumes of users, smaller queries – zIIP: lower cost BI solution – Data compression: minimal overhead with hardware compression SG24-7674 Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 15 of 63 All rights reserved
  • 16. Cost Benefits of System z Reduce Operational Costs Reduce overall Risk Exposure Save on storage using DB2 for z/OS System z Highly sensitive personal or financial data is hardware based data compression without secure and auditable compromising performance DB2 for z/OS data sharing and GDPS provide – Typical savings in the 50-60% range unparalleled availability Index compression, DB2 9, software based Mixed workloads benefit from the capability of the Save on labor, energy, and floor space through world class System z workload manager consolidation to System z Reduced latency and duplication provide a sound – Save up to 85% on floor space** basis for timely and consistent business analysis – Save up to 80% on energy costs** Position for Growth – Save up to 50% on labor resource** Application growth on System z scales well, while cost savings increase Parallel Sysplex and DB2 for z/OS data sharing enable incremental growth System z provides a non-disruptive upgrade path; System z tech dividends make that upgrade path more cost effective ** Based on calculations of savings realized in internal IBM System z consolidation projects Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 16 of 63 All rights reserved
  • 17. An Introduction to Data Warehouse and BI on System z & zEnterprise MDM Server Industry Cognos 8 BI Models DB2 for z/OS InfoSphere Information Warehouse Server Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 17 of 63 All rights reserved
  • 18. The Data Warehouse and BI Solution on System z OLTP data ‘09 ‘09 w InfoSphere New Data Ne InfoSphere Warehouse Warehouse Warehouse Cubing SQW Services DB2 for z/OS InfoSphere InfoSphere Replication Server Cognos 8 BI Information for Linux on Server for System z System z Source Systems : DB2 Serving Up IMS Complete ETL The Enterprise Data Consolidated VSAM Solution Warehouse Enterprise BICombining the Reliability and Availability of DB2 for z/OS with Cost Effective Applications running on Linux for System z Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 18 of 63 All rights reserved
  • 19. Warehouse/BI Highlights of DB2 for z/OS V8 Materialized Query Tables –Improved performance for query Multi-row insert and fetch –Improved speed of warehouse ETL and query Online Schema evolution –Improves availability and efficiency Longer Table and Column names –Increased compatibility with ETL and BI tools Increased SQL vocabulary –Increased compatibility with ETL and BI tools 64 bit support –Expanded size capability Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 19 of 63 All rights reserved
  • 20. Warehouse/BI Highlights of DB2 9 for z/OS Index over Expression –Improved performance on ETL and BI tools Index Compression –Improved use of space (up to 50%) Not Logged Tablespace –More efficient for temporary tables such as Staging tables Universal Table Space – partition by growth –Easier to manage growth –Best of segmented tables and partitioning Utility Improvements –More online utility operations, reduced CPU Overall DB2 9 for z/OS– reduced CPU Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 20 of 63 All rights reserved
  • 21. 21 Top 10 in DB2 10 for z/OS 1. CPU reductions for transactions, queries, & batch 2. Ten times more users by avoiding memory constraints 3. More concurrency for catalog, utilities, and SQL 4. More online changes for data definition, utilities and subsystems 5. Improved security with more granularity 6. Temporal or versioned data 7. SQL enhancements improve portability 8. pureXML performance and usability enhancements 9. Hash, index include columns, access path stability, skip migration, … Pick your favorite! 10.Productivity improved for database & systems administrators, and application programmers Copyright © 2010 IBM Corporation IM03 - Data Warehousing: Whats available on System z today Slide 21 of 63 All rights reserved
  • 22. InfoSphere Information Server on System z Information Services Director Publish SOA services for information integration and access Business Glossary QualityStage DataStage Federation Server Enterprise Data Data Quality: Standardize, Virtualize access to Dictionary Correct & Match Data disparate information Information Analyzer Global Name Recognition Extract, Transform, and CDC & Replication Data Source Profiling & Recognize & Classify Load in Batch or Real- Deliver and replicate Problem Diagnosis Multi-cultural names time changed data Metadata Workbench / FastTrack Manage and track consistent metadata across information integration tasks and automate generation of data flow logic Parallel Processing Rich Connectivity to Applications, Data, and Content Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 22 of 63 All rights reserved
  • 23. Maintaining a Low Latency Warehouse or ODS Replication, InfoSphere CDC, Event Publisher, Classic Event Publisher Provides incremental near real time feed to InfoSphere DataStage from IMS, VSAM, IDMS, Adabas, DB2 all platforms, Oracle, MS SQL Server, Sybase Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 23 of 63 All rights reserved
  • 24. The core Cognos 8 BI components for Linux on System z Reporting • Provides full breadth of report types • Ensures consistent information to all users • Engages business users with simplified role-based interface • Delivers personalized content via email, portal, MS- Office, search and mobile devices etc • Enables collaboration across users, communities and with IT Analysis • Provides guided exploration across multiple dimensions of information • Performs complex analysis and scenario modeling easily and quickly • Exposes the “why” behind trends to reveal symptoms and causes • Moves from summary level to detail levels of information effortlessly Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 24 of 63 All rights reserved
  • 25. Right time Information Dashboards • Provides at-a-glance, high impact views of complex information • Helps quick focus on issues that need attention and action • Are highly visual and intuitive • Combines information across disparate sources Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 25 of 63 All rights reserved
  • 26. Cognos 8 BI for Linux on System z PRESENTATION TIER Broad Range of Capabilities Common Set of SERVICES APPLICATION TIER Services Right time Information Open Data Access DATA TIER (Transactional, Warehouses or Modern data sources) Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 26 of 63 All rights reserved
  • 27. OLAP – Online Analytical ProcessingBI analyses most often involve aggregates andcalculations such as …“I want to see all departments where the totalsalary is greater than $xx and if they exceed theprevious year by 15% then …”Let’s start with a simple SELECT DEPT,(SUM) SALARY AS SUMSALexample … just the sum of FROM BIG_PERSONNEL_TABLEthe salaries … GROUP BY DEPT DB2 will do a vast scan of the table … form the aggregate values … and present the result set to the end user or application …and frequently many business users are DB2 looking at the same data over and over Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 27 of 63 All rights reserved
  • 28. Multidimensional Analytics Multidimensional Analytics (aka OLAP) – Multidimensional view of the business: customers, products, time and measures – Analysis of business metrics/measures over time, previous to “current” – Maps well to Star Schema concepts (Dimensions, Facts, Aggregates) Key Aspects – Dimensions, Hierarchies, Measures, Summarizations – Cross dimensional calculations – Time Series, Parallel Period analysis – Dimensional navigation – slice, dice, drill, pivot Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 28 of 63 All rights reserved
  • 29. OLAP Portfolio from IBM Different methods for different usesMODELING Specialized OLAP Modeling Tools Transformer Turbo Integrator Data Architect IBM Cognos IBM Cognos TM1 IBM IW Cubing PowerCube Services Optimized for write back and high Optimized for broad, general Optimized for very large datasets volatility applications purpose BI usage with very large dimensions Large read only user communities Read/write user communities Large user communities Moderate ‘focused area’ data sets 64 bit in-memory fast performance Large data sets Pre-aggregated static fast results Larger highly dynamic data sets Planned performance/optimization facilities -------------------------------------------- -------------------------------------------- --------------------------------------------OLAP Off-line portable/ partitioned storage Dynamic changing dimensions and hierarchy, Optimized ROLAP Rapid startup for advanced business what-if scenarios, data contribution Zero Latency user self service modeling Common dimensions shared across multi-cube High volume concurrency Automatic time series analysis & trending models Largest Data Volumes Point in time data Budgeting and planning Centralized IT management of information Personal and corporate data sources Personal and corporate data sources Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 29 of 63 All rights reserved
  • 30. InfoSphere Warehouse on System z Adds core data warehouse and analytics capability to DB2 for z/OS: – Advanced physical database modeling and design – In-database data movement and manipulation capabilities of SQL Warehouse Tool (SQW) – Optimize multidimensional reporting and analysis of data with Cubing Services z/OS Linux on System z MS Excel SQW MDX Queries Cubing Services Cognos IW Design Studio OLTP DB2 DWH DB2 Copyright © 2010 IBM Corporation 30IM03 - Data Warehousing: Whats available on System z today All rights reserved Slide 30 of 63
  • 31. InfoSphere Warehouse on System z - Architecture MQT MQT EclipseAdvisorAdvisor Design Studio Design Studio Client Layer • Design and admin client IE/Firefox Admin Console • BI / Reporting tools and Admin Console Cognos 8 BI for Excel apps Windows / Linux System z MDX Cubing Services Cubing Services Engine Engine WebSphere WebSphere SQL Application Server Application Server Application Server SQW Runtime SQW Runtime Linux on System z Partition / IFL JDBC/DB2 Connect/Hipersockets Data Warehouse MQT Cube Metadata DB2 for z/OS DB2 for z/OS Control DB Server DB2 for z/OS DB2 for z/OS IMS IMS VSAM VSAM RDBMS RDBMS Source Systems Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 31 of 63 All rights reserved
  • 32. Cubing Services Supports Microsoft Excel 2007 IBM OLE DB Provider for OLAP Uses Excel Pivot Table Services Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 32 of 63 All rights reserved
  • 33. Cubing Services Supports Cognos All Cognos Studios can access Cubing Services Query Studio Report Studio Analysis Studio Integrate cube data into Cognos Dashboards and Reports Cognos 8 BI uses metadata directly from Cubing Services – no duplicate metadata development Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 33 of 63 All rights reserved
  • 34. Modernize an Existing Reporting ServerTransform it into a DB2 for z/OS Warehouse 1. Model your data for OLAP access using the InfoSphere Warehouse Design Studio 2. Populate your star schema using InfoSphere Warehouse SQW Scripts 3. Build one or more Cube structures using the InfoSphere Warehouse Design Studio 4. Access data through Excel or Cognos MDX queries z/OS Linux on System z SQW Excel 2 MDX Queries 4 InfoSphere Warehouse Cubing Services Design Studio 1 3 Cognos OLTP DB2 DWH DB2 System z Environment Improved with InfoSphere Warehouse Copyright © 2010 IBM Corporation 34IM03 - Data Warehousing: Whats available on System z today All rights reserved Slide 34 of 63
  • 35. Modernize an Existing Reporting ServerAdd Cubing Services to enhance business user experience Data can remain in one single repository – DB2 for z/OS C S ube erver Performance Increasing ease of data compliance, security and 12000 responds time in sec governance 10000 8000 6000 Series1 Analysis can be performed with 4000 high speed through in-memory 2000 caching 0 1.runnocache 1.runcache 2.runcache CPU on System z can be reduced cu eserv cach b er e when more queries can be answered through the in-memory workload contains 30 MDX queries caching Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 35 of 63 All rights reserved
  • 36. Scalable Architecture for Financial Reporting (SAFR)Problem SAFR Solution Wasted I/O or resource contention Generate multiple extracts or reports because of multiple programs simultaneously with a single pass of reading the same transaction data the transaction data Sales Sales Trans Trans SAFR Program Program Program Views A B C A/B/C “Scan sharing” Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 36 of 63 All rights reserved
  • 37. IBM Smart Analytics System 9600 Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 37 of 63 All rights reserved
  • 38. Solution Edition for Data Warehousing –Legendary System z quality, priced aggressively to fit within a shrinking budget Complete Offering: – Solution – based offering – Customized hardware to meet your business requirements Solution – Pre-determined software stack tuned for Data Warehousing Editions workloads – Maintenance for the hardware For a highly available, energy efficient Data Warehousing infrastructure designed for growth Created to simplify your IT decision! Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 38 of 63 All rights reserved
  • 39. New! IBM® Smart Analytics System 9600 Delivers - unprecedented value in deploying new business analytics What’s new: – Delivers a complete end-to-end software, hardware, and services solution for a rapid deployment of business analytics on System z at a compelling price point. Features / Business Value: – Provides unprecedented value for an end-to-end analytics solution on System z – Inherits the unique System z quality of service, for new business analytic workloads – Delivers continuous availability to a centralized single view of the business to support enterprise wide business analytics – Leverages customers existing disaster recovery and backup processes to simplify deployment without requiring additional backup and recovery processes. Client Benefits: Powerful Data Warehouse Software –To deliver enterprise-wide business InfoSphere Warehouse on System z analytics to operational users Cognos 8 BI for Linux on System z –Deliver business insights to the right DB2 for z/OS Value Unit Edition (MLC person, at the right time, in the right context Option) DB2 Utilities Suite z/OS Operating System Stack Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 39 of 63 All rights reserved
  • 40. IBM Smart Analytics System Offerings Deliver AnalyticsValue Across Platforms Faster Time to Value, Faster Business Results 5600Meeting clients where Based System xtheir information is… Consistent value, Right fitted to your needs 7600 9600 Based Power System Based on System z40 Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 40 of 63 All rights reserved
  • 41. IBM Smart Analytics System 9600What is it? How is it different? The IBM Smart Analytics System 9600 is an Secure, Available Business Analytics integrated solution of hardware, software and – Rapidly delivers analytic information to decision makers at services that enables customers to rapidly deploy the time of decision. cost effective game changing analytics across their – New environment for the availability, reliability and business. scalability necessary to stay aligned with the operational systems Simplified administration – Appliance-like delivery – Faster deployment at lower cost. – Leverages customers existing disaster recovery, and backup processes Proven Operational Characteristics – Extends the qualities of service of System z. – Reduces risk through extending System z manageability and security across the entire system. High Value Operational BI – Cost effective way to drive daily operational decisions Delivering business results in days, not months Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 41 of 63 All rights reserved
  • 42. IBM Smart Analytics System 9600High Value Dynamic Warehousing Cognos 8 BI System z InfoSphere Warehouse Cubing Services Data Warehouse Powercube Services DB2 for z/OS VUE Implementation ELT (option for MLC) Services DB2 Utilities Suite Operational Source Systems Image Copy, LOAD, UNLOAD, Structured/ Unstructured Data REORG, etc Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 42 of 63 All rights reserved
  • 43. IBM Smart Analytics System 9600 Software Deeply Optimized by IBM Experts… Flexible Growth… Powerful Data Warehouse and BI Software DB2 for z/OS Value Unit Edition (primary) V9 - Option for MLC DB2 Utilities Suite V9 DB2 Connect InfoSphere Warehouse on System z V9.5.2 IBM Cognos 8.4 BI for Linux on System z IBM Cognos® 8 BI reporting, IBM Cognos® 8 BI analysis, IBM Cognos® 8 BI dashboard, Cognos 8 Go! Mobile, Cognos 8 Go! Search, Cognos 8 Go! Office z/OS Operating System Stack V1.11 z/VM 6.1 Optional Value Priced Add-ons Tivoli OMEGAMON for DB2 Performance Expert Tivoli Directory Server InfoSphere Master Data Management Server InfoSphere Information Server InfoSphere Replication Server Q-Rep, CDC and Event Publisher eligible InfoSphere Federation Server plus Classic Federation on System z SPSS Tivoli ITCAM, ITUAM Cognos Now! For Linux on System z Cognos Blueprints for Healthcare, Banking and others… BI User on-boarding application (as proposed for Smart Analytics Cloud) Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today All rights reserved Slide 43 of 63 43
  • 44. IBM Smart Analytics System Pre-Set Configurations Sized to Meet Business Requirements Data Capacity Sizing Database Size Amt Amt Usable Disk* User Data* 244TB 100TB 122TB 50TB 61TB 25TB 27TB 12TB 10TB 4TB *Usable = Disk for compressed table data, indexes, work files, MQTs etc. *User Data = Raw, uncompressed, user data Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 44 of 63 All rights reserved
  • 45. IBM Smart Analytics System Pre-Set Configurations Sized to Meet Business Requirements BI Capacity Sizing Cognos Workload Max Concurrent Named Users Users 5000 - 10,000 100 50 5-2500 25 Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 45 of 63 All rights reserved
  • 46. Choosing A Deployment Style Standalone Delivery Server delivered in “appliance-like” fashion Virtual Upgrade Delivery Capacity delivered as a “bolt-on” to existing server(s) or as new server(s) depending on customer needs in a “virtual appliance-like” fashion Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 46 of 63 All rights reserved
  • 47. Scales for Your Unique Needs Deployed in scalable increments to match each type of need Rapidly & easily add Rapidly & easily add new capacity as new users as business information & new needs expand analytic capabilities grow Building blocks for each growth increment Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 47 of 63 All rights reserved
  • 48. Faster Time to Value Results in Days Versus Months Build from Scratch Pre-Built June Jan. Testing & Validation 5 Faster Results Installation & Less Risk 4 Configuration Acquire 3 Components Pre-implementation 2 System Sizing Jan. Months Days Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 48 of 63 All rights reserved
  • 49. IBM Smart Analytics Optimizer Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 49 of 63 All rights reserved
  • 50. IBM Smart Analytics Optimizer Capitalizing on the best of relational and the best of columnar databasesWhat is it? How is it different The IBM Smart Analytics Optimizer is a workload Performance: Unprecedented optimized, appliance-like, add-on, that enables the response times to enable train of integration of business insights into operational thought analyses frequently blocked by processes to drive winning strategies. It accelerates poor query performance. select queries, with unprecedented response times. Integration: Connects to DB2 through deep integration providing transparency to all applications. Self-managed workloads: queries are executed in the most efficient way Transparency: applications connected to DB2, are entirely unaware of the accelerator Simplified administration: appliance- like hands-free operations, eliminating many database tuning tasks Breakthrough Technology Enabling New Opportunities Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 50 of 63 All rights reserved
  • 51. Smart Analytics Optimizer – Deep DB2 Integration Applications DBA Tools, z/OS Console, ... Application Interfaces Operation Interfaces (standard SQL dialects) (e.g. DB2 Commands) Smart Data Buffer Log Manager Manager IRLM Manager ... Analytics Optimizer DB2 Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 51 of 63 All rights reserved
  • 52. Smart Analytics Optimizer - Platform View Applications DBA Tools, z/OS Console, ... Application Interfaces Operation Interfaces (standard SQL dialects) (e.g. DB2 Commands) Price/Performance Hardware optimizedz/OS Smart Data Buffer Log Manager Manager IRLM Manager ... Analytics Optimizer DB2 Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 52 of 63 All rights reserved
  • 53. Extreme performance for complex queries Game Changing Performance Rapidly delivers information to decision makers through breakthrough technologies providing dramatic performance improvement. The best of row and columnar store technologies Highly compressed data Compressed data operations In-memory processing Massively parallel architecture Enables decision makers to submit queries they never dared in the past, that analyze trends, predict outcomes, and produce better business results. Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 53 of 63 All rights reserved
  • 54. Target Market: Business Intelligence (BI) Characterized by: – “Star” or “snowflake” schema: Dimensions Region Fact Table Brand City Store Product Month SALES Time Category Quarter – Complex, ad hoc queries that typically • Look for trends, exceptions to make actionable business decisions • Touch large subset of the database (unlike OLTP) • Involve aggregation functions (e.g., COUNT, SUM, AVG,…) • The “Sweet Spot” for IBM Smart Analytics Optimizer! Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 54 of 63 All rights reserved
  • 55. Database Performance Appliance Significantly reduces costs and enables quick time to value Appliance-like, add-on device Application transparent, install and begin reaping the benefits of higher performance Rapidly add new applications and user requirements driving immediate value to the bottom line No need for indices, materialized query tables (MQTs), query plans or query hints Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 55 of 63 All rights reserved
  • 56. Orders of Magnitude Faster for Queries Beta Customer Results For customers who have struggled with gaining the required performance out their complex queries of full table scans, multiple compares, and complex logic – the results are astounding! ... and its acceleration factor : : Runtime of queries w/o ISAOpt Factor with ISAOpt 163 s 48 3s 2311 s 511 5s 25 s 12 2s 1593 s 206 8s 35 s 4 8s 5435 s 1424 4s Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 56 of 63 56 All rights reserved
  • 57. Combining the Smart Analytics offerings in System z: IBM Smart Analytics System 9600 IBM Smart Analytics Optimizer Must Connect to D W GA June 2010 GA 4Q 2010 Complete, end-to-end environment for BI workload Workload optimized, appliance-like, add-on to a Processes ALL queries submitted by end-users Data Warehouse on System z Software: MUST connect TO a DB2 for z/OS environment that is running a BI workload Includes z/OS, DB2 for z/OS, Linux, InfoSphere Will enhance a Smart Analytics System 9600 Warehouse, Cognos, DB2 Connect Software: Supports: Includes ISAO software running on blades and Data movement / ETL connects to DB2 for z/OS to enable query routing End user tools (Cognos) / BI queries/reports to ISAO Data Storage (Data warehouse) Supports: Runs in z/OS-DB2 LPAR, Linux for System z LPAR for (Subset of) complex and long-running BI queries Tooling with access to data in a star or snowflake schema Is an all purpose environment to deploy any BI Order of magnitude acceleration of a SUBSET of workload queries that are selected/routed to ISAO by DB2 for z/OS For acceleration of multidimensional star schema queries, use IBM Smart Analytics Optimizer as add on option Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 57 of 63 All rights reserved
  • 58. Co-locating Transactional and Data Warehouse Workloads Poughkeepsie Lab / Silicon Valley Lab joint effort Managing analytic and traditional workload best practices Using workload manager (WLM) to manage mixed workloads OLAP vs data warehouse workloads Data sharing vs non data sharing considerations Single vs multiple LPAR configurations Implementation considerations Benchmark results SG24-7726 Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 58 of 63 All rights reserved
  • 59. Other Significant System z Data Warehouse Redbooks SG24-7637 SG24-7813 REDP-4606 Enterprise Data InfoSphere Warehouse: A Using IBM System z As the Warehousing with DB2 9 Robust Infrastructure for Foundation for Your for z/OS Business Intelligence Information Management Architecture Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 59 of 63 All rights reserved
  • 60. More Significant System z Data Warehouse Redbooks REDP-3927 SG24-6489 REDP-4668 Workload Management Best Practices for SAP BI IBM zEnterprise for DB2 Data using DB2 9 for z/OS BladeCenter Extension Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 60 of 63 All rights reserved
  • 61. Reference Materials Relevant System z DW/BI Redbooks: – 3 more currently in progress: Cognos on System z, Data Collocation, InfoSphere Warehouse Cognos 8 BI Performance Whitepaper: – http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/WP101437 WLM Magazine Article: – http://www.ibmsystemsmag.com/mainframe/novemberdecember09/tipstechniq ues/26908p1.aspx More info: – http://www-01.ibm.com/software/data/businessintelligence/systemz/ Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 61 of 63 All rights reserved
  • 62. More information on zEnterprise IBM zEnterprise Announcement Landing Page: ibm.com/systems/zenterprise196 IBM zEnterprise HW Landing Page: ibm.com/systems/zenterprise196 IBM zEnterprise Events Landing Page: ibm.com/systems/breakthrough IBM Software: ibm.com/software/os/systemz/announcements IBM System Storage: ibm.com/systems/storage/product/z.html IBM Global Financing: ibm.com/financing/us/lifecycle/acquire/zenterprise/ Global Technology Services: – vanity: ibm.com/services/zenterprise Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 62 of 63 All rights reserved
  • 63. Thai Traditional Chinese Russian Gracias Spanish Thank You English Merci French Obrigado Brazilian Portuguese Arabic Bedankt Danke German Nederlands Simplified Chinese Japanese Copyright © 2010 IBM CorporationIM03 - Data Warehousing: Whats available on System z today Slide 63 of 63 All rights reserved