An Integrated Approach to Database Performance Management to ...
Upcoming SlideShare
Loading in...5

An Integrated Approach to Database Performance Management to ...






Total Views
Views on SlideShare
Embed Views



0 Embeds 0

No embeds



Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
Post Comment
Edit your comment

    An Integrated Approach to Database Performance Management to ... An Integrated Approach to Database Performance Management to ... Document Transcript

    • TECHNOLOGY BRIEF: IMPROVING MAINFRAME DATABASE PERFORMANCE An Integrated Approach to Database Performance Management for DB2 for z/OS Environments Adam Frary CA P RO D U CT M A R K E T I N G
    • Table of Contents Executive Summary SECTION 3: BENEFITS 8 Realizing a Singular Goal Through Automated SECTION 1: CHALLENGE 2 and Repeatable Processes A Fractional Approach to Complex Problems: The Reality of Functional and Technology Silos SECTION 4: CONCLUSIONS 10 Reversing the Cycle So Many Problems, So Much Performance Data: Where to Start? Getting a Handle on Performance Data SECTION 2: OPPORTUNITY 5 Enabling a More Comprehensive Approach to Performance Management Better Data Enjoyed by All Integration Across the Performance Management Lifecycle Intelligent Tools Can Carry Much of the Load Copyright © 2008 CA. All rights reserved. All trademarks, trade names, service marks and logos referenced herein belong to their respective companies. This document is for your informational purposes only. To the extent permitted by applicable law, CA provides this document “As Is” without warranty of any kind, including, without limitation, any implied warranties of merchantability or fitness for a particular purpose, or noninfringement. In no event will CA be liable for any loss or damage, direct or indirect, from the use of this document, including, without limitation, lost profits, business interruption, goodwill or lost data, even if CA is expressly advised of such damages.
    • Executive Summary Challenge Difficulties in managing IT issues in large enterprises often stem from poor integration between technologies used to monitor and manage complex environments. Many offer limited information on the core problem — or worse — provide a narrow view of symptoms of the problem and deliver that information to a small subset of the stakeholders who need it. With regard to database performance management, this lack of end-to-end integration affects database management teams, application teams and others responsible for meeting business SLAs and ensuring end-user satisfaction. Even more concerning, the fractional approach to “problem solving” that it fosters results in a large disconnect between and among database administrators (DBAs), data modelers, capacity planners and their peers in application development, storage and other IT groups. Opportunity Integrated mainframe database management capabilities and tools across functional areas help infuse a more disciplined, collaborative and efficient approach to database performance management. This technical change can produce a fundamental and productive change in organizational culture that is necessary to deliver higher levels of visibility and accountability, in addition to superior database performance results. With one view, one click and one truth regarding mainframe database performance, database personnel can break down the siloed functional walls within an enterprise and create the foundation necessary to work from a common set of database performance information. Benefits The components of the CA Mainframe Database Performance Management for DB2 Suite work seamlessly to deliver the comprehensive knowledge organizations require for holistic DB2 performance management, easing overall IT performance workload by: • Collecting and monitoring a rich set of DB2 performance data • Deriving the root cause of database performance problems • Automating responses to performance issues and prioritizing performance issues that demand expert, labor-intensive attention This integrated approach spans the database management lifecycle to improve responsiveness, enhance productivity and reduce costs and risks. TECHNOLOGY BRIEF: IMPROVING MAINFRAME DATABASE PERFORMANCE 1
    • SECTION 1: CHALLENGE A Fractional Approach to Complex Problems: The Reality of Functional and Technology Silos Today, many enterprises suffer higher database management costs, lower productivity and poor responsiveness that can ultimately be traced to a siloed or fractional approach to complex problems. Without tightly integrated performance management technologies and an organizational structure that facilitates collaboration and cooperation, these organizations spend more time and resources reacting to performance issues and less time on proactive performance management. They also have little coordination between and among functional teams, such as database management, applications management, systems management and storage management. Meanwhile, a lack of integration and automation for related technologies can lead to a narrow approach to database management — and specifically to database performance management — that can hinder accurate and comprehensive database/application performance monitoring and slow or misdirect optimum problem remediation. This lack of integration can exacerbate the challenge of aligning the efforts of teams responsible for managing and improving the performance of complex business services that span all aspects of well-performing data infrastructures — from database design, SQL tuning, subsystem and object management and backup and recovery to application development, storage and network management. In turn, the urgency of performance challenges can result in a variety of knee-jerk reactions to ongoing database performance management problems, including stop-gap investments in unwarranted CPU upgrades, unproductive finger-pointing between functional teams and a diminishing ability of the broader organization to be proactive in managing for performance. Reversing the Cycle These problems are reflective of a larger struggle between and among database and IT performance stakeholders. Functional groups (database, applications, storage, systems, network and so on) approach the portion of the problem, or worse, symptoms of the core problem, that they see from their own siloed area of expertise and purview. And, as there are many contributing factors to poor performance, there are typically many potential remedies. The result? Representatives of the various functional areas may lobby to deflect attention from their “portion of the problem” or compete with other groups for a share of the limited resources. As teams push to delve into these issues, they tend to lose the latitude to contribute to holistic IT performance management. Over time, the process repeats and the focus becomes even narrower. 2 TECHNOLOGY BRIEF: IMPROVING MAINFRAME DATABASE PERFORMANCE
    • To affect real change, organizations require a highly cooperative, cross-functional solution to complex database performance problems, supported by very rich performance data, to evaluate which remedy or combination of remedies warrants resources. Without integrated technologies that foster best-in-class performance monitoring, exceptional problem remediation and cross-functional communication and collaboration, there is a real risk that the full complement of remedies is overlooked. So Many Problems, So Much Performance Data: Where to Start? Powerful technologies are encouraging more attention and emphasis on database performance management. That focus is creating renewed interest in integration that supports new levels of automation. For DB2 for z/OS, for example, the possibilities of performance gains entice and compel enterprises to continually “raise the bar” on IT teams. Stringent service level agreements (SLAs), increased pressure on small, expert teams of DBAs and more easily tracked IT performance measures all fuel the rush to tuning for optimum database performance. DATABASE TUNING Still, there are many obstacles to realizing this desired, optimal state. Most notable is the complexity and dynamic nature of database and application infrastructures. Even well-tuned databases outgrow their initial scope and design parameters, can be overtaxed by unforeseen loads, or may simply experience deteriorating performance as they evolve, become disorganized or when applications that request the data change over time. DATABASE MONITORING Monitoring performance of complex data and application infrastructures is difficult. Many performance management technologies actually consume valuable resources to the point that utilizing these resource-hungry tools degrade the very performance they are employed to improve. DB2 for z/OS itself generates an enormous volume of performance data to assist DBAs. And, for very large enterprises, this equates to monitoring millions of SQL statements, capturing and storing that data, then making that performance data available for DBAs to view and mine. But, simply finding the “top ten” SQL statements requiring attention is a challenge in and of itself. Is the longest-running SQL statement the one needing attention or is time better spent attending to a short-running SQL statement that runs millions of times per day? TECHNOLOGY BRIEF: IMPROVING MAINFRAME DATABASE PERFORMANCE 3
    • OTHER PERFORMANCE MANAGEMENT NEEDS Efficient SQL access paths rely on accurate DB2 Catalog statistics. The DB2 optimizer relies on these statistics to help determine which access path to use for a given SQL statement. When the statistics are not current, database performance suffers. The continual use of RUNSTATS keeps the statistics up to date, but can negatively impact the DB2 system and may not provide the best performance data available. Other common problems database teams struggle with include: • Maintaining and improving database performance while keeping data available and consistently online • Attacking performance issues from both top-down and bottom-up approaches (application plan package DBRM SQL statement) • Balancing reactive, real-time performance management demands with proactive, in-depth analysis based on longer term historical performance data • Preparing for performance in test environments that do not actually reflect production; subsequent changes made in production are much more expensive to implement • Managing performance of packaged applications that ship with pre-set SQL and numerous tables and indexes that may not be necessary or suitable for a specific database or business environment • Systematically investigating complex performance problems from multiple angles, such as evaluating changes in applications, access methods, SQL, database objects, buffer pools and so on • Automating the appropriate aspects of performance management so that expert resources can focus on those performance problems that warrant a skilled, labor-intensive approach Getting a Handle on Performance Data There is great pressure to resolve performance problems quickly, but where should you actually start? Moreover, how do you facilitate focused, efficient problem-solving without sacrificing a holistic approach to performance management? Is the problem a DB2 subsystem requiring changes to DB2 parameters? You may have a DB2 buffer pool that is experiencing a high rate of synchronous I/O and is causing a performance problem. But, is that because the application driving the I/O has poorly written SQL that cannot use prefetch or because DB2 prefetch has been disabled for that buffer pool? Is the application the source of poor performance or should the database team be consulted first? Is the primary answer as simple as archiving more data? Performance degradation could stem from one underlying problem, or quite possibly be caused by a combination of stresses to the system that eventually degrades performance to the point that SLAs are missed and users are complaining loudly and often. 4 TECHNOLOGY BRIEF: IMPROVING MAINFRAME DATABASE PERFORMANCE
    • SECTION 2: OPPORTUNITY Enabling a More Comprehensive Approach to Performance Management Better Data Enjoyed by All The first step toward improving the approach to database performance management should entail ensuring the creation of superior database performance data and sharing that data in a usable context with all appropriate stakeholders who may work in various functional groups and be aligned to various IT silos. Keeping your DB2 Catalog statistics current requires you to collect RUNSTATS on a regular basis, and this is especially important if you have applications that use dynamic SQL or where data volumes vary widely over time. But in large enterprises that maintain increasingly large data volumes, consistently running RUNSTATS can be very expensive, time consuming and may not yield all the performance data actually desired. With CA Database Performance Management for DB2 for z/OS, however, you can replace the use of RUNSTATS and rapidly collect DB2 Catalog statistics through a CA process. This allows you to aggregate statistics more frequently and with less impact to your system. The CA Extract Procedure employs multi-tasking, so multiple objects are processed in parallel. This allows for collection of nearly twice the number of data points for each object compared to RUNSTATS. While DB2 provides accounting traces, performance traces and statistics reports, these datapoints are difficult to interpret, are far from automatic and their use impacts performance of the systems they actually monitor. With CA Insight™ Database Performance Monitor for DB2 for z/OS (CA Insight DPM for DB2), you can collect performance data from z/OS subsystem interfaces, DB2 and z/OS control blocks, zIIP processor fields and DB2 performance traces and access performance statistics online. CA Insight DPM for DB2 can monitor DB2 subsystems, DB2 connections from CICS, IMS, NATURAL and network-connected applications outside the z/OS environment. It also delivers application statistics to troubleshoot problems as they arise. Additionally, CA Insight DPM for DB2 traces dynamically, which enables traces as needed to minimize overhead. Finally, in contrast to native DB2 performance data, the data from CA database performance management technologies is easy to understand, customize, analyze and off-load for sharing with other stakeholders. For instance, data from CA Database Analyzer™ for DB2 for z/OS can be viewed as a data query, a graph, a trend or forecast and aggregated by various time slices. TECHNOLOGY BRIEF: IMPROVING MAINFRAME DATABASE PERFORMANCE 5
    • Integration Across the Performance Management Lifecycle Another important step is connecting the phases of performance management from real-time monitoring, to historical trending through problem analysis and execution of the right combination of steps to address the underlying problems. And with CA technology, you can take an end-to-end, multi-pronged approach and include all relevant data assets, such as DB2 subsystems, databases and applications. This integration extends across DB2 performance management technologies to DB2 administration and backup and recovery technologies. With CA Database Analyzer, for example, you can define conditions that can trigger jobs, such as a database reorg using CA Rapid Reorg® for DB2 for z/OS (CA Rapid Reorg), IBM utilities or other utility programs. With CA Rapid Reorg, database reorganizations are conducted quickly and DBAs can control when access to the database object is suspended. Moreover, the product maintains: • The highest levels of data availability through the use of multi-tasking • Parallel processing of partitions • An intelligent approach to sorting of compressed data and offers an online reorg capability Intelligent Tools Can Carry Much of the Load According to a survey conducted in April 2008 of 853 data professionals who are members of the International DB2 Users Group (IDUG), database performance management is the top operational challenge. However, few of these data professionals indicate that they have ample time, staff, skills or management tools to adequately address challenging issues. Prioritizing the right problems to attack is just part of the answer. Allocating precious computing resources to resolution is another piece of the puzzle. A third involves automating appropriate performance management tasks. Automation frees key staff from mundane tasks so they can focus on issues that demand labor-intensive investigation or remediation. By automating the monitoring of performance through thresholds using the Exception Monitor in CA Insight DPM for DB2, DBAs are able to react more quickly when problems occur. This also frees the staff to dedicate more cycles toward proactive performance management because they are no longer stuck watching screens looking for potential performance problems. CA performance management technologies for DB2 collect vast amounts of data while reducing the burden on IT teams. Using CA Detector® for DB2 for z/OS (CA Detector), performance management stakeholders are able to view activity at the application, plan, package, DBRM and SQL statement level. CA Detector utilizes performance data to address performance at an application level, allowing teams to focus on tuning applications to perform efficiently on your system, rather than tune your system to accommodate deficiencies in applications. CA Detector also shows you the SQL statements that consume the most resources over time, so you can concentrate your tuning efforts where they will provide the greatest benefit. 6 TECHNOLOGY BRIEF: IMPROVING MAINFRAME DATABASE PERFORMANCE
    • CA Subsystem Analyzer for DB2 for z/OS (CA Subsystem Analyzer) utilizes the same datastore and collection processes as CA Detector, but allows performance teams to take a broad, system-wide view to examine the most active DB2 databases, tablespaces, tables, indexes, buffer pools and DASD volumes. Tight integration between these two products allows staff to transition seamlessly and automatically from an application approach to a system/subsystem approach to performance management. For example, you may want to examine the busiest DB2 table with CA Subsystem Analyzer, then evaluate, with CA Detector, all the SQL accessing that table. If the area needing further investigation involves access path selection, CA Plan Analyzer® for DB2 for z/OS (CA Plan Analyzer) can be directly invoked — in-context — for a third interrogation of the issue. CA Plan Analyzer allows users to assess SQL statements at many levels, including all SQL of a complete application, a set of SQL statements in some logical group or a single SQL statement. Integration between CA Plan Analyzer and CA Detector supports analysis of SQL directly within CA Detector application performance management functions. This is especially useful for ERP applications, where dynamic SQL is used. Finally, CA Detector allows you to capture problematic dynamic SQL statements and pass them directly to CA Plan Analyzer for remediation. INTELLIGENT TOOLS COMPLEMENT A REPOSITORY OF PERFORMANCE DATA AND HELP PERFORMANCE MANAGEMENT STAFF Tight integration enables an individual or the broader team of stakeholders to dissect complex problems without losing sight of the larger context that can span functional areas. It also supports intelligent, automated recommendations for addressing performance issues. Sharing a common datastore, for example, exposes the performance data to various CA performance management technologies. CA Plan Analyzer uses the same Enhanced Explain capability and expert system as CA SQL-Ease® for DB2 for z/OS, another CA performance management product. This product offers expert recommendations to improve SQL efficiency by modifying SQL coding, predicate coding or by making changes to physical objects. CA Plan Analyzer augments these recommendations with suggested changes to plans and packages. And, the datastore matures into a powerful repository for change analysis and trending. CA Plan Analyzer can compare current SQL access paths to previous access paths and highlight modifications that may affect application performance. This feature is especially helpful when migrating to new versions of DB2, because it eliminates the need to bind your plans or packages. Using the Compare feature, you only have to evaluate SQL statements whose access paths have changed, rather than all statements in your entire application. TECHNOLOGY BRIEF: IMPROVING MAINFRAME DATABASE PERFORMANCE 7
    • SECTION 3: BENEFITS Achieving the Singular Goal: Improving the Comprehensive Database Experience A consistent set of data, presented within appropriate contexts for different teams, improves cross-functional communication and problem solving. This insight can benefit the enterprise in terms of collaboration and cooperation with regard to database performance, which will ultimately have an influence on organizational workflow and culture. For example, when data models, such as those created with CA ERwin® Data Modeler (CA ERwin DM), are easily accessed or shared across stewards of databases, applications and business information services, or when data modelers and architects are co-located with the application developers and DBAs responsible for physical data models, the team naturally evaluates the full “blueprint” of the database and application system when considering: • What is working well • What is not • What should or could be modified • What the extended consequences might be for performance modifications Similarly, when complex DB2 performance data, such as SQL statement resource consumption, is presented in a business context or mapped to individuals or applications utilizing those statements, the organization benefits. The final result is that the organization gains better visibility, develops more accountability and can better deploy appropriate resources to address performance issues. Integrated mainframe database management capabilities and tools are critical to infusing this additional level of discipline, collaboration and efficiency into a corporate culture — in addition to database performance management. Specifically, a more comprehensive and unified view of database and application performance can provide the technical catalyst to instill a cross- functional culture that is focused on problem-solving, collaboration and accountability. To help, CA Mainframe Database Performance Management for DB2 Suite components work seamlessly to deliver the comprehensive knowledge organizations require for holistic DB2 performance management, easing the overall workload by: • Collecting and monitoring a rich set of DB2 performance data • Deriving the root cause(s) of problems with technologies that interrogate issues from multiple angles • Automating problem resolution where appropriate and providing expert recommendations to assist IT performance stakeholders working in various IT silos 8 TECHNOLOGY BRIEF: IMPROVING MAINFRAME DATABASE PERFORMANCE
    • Specifically, the CA Mainframe Database Performance Management for DB2 Suite includes: • CA Insight DPM for DB2, which monitors DB2 subsystem and application performance problems in real time • CA Database Analyzer for DB2 for z/OS, which automates DB2 object management by gathering information on database growth, organization and performance • CA Detector for DB2 for z/OS, which optimizes performance of applications and databases while minimizing DB2 resource consumption • CA Plan Analyzer for DB2 for z/OS, which determines the impact of SQL statements and access paths on system performance • CA Subsystem Analyzer for DB2 for z/OS, which efficiently tunes DB2 by providing a comprehensive view of subsystem performance within or across LPARs Each product within the suite offers excellent value as a stand-alone product, however, enterprises derive exponentially more benefit through advanced integration and automation when they implement the full suite. This is because the cohesive set of tools is strong across the full spectrum of database performance management and provides a powerful interface to application performance management. This technological breadth and integration is unrivaled. As such, the comprehensive suite eases overall IT performance management workload by: • Collecting and monitoring a rich set of DB2 performance data — making it readily available to numerous performance management stakeholders and associated performance management technologies • Deriving the root cause of database performance problems • Automating responses to performance issues and prioritizing those that demand expert, labor-intensive attention This integrated approach spans the database management lifecycle to improve responsiveness, enhance productivity and reduce costs and risks. TECHNOLOGY BRIEF: IMPROVING MAINFRAME DATABASE PERFORMANCE 9
    • SECTION 4: CONCLUSIONS While each component within the CA Mainframe Database Performance Management for DB2 Suite provides excellent value as a stand-alone product, more IT teams across functional silos will realize far greater benefits by implementing the full set of technologies. The fully integrated suite extends across your environment, delivering comprehensive vision into your data infrastructure, including subsystems, databases and applications. This facilitates a more proactive approach to performance management, better cross-functional collaboration and quicker remediation of performance issues. As such, the CA Mainframe Database Performance Management for DB2 Suite promotes an unparalleled level of integrated and proactive database performance management. To learn more about the CA mainframe database performance architecture and technical approach, visit 10 TECHNOLOGY BRIEF: IMPROVING MAINFRAME DATABASE PERFORMANCE
    • CA (NSD: CA), one of the world’s leading independent, enterprise management software companies, unifies and simplifies complex information technology (IT) management across the enterprise for greater business results. With our Enterprise IT Management vision, solutions and expertise, we help customers effectively govern, manage and secure IT. 330350608 Learn more about how CA can help you transform your business at