Jobo 5 im_stools_update_2012_q2


Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Jobo 5 im_stools_update_2012_q2

  1. 1. Helene, European IMS Architecture Team Technical ExecutiveIMS Tools from IBMLatest NewsJune 2012 © 2012 IBM Corporation
  2. 2. DB2 and IMS Data Management Tools Reducing TCO is our first focus Provide autonomic features to add capability 2007+ Reduce your TCO & and simplify operations Increase your value Avoid tedious tasks and reduce errors Preserve your investment in z/OS applications and databases 2004 Autonomic Computing and End to End Monitoring2000: Reduce your TCO 2003: Integration of products, new capabilities, better performance 2001-2002 Product replacements 2003- Day 1 Support © 2012 IBM Corporation
  3. 3. IMS Tools Modernization and Autonomics IMS Database Solution IMS Fast Path Solution IMS Recovery Solution Pack IMS Performance Solution Pack Pack for z/OS Pack for z/OS for z/OS for z/OSIMS DB Reorganization Expert IMS HP Fast Path Utilities IMS HP Image Copy IMS Connect Extensions - Unload, Load, Index Build, IMS DB Repair Facility IMS Database Recovery Facility IMS Performance AnalyzerPrefix Resolution/Update IMS HP Image Copy IMS HP Change Accumulation IMS Problem InvestigatorIMS HP Image Copy IMS Library Integrity Utilities IMS Index BuilderIMS HP Pointer Checker IMS DRF Extended FunctionsIMS Library Integrity Utilities IBM Tools Base for z/OS System / TM SystemData Base IMS HALDB Toolkit Administration IMS Command Control FacilityAdministration IMS Sequential Randomizer Generator IMS ETO Support IMS HP Sysgen Tools IMS Queue Control FacilityUtility IMS Online Reorganization Facility IMS Workload RouterManagement IMS Cloning Tool TM IMS Database Control Suite IMS Configuration Manager IMS Sysplex ManagerBackup and IMS HP Image CopyRecovery IMS DEDB Fast Recovery Application Batch Terminal Simulator IMS Recovery Expert V2 Management Batch Backout Manager Program Restart FacilityPerformance IBM Transaction Analysis WorkbenchManagement IMS Buffer Pool Analyzer Regulatory Guardium S-TAP for IMS IMS Network Compression Facility Compliance IBM Infosphere Guardium Data Encryption for DB2 and IMS Databases 3 © 2012 IBM Corporation
  4. 4. IMS Tools Solution Packs High performance IMS Tools help you perform your IMS database management tasks – providing full end-to-end solutions A full suite of IMS Tools to help with: – Full-function database maintenance – Fast Path database maintenance – Recovery – Performance and tuning IMS Fast Path IMS Database Built on our vision, built for you Solution Pack Solution Pack – Easier to install – Easier to maintain – Increased integration IMS Performance IMS Recovery – Automated Solution Pack Solution Pack – Modern – Built to fit any size shop IBM Tools Base4 © 2012 IBM Corporation
  5. 5. Agenda The Path to Autonomics IMS Performance & Debugging Solutions Update IMS Database Utilities Update IMS Backup & Recovery Update5 © 2012 IBM Corporation
  6. 6. Why Autonomics and ModernizationNow more than ever, business challenges demand it! Unanticipated problems may result in downtime and loss of revenue Increased burden of system management and maintenance Problem determination is time and resource intensive – Expert skills are often spent ascertaining when a problem took place rather than figuring out how to fix it DBA resources are expensive and dwindling – Expert skills are wasted on repetitive tasks Time and resources are not available for developing new applications, pursuing new technologies, and growing business6 © 2012 IBM Corporation
  7. 7. When problems do occur, the impact can be extensive The database server is in trouble. Why am I I’ll create an incident as soon as I can having these database and work on it. I hope no one is events? Everything affected. seems ok. IT Why are these application Operations DB transactions taking so long? Specialist Databases Databases Internet Mainframe E-commerce Load Servers Applications Enterprise Server Business Balancer Applications Analyst Middleware ERP So many calls, Messaging Internet so many incidents. Executives are upset I don’t know what Intranet with orders not to tell customers. Extranet being processed. I need to tell We are behind in them why. order processing. Why? Help IT Business Desk Manager Executive7 © 2012 IBM Corporation
  8. 8. Modern Graphical User Interfaces are critical Modern Graphical User Interfaces – Provide a richer user experience, can convey more information – Reduce the need for IMS or Z specific knowledge – Shorten the IMS learning curve for new DBAs – Enable deeper integration between tools and across platforms – Customers expect it!! Leap ahead to Graphical interfaces for IMS – Focus on Web-based interfaces for administration • Allow access from anywhere – Focus on Eclipse-based interfaces for development Eclipse Web Browser (development) (administration) Developers Administrators8 © 2012 IBM Corporation
  9. 9. IBM Tools Base for z/OS A pre-requisite for all IMS Tools Solution Packs Contains all the necessary common infrastructure components for enabling autonomics and next generation UIs No charge PID – Program number: 5655-V93 s y ic – IBM Tools Base for z/OS 1.3 rts or ie s ver om po ns olic sco t on Re Se P Di Au Auto Discovery IMS Tools Knowledge Base Dynamic Administration Console Application Infrastructure Autonomics Director Policy Services99 © 2012 IBM Corporation
  10. 10. IMS Tools Distributed Access InfrastructureTerminal Emulator z/OS ISPF Tool Browser Tool HTTP Application TCP/IP Server DAI Tool IMS ToolMany IMS Tools P /IP Eclipse TC Tool … BTS10 © 2012 IBM Corporation
  11. 11. IMS Administration Console Goals Provide a holistic view of your IMS system from a single, easy-to-use web interface – Dynamic, interactive graphs and charts provide you with a visual representation of your sensor data – Integration with the Autonomics Director provides a list of policy exceptions and recommended resolutions for all of your monitored databases – All IMS Tools reports stored in the IMS Tools Knowledge Base can be searched, retrieved, and viewed effortlessly Prepare for the next generation of IMS DBAs – Uses the latest web technologies for a rich user experience – Access from anywhere via the Internet using the most popular web browsers – Includes a robust help system that serves as a learning aid for new IMS DBAs.11 © 2012 IBM Corporation
  12. 12. Overview of IMS Resources with Drill-down Resource status, errors, and recommendations can be aggregated with an ability to drill down12 © 2012 IBM Corporation
  13. 13. Holistic View of IMS Resources …from Various HP Tools …from Autonomics Director…from Auto Discovery …from Sensors13 © 2012 IBM Corporation
  14. 14. Prepare the next generation of IMS DBAs Integrated help educates new and experienced DBAs on database concepts and how to interpret charts14 © 2012 IBM Corporation
  15. 15. Administration Console Benefits Install once, access anywhere via the Internet – Single, server-based installation – Access through popular web browsers Safety and security features are built in – Uses SSL and RACF authentication Works “out of the box” – Immediately view your databases using your existing DBRC groups or Autonomics Director monitor list Easily customized – Define your own groups of databases to view Consolidated information at your fingertips – Summary pages provide total counts of warning, severe, and critical exceptions for a database group – drill down to the individual database level from there15 © 2012 IBM Corporation
  16. 16. Policy Services - Using Sensor Data to Help Make Decisions Policy definitions to evaluate specific database states – E.g. the state of space utilization at a specific instance in time – Threshold values are compared against sensor data for a given database or group of databases – When thresholds are met or exceeded, exceptions occur Statistical point-in-time sensor data – Stored in IMS Tools Knowledge Base repository – Historically maintained per user specifications – Over 60 separate data elements related to space usage, optimization, and fragmentation • E.g. data set extents, DASD volume usage, data set free space, roots distribution, RAP usage, CI/CA splits, and IMS free space Two methods to collect sensor data – Standalone database sensor utilities for Full-Function and Fast Path databases – Integrated with existing IMS Tools • High Performance Image Copy, High Performance Pointer Checker • Fast Path Analyzer, Fast Path Online Pointer Checker Works “out of the box” – Ships with predefined policies and threshold values Customizable to fit your shop – You can define your own sets of threshold values – Customize the messages sent when exceptions do occur – Specify who receives which messages and how • WTO, e-mail, or text16 © 2012 IBM Corporation
  17. 17. Autonomics Director Overview Automatic collection of Sensor data On Demand collection/ evaluation for Exploits the power of IMS sysplex immediate issues – Redundant servers for highest levels of – “I have a problem and need the information availability now!” – Spreads data collection/tools workload based on system capacity and status Automatic analysis and evaluation of database status Easily customized for groups or individual – Based on user-defined policies and databases thresholds – Auto-discovery of databases and existing database groups Recommendation for reorganization – User-defined groupings: “These are the – Easy to understand: simple “yes” or “no” databases that I’m responsible for” E-mail or text notification when a – Group-assigned defaults propagate to reorganization is recommended individual databases – Alert DBA to consider taking action Intuitive user interfaces for all users Flexible scheduling around peak workloads – Full ISPF interface – Doesn’t interfere with production throughput – Integrates with new IMS Administration or response Console for viewing database status on the web Works with existing job schedulers17 © 2012 IBM Corporation
  18. 18. Autonomics Director Configuration MVS1 MVS3 Sensors AD AD Sensors Failover Active Server Server AD ITKB AD Master Server Active Server Server Sensors Sensors MVS2 MVS418 © 2012 IBM Corporation
  19. 19. Autonomics Director Process Flow Autonomics Director Master Server Policy Repository Tools Input Monitor Scheduler Repository Services Services DB Sensor Policy/Sensor Evaluation ITKB AD JCL Lib(s) Services Repository Repository Server DBDLIBs Sensor USDB1 HDAM Sensor=8 Eval Data hrs =8 hrs Repository DBRC USDB2 DEDB Sensor=12 Eval RECONs hrs =12 hrs DB Sensor Internal Reader IC Auto Router PC Discovery Services User Interface Services Customization Recommendations1919 © 2012 IBM Corporation
  20. 20. Agenda The Path to Autonomics IMS Performance & Debugging Solutions Update IMS Database Utilities Update IMS Backup & Recovery Update20 © 2012 IBM Corporation
  21. 21. IMS Performance Analysis & Debugging Metrology/CapacityPlanning Monitoring J-n J-1 J ONLINE A n a l y s i s IT CAM Tivoli Decision Support Omegamon IMS/CICS Performance Analyser Transaction Analysis Workbench DB2 Performance Expert d e p t h IMS Problem Investigator Transaction Analysis Workbench DB2 Log analysis LOG21 © 2012 IBM Corporation
  22. 22. IMS Performance Analysis & Debugging … SMF CQS LGSTRM IMS log 110 DB/DC Monitor CEX journal OTMA CQS CEX IMS Connect IMSMQ log IMS TM DL/1 MQ OMEGAMONSMF WAS/z114/115 CICS ATF/TRF120/111 CTG DB2 log CEX CEX IMS Connect DB2 SMFjournal DB2 SP 100/101/102 DDF z/OSOPERLOG SMF / RMF 30,64,88 … /7x22 © 2012 IBM Corporation
  23. 23. IBM Transaction Analysis Workbench for z/OS A transaction analysis framework for System z – Not transaction manager specific – Leverages current IBM tools for transaction analysis Not IMS or CICS specific, but first release provides more synergy with the existing tools for those transaction managers – Synergy with IMS and CICS Performance Analyzer, with IMS Problem Investigator – No prereq for CICS PA, IMS PA or IMS PI Automates collection of data needed for problem analysis Provides a session manager to manage problem analysis through its lifecycle Goal – Enable higher productivity by lower skilled staff, reduce problem analysis time, and serve as a training tool for new support staff – Allow the ‘First Responder’ to determine the most likely source of the problem so that the right subject matter expert can work on the problem – Allow for ‘Deep dive’ problem determination via synergy with other IBM tools • Subject matter experts may also use tools not supported by the Workbench23 © 2012 IBM Corporation
  24. 24. IBM Transaction Analysis Workbench for z/OS (5697-P37) … Integrated CICS and IMS performance management and problem determination System and subsystem performance that directly affects CICS and IMS Integrated CICS-DBCTL performance reporting using both CICS and IMS performance data SMF, OPERLOG, CMF other data sources IMS log DB2/MQ log CICS Transaction IMS IMS Performance Analysis Performance Problem Analyzer Workbench Analyzer Investigator24 © 2012 IBM Corporation
  25. 25. IMS Performance Solution Pack for z/OS IMS Performance Solution Pack IMS Performance Solution Pack Dashboard Custom FORMs based reports IMS Connect Event Collection Rules Based Routing IMS Performance Analyzer IMS Performance Analyzer DB Integrity Check IMS Connect Extensions IMS Connect Extensions IMS Performance Solution Pack Transit Reports IMS Transaction Index IMS Problem Investigator IMS Problem Investigator Log data: ISPF IMS dialog DB2 Reports Websphere MQ IMS Connect Extracts OMEGAMON25 © 2012 IBM Corporation
  26. 26. IMS Connect Extensions Enhances IMS Connect performance, availability & security – Streamlines operational management of IMS Connect and its clients – Flexible access control to Improve system security Enhances IMS Connect availability with dynamic workload management – Management of customer user exits and control of input message traffic Event recording & performance monitoring features – Examine the details and timing of internal IMS Connect events – Collects performance and accounting information for IMS Connect – IMS Connect internal and external transit times and latency times – Exception reporting showing failures and timeouts Provides instrumentation and performance reporting for IMS Connect – Creates detailed IMS Connect reports in conjunction with IMS Performance Analyzer – Solves IMS Connect problems in conjunction with IMS Problem Investigator – Displays IMS Connect activity and utilization in real time – Enables reporting for Omegamon XE, IMS Performance Analyzer, and IMS Problem Investigator26 © 2012 IBM Corporation
  27. 27. Cancel sessions Single consolidated view of sessions running on all systems (or view activity for individual systems or user-defined groups) The system view shows the Extensive details on status of individual sessions all systems27 © 2012 IBM Corporation
  28. 28. IMS Performance Analyzer The premier IMS tools for… – Maintaining service levels and capacity planning – Response time analysis – Monitoring enterprise-wide indicators that can adversely affect IMS performance Analysis of data from the IMS logs, IMS monitor, and IMS Connect – Shared Queue support - merge logs to produce end to end transaction response times – 100’s of fields can be summarized and analysed Forms-based reporting to identify specific processing deficiencies – Reporting on IMS through ISPF dialogs or batch commands Generation of “Transaction accounting index” to be used to intelligently navigate log files with IMS Problem Investigator based on filters Cold start analysis – Analyses what would happen after an emergency cold start of IMS at some point in time (for example, now or at end of log) • Identifies what messages would be lost • What in flight transactions with external subsystems be lost Gap analysis – Identifies periods of time where log records are not being cut – Can highlight an external system event that may have caused IMS to slow down28 © 2012 IBM Corporation
  29. 29. IMS Performance Analyzer … Disk or tape: IMS PA SLDS (or OLDS) ISPF dialog IMS Log records Generates & submits JCL IMS Connect Extensions journal data sets Report/extract request IMS Connect records with input file ddnames Reports IMS Monitor data sets IMS Monitor records Extracts Batch job: report/extract request OMEGAMON Transaction TRF Extractor data sets Specified Index input files29 © 2012 IBM Corporation
  30. 30. IMS Performance Analyzer IMS Performance Analyzer 4.1 Combined IMS and Connect SummaryCOMBSUMM Printed at 11:15:00 04May2006 Data from 11.16.33 18Apr2006 to 12.04.17 18Apr2006 Avg Avg Avg Avg Avg Avg Avg OTMA response time Connect Input Tran CON Resp Input ReadSock ReadExit SAF Call OTMAproc IMS RespTrancode Count Time Time In Time Time Time Time Time . . .BALANCE 14 57 0 0 0 0 51 28DEPOSITORDER 432 1458 540 202 0 5 0 5 0 0 0 0 539 17 522 16 IMS internal response timeWITHDRAW 16 3035 214 214 0 0 605 332 Avg Avg Avg Avg Avg Avg IMS transit breakdownTotal resourceDB Call InputQ Process OutputQ and CPU usage . . . Time Time Time Time Time Count . . . 5 54 0 60 3 2 6 7 4203 4216 2 1 IMS Connect 8 213 17528 17749 1 1 8 291 2251 2549 3 1 response time Avg Avg Avg . . . Connect Output Confirm Time Output XmitExit Time Time • Combined IMS Connect and IMS log metrics 6 0 0 • Design a Form to include required information only 0 1 0 179 0 0 • No restriction on report page width 249 1967 0 • Export to CSV or DB2 as an alternative to reporting Combined Transit analysis report30 © 2012 IBM Corporation
  31. 31. IMS Problem Investigator Analysis of IMS event data can help identify problematic applications and identify system performance issues. IMS Problem Investigator complements IMS Performance Analyzer for enhanced log analysis and reporting. IMS Problem Investigator provides an ISPF interface and batch reporting capabilities that enable the investigator to interactively navigate, investigate, and analyze: – IMS log, IMS Monitor records, IMS Common Queue Server (CQS) log records, – IMS Connect event data, – SMF records – Omegamon TRF log and extract, – DB2 log, – Websphere MQ log extract. Key Features include: – Browse, analyze, and interpret logs – Gain an end-to-end picture of transactions in the Sysplex. – Understand IMS log record with detailed field description and global fields. The TX line action will connect records associated with the same transaction across all logs.31 © 2012 IBM Corporation
  32. 32. IMS Problem Investigator ISPF Reports Extracts dialog Modern IMS transactions affect multiple subsystems Transaction activity merged into a single view Information about these Data sources transactions is recorded in even more sources IMS PA Transaction IMS PI provides a unified IMS log Index logical view of transactions User records spanning all these systems OMEGAMON TRF Extractor TRF records data set IMS monitor IMS Connect SMF Extensions IRLM long-lock WebSphere MQ DB2 log journal records CQS log log extract Transaction activity logged in multiple locations IMS-related subsystems IMS Connect Extensions WebSphere DB2 IMS Connect IMS DB/TM CQS MQ IMS transaction32 © 2012 IBM Corporation
  33. 33. 33 © 2012 IBM Corporation
  34. 34. IMS Problem InvestigatorFormat and navigate log files quickly and easily IMS PI allows you to interactively browse and analyze log records Instantaneous view of the logs Navigate by the time of day Select records to drill down right to the values of individual flag bits34 © 2012 IBM Corporation
  35. 35. Response times over 2 seconds! "WebSphere Application Server waits 2 seconds "IMS responds for a response from IMS. Contact IMS support." in a millisecond." The problem is somewhere in here: a reporting "black hole" between WAS the two product support teams IMS support staff support staff WebSphere Application IMS ODBM IMS Server (WAS) Connect IMS Connect Extensions IMS log Event journal Reports separate IMS IMS response times Tracks DRDA Problem Performance for IMS Connect flow Investigator Analyzer and IMS35 © 2012 IBM Corporation
  36. 36. Agenda The Path to Autonomics IMS Performance & Debugging Solutions Update IMS Database Utilities Update IMS Backup & Recovery Update36 © 2012 IBM Corporation
  37. 37. Utilities Management IMS Database Solution Pack for z/OS IMS Fast Path Solution Pack for z/OS – IMS Database Reorganization Expert – IMS Fast Path Advanced Tools – IMS High Performance Unload – IMS Fast Path Basic Tools – IMS High Performance Load – IMS Fast Path Online Tools – IMS Index Builder – IMS Database Repair Facility – IMS High Performance Prefix Resolution – IMS High Performance Pointer Checker – IMS High Performance Image Copy – IMS Library Integrity Utilities IMS Cloning Tool IMS Database Control Suite IMS Online Reorganization Facility37 © 2012 IBM Corporation
  38. 38. IMS DB Solution Pack DB Solution Pack provides a complete set of high performance tools to unload, load, reorganize, build indexes for, backup, verify, and report on full-function databases DB Space Utilization DB Integrity Check Analysis DB Repair IMS High Performance IMS High Performance IMS High Performance IMS High Performance DB Repair Facility DB Repair Facility Unload Unload Pointer Checker Pointer Checker Unload Reorganization Load IMS High Performance IMS High Performance Prefix Resolution Prefix Resolution IMS High Performance IMS High Performance IMS Database Load Load Reorganization Expert Index Backup Build/Recovery Image Copy IMS High Performance IMS High Performance IMS Index Builder IMS Index Builder IMS Library Integrity IMS Library Integrity Image Copy Image Copy Utilities Utilities IMS Definition Libraries Management38 © 2012 IBM Corporation
  39. 39. IMS Database Reorganization Expert Follow-on product of IMS Parallel Reorganization (IPR) V3R2 IMS Parallel Reorg Driver renamed to “Smart Reorg” features: – Collecting statistics data for database space management • We will call this data the sensor data! – Defining and managing the reorganization policy for detecting space management exceptions – Utilizing the policy for conditional reorganization – Utilizing the policy for exception notification and reporting – Tracking detected exceptions and effectiveness of reorganization IPR Unload, IPR Reload, and IPR DB Scan utilities are also included and are fully compatible with those in IPR39 © 2012 IBM Corporation
  40. 40. IMS Database Reorganization Expert … Concurrent Online Database Read Access Single Step Execution Single Step Execution Sep. 21 Announcement Backup “Smart Reorg” DB - IMS DB Reorganization Expert - IMS High Performance Unload Database Image Copy - IMS High Performance Load - IMS Index Builder - IMS High Performance Image Copy Secondary - IMS High Performance Pointer Checker Index - IMS High Performance Prefix Resolution Index Image Copies - IMS Tools Base Pack Reports and DB DB DB Statistics Admin (Shadow) Automated Database DBRC Sec. Index “Health Check” Processing (Shadow)40 © 2012 IBM Corporation
  41. 41. Smart Reorg utility in Reorg Expert Smart Reorg utility job step Repositories IMS Tools Knowledge Base Reports Report Service IMS Tools Policy Knowledge Conditional Reorg Policy Services Base Support Service Policy Evaluation Server Exception Notification Sensor Data Store Sensor Sensor Data Read Data Smart DB Reorg Analyzer DB Sensor Scanning Online DB Driver Unload Database Parallel Reorganization Reload Service Shadow IMS Tools Online System Interface Database IMS Online Subsystems Smart Reorg utility scans and analyses database, collects sensor data, judges reorganization requirement based on policy, and takes reorganization automatically in one job step!41 © 2012 IBM Corporation
  42. 42. IMS Library Integrity Utilities Productivity aid for managing IMS Definition Libraries DBD/PSB/ACB Integrity Checking Facility Mapper Integrity Checker help prevent system outages caused Reversal by databases corrupted by using wrong DBD Compare Consistency Checking Utility Advanced ACBGen Consistency Checker ensure all the necessary Providing High-speed generation process for definitions have been created for a database processing large volumes of IMS ACBs MFS Reversal MFS Reversal - Convert MFS MID/MOD/DIF/DOF control blocks back into IMS MFS utility control statements MFS Compare - is designed to compare two sets of MFS source libraries42 © 2012 IBM Corporation
  43. 43. IMS Fast Path Solution Pack “An All-In-One Fast Path full maintenance solution” – IMS High Performance Fast Path Utilities (HPFPU) – IMS High Performance Image Copy for z/OS (HPIC) – IMS Library Integrity Utilities for z/OS (LIU) – IMS Database Repair Facility (DB Repair) – Prereq: IBM Tools Base for z/OS DB Space Utilization Analysis DB Repair IMS IntegrityUtilities DB HP FP Check IMS HP FP Utilities DB Repair Facility DB Repair Facility Unload Backup Reload Image Copy IMS Fast Path Solution Reorganization Pack IMS HP Image Copy IMS HP Image Copy IMS Library Integrity Utilities IMS Library Integrity Utilities IMS Definition Libraries Management43 © 2012 IBM Corporation
  44. 44. History of IMS FP Tools IMS 9 IMS 10 QPP GA IMS 11 QPP GA IMS 12 QPP GA Day 1 support for each new IMS release Simplification & Simplification & Modernization Modernization Tools integrated solutions Common Infrastructure FPSP V1.2 Online Tooling Enhancements FP Solution Pack V1 in FPSP V1 Ease of Use HPFPU V3.2 HPFPU components HPFPU V3.2 Enhancements HPIC DB Sensor HPFPU V3 FPA REORG ITKB support LIU Capability HPFPU V2.2 Online Expert Reorg DB rec. length report DB RepairHPFPU V2 FPA ANALYZE Online DMACPRINT Multi areas All in a single package FPA UNLOAD FPA CHANGE FPA EXTRACT HPIC HASH enh. FPSI Support FPA RELOAD FPA DMACPRINT FPB HPIC V4.2 FPO Fast Dump HPIC V4 Enhancements DB Quiesce LIU V2 ITKB support HPIC Image Copy under FPO HPIC V4 LIU V2 Enh. Fast Recovery IC MFS Reversal LIU V1 & Compare FPA support Consistency Checker, DBD/PSB/ACB Compare/Mapper/Reversal, Integration Adv. ACB Generator with DRF/HPIC Integrity Checker Tools Base V1.3 IMS Tools Base V1.1/V1.2 (added AD & AC) IMS Tools Knowledge Base (added Policy Services) 2005 2006 2007 2008 2009 2010 2011 2012 44 © 2012 IBM Corporation
  45. 45. IMS Fast Path Solution Pack V1.2 • IMS Versions supported: V10, V11, V12 Strategic – From individual tools to solution packs IMS FP Solution Pack for z/OS V1.2 – Product simplification and modernization Provides complete tool set • Fast Path Advanced Tool Senso r Senso r – Reorganization and restructure • Unload/reload with/without structure change • Fast Path Online Tool Sensorr Senso • Direct free space reorganization • Fast Path Basic Tools – Pointer check and space analysis – High performance/function Image Copy • IMS High Performance Image Copy Sensorr Senso – Library consistency verification • IMS Library Integrity Utilities Added DB Sensor capability • IMS Database Repair Facility – Supports sensor data collection • Built on Tools Base V1.3 services • Fast Path Stand-alone DB Sensor Sensorr Senso – A core component for Autonomic Director (AD) / Administration Console (AC) solutions IBM Tools Base for z/OS V1.3 • Autonomics Director • Administration Console • Policy Services • IMS Tools Knowledge Base • …45 © 2012 IBM Corporation
  46. 46. Agenda The Path to Autonomics IMS Performance & Debugging Solutions Update IMS Database Utilities Update IMS Backup & Recovery Update46 © 2012 IBM Corporation
  47. 47. IMS Backup and Recovery Databases Pointer OLDS to SLDS/RLDS Checker Tool Online Log IMS Batch Archive Logging Database Image Copy Utility or Tool IMS Database Logging Unload / Reload Image Utility or Tool Copy Unload Dataset Change Database Accumulation Recovery Batch Backout Utility or Tool Utility or Tools Utility or ToolIndex Builder DBRC RECONs Tools Incremental Image Copy CA (-) CA (+) Rebuild Index Recovered Databases System Level 47 Backup © 2012 IBM Corporation
  48. 48. How to identify available resources ? Manually : DBRC commands are great ! What is the image copy frequency in production? Is this automated? Are the jobs scheduled on a regular basis? How often do image copy jobs fail? Is it lack of space or objects not in correct state? What types of backups are being used? – DB2 DSN1COPY, FDR, HSM? – IMS batch image copy (SHRLEVEL reference), concurrent image copy (SHRLEVEL change), SMS image copies? Is storage team already making volume copies of DB2/IMS data? Are you image copying the same object/database many times during a night without you knowing it? Asking for help ? Use RRR Recovery Readiness Do you have control over your backups? Reporter Are incremental copies made? – How many between full copies? – DB2 Merge copy run? – IMS Change Accums? Are these copied to disk or tape? Stacked on tape? Is everything in sync with the ICF catalog? Do you verify recovery on a scheduled basis? Are you taking copies of application spaces – test and production?48 © 2012 IBM Corporation
  49. 49. Resource Readiness Reporter RRR is an informative tool that will provide sites with the help they need in the following: 0 – Risk • Reduce risk of data loss by reporting missed backups Rand – Exposure • Reduce exposure for application outage – Costs • Reveal the price of image copies – by examining their resource usage. Analyzes all recovery resources for DB2 and IMS subsystems over a specified period of time. – Note: Resource usage is valid for only DSNUTILB (DB2 image copies). RRR does not report on CPU/IO for vendor utilities. Same for IMS IC for now. Simple installable “Load and Go” program downloadable from – ibmrrrdi&S_PKG=dl&lang=en_US&cp=UTF-849 © 2012 IBM Corporation
  50. 50. How does it work ? SMF DB2 Catalog Or IMS RECON RRR ICF Catalog RRR will produce a report on – Which tsnames/dbnames do not have a valid image copies within a given time period. – Which tsnames/dbnames have valid image copies within the same time period •And whether or not these “registered” image copies datasets still exist on the z/OS system – The CPU and I/O resources required to create these image copies – It shows IMS Change Accum consumption50 © 2012 IBM Corporation
  51. 51. Sample Report- SMF Report for IMS START-TIMESTAMP/ END-TIMESTAMP INFO Image Copy consumption of resources Change Accum resource consumption summary This information is for the LPAR – break down on how often ICs are done and which day5151 © 2012 IBM Corporation
  52. 52. Sample Reports – DB2 Recovery Readiness Image Copy Report Subsystem EA1A Start Timestamp 2011-05-04- End Timestamp 2011-05-04- Objects without Image Copies Without ICs DBNAME TSNAME Part Type IC Dataset IC Dataset Check ________ ________ ____ ____ __________________________ ________________ PARTDB01 PARTTS01 0001 TS Not Checked PARTDB01 PARTTS01 0002 TS Not Checked PARTDB01 PARTTS01 0003 TS …. Not Checked … Objects with Image Copies With IC data sets checked DBNAME TSNAME Part Type IC Dataset IC Dataset Check ________ ________ ____ ____ __________________________ ________________ PARTDB02 PARTTS02 0001 TS PDBOB.DB02.TS02.P01.COPY Checked PARTDB02 PARTTS02 0002 TS PDBOB.DB02.TS02.P02.COPY Checked PARTDB02 PARTTS02 0003 TS PDBOB.DB02.TS02.P03.COPY Checked52 © 2012 IBM Corporation
  53. 53. IMS « Local » Recovery •Prepare and test jobs before •Take time to educate yourself and Using IMS standard utilities test different possibilities – Use DBRC GENJCL.RECOVER command to generate the correct JCL •Organize cross team procedures – Utilities for indexes for DB2 and IMS Using IMS Tools for increased availability, simplification and productivity IMS Recovery Expert (IMS RE) – To facilitate, automate and create easy recovery procedures, and to « power » the use of storage-based fast replication solutions. IMS Recovery Solution Pack – Including DRF to do PITR, to speed up IC processing and build index DB2 Recovery Expert with IMS RE to coordinate recovery between DB2 and IMS53 © 2012 IBM Corporation
  54. 54. IMS Recovery Expert for z/OS Database and Storage-aware backup and recovery tool Backup Functions for IMS databases, IMS systems and application libraries – IMS System Level Backup • IMS Databases, IMS Systems, Recovery Structures, and Application Libraries in one backup at same point in time – Automated offloading and encryption of data – Meta-data repository to maintain information on system level backups Intelligent “local” Recovery Manager – Performs efficient local recoveries using available recovery resources and tools – IBM IMS backup and recovery utilities look like a single product from the end-users perspective Intelligent “Disaster” Recovery Manager – Simplifies and automates traditional disaster recovery process • Restore system level backup and restart DBMS • Restore system level backup, restore RECON, run recovery to point in time, restart DBMS5454 © 2012 IBM Corporation
  55. 55. IMS Recovery Expert for z/OS - Intelligent Recovery Manager (IRM) Single interface for recovery processes, ISPF or GUI Recovers application, individual database, or indexes – Even if the SLB contains other databases than the ones we want to recover – Using Current, Timestamp, or PITR Application profile is created in advance – Single database or group of databases – Logically related databases and indexes can be included automatically Determines best recovery method – Restores from either IC or SLB – Indexes that can not be restored are rebuilt – Recovery using log apply needs one pass of the logs – Access to DBs is automatically stopped and restarted at end of recovery – Drives the IMS Recovery Solution Pack if needed • Runtime analysis determines utilities to run (and their order) • Spawns recovery jobs as needed Storage-based fast-replication performs restore – Performs an instantaneous data set restore process55 © 2012 IBM Corporation
  56. 56. IMS Recovery Expert / DB2 Recovery Expert Reduce backup, recovery, and administration costs Provide a sophisticated infrastructure and metadata to manage the DBMS and storage DB2 & IMS processor coordination – DBMS and storage-based fast-replication integration DB2 & IMS Perform backups instantly RE Fast restore and parallel recovery reduces Storage Processor APIs recovery time Used for both DR and Local Application Source DB Recovery Volumes Used for IMS and DB2 Target Volumes DB System Backup5656 © 2012 IBM Corporation
  57. 57. IMS Recovery Solution Pack for z/OS IMS Recovery Solution Pack IMS Recovery Solution Pack Database Recovery Change Accumulation IMS HP Change IMS HP Change Database Recovery Facility DB Integrity Check Database Recovery Facility Accum Accum Backup Incremental IMS Recovery Image Copy Image Oopy Solution Pack IMS HP Image Copy IMS HP Image Copy Recovery Expert Recovery Expert Recovery Health Check Recovery Health Check57 © 2012 IBM Corporation
  58. 58. IMS Recovery Solution Pack for z/OS – Recovery engine Based on DRF functions High Performance IMS Database Recovery Solution – Parallel Input/Output – Parallel Processing / Sorting – Single archived Log and CA Data Set Pass – Single pass DB write – DBRC Controlled Recovery of Multiple DBDS or Areas in one step – Runs in Parallel with IMS Transaction Processing Recovery Time Options – Recover to End of Logs – Time Stamp Recovery (Recovery Point) – Point-In-Time Recovery (Arbitrary Point) • "Image Copy Needed" state is set in RECON for recovered databases after PITR • List of Open UOW58 © 2012 IBM Corporation
  59. 59. IMS Recovery Solution Pack for z/OS – Recovery engine … DRF Master Subordinate Auxiliary Address Space Address Spaces Process .. IB JCL Sub A/S . DFSPREC0 DRF Sub A/S HPPC DEDB PC Control Sub A/S Function HPIC Log and CA SORT Reader ICs FP Logs DBDS / Area Area Restore Dupli Report DS CAs RECON DBDS ICs59 © 2012 IBM Corporation
  60. 60. IMS Recovery Solution Pack for z/OS – Recovery Expert functions Based on IMS Recovery Expert Version 1 Aid to ensure that the IMS database environment is recoverable – Does not perform the actual database recovery – IMS Database Recovery Facility (DRF) is the recommended tool for performing IMS database recoveries Functions – Create clean recovery points 6 separate features – Locate existing recovery points Recovery Point Creation (RPCR) – Identify problems which may affect recoveries Recovery Point Identification (RPID) – Verify needed recovery assets Verify Recovery Assets (VERIFY) RECON Data Set Cleanup (RCU) – Condition RECON data sets for disaster recovery IMS Command Interface (IMSCMD) – Issue IMS commands via batch Health Checker (HCHECK) And in addition RECON Copy (RECONCOPY) Database List (DBLIST)60 © 2012 IBM Corporation
  61. 61. IMS and DB2 Disaster Recovery Tutorials IBM developerWorks – • External IBM website with articles, tutorials and demonstrations IMS Disaster Recovery Tutorials – Four parts: • Part 1: Overview of all solutions • Part 2: IMS Base and IMS Tool solutions • Part 3: IMS Recovery Expert Disaster and Local Recovery • Part 4: Coordinated IMS and DB2 Disaster Recovery – Downloadable demonstration file • Demos are installed on hard disk and viewed with internet browser61 61 © 2012 IBM Corporation
  62. 62. DeveloperWorks URL for Tutorials • y+solutions62 62 © 2012 IBM Corporation
  63. 63. Agenda The Path to Autonomics IMS Performance & Debugging Solutions Update IMS Database Utilities Update IMS Backup & Recovery Update Questions63 © 2012 IBM Corporation
  64. 64. Summary Greater IMS Tools from IBM provide, integrated, function easy-to-use solutions that fit your company’s needs IBM is dedicated to the continued success and support of IMS and the mainframe. We’re invested for the long term, right beside you. We are continuing to invest in our IMS Tools technology and have a vision for our IMS Tools that centers around autonomic computing Even better value for Money Better performance64 © 2012 IBM Corporation
  65. 65. IMS Resources On-line IMS on the web – IMS Tools on the Web – IMS Tools Support for IMS V12 – IMS Tools Users Guides and Documentation – © 2012 IBM Corporation