Bra what's new in ims tools 2010
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Bra what's new in ims tools 2010

on

  • 859 views

 

Statistics

Views

Total Views
859
Views on SlideShare
859
Embed Views
0

Actions

Likes
0
Downloads
8
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Bra what's new in ims tools 2010 Presentation Transcript

  • 1. 2010 – Information Management Tech Conference - Brazil What’s new in IBM IMS Tools Janet LeBlanc Silicon Valley Lab leblancj@ca.ibm.com Information Management Janet LeBlanc Silicon Valley Lab © 2010 IBM Corporation leblancj@ca.ibm.com © 2010 IBM Corporation
  • 2. Information Management Updates to IMS Tools 2009 2010 August 2009 February 2010 – IMS Tools Solution Packs: – IMS Audit Management Expert, V1.2 •IMS Fast Path Solution Pack, V1.1 – IMS Cloning Tool, V1.1 •IMS Performance Solution Pack, V1.1 – IMS Connect Ext, V2.2 •IMS Database Solution Pack, V1.1 •IMS Recovery Solution Pack, V1.1 – IMS Performance Analyzer, V4.2 •IMS Tools Base, V1.1 October 2009 – IMS Database Reorganization Expert, V4.1 – IMS Configuration Manager, V1.3 – IMS Problem Investigator, V2.2 – IMS High Performance Image Copy, V4.2 August 2010 – IMS Recovery Expert V2.1 2 © 2004 © 2010 IBM Corporation IBM Corporation
  • 3. IMS Audit Management Expert Information Management © 2010 IBM Corporation © 2010 IBM Corporation
  • 4. Information Management Overview of IMS Audit Management Expert for z/OS Automation – Simplifies the collection of audit data • Reduces manual efforts and increases productivity – Achieve more thorough audits – Reduces the cost of auditing Centralization – Collects and correlates information from many systems and data sources into an audit repository – Provides a coherent view of IMS audit data into useful representations • GUI and batch reports for examining the data – Supports internal and external auditors Segregation of duties – Provides segregation of duties • Provides audit data integrity • Removes opportunity for data tampering • Auditors are no longer dependent on developers or database administrators to set up or gather the audit information required • Frees up DBAs to perform their own duties and allows auditors to run audit reports independently of the DBAs 4 © 2004 © 2010 IBM Corporation IBM Corporation
  • 5. Information Management IMS Audit Management Expert for z/OS Data collection – Audit and report READ, INSERT, UPDATE and DELETE accesses to databases – Audit and report READ, INSERT, UPDATE, and DELETE calls on specific database segments • READ and DELETE calls retain the concatenated key of the audited segment • UPDATE and INSERT calls retain the concatenated key of the audited segment as well as the segment data, as found in the DLI call I/O area – Access to: • Databases and segments from IMS Batch (DLI/DBB/BMP) jobs • Databases and segments from IMS Online regions • Database, image copy and RECON data sets as recorded in SMF • User access to the IMS system via SIGNON as recorded in the IMS log • PSB and database ‘change of state’ activity as recorded in the IMS log • System STOP and START activity as recorded in the IMS log 5 © 2004 © 2010 IBM Corporation IBM Corporation
  • 6. Information Management Reporting GUI – Drilling Down 6 © 2004 © 2010 IBM Corporation IBM Corporation
  • 7. Information Management IMS Audit Management Expert 7 © 2004 © 2010 IBM Corporation IBM Corporation
  • 8. IMS Cloning Tool Information Management © 2010 IBM Corporation © 2010 IBM Corporation
  • 9. Information Management New IMS Cloning Tool V1.1 Clones IMS systems (includes all databases) – Uses volume-based fast replication, including: • FlashCopy (IBM,EMC,HDS), TimeFinder/Snap(EMC), SnapShot (IBM,STK), Onsite Mirrors, Software Point-in-Time – Performs the necessary operations so that the data can be used by the cloned IMS system – IMS Cloning Tool takes an existing IMS system (complete installation and system generation process completed) and creates a new, or cloned, IMS system from it without having to repeat the entire installation and system generation processes Refreshes specific or sets of IMS databases – Uses data set based fast replication, including: • FlashCopy (IBM,EMC,HDS), TimeFinder/Snap(EMC), SnapShot (IBM,STK) – Performs the necessary operations to enable the cloned databases to be used on the same or another IMS system 9 © 2004 © 2010 IBM Corporation IBM Corporation
  • 10. Information Management Copying/Cloning HALDB Databases Can be complex, expensive and can affect database availability • HALDB partition numbers are stored in the RECON and in the database data sets themselves – can’t open if they don’t match • Coordinating this manually complicates the copy process HALDB partitions must be deleted and redefined in the target IMS Each HALDB redefinition must use the same partition number and gap sequence that exists on the source IMS • Unload utilities are traditionally run at a database level affecting application availability • If used Image copy process, the steps are complex: » delete the target database definition from the RECONs » import the HALDB partition definition » register the image copy to the target RECONs » perform a database recovery on the target database » Primary and secondary index and Indirect List Data Set (ILDS) rebuilds are performed 10 © 2004 © 2010 IBM Corporation IBM Corporation
  • 11. Information Management Everything you need for… IMS Fast Path IMS Database Solution Pack Solution Pack IMS Performance IMS Recovery Solution Pack Solution Pack IMS Tools Base 11 © 2004 © 2010 IBM Corporation IBM Corporation
  • 12. Information Management What is IMS Fast Path Solution Pack ? .. “An All-In-One Fast Path full maintenance solution” 1.IMS High Performance Fast Path Utilities (HPFPU) 2.IMS High Performance Image Copy for z/OS V4R2 (HPIC) (new release) 3.IMS Library Integrity Utilities for z/OS V2R1 (LIU) 4.IMS Database Repair Facility (DB Repair) Each of these tools is also shipped as a separate product One program directory, combined sample installation JCL, and simplified SMP/E install IMS Tools Base for z/OS is required DB Space Utilization Analysis DB Repair IMS HP FP Utilities IMS HP FP Utilities DB Repair Facility DB Repair Facility Unload Backup Reload IMS Fast Path Image Copy Reorganization Solution Pack IMS Library Integrity Utilities IMS Library Integrity Utilities IMS HP Image Copy IMS HP Image Copy IMS Definition Libraries Management DB Integrity Check 12 © 2004 © 2010 IBM Corporation IBM Corporation
  • 13. Information Management DB Solution Pack helps daily DBA tasks DB Solution Pack provides a complete set of high performance tools to unload, load, reorganize, build indexes for, backup, verify, and report on full-function databases DB Space Utilization DB Integrity Check Analysis DB Repair IMS High Performance IMS High Performance IMS High Performance IMS High Performance DB Repair Facility DB Repair Facility Unload Unload Pointer Checker Pointer Checker Unload Reorganization Load IMS High Performance IMS High Performance Prefix Resolution Prefix Resolution IMS High Performance IMS High Performance IMS Database Load Load Reorganization Expert Index Backup Build/Recovery Image Copy IMS High Performance IMS High Performance IMS Index Builder IMS Index Builder IMS Library Integrity IMS Library Integrity Image Copy Image Copy Utilities Utilities IMS Definition Libraries Management 13 © 2004 © 2010 IBM Corporation IBM Corporation
  • 14. Information Management A solution for your Backup and Recovery needs IMS Recovery Solution Pack V1.1 IMS Recovery Solution Pack V1.1 Change Database Recovery Accumulation DB Integrity Check IMS HP Change IMS HP Change Database Recovery Facility Database Recovery Facility Accum Accum Backup Incremental IMS Recovery Image Copy Image Copy Solution Pack IMS HP Image Copy IMS HP Image Copy Index Builder Index Builder Recovery Health Check Build Indexes, ILDS Recovery Expert Recovery Expert 14 © 2004 © 2010 IBM Corporation IBM Corporation
  • 15. Information Management IMS Performance Solution Pack V1.1 IMS Performance Solution Pack V1.1 Dashboard Custom FORMs based reports IMS Connect Event Collection Rules Based Routing IMS Performance Analyzer IMS Performance Analyzer DB Integrity Check IMS Connect Extensions IMS Connect Extensions IMS Performance Solution Pack Transit Reports IMS Transaction Index IMS Problem Investigator IMS Problem Investigator ISPF Log data: dialog IMS DB2 Reports Websphere MQ IMS Connect OMEGAMON Extracts 15 © 2004 © 2010 IBM Corporation IBM Corporation
  • 16. Information Management IMS Tools Base provides common services Tools in IMS Database Solution Pack optionally use following services in IMS Tools Base: – IMS Tools Generic Exits – IMS Tools Knowledge Base (ITKB) – IMS Tools Online System Interface (TOSI) – Policy Services – IMS HD Compression Ext Most of the tools in the Pack can use ITKB for centralized report repository Reorg Expert uses ITKB for policy repository and sensor data repository HPIC and Reorg Expert use TOSI (and Generic Exits) for automated IMS online command operation 16 © 2004 © 2010 IBM Corporation IBM Corporation
  • 17. IMS Database Reorganization Expert Information Management © 2010 IBM Corporation © 2010 IBM Corporation
  • 18. Information Management Reorg Expert solutions 1.Central management of information and data Reorg Expert offers IMS DBAs the capability of centrally controlling the information and statistics data that are needed to plan and perform reorganization of IMS databases effectively Necessary info/data are always there in well-defined format Necessary info/data are always there in well-defined format 2.Policy-based database space management Reorg Expert reduces the amount of work and expertise required to perform complex report analysis for determining reorganization need Decision criteria and actions are documented in policies Decision criteria and actions are documented in policies 3.Conditional reorganization Reorg Expert helps avoid unnecessary reorganizations that are based on fixed schedules that do not consider if a reorganization is actually required or what type of reorganization is appropriate Reorganization need/effectiveness are evaluated and notified Reorganization need/effectiveness are evaluated and notified 18 © 2004 © 2010 IBM Corporation IBM Corporation
  • 19. Information Management Smart Reorg utility features at a glance Sysplex 1. Sensor Data 3 Smart Reorg job TSO users 4 Notification messages are sent and/or Collection z/OS operator 3 A policy is retrieved consoles 2. Reorg policy System z Definition Server from repository and is 1 Sensor data records applied 2 3. Conditional and reports are sent ISPF Policy to repository Management Reorganization IMS Tools KB Server 4. Exception Notification and 5 Reporting ISPF Report Search/View 5. Tracking exceptions and reorgs Policy Sensor Data Report Repository*1 Repository Repository*2 All information are stored in and managed by IMS Tools KB repositories Sysplex-wide access to these repositories is supported by IMS Tools KB Server *1: ITKB Input Repository is used as the Policy Repository. *2: ITKB Output Repository is used2004 IBM Corporation © as the2010 IBM Corporation Report 19 © Repository.
  • 20. Feature-2. Policy Information Management Exception detection condition is defined in a rule A Sample Condition Description Sample Data Elements DB_PCT_OF_MAX_DS_SIZE The percentage of allocated bytes (bytes for High Allocated RBA) compared to the maximum size (4 GB or 8 GB). DB_PCT_BYTES_FREE_SPACE The percentage of bytes of total free spaces to the total used bytes for the data set. A Sample Set of Threshold Values Threshold Set A named set of threshold values for the threshold variables that are referred to in the condition descrition above is called a threshold set. You can tweak “MED” = &1 = 85 these threshold &2 = 20 values 20 © 2004 © 2010 IBM Corporation IBM Corporation
  • 21. Feature-2. Policy Information Management Attributes of an exception An Example of Exception Class Exception Class: Exception Class: Exception class FRAGMENTED_FREE_SPACES FRAGMENTED_FREE_SPACES – Represents the specific database event category being monitored * Name of the rule that detects the this exception: * Name of the rule that detects the this exception: IBM.FRAGMENTATION.10 IBM.FRAGMENTATION.10 Exception severity level – Is a category representing the severity of the detected exception – There are fixed three levels: • WARNING Exception • SEVERE • CRITICAL Exception message Class CRITICAL CRITICAL – Is the text that can be used by the resulting policy action to describe the Level SEVERE SEVERE database event that crossed a rule WARNING WARNING threshold set Message Text – Users can modify the message text An Example of Exception Message “The fragmentation of free space in %RESOURCE% “The fragmentation of free space in %RESOURCE% has increased” has increased” * The symbol %RESOURCE% is replaced by a DBD * The symbol %RESOURCE% is replaced by a DBD name or a partition name. name or a partition name. 21 © 2004 © 2010 IBM Corporation IBM Corporation
  • 22. Feature-2. Policy Information Management Exception-to-Action mapping An action is the result of a rule An Example of threshold/exception/action mapping condition being reached or exceeded during a policy evaluation Threshold Exception Class Action Set + Severity Level A rule threshold set has been mapped HIGH CRITICAL to a severity level for the exception REORG class associated with the rule MED SEVERE MESSAGE In turn, the severity level is mapped to LOW WARNING an action Note: In IBM-provided REORG policies, severity- level-to-action mappings are fixed for each exception class and are not customizable. 22 © 2004 © 2010 IBM Corporation IBM Corporation
  • 23. Feature-3. Conditional Reorg Information Management Associating a database with a policy //CREORG EXEC PGM=HPSGMAIN,PARM='DBD=SAMPLEDB,DBRC=Y' //CREORG EXEC PGM=HPSGMAIN,PARM='DBD=SAMPLEDB,DBRC=Y' //STEPLIB DD DISP=SHR,DSN=IMSTOOL.LOADLIB //STEPLIB DD DISP=SHR,DSN=IMSTOOL.LOADLIB Smart Reorg utility provides three // // DD DISP=SHR,DSN=IMS.SDFSRESL DD DISP=SHR,DSN=IMS.SDFSRESL types of policy association: // // DD DISP=SHR,DSN=USER.PGMLIB DD DISP=SHR,DSN=USER.PGMLIB – By database type //IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB //IMSDALIB DD DISP=SHR,DSN=IMS.MDALIB • This is the default. //IMS DD DISP=SHR,DSN=IMS.DBDLIB //IMS DD DISP=SHR,DSN=IMS.DBDLIB • IBM-provided SYS.DBDTYPE.type //HPSIN DD * //HPSIN DD * policies is selected (REORG) (REORG) – By database name CONDREORG=YES CONDREORG=YES • This is intended to be used to specify ITKBSRVR=FPQSVR00 ITKBSRVR=FPQSVR00 a database specific policy SPACEALLOC=YES SPACEALLOC=YES NAMESWAP=YES NAMESWAP=YES – By policy name (CONDREORG) • This is intended to be used to specify (CONDREORG) POLICYBY=DBTYPE POLICYBY=DBTYPE a same policy for a group of /* /* databases By database type Policy to be selected POLICYBY=DBTYPE POLICYBY=DBTYPE SYS.DBDTYPE.type (type = HDAM, HIDAM, PHDAM, PHIDAM, HISAM, or SHISAM) By database name POLICYBY=DBDNAME POLICYBY=DBDNAME SYS.DBDNAME.dbdname By policy name POLICYBY=NAME POLICYBY=NAME MY.POLICY.GROUP1 POLICYNM=MY.POLICY.GROUP1 POLICYNM=MY.POLICY.GROUP1 23 © 2004 © 2010 IBM Corporation IBM Corporation
  • 24. Feature-4b. Exception Reporting Information Management Report Example – Summary of Policy Evaluation IMS DB Reorg Expert - V4R1 Database Diagnosis Report Page: 2 Policy name 5655-S35 Reorg Expert - V4R1 IMS DB Database Diagnosis Report Date: 12/16/2009 Time: 00.05.14 2 Page: 5655-S35 Date: 12/16/2009 Time: 00.05.14 The locale where the Summary of Policy Evaluation (DBD: BKDB ) policy is defined Summary of Policy Evaluation (DBD: BKDB ) ----------------------------------------------------------------- ----------------------------------------------------------------- Name of Policy Applied............ SYS.DBDTYPE.HIDAM Name of Policy Applied............ SYS.DBDTYPE.HIDAM Policy Locale..................... Global Result of decision on Policy Locale..................... Global Reorganization Need............... Yes Reorganization Need............... Yes reorganization need Exceptions before Reorganization Exceptions before Reorganization -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- The number of available extents for a data set of BKDB is small 1 The number of available extents for a data set of BKDB is small Exceptions detected before the Class: DATA_SET_EXTENTS_AVAILABILITY Level: CRITICAL Class: DATA_SET_EXTENTS_AVAILABILITY Rule: G:IBM.DBDS_EXTENTS.10 Threshold Level:HIGH Set: CRITICAL reorganization. In this example, Rule: G:IBM.DBDS_EXTENTS.10 Threshold Set: HIGH 2 The size of a data set in BKDB, which still has a certain amount of free space, Three CRITICAL exceptions were has increased a data set in BKDB, which still has a certain amount of free space, The size of has increased Class: GROWING_DBDS_WITH_FREE_SPACES Level: CRITICAL -> REORG detected Class: GROWING_DBDS_WITH_FREE_SPACES Rule: G:IBM.DBDS_GROWTH.20 Threshold Level:HIGH Set: CRITICAL -> REORG Rule: G:IBM.DBDS_GROWTH.20 Threshold Set: HIGH 3 The fragmentation of free space in BKDB has increased Two of them can be removed by The fragmentation of free space in BKDB has increased Class: FRAGMENTED_FREE_SPACES Level: CRITICAL -> REORG Class: FRAGMENTED_FREE_SPACES Level: CRITICAL -> REORG REORG (unload and reload) Rule: G:IBM.FRAGMENTATION.10 Threshold Set: HIGH 4 A data set of BKDB has many pointers Threshold Set: other bocks or CIs Rule: G:IBM.FRAGMENTATION.10 that point to HIGH A data set of BKDB has many pointers that point to other bocks or CIs One sever exception was detected Class: EXCESSIVE_SEGMENT_SCATTERING Class: EXCESSIVE_SEGMENT_SCATTERING Level: SEVERE Rule: G:IBM.SEGM_SPREAD.10 Threshold Level:MED Set: SEVERE Rule: G:IBM.SEGM_SPREAD.10 Threshold Set: MED -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Result of the reorganization Exceptions after Reorganization processing (success/failure) Exceptions after Reorganization -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- BSN2800I GENERAL STATUS: RESOURCE=BKDB ACTION_NAME=REORG BSN2800I GENERAL STATUS: RESOURCE=BKDB ACTION_NAME=REORG EXECUTION_STATUS=SUCCESSFUL EXECUTION_STATUS=SUCCESSFUL Exceptions that still remain after the 1’ The number of available extents for a adata set of BKDB is small The number of available extents for data set of BKDB is small Class: DATA_SET_EXTENTS_AVAILABILITY Level: CRITICAL reorganization. In this case, one CRITICAL Class: DATA_SET_EXTENTS_AVAILABILITY Rule: G:IBM.DBDS_EXTENTS.10 Threshold Level:HIGH Set: CRITICAL exception remains. Rule: G:IBM.DBDS_EXTENTS.10 Threshold Set: HIGH -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- Summary message, which shows that a Summary of Policy Evaluation and Action: Summary of Policy Evaluation and Action: -------------------------------------------------------------------------------- CRICTICAL exception still remains after -------------------------------------------------------------------------------- BSN2904I BKDB HAS BEEN REORGANIZED, BUT IT IS STILL IN A CRITICAL STATE BSN2904I BKDB HAS BEEN REORGANIZED, BUT IT IS STILL IN A CRITICAL STATE the reorganization. -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- 24 © 2004 © 2010 IBM Corporation IBM Corporation
  • 25. Feature-4b. Exception Reporting Information Management Report Example – IMS Space Utilization Statistics IMS DB Reorg Expert - V4R1 Database Diagnosis Report Page: 6 5655-S35 Reorg Expert - V4R1 IMS DB Database Diagnosis Report Date: 12/16/2009 Time: 00.05.14 6 Page: 5655-S35 Date: 12/16/2009 Time: 00.05.14 Data Set Statistics (DBD: BKDB , DSG: 01) Data Set Statistics (DBD: BKDB , DSG: 01) -------------------------------------------------------------------------------- -------------------------------------------------------------------------------- ==================================== ==================================== IMS Space Utilization Statistics IMS Space Utilization Statistics ==================================== ==================================== Note: The mark * in column P means that the data element is used in the policy. Note: The mark * in column P means that the data element is used in the policy. Data Element Name P Before Reorg After Reorg Difference Data Element Name P Before Reorg After Reorg Difference ------------------------ - ---------------- ---------------- ------------------ ------------------------ - ---------------- ---------------- ------------------ DB_BYTES_SEG 2,465,800,000 2,465,800,000 0 Allocated space is more efficiently used by DB_BYTES_SEG DB_BYTES_FREE_SPACE 2,465,800,000 1,610,723,680 2,465,800,000 283,136,678 -1,327,587,002 0 segment data. DB_BYTES_FREE_SPACE DB_BYTES_UNIDENTIFIED * 1,610,723,680 110 283,136,678 0 -1,327,587,002 -110 DB_BYTES_UNIDENTIFIED * 110 0 -110 DB_PCT_BYTES_FREE_SPACE * 39% 10% -29 DB_PCT_BYTES_FREE_SPACE * * DB_PCT_BYTES_SEG 39% 60% 10% 89% -29 +29 DB_PCT_BYTES_SEG * 60% 89% +29 DB_PCT_UNUSED_BYTES * 1% 1% 0 DB_PCT_UNUSED_BYTES DB_NUM_SEG * 1% 85,620,000 1% 85,620,000 00 DB_NUM_SEG 85,620,000 85,620,000 0 DB_NUM_VLSEG 8,560,000 8,560,000 0 DB_NUM_VLSEG DB_NUM_VLSEG_SPLIT * 8,560,000 0 8,560,000 0 00 DB_NUM_VLSEG_SPLIT * 0 0 0 DB_PCT_NUM_VLSEG_SPLIT * 0% 0% 0 DB_PCT_NUM_VLSEG_SPLIT * * DB_NUM_UNIDENTIFIED 0% 51 0% 0 -51 0 DB_NUM_UNIDENTIFIED * 51 0 -51 DB_AVG_NUM_UNIDENTIFIED * 0 0 0 DB_AVG_NUM_UNIDENTIFIED * * DB_NUM_FSE 23,728,638 0 673,759 0 -23,054,879 0 DB_NUM_FSE * 23,728,638 673,759 -23,054,879 DB_AVG_NUM_FSE * 23.75 1.00 -22.75 DB_AVG_NUM_FSE DB_NUM_FSE_MIN * * 23.75 23,558,660 1.00 673,759 -22.75 -22,884,901 Free spaces fragmentation on each DB_NUM_FSE_MIN DB_NUM_FSE_MAX * * 23,558,660 718,662 673,759 673,759 -22,884,901 -44,903 DB_NUM_FSE_MAX ** 718,662 673,759 -44,903 database block has been resolved by DB_AVG_NUM_NOREUSE_FSE DB_AVG_NUM_NOREUSE_FSE * .17 .17 0 0 -.17 -.17 unload and reload of the database. DB_NUM_PTR 85,070,408 84,946,241 -124,167 DB_NUM_PTR DB_NUM_PTR_DIFF_BLK * 85,070,408 32,424,879 84,946,241 663,666 -124,167 -31,761,213 DB_NUM_PTR_DIFF_BLK * 32,424,879 663,666 -31,761,213 DB_PCT_NUM_PTR_DIFF_BLK * 38% 1% -37 DB_PCT_NUM_PTR_DIFF_BLK * 38% 1% -37 Segments of a database record fit in a single database block in almost all database records. 25 © 2004 © 2010 IBM Corporation IBM Corporation
  • 26. IMS Configuration Manager Information Management © 2010 IBM Corporation © 2010 IBM Corporation
  • 27. Information Management Introduction to IMS Configuration Manager IMS Configuration Manager consists of a resource manager and a parameter manager The resource manager provides offline management of IMS resources with an online resource installer that leverages the capabilities of the IMS Operations Manager (OM) The parameter manager provides a robust smart editor for IMS parameters, syntax checking, and an edit history 27 © 2004 © 2010 IBM Corporation IBM Corporation
  • 28. Information Management Benefits Create and update IMS resources with more frequently and more reliably while providing unparalleled levels of availability Provide greater autonomy for application developers Deskill the process of managing resources and parameters Integrate DRD into existing change management processes Automate install and backout with an intelligent resource installer A complete audit history of all install activity performed through the product 28 © 2004 © 2010 IBM Corporation IBM Corporation
  • 29. Information Management IMS Configuration Manager resource installer The installer provides enhanced services on top of the IMS type-2 command interface Autonomically determines whether an install or update is required Rollback option Full-logging and auditing of install activity 29 © 2004 © 2010 IBM Corporation IBM Corporation
  • 30. Information Management Parameter management Enhanced parameter listing and search – Semantic search: finds parameters and members based on keywords; identifies missing parameters and members – Listing of PROCLIB members that are active on a given system – Edit history for all members Enhanced ISPF edit session that provides: – Checking of parameter syntax – Ability to insert parameters from a model – Context sensitive help for all parameters – Retains many ISPF edit functions – Does not alter or modify the member in anyway (unless you explicitly add or modify parameters) – Allows you to back up members before saving them – In the future will be extended to perform checking of entire PROCLIBs 30 © 2004 © 2010 IBM Corporation IBM Corporation
  • 31. IMS HP Image Copy Information Management © 2010 IBM Corporation © 2010 IBM Corporation
  • 32. Information Management 1. HASH pointer check support for Fast Recovery image copies HASH check is done for output image copy data sets, after FlashCopy or Snapshot is done Verifies that your image copy data set is correct Provides a quick and easy way for high reliable backup processing with the FlashCopy or Snapshot function In 4.1, HASH check is done only when you create the secondary image copy in the standard IC format. In 4.2, HASH check is done even when you have a primary Fast Recovery image copy only, or when you have a secondary copy in the Fast Recovery IC format 32 © 2004 © 2010 IBM Corporation IBM Corporation
  • 33. Information Management 2. Checkpoint Restart enhancement for stacking image copies If one of the image copy processes fails, you can restart the failed image copy process and its subsequent image copy processes either: – On the same stacked tape, or – On the new stacked tape The unit of restart is a database (for full-function DB) or a partition (for HALDB). If an error occurs on one of the data set groups in a single database, the whole data set groups of it will be subject to the restart. You don’t have to re-run the job from the beginning of the databases to be stacked. You can save the time and resource 33 © 2004 © 2010 IBM Corporation IBM Corporation
  • 34. Information Management 3. Conditional image copy registration for the Image Copy function You can use the NOTIFYMODE keyword to select the image copies that are to be registered to DBRC RECON With the NOTIFYMODE=COND parameter, – You can avoid registering image copies for which pointer error detected at the end of the job step – You can avoid the duplicated image copy registrations for the image copies which are subject to be processed twice by the restart function 34 © 2004 © 2010 IBM Corporation IBM Corporation
  • 35. Information Management 4. New FASTIC= mode using FlashCopy to reduce unavailable time of databases You can shorten the unavailable time of the database when taking stacked image copies, by using the new FASTIC mode that is enabled with the FASTIC=(,FDUMP) keyword. The output image copy data set is created by following method: 1. The temporary image copy data sets, also called as shadow image copy data sets, are created by Snapshot or FlashCopy. 2. After all temporary image copy data sets are created, actual image copy data sets are created from the temporary data sets on a DASD volume or on a tape in the standard image copy format. 3. IMS HP Image Copy deletes the temporary image copy data sets. The advantage: – The unavailable time of the database is much shorter compared to the normal stacking method. IMS HP Image Copy gets the database back to online when temporary image copy data sets are created. 35 © 2004 © 2010 IBM Corporation IBM Corporation
  • 36. Information Management 5. Database quiesce support for IMS Version 11 By using the TOIAUTO_Q keyword, you can take batch image copies of online databases without taking the databases offline You don’t need to terminate online applications before the batch image copy process begins IMS Version 11 or later required IMS Type 2 command needs to be available through the OM API 36 © 2004 © 2010 IBM Corporation IBM Corporation
  • 37. IMS Recovery Expert V2 Information Management © 2010 IBM Corporation © 2010 IBM Corporation
  • 38. Information Management Database and Storage Administration Trends and Directions Large IMS systems require high availability – Fast and non-intrusive backup facilities are required – Fast recovery capabilities required to minimize down time and promote high availability – Most backup, recovery solutions do not leverage storage-based fast-replication facilities Storage-based fast-replication facilities are under-utilized – Tend to be used by storage organizations – Tend not to be used by database administrators (DBAs) Storage aware database products allow DBAs to use fast-replication in a safe and transparent manner – Provides fast and non-intrusive backup and cloning operations – Simplifies recovery operations and reduces recovery time – Simplifies disaster recovery procedures 38 © 2004 © 2010 IBM Corporation IBM Corporation
  • 39. Information Management IMS System Level Backup A System Level Backup is a backup of the entire IMS environment at a point in time IMS Leverages storage-based fast replication to drive the volume backup IMS RE – Backup in seconds – Significantly reduce costs: Storage Processor APIs • Offload copy to storage processor • Saves CPU and I/O resources • Faster than data set copies Data consistency ensures data is dependent write consistent Source IMS – IMS Suspend Volumes – Storage-based consistency functions Target – Equivalent to a power failure Volumes IMS System Backup 39 © 2004 © 2010 IBM Corporation IBM Corporation
  • 40. Information Management IMS System Level Backup Can be used in combination with other IMS backups (image copies) Storage-Aware Can include more than just databases Backup and Recovery Automated backup offload (archive/recall) – Copies system backup from fast replication disk to Storage Processor APIs tape for use at either local or disaster site (or both) Restore Backup IMS without affecting applications Source – Backup windows reduced or Database Volumes SLB eliminated – Extends processing windows Offload DB2 BACKUP SYSTEM System – Proven concept Backup – Available for years Tape Processing 40 © 2004 © 2010 IBM Corporation IBM Corporation
  • 41. Information Management IMS Intelligent Recovery Manager Ability to perform efficient local recoveries using available recovery resources and tools – Provides centralization Leverages existing IMS backup and recovery tools – IMS Recovery Solutions Pack The complete suite of IMS backup and recovery utilities look like a single product from the end-users perspective. – Sophisticated ISPF interface – Centralizes backups - provide a single point of control for all backup and recovery processes – Only one product is needed for all recovery processes (local recovery, disaster recovery, rebuilding damaged index, applications, etc.) Simplifies and Automates Recovery Processes – Recovery JCL built once (in advance) – Run-time analysis to determine recovery resources available • Combination of SLB and other IMS recovery assets • Can be directed to use IMS recovery assets only – Run-time analysis of what recovery utility to invoke – Spawns jobs to perform recovery tasks – Takes the technical knowledge out of having to create complex recovery JCL 41 © 2004 © 2010 IBM Corporation IBM Corporation
  • 42. Information Management IMS Intelligent Disaster Recovery Manager Performs local site procedures to prepare for offsite disaster recovery or disaster restart in advance – Identify image copies, change accumulations, and archive logs and what copy for transport to DR site • Tape pick list – Copy of RECON is created and conditioned with any logs, change accums and image copies being sent to DR site • Removes the requirement to modify the RECON at the DR site • If logs and change accums aren’t required, they are marked in error in the conditioned recon so they won't be pulled in – IMS RE repository backed up and sent offsite – Recovery JCL is created, backed up, and sent offsite Performs intelligent remote site restore operations for disaster recovery or disaster restart procedures Restore IMS RE DR PDS – Run JCL to restore IMS Recovery Expert Repository – Run JCL to restore image copies if disaster recovery – Run JCL to restore system level backup if disaster restart – IMS emergency restart Reduces recovery time objectives by transforming disaster recovery into a disaster restart process 42 © 2004 © 2010 IBM Corporation IBM Corporation
  • 43. Information Management Functions and Features ISPF Interface used to: – Register an IMS environment – Analyze IMS data set layout for SLB usage – Setup SLB backup profiles • Copy blades - supports IBM, EMC, and HDS storage systems and fast-replication facilities using integrated copy blades • Offload SLBs – Setup application profiles to allows users to recover IMS databases or groups of related databases that represent applications from a system backup or image copies • IMS Recovery Expert can invoke additional recovery utilities after restoring the databases to bring them to a more current point-in-time – Setup disaster recovery profile • See later slide – System restore • Displays all the system backups that have been performed – Build JCL to perform backup, offload, application recovery, DR preparation, or system recovery 43 © 2004 © 2010 IBM Corporation IBM Corporation
  • 44. Information Management Functions and Features Backup Validation – Provides extensive backup validation to ensure that the backup contains all IMS files and catalog structures required for a successful recovery Metadata Repository – Backups recorded in a meta-data repository Tape Offload Support – DFSMSdss or FDR – Compression and encryption support Tape-Based Disaster Restart – IMS Recovery Expert provides disaster recovery support by transforming traditional IMS disaster recovery procedures into a tape-based disaster restart methodology 44 © 2004 © 2010 IBM Corporation IBM Corporation
  • 45. Information Management Functions and Features Automation and Management of Disaster Recovery – Disaster Recovery Profile indicates what recovery assets will be sent to recovery site • System Backups • Archive Logs • Change Accumulation Files • Image Copies – Intelligent Disaster Recovery Manager runs at some set interval at local site • Analyzes, prepares, and identifies new assets to be sent to recovery site • Copies the RECON and conditions with the recovery assets to be used at the remote site • Creates a DR PDS that contains: Backup of conditioned RECON Backup of IMS RE Repository JCL that will be executed at the DR site to restore the SLB and recover the system • Produces a detailed report showing all tapes that need to be transported to the DR site. • The user simply has to submit the predefined jobs that were created at the local site to perform the actual recovery of the IMS system. – Using IMS Recovery Expert to automate and manage traditional disaster recovery processes simplifies disaster recovery procedures and makes the recovery process less error-prone 45 © 2004 © 2010 IBM Corporation IBM Corporation
  • 46. Information Management IMS System Analysis and Configuration Discovers and analyzes the IMS subsystem and displays an interactive report showing DASD volume usage Provides colored alerts and warnings when detecting anything preventing a successful system backup Helps segregate IMS log and database data to support a system backup methodology Identifies ICF catalog placement requirements 46 © 2004 © 2010 IBM Corporation IBM Corporation
  • 47. Information Management IMS System Analysis and Configuration Verify Data Set Placement 47 © 2004 © 2010 IBM Corporation IBM Corporation
  • 48. Information Management IMS System Analysis and Configuration (2) 48 © 2004 © 2010 IBM Corporation IBM Corporation
  • 49. Information Management Create a System Backup Profile 49 © 2004 © 2010 IBM Corporation IBM Corporation
  • 50. Information Management IMS Recovery Expert Backup Validation Processes Ensures backups are usable for a restore process – All IMS subsystem volumes are included in the backup – All IMS log volumes are included in a FULL system backup – User catalogs used by the IMS subsystem, including the log data sets, are included in backup – IMS logs and database data are on separate volumes • FULL restore only if log structures and data are not separated – All source volumes are valid, online, and available – All target volumes are valid, offline, and available – Target backup volumes not in use by other backup profiles – All source and target volumes are the same device type 50 © 2004 © 2010 IBM Corporation IBM Corporation
  • 51. Information Management Offloading a System Level Backup Options defined in the System Backup Profile Multiple Copies Can be Created Up to 99 generations can be managed Data can be compressed Data can be encrypted 51 © 2004 © 2010 IBM Corporation IBM Corporation
  • 52. Information Management System Backup Reports System Backup information maintained in Repository Can Build JCL to restore entire system Can view information about objects in the system backup 52 © 2004 © 2010 IBM Corporation IBM Corporation
  • 53. Information Management Full System Restore Local or remote site – Most likely full system restore only used at remote site Ability to recover to point-in-time besides SLB time – Drives recovery utilities – roll forward recovery Other/IMS system data sets can be restored – OLDS, WADS, RDS, etc. – ACBLIBs, DBDLIBs, etc. – User specified data sets IMS is emergency restartable after a full system restore and no recovery – ‘Disaster Restart’ 53 © 2004 © 2010 IBM Corporation IBM Corporation
  • 54. Information Management Application Recovery Related databases can be grouped – “Application” – Masking, wildcarding, DBRC groups All databases and indexes in the group are recovered to same point in time Recovery utilities and options are defined – Usually defaults are set during product configuration Run-time recovery analysis – What recovery assets are available – What recovery utilities to invoke – JCL used to perform recovery does not change 54 © 2004 © 2010 IBM Corporation IBM Corporation
  • 55. Information Management IMS Recovery Expert Controlled Recovery Execution IMS Recovery Expert IMS RE Repository RECON Data Set Change Database Index HALDB Post Restore/ Accumulation Recovery Rebuilder ILDS/Index Recovery Utility Facility Rebuild Image Copy DBRC (IIB) (DFSPREC0) Utility Notifications (HPCA) (DRF) (HPIC/HPPC) IBM DfSMSdss IBM Flashcopy EMC SNAP IMS RE Invoked Recovery Processes Fast-replication Data Set Restore IMS System Backup IMS Databases 55 © 2004 © 2010 IBM Corporation IBM Corporation
  • 56. Information Management Disaster Recovery System Level Backup maybe used for ‘Disaster Restart’ – Recover to Objective is SLB time – No other recovery assets shipped to remote site Disaster Recovery Management for other recovery assets – Archive Logs • Copy 1, Copy 2, or create a copy – Change Accums • Not used, used, create a copy – Image Copies • IC1, IC2, or create a copy 56 © 2004 © 2010 IBM Corporation IBM Corporation
  • 57. Information Management DR Preparation Utility Scheduled on a periodic basis at local site – After an SLB is created – After log is archived – Time basis Identifies and or creates new recovery assets – Tape pick list Creates a conditioned RECON Creates a PDS to be shipped to remote site – JCL to restore SLB – JCL to copy remote site recovery assets to disk – JCL to recover all databases if ‘other’ recovery assets are used – Copy of conditioned RECON if ‘other’ recovery assets are used – Copy of IMS Recovery Expert Repository 57 © 2004 © 2010 IBM Corporation IBM Corporation
  • 58. Information Management Disaster Recovery Profile 58 © 2004 © 2010 IBM Corporation IBM Corporation
  • 59. Information Management Remote Site Recovery Assets 59 © 2004 © 2010 IBM Corporation IBM Corporation
  • 60. Information Management IMS Recovery Expert V2 Summary of Benefits Simplifies and automates an IMS SLB methodology – Leverages storage-based fast-replication – Fast, non-intrusive, and reduces CPU, I/O and storage utilization IMS SLBs can be used for IMS system, application, or database recovery – Parallel recovery reduces system and database recovery time Database recovery can leverage existing products IMS SLBs simplify disaster recovery procedures – Transforms IMS DR procedures into a disaster restart process Less skills required to implement advanced IMS backup, recover, and disaster recovery solutions 60 © 2004 © 2010 IBM Corporation IBM Corporation
  • 61. Information Management IMS Tools Product Portfolio IMS Tools Base IMS Database Solution IMS Fast Path Solution IMS Recovery Solution Pack for z/OS Pack for z/OS Pack for z/OS for z/OS IMS Tools Generic Exits DB Reorganization Expert IMS HP Fast Path Utilities Image Copy TOSI - Unload, Load, Index Build, IMS DB Repair Facility Recovery Policy Services Prefix Resolution/Update IMS HP Image Copy Change Accumulation IMS Tools Knowledge Base HP Image Copy IMS Library Integrity Utilities Recovery Health Check IMS HD Compression Ext HP Pointer Checker Library Integrity Utilities HALDB Toolkit Online Reorganization Facility IMS HP Image Copy Sequential Randomizer IMS Cloning Tool DEDB Fast Recovery Generator IMS Database Control Suite IMS Recovery Expert V2 Data Base Utility Backup and Administration Management Recovery System Transaction Performance Application Regulatory Administration Management Management Management Compliance IMS Configuration Manager Command Control Facility Buffer Pool Analyzer Batch Terminal Simulator IMS Audit Management Expert IMS Sysplex Manager ETO Support Network Compression Batch Backout Manager IBM Data Encryption for IMS and HP Sysgen Tools Facility Program Restart Facility DB2 Databases Queue Control Facility IMS Workload Router IMS Performance Solution Pack for z/OS IMS Connect Extensions IMS Performance Analyzer IMS Problem Investigator 61 © 2004 © 2010 IBM Corporation IBM Corporation
  • 62. Information Management Q&A 62 © 2004 © 2010 IBM Corporation IBM Corporation
  • 63. Information Management Summary IMS Tools from IBM provide, integrated, easy-to-use solutions that fit your company’s needs IBM is dedicated to the continued success and support of IMS and the mainframe. We’re invested for the long term, right beside you. We are continuing to invest in our IMS Tools technology and have a vision for our IMS Tools that centers around autonomic computing 63 © 2004 © 2010 IBM Corporation IBM Corporation