SlideShare a Scribd company logo
1 of 23
The State of Resilience and
                                       Optimization on IBM Power
                                       Systems

                                       Research Findings Based on Surveys of IBM i
                                       and AIX Users




Power Sys
         t   ems 2
                  0   th An
                           niversary



                                                                                     1
Contents

           Executive Summary _________________________________________________________________________ 1
           Foreword: Power Systems, 20 Years On ________________________________________________________ 2
           Report Focus _______________________________________________________________________________ 3
           Research Environment and Methodology _______________________________________________________ 4
           The State of Disaster Recovery Expectations ____________________________________________________ 5
                   Service Level Agreements ____________________________________________________________ 5
                   Recovery Time Objectives ____________________________________________________________ 6
                   Recovery Point Objectives ____________________________________________________________ 7
                   DR Plan Completeness _______________________________________________________________ 8
           The State of Disaster Recovery Technologies ___________________________________________________ 8
                   Data Protection Methods _____________________________________________________________ 9
                   Data Replication Technologies ________________________________________________________ 11
                   Continuous Data Protection __________________________________________________________ 13
           The State of Systems Optimization ____________________________________________________________ 14
                   System Management Capabilities _____________________________________________________ 15
                   Automation of Optimization __________________________________________________________ 16
                   Optimization Tools and Methods ______________________________________________________ 16
                   Optimization Time Requirements _____________________________________________________ 17
                   Optimization of Large Files and Objects ________________________________________________ 18
           Summary: The State of Resilience and Optimization _____________________________________________ 19




                                                                                                                 2
Executive Summary
                 The AS/400 and RS/6000 platforms have evolved greatly over 20 years, and now IBM has brought them together to
                 create the Power Systems server line. The technologies and methods for data protection and system optimization for
                 both platforms have seen great changes as well. Even as transaction and data storage volumes have increased, ensuring
                 that the right data protection and management practices are in place has moved up from a line-level responsibility to a
                 core boardroom mandate.

        Central Issues for Executives

                 • Ensuring that the technologies and processes currently in place will achieve the recovery time objectives (RTOs)
                   and recovery point objectives (RPOs) of the organization is imperative. A large percentage of firms surveyed do not
                   have appropriate technologies in place to achieve their stated goals.

                 • Data protection and High Availability are related but still distinctly different objectives. In general, companies
                   surveyed show increasing adoption of solutions to address both areas, but keeping data and applications continu-
                   ously available has not been addressed as fully or consistently as protecting against catastrophic data loss.

                 • The older focus on Disaster Recovery (recovering from fire, flood, earthquake, or other natural catastrophe) is
                   yielding to a broader understanding of protection against all causes of business interruption. Technologies for recov-
                   ering from and actively avoiding downtime caused by wide-area power outages, loss of telecomm services, and even
                   accidental damage or deletion of individual files are maturing and gaining support.

                 • Data quality—in terms of its currency, accuracy, and relevance to current business, as well as data access efficiency
                   and productivity—is another issue that is moving front and center for executives and operational managers in all
                   areas of the company. As data stores grow, so do the costs of the labor and downtime resulting from data mainte-
                   nance activities. This area is ripe for automation, and a new range of technologies is emerging to fill the need.




                                                                                                                                           1
Executive Summary




Next Steps

        • Evaluate the costs associated with downtime of any duration from any cause.

        • Budget for and implement technologies and processes to address the issues of data quality and availability based not
          just on the avoidance of potential downtime costs but also on the measureable savings that accrue from operational
          efficiencies and flexibility that automatically result from those solutions.

        • Where technologies are in place, ensure that the company’s actual ability to recover from downtime or data loss
          events is in fact sufficient to meet stated Service-Level Agreements (SLAs) and internal expectations. Live testing of
          systems and procedures is necessary, for both the training and readiness of personnel and the evaluation of current
          capabilities versus present and future needs.




                                                                                                                                   2
Foreword: The AS/400, 20 Years On

                   “The value of data will be treated as an asset on the balance sheet and reported by the Chief Financial Officer while
                   the quality of data will become a technical reporting metric and key IT performance indicator.”

                                                                                            IBM Data Governance Council, 7 July 2008



               There is little doubt that data is increasingly viewed as perhaps the single most valuable asset in any business.
               Quantifying that value monetarily, as suggested by IBM’s Data Governance Council, may indeed be the next step in
               international accounting standards.

               But even without putting an exact number on it, working business leaders understand intuitively the value of their data
               and know that they must daily address the practical, tangible issues of protecting their business information from loss
               or corruption and putting it to work effectively, efficiently, and profitably.

               Since its inception, IBM® has, of course, been at the forefront of responding to such core business requirements. And
               while its mainframe computers are legendary, it is clear that IBM’s introduction of personal computers and midrange
               servers in the 1980s had the greatest impact for the majority of businesses, the so-called mid-market or “small and
               medium businesses” (SMBs). The introduction of the AS/400® server in 1988 opened up a new realm of possibilities
               for many such companies. Powerful yet affordable and much less complex to program and manage than a mainframe
               system, the AS/400 enabled SMBs to compete with larger companies and to operate far more efficiently, forever raising
               the bar for what it took to compete in any marketplace.

               In the twenty remarkable years since, the sophistication of the platform and the range of business functions depending
               upon it have grown exponentially. Through continuous development, the AS/400 evolved into the iSeries® and then the
               System i™ and became capable of running not only its native OS, but also IBM’s AIX® and even Linux®, becoming over
               time a core computing platform for hundreds of thousands of businesses globally.




                                                                                                                                         3
Today, IBM has merged the System i server line with its AIX-based System p™ counterpart, creating the Power™
               Systems server. Nevertheless, the soul of the AS/400 lives on in the IBM i operating system. And the core mission of
               the combined IBM i and AIX platform remains the same, with businesses of all sizes around the world depending on
               their IBM Power Systems servers and the data they process and store.



Report Focus

               As part of its core mission, the Information Availability Institute (IAI) regularly surveys the IBM i and AIX customer
               base, seeking to understand current and developing information availability and data protection needs. And clearly,
               the range and sophistication of the tools and technologies available to business of all sizes to address these needs have
               grown right along with the market.

               So, at this twentieth anniversary of the introduction of the AS/400, considering our focus on information availability, we
               felt it would be appropriate to undertake a review of the data protection and recovery technologies and strategies that
               IBM i and AIX customers have adopted. We also looked into their related database and systems optimization practices.



Research Environment and Methodology

               The data set used for this report includes the results of over a dozen surveys, conducted between July 2007 and
               July 2008. In total, responses were received from over 2,000 technical professionals and executives involved in the
               management of IBM i and AIX environments.

               Throughout this report, we will identify responses as pertaining to users of the IBM i and AIX operating systems. As a
               practical matter, under these “umbrella” identifiers, we include all prior variants of the IBM i (i5/OS, OS/400) and do
               not differentiate between, for example, AIX running on a legacy System i or System p server.




                                                                                                                                           4
The State of Disaster Recovery Expectations




The State of Disaster Recovery Expectations

                 To begin our study, we asked four questions about our survey participants’ perceptions of their organizations’ current
                 readiness to handle business interruptions (planned and unplanned downtime events).



         1. Are Service-Level Agreements (SLAs) important to your organization?
                 For this question, the available responses were: “Yes, we
                 have SLAs in place today” and “No, we don’t use SLAs at                  Are SLAs Important to Your Organization?
                 this time.”

                 Sixty-nine percent of respondents indicated that SLAs
                                                                                           31%
                 were indeed a part of the environment (and performance
                                                                                                     No
                 pressures) with which they must contend. Though
                 business contract terms specifying performance criteria
                                                                                                                  Yes
                 were not uncommon twenty years ago, Service-Level
                 Agreements were not a common IT issue. In today’s
                 on-demand, right-now economy, even smaller businesses
                                                                                                                        69%
                 are heavily dependent upon e-mail and Internet services
                 to conduct business. Access to IT services has become an
                                                                               Figure 1
                 imperative. There is no reason to expect the prevalence of
                 SLAs to do anything but grow.




                                                                                                                                              5
The State of Disaster Recovery Expectations




2. What is your organization’s recovery time objective (RTO) after a disaster or complete server
   or application failure?

        With this question, we expected and in fact observed a significant bias toward shorter time frames, which is certainly
        in line with ever-increasing SLA pressures. Overall, 45 percent said recovery within 6 hours was the mark, while 78
        percent indicated that, at a minimum, a 24-hour (intra-day) recovery capability was required. (Figure 2)


                               RTOs All Responses                                        RTOs in IBM i Shops and AIX Shops
             60%      45%
                                                                         50%
             50%
                                                                         40%
                                                                                                                                     IBM i
             40%
                                                                         30%                                                         AIX
             30%
                               17%                                       20%
                                                    16%
                                         16%
             20%

                                                                         10%
                                                               7%
             10%

                                                                           0%
              0%
                                                                                   Less Than   6 to 12   12 to 24   24 to 48   Greater than
                      Less    6 to 12   12 to 24   24 to 48   Greater
                                                                                    6 Hours     Hours     Hours      Hours      48 Hours
                     Than 6    Hours     Hours      Hours     than 48
                     Hours                                     Hours

        Figure 2                                                        Figure 3

        Within these results, comparing the responses from the IBM i shops to those from the AIX shops, there was a notably
        stronger bias in the AIX responses toward shorter, more aggressive recovery time requirements. (Figure 3) For
        example, 68 percent of AIX respondents cited less than 12 hours as the objective, compared to 56 percent in IBM i
        shops.




                                                                                                                                              6
The State of Disaster Recovery Expectations




3. What is your organization’s recovery point objective (RPO), expressed in time? That is, what
   is the maximum volume of transactions you are willing to lose as a result of a disaster or a
   complete server or application failure?
                                                                                                      RPOs All Responses
                                                                             40%
        Compared to the results for the recovery time question,                            35%
                                                                             35%
        the responses for this question were somewhat more
                                                                             30%
        evenly spread across the provided range. But data loss still
                                                                                                       24%
                                                                             25%
        appears to be of greater concern than is the time to resume
                                                                             20%
        operations. Most notably, while 55 percent of respondents                                                                            18%

        indicated that they could accept business downtime of six            15%
                                                                                                                             12%
                                                                                                                 11%
        hours or more after a server or application failure, a full 59       10%

        percent indicated that they were unwilling to lose more than          5%

        a few minutes worth of transactions or operational data.              0%
                                                                                          No Data    Last Few    Last       Last Few    Last Day
                                                                                           Loss      Minutes     Hour        Hours

        But there remains a noticeable contingent of respondents
                                                                         Figure 4
        whose organizations are apparently not especially worried
        about losing many hours or even a day’s worth of online
                                                                                           RPOs in IBM i Shops and AIX Shops
        data in the event of a catastrophic server failure. This may                39%
                                                                           40%
        reflect a subset of businesses that are still comfortable with
                                                                           35%
        relying upon manual re-entry of transactions from paper                           31%
                                                                                                                                                      IBM i
        records.                                                           30%
                                                                                                                                                       AIX
                                                                                                          25%
                                                                           25%
                                                                                                    22%
        For this question, the responses from IBM i users were
                                                                                                                                               19%
                                                                           20%
        roughly similar to those of AIX users, with differences of 3                                                                                   18%

        percent or less in most categories.                                15%                                        13%              13%
                                                                                                                              11%
                                                                                                                10%
                                                                           10%

                                                                            5%

                                                                            0%
                                                                                     No Data        Last Few      Last         Last Few            Last Day
                                                                                      Loss          Minutes       Hour          Hours

                                                                         Figure 5

                                                                                                                                                              7
4. How do you rate the completeness of your organization’s disaster recovery plan for IT systems,
            including testing of the DR plan?

                 This question was asked specifically to gauge the respon-
                                                                                        Self Assessment of DR Plan Completeness
                 dents’ self-confidence in their DR readiness.
                                                                              40%
                                                                              35%
                 For this question, we have responses from companies
                 that use IBM i or AIX, as well as companies that use both    30%
                                                                                                                                  IBM i
                 operating systems.                                           25%
                                                                                                                                  AIX
                                                                              20%                                                 Both
                  Only about 10–15 percent of the respondents had full          15%
                 confidence (100 percent) that their DR plan was complete,      10%
                 tested, and ready to go. About 50 percent of all respondents    5%
                 expressed at least some doubt or concern, as they rated         0%
                                                                                      100%    90%     75%     50%     25%   No DR Plan
                 their confidence at 75 percent to 90 percent. But overall, the
                 distribution of the responses between AIX and IBM i shops Figure 6
                 was very similar.



The State of Disaster Recovery Technologies

                 When we discuss High Availability (HA) and Disaster Recovery (DR), we are really addressing a wide range of
                 technologies and processes, all of which are focused on protecting data from loss or corruption. For this report, we
                 bring together results from questions that attempt to define and measure which of these technologies and processes
                 are more or less prevalent in businesses today. Clearly, when the AS/400 was first introduced in 1988, and likewise
                 the RS/6000 some two years later, the options for data protection were very limited. Backup to tape was clearly the
                 predominant method. Compared to today’s standards, disk was very expensive, and disk parity (RAID) and disk-to-disk
                 replication were in their infancy.




                                                                                                                                          8
The State of Disaster Recovery Technologies




        Since then, of course, many technologies have been developed, generally offering more efficient and granular
        management of data using journaling, logical replication, clustering, disk mirroring, continuous data protection (CDP),
        and more.



5. What data protection methods do you currently employ?
        For this question, a range of
        options was presented, and the                                             Data Protection Methods in Use
        participants were invited to
        “check all that apply.” Thus the                                                                                                   79%
                                                    Save to Tape, Stored Offsite

        percentages reported add up to
                                                                                                                                     71%
                                                              RAID (Disk Parity)
        more than 100 percent.
                                                                                                           37%
                                                Mirroring Data to Second System

        This is a combined result for         Save to Tape plus Journaling/Logging                      35%
        IBM i and AIX shops. Several
        features of the results are very                                                               34%
                                                           Disk to Disk Replication

        clear. First, tape backup is still                                                             34%
                                                        Tape Management System
        very much in use. In some
                                                                                           10%
                                                              Hot Site Subscription
        shops, it has become more of an
        adjunct technology: clearly, the                                    OTHER     2%
        shops using disk-to-disk repli-
                                                                                      0%
                                                                           Nothing
        cation or mirroring must have
        contributed to the 79 percent                                              0%    10%   20% 30%   40% 50% 60% 70% 80%
        ranking of tape stored offsite. In
        such a case, it seems reasonable Figure 7
        to state that the primary recovery plan depends upon the secondary disk, with recovery from tape being reserved for
        “worst-case” scenarios.

        However, based on these numbers, a significant percentage of organizations are still relying solely or almost entirely
        on tape-based methods for DR, whether tape stored offsite, a tape management system, or tape in conjunction with


                                                                                                                                                 9
The State of Disaster Recovery Technologies




disk-based journaling or logging. It is interesting to note that alternative tape-based options, specifically tape backup
automation and tape plus journaling/logging, are reported in similar numbers as the far more sophisticated and
powerful replication options.

RAID disk technology is also nearly universal. It is a mature technology that requires minimal intervention. By its
strong prevalence, it coexists in many of the reporting companies, alongside mirroring and replication technologies, as
a fundamental element of a multi-tiered approach to data protection.

But perhaps the most interesting result comes when this set of responses is compared with the earlier questions
regarding RTO and RPO, as well as the estimation of DR plan completeness. Recalling, some 56 percent to 68 percent
of respondents declared recovery time objectives (RTOs) being under 12 hours, and some 70 percent identified
recovery point objectives (RPOs) in the range of one hour or less of data loss. In addition, self-reported DR plan
completeness was very high, with roughly 65 percent saying their DR plan was 75 percent or more complete.



    Key Finding
    From the present chart, it appears that a large percentage of companies have a disconnect between their goals
    and perception of DR readiness and the actual state of affairs. Again, a large percentage of shops reported relying
    solely or predominantly on tape-based methods. Achieving intra-day recovery time with these methods is generally
    unlikely, and to expect tape to support RPOs of one hour or less is just not realistic.

    To borrow a phrase from Alan Greenspan, former Chief of the U.S. Federal Reserve, the likely reality is that the
    reported RPOs and RTOs, as well as the numbers for confidence in DR plan completeness, suffer from a bit of
    “irrational exuberance,” unless more advanced technologies are implemented to support the more aggressive
    objectives.




                                                                                                                              10
The State of Disaster Recovery Technologies




6. Does your company use any of the following data replication technologies?
        Setting aside tape backup and RAID, in
                                                                                        Replication Technologies Used
        this question we focused more closely
        on replication technologies in use. Once
                                                                                                                                                    AIX
                                                                               None
        again, respondents were invited to report
                                                                 Logical Replication
        all technologies they have in use, so the
                                                                                                                                                    i5
                                                                          Flash copy
        percentages add up to over 100 percent.
                                                                               SRDF
        For this question, we again have                                       PPRC
        responses from companies that use both                             Not Sure
        IBM i and AIX. This group provided us                             Clustering
                                                                                                                                         i5
        with an especially interesting result.
                                                                                                                                         AIX
                                                       Logical Replication + Failover

                                                                     Metro Mirroring
        First, looking only at those shops that
                                                                     Global Mirroring
        identified with one OS, the unambiguous
        answer “None” was strong, with that                     Cross Site Mirroring
        response exceeding 45 percent in IBM i                 Geographic Mirroring
        shops. (Figure 8)                                                              0%      10%       20%        30%        40%       50%

                                                    Figure 8



           Key Finding
           Software-based logical replication was in use in about 25 percent of all businesses reporting, while only 5 percent
           indicated that they use logical replication in conjunction with automated failover (High Availability, or HA). This
           result is consistent with all previous reviews of shops using logical replication, based on formal surveys and
           informal conversations with end users and software providers. Despite the continuing development by replication
           software vendors of easier and more effective failover capabilities, the vast majority of end users who are using
           logical replication have not yet implemented the failover capability.




                                                                                                                                               11
The State of Disaster Recovery Technologies




Adding to the wonder of this result is the fact that, within the IBM i market, IBM has made major efforts recently to
make software-based server failover more popular and affordable through the introduction and strong promotion of
low-cost Capacity Backup Unit (CBU) servers. Despite all this, the untapped potential for High Availability failover
solutions remains large.

Looking at the results for other replication technologies, a technological divide between IBM i users and their AIX
counterparts is apparent. Flash Copy, EMC’s SRDF (Symmetrix™ Remote Data Facility) for storage network mirroring,
and IBM’s PPRC (now referred to as “Metro Mirror”) all play strongly in AIX shops, but not within the IBM i
community. (Note that the lag in recognition of the Metro Mirror naming is apparent in the results: while the PPRC and
Metro Mirror results could logically have been combined, we have kept them separate for this report.)

This difference is not unexpected. In AIX environments, clustering does not necessarily involve replication. Instead,
server and application availability is maintained through “switchable” storage—that is, two servers that can attach
to one set of storage (though, due to OS design restrictions, not at the same time). As a result, replication of data to
a secondary site tends to be storage-system-centric, with Flash Copy, SRDF, and Metro Mirroring all fitting into that
category.

In contrast, within IBM i architectures, separate storage is nearly always associated with each deployed server. In this
architecture, clustering involves replication between separate servers with clustering software managing failover when
needed. So while clustering is a topological concept for AIX pros, it is a distinct set of server availability management
software in the context of the IBM i architecture.

The prevalence of storage hardware-based mirroring over long distances, or “Global Mirroring,” is lower than that
of “Local Mirroring.” In general, Global Mirroring continues to be an option taken only by a smaller number of large
enterprises.

At the beginning of this section, we mentioned an interesting result. Within the community of companies reporting the
use of both AIX and IBM i, the use of logical replication jumps, along with Flash Copy and Metro Mirroring, while the
reported use of the other technologies is generally similar to the single-OS shops. From other data reviewed, we also
know that these same firms more often report using other UNIX- and Linux-based applications in their IT architecture
as well.


                                                                                                                             12
The State of Disaster Recovery Technologies




         From our own research and from
        numbers provided by IBM, we know that                                   Replication Technologies Used: Dual OS Shops Included
        the percentage of shops within the IBM
        customer base utilizing both operating                         None
        systems, though growing, has historically
        been in the 5–10 percent range. Taken             Logical Replication

        together, the data suggests that there is a               Flash copy
        small but growing group of IBM midrange
        customers that tend to be more aggressive                      SRDF
        in the adoption of multiple technologies to
                                                                       PPRC
        help achieve their HA and DR goals.
                                                                   Not Sure


7. How useful would it be if you had the                          Clustering                                                      i5
                                                                                                                                  AIX
                                                       Logical Replication +
   ability to quickly recover accidentally                                                                                        Both
                                                                     Failover
   deleted or otherwise corrupted                            Metro Mirroring
   records or objects back to any
                                                            Global Mirroring
   specific point in time?
                                                         Cross Site Mirroring
        This question probes for a general
                                                         Geographic Mirroring
        reaction to the desirability of continuous
        data protection (CDP). A relatively new                              0% 10% 20%     30%    40%   50%      60%      70%

        category of data protection technology,
                                                     Figure 9
        CDP is, in essence, a replication-based
        DR technology that is focused on recovering from “micro disasters,” those all-too-common events in which a single file
        or object is accidentally deleted or corrupted. By keeping a time-stamped record of every change made to the backup
        copy during real-time replication, CDP software makes it possible to recover, on demand, a copy of that file as it was
        just before the damage occurred or at any prior point.

        In addition to the advantage of a more granular recovery (that is, recovery of individual objects at any chosen point
        in time), the most current and advanced CDP solutions feature user interfaces that speed and simplify the recovery

                                                                                                                                           13
process, so much so that it is little more difficult than
                scrolling back through a DVD to replay a favorite scene in a                         Would CDP Be Useful to You?
                movie.
                                                                                                        35%
                                                                                      35%
                 Again, a preponderance of responses was positive, with                        29%
                                                                                      30%
                64 percent indicating that this would be very useful or
                                                                                      25%
                extremely so. Keep in mind that this was the response from
                                                                                                                19%
                                                                                      20%
                IT professionals who are accustomed to the world-class
                reliability and stability of their Power Systems servers. But         15%                              13%
                even the best application, OS, and hardware designs cannot            10%
                fully protect against human error. It is clear that easier                                                     5%
                                                                                       5%
                file- and object-level recovery technology, such as CDP, is
                                                                                       0%
                desirable and will without a doubt be increasingly adopted                  Extremely Very Somewhat Rarely     Not
                                                                                             useful   useful useful useful    useful
                by IBM server customers.                                                                                      at all

                                                                                Figure 10

The State of Systems Optimization

                Data stores have always required maintenance and quality assurance work. That much has not changed in the twenty
                years since the AS/400 was introduced. But what has changed is the sheer volume of data being added annually to the
                average corporation’s database and the level to which those companies’ livelihoods depend upon the availability and
                accuracy of that data. All of the data protection technologies previously reviewed focus on ensuring the existence of
                data, with some amount of built-in error detection and correction being applied to the copying process.

                But the measures of data quality go beyond simple accuracy. For example, a million-record database, in which each
                record is individually accurate, can still be of low quality if the records are not ordered or keyed properly or if half of
                the records are in fact marked as deleted but still must be manipulated for reporting. Data stores that cause poor inter-
                active response or batch processing time are poor quality data, no matter how accurate the information is. Thus, rather
                than referring to data quality, per se, we will use the term “optimization” in order to address the wider range of data
                management needs.


                                                                                                                                         14
The State of Systems Optimization




        With so much data flowing daily, the work of keeping the databases and systems operating efficiently is a constant
        challenge. Just as in the realm of data protection, data and systems management tools and technologies have been
        developing apace with the growing challenges since the birth of the AS/400 twenty years ago. So this is another area
        that we wanted to explore to review how well current systems management and optimization practices are supporting
        the greater goals of information availability and overall business resilience.

        A note about the survey results we are about to discuss: for this subject, we conducted surveys only among the IBM i
        community. As you will see, the results are rather interesting, and we do intend to expand future work on this subject to
        include the AIX community.



8. Which of the following system management capabilities would be beneficial to you?
        We’ll begin by examining survey questions that probed for perceived needs. The full wording of the options—from
        which respondents could choose all that applied to them—was as follows:

        • Ongoing optimization of my IBM i environment
        • Reclaiming DASD—we’re growing close to capacity now                               System Optimization Desires
        • Improving response times for our interactive application
          users                                                         On-Going Optimization
        • Improving response times for batch processing
                                                                             Reclaiming DASD

        Essentially, the three primary benefits of optimizing files       Improving Interactive
                                                                                     Response
        and objects were identified as priorities by the respondents
                                                                          Improve Batch Time
        in fairly equal proportion. But the desirability of “ongoing”
        optimization, which implies automation and real-time                                  0% 10% 20% 30% 40% 50% 60% 70% 80%
        processing, was much more universally acknowledged.
        Clearly, we identified an operational pain point with this      Figure 11
        question.

        The response we received to a related though somewhat simpler question confirms automation as an important need:


                                                                                                                                       15
The State of Systems Optimization




9. Would you like to be able to automatically perform optimization and maintenance on physical
   and logical files, programs, queues, and spool files?

        On a basic up or down vote, the Yes vote for this question
        was 76 percent. From the strength of the vote, we surmise                     Would like Automated Optimization
        that automating optimization is a new idea—or at least a
        newer option that these IT pros have not likely already
                                                                                           24%
        implemented.
                                                                                                     No

        Based upon this, our line of questioning moved on to
        determining, in the absence of automation, what is currently                                      Yes
        being done to optimize data in these companies.
                                                                                                                  76%


10. How do you handle ongoing maintenance                              Figure 12
     and optimization for your IBM i systems and
     applications?                                                                        Current Optimization Methods

        Respondents were allowed to identify whether more than                     i5/OS commands

        one method or tool was in use. Given its OEM nature, we         In-house Written Programs
        expected to see IBM’s Systems Director as a common
                                                                               Appl-specific tools
        response, so it was included by name in the list of possible
                                                                            IBM Systems Director
        responses.
                                                                            ISV software package
        The use of command line invocation for optimization tasks,                      Outsource
        whether manually or as part of scripted Control Language
                                                                                            Other
        (CL) programs, was quite prevalent. Given the audience for
        this question, we expect that in-house developed programs                                0%   5% 10% 15% 20% 25% 30% 35%

        that utilize other than IBM OS CL scripting are included in    Figure 13
        the results but do not predominate.


                                                                                                                                        16
The State of Systems Optimization




        For both the Other and ISV categories, respondents were invited to name their alternate method or product. Director™
        from Vision Solutions was identified in more than 1 percent of the responses while 40 other products, including just a
        few services, made up the remaining responses for these write-in votes, indicating a fragmented marketplace that has
        not yet matured or chosen a reigning champion.

        Despite the fact that we know automation is desired, Do It Yourself is still the most common modality by far. So if
        manual optimization is in fact an operational pain point, what are the root causes of that pain? Why is Do It Yourself not
        loved? The next question addresses this.



11. How often do you ensure that your IBM i environment is clean and optimized? Include time
     spent performing tasks such as reorganizing DASD, tracking jobs by CPU or resource usage,
     and optimizing and maintaining applications and physical and logical files.

        Given the relatively new territory in which we are working
                                                                                        Current Optimization Frequency
        (for the participants as well as ourselves), we opted for the
        detailed question to ensure the goal of the question was                35%
        understood. Responses were limited to four time-frame                   30%
        frequencies.                                                            25%
                                                                                20%
        Note the bias to the extremes. Not to say that two                      15%
        completely differing camps exist, but there appears to be a             10%
        tendency either to make optimization a daily routine or to
                                                                                 5%
        defer it as occasional “project-level” work.
                                                                                 0%
                                                                                          Daily   Weekly   Monthly   Ad-Hoc
        To help explain this, we now correlate the prior two           Figure 14
        questions regarding methods and frequency. In other
        words, does how you do it affect how often you do it? Indeed, it does. Breaking out the responses into three groups,
        effectively by level of automation in their methods, we plotted responses against their declared frequency.




                                                                                                                                    17
The State of Systems Optimization




            Key Finding
            The results are clear. Automation enables and encourages daily application of the optimization discipline. Lack
            thereof influences a deferral pattern of behavior. In a similar exercise, we asked in the same survey about the
            impact of large files or objects on the optimization process.




12. Do you have any large files that you have not                                  Optimization Frequency Vs Methods Used
                                                                                   Optimization Frequency Vs Methods Used
     optimized because you believe that the time                             50%
     to reorganize them might exceed your planned                            50%                                           IBM, App
                                                                             40%                                           Specific ISV Tools
     downtime window?                                                                                                      IBM, App
                                                                             40%                                           Specific ISV Tools
                                                                                                                           In-House Programs
                                                                             30%
                                                                                                                           In-House Programs
                                                                                                                           CL Commands /
                                                                             30%
        This self-classification question was limited to a Yes or No
                                                                                                                           Manual
                                                                                                                           CL Commands /
                                                                             20%
        response. The result was a near tie: 48 percent said Yes, they                                                     Manual
                                                                             20%
        avoid optimizing large files due to the downtime impact.             10%
                                                                                      Daily   Weekly   Monthly   Ad Hoc
                                                                             10%
                                                                                      Daily   Weekly   Monthly   Ad Hoc
        Perhaps ambiguous on its own, this result gains more
        meaning when, as with the prior question, we overlay these        Figure 15
        Yes and No responses on their corresponding responses to
        the optimization frequency question.
                                                                                   Large File Impact on Optimization Frequency
                                                                                   Large File Impact on Optimization Frequency
        In Figure 16, we see an amplification of the extreme-biased          50%
                                                                             50%
        result of the frequency question. Clearly, the avoidance of
                                                                             40%                                           No
        optimizing large files enhanced the likelihood that optimi-          40%                                           No
        zation, though incomplete, would be done daily. In other                                                           Yes
                                                                             30%
                                                                                                                           Yes
        words, “keep it quick, and I’ll do it more often.” Alternately,      30%
                                                                             20%
        dedication to inclusion of large files tended to influence a
                                                                             20%
        decision to defer optimization altogether until large, project-      10%
        level windows of opportunity were available.                                  Daily   Weekly   Monthly   Ad Hoc
                                                                             10%
                                                                                      Daily   Weekly   Monthly   Ad Hoc
                                                                          Figure 16

                                                                                                                                           18
So, while optimization is clearly understood to be necessary by most practitioners, it is certainly not viewed as painless,
                simple, or quick. It is, in short, a chore. And any IT task that is a chore is ripe for automation.



Summary: The State of Resilience and Optimization

                Overall, we find that Power Systems customers continue to reflect the same values they always have. They are at
                once very pragmatic and yet open to change when new technologies prove themselves valuable and truly ready for
                deployment. The global proliferation of the AS/400 occurred not in spite of, but rather primarily because of, twenty
                years of constant innovation and change. And because of these same advances, business today moves and changes at a
                pace that makes 1988 seem like “the good old days.”

                Up against demands for greater operational efficiencies, faster processes, and increasingly, 24 x7 operations,
                businesses cannot afford to take chances with unproven or immature technologies. But these very demands for
                efficient, uninterrupted operations also make these same businesses ripe for adoption of newer resiliency and optimi-
                zation options that better protect their data and more effectively meet internal and external availability SLAs.

                And so we see in our data evidence of a dynamic tension, a balance under pressure. Our survey respondents are well
                aware of the resiliency and optimization that modern business requires and acknowledge increasingly stringent RTOs
                and RPOs. They also exhibit a pattern of careful and deliberate choices among the increasing number and range of data
                protection, availability, and optimization technologies that have become available over the past twenty years.

                Some technologies, such as tape backup and RAID, have become ubiquitous. Others, such as replication with failover
                (HA), show focused adoption within particular groups of businesses. But in other areas, legacy methods, such as
                relying upon CL scripts for optimizing data stores, still persist while their practitioners, clearly hungering for an easier
                and better way, carefully gauge the readiness of more automated options.

                Thus, we may confidently expect to see the adoption of all of the discussed data protection and optimization technol-
                ogies to accelerate within the Power Systems market, with those that are the most pragmatic and simplest to use
                gaining the most new mind and market share. And undoubtedly, the resiliency of businesses using Power Systems
                servers, and their successors, will continue to improve over the next twenty years and beyond.
                                                                                                                                           19
About the Information Availability Institute

                 The Information Availability Institute provides research and education that helps business professionals of all disci-
                 plines to understand, evaluate and apply information availability technologies.

                 Drawing upon the deep resources of Vision Solutions, a leading provider of IT resiliency, recovery, and optimization
                 technologies, as well as its technology partners and independent industry experts, the IAI is committed to identifying
                 and communicating improvements in technologies that increase Information Availability and overall business resilience
                 across the entire enterprise.




                 Copyright 2008, Vision Solutions Inc. All Rights Reserved. IBM, AS/400, RS/6000, System i, System p, iSeries, pSeries, and Power Systems are trademarks or registered trademarks of International Business Machines Corporation.




                                                                                                                                                                                                                                           20
visionsolutions.com   |   info@visionsolutions   |   1-949-253-6500
Information Availability Institute


                                                                                                           21

More Related Content

What's hot

full assignment answer for BIS
 full assignment answer for BIS full assignment answer for BIS
full assignment answer for BISmarine9090
 
Efficient Data Centers Are Built On New Technologies and Strategies
Efficient Data Centers Are Built On New Technologies and StrategiesEfficient Data Centers Are Built On New Technologies and Strategies
Efficient Data Centers Are Built On New Technologies and StrategiesCMI, Inc.
 
How windows server 2008 r2 helps optimize it and save you money
How windows server 2008 r2 helps optimize it and save you moneyHow windows server 2008 r2 helps optimize it and save you money
How windows server 2008 r2 helps optimize it and save you moneyupendhra90
 
Competitive Strategies Benchmarking in Datacenter Infra Industry
Competitive Strategies Benchmarking in Datacenter Infra IndustryCompetitive Strategies Benchmarking in Datacenter Infra Industry
Competitive Strategies Benchmarking in Datacenter Infra IndustryAmit Singh
 
IBM zEnterprise System Brings Hybrid Computing Capabilities to Midsize Organi...
IBM zEnterprise System Brings Hybrid Computing Capabilities to Midsize Organi...IBM zEnterprise System Brings Hybrid Computing Capabilities to Midsize Organi...
IBM zEnterprise System Brings Hybrid Computing Capabilities to Midsize Organi...IBM India Smarter Computing
 
Supercharging Electric Utilities With Material MDM
Supercharging  Electric Utilities With  Material MDMSupercharging  Electric Utilities With  Material MDM
Supercharging Electric Utilities With Material MDMVipul Aroh
 
Improvements in Data Center Management
Improvements in Data Center ManagementImprovements in Data Center Management
Improvements in Data Center ManagementScottMadden, Inc.
 
Ibm smarter data center at citi
Ibm smarter data center at citiIbm smarter data center at citi
Ibm smarter data center at citiFriedel Jonker
 
Andmekeskuse hüperkonvergents
Andmekeskuse hüperkonvergentsAndmekeskuse hüperkonvergents
Andmekeskuse hüperkonvergentsPrimend
 
CBMS4303 Topic 1 Short Notes (Open University Malaysia)
CBMS4303 Topic 1 Short Notes (Open University Malaysia)CBMS4303 Topic 1 Short Notes (Open University Malaysia)
CBMS4303 Topic 1 Short Notes (Open University Malaysia)Lorna Timbah
 
Hybrid ERP Pov
Hybrid ERP PovHybrid ERP Pov
Hybrid ERP PovTim Hofer
 
ERP System Implementation Benefits and Economic
ERP System Implementation Benefits and EconomicERP System Implementation Benefits and Economic
ERP System Implementation Benefits and EconomicBaker Khader Abdallah, PMP
 
Deerns Data Center Chameleon 20110913 V1.1
Deerns Data Center Chameleon 20110913 V1.1Deerns Data Center Chameleon 20110913 V1.1
Deerns Data Center Chameleon 20110913 V1.1euroamerican
 

What's hot (19)

DC-Book by Estap
DC-Book by EstapDC-Book by Estap
DC-Book by Estap
 
full assignment answer for BIS
 full assignment answer for BIS full assignment answer for BIS
full assignment answer for BIS
 
Efficient Data Centers Are Built On New Technologies and Strategies
Efficient Data Centers Are Built On New Technologies and StrategiesEfficient Data Centers Are Built On New Technologies and Strategies
Efficient Data Centers Are Built On New Technologies and Strategies
 
How windows server 2008 r2 helps optimize it and save you money
How windows server 2008 r2 helps optimize it and save you moneyHow windows server 2008 r2 helps optimize it and save you money
How windows server 2008 r2 helps optimize it and save you money
 
IBM: Redefining Enterprise Systems
IBM: Redefining Enterprise SystemsIBM: Redefining Enterprise Systems
IBM: Redefining Enterprise Systems
 
Competitive Strategies Benchmarking in Datacenter Infra Industry
Competitive Strategies Benchmarking in Datacenter Infra IndustryCompetitive Strategies Benchmarking in Datacenter Infra Industry
Competitive Strategies Benchmarking in Datacenter Infra Industry
 
IBM zEnterprise System Brings Hybrid Computing Capabilities to Midsize Organi...
IBM zEnterprise System Brings Hybrid Computing Capabilities to Midsize Organi...IBM zEnterprise System Brings Hybrid Computing Capabilities to Midsize Organi...
IBM zEnterprise System Brings Hybrid Computing Capabilities to Midsize Organi...
 
Supercharging Electric Utilities With Material MDM
Supercharging  Electric Utilities With  Material MDMSupercharging  Electric Utilities With  Material MDM
Supercharging Electric Utilities With Material MDM
 
Improvements in Data Center Management
Improvements in Data Center ManagementImprovements in Data Center Management
Improvements in Data Center Management
 
zEnterprise EC12 (zEC12)
zEnterprise EC12 (zEC12)zEnterprise EC12 (zEC12)
zEnterprise EC12 (zEC12)
 
Ibm smarter data center at citi
Ibm smarter data center at citiIbm smarter data center at citi
Ibm smarter data center at citi
 
Andmekeskuse hüperkonvergents
Andmekeskuse hüperkonvergentsAndmekeskuse hüperkonvergents
Andmekeskuse hüperkonvergents
 
CBMS4303 Topic 1 Short Notes (Open University Malaysia)
CBMS4303 Topic 1 Short Notes (Open University Malaysia)CBMS4303 Topic 1 Short Notes (Open University Malaysia)
CBMS4303 Topic 1 Short Notes (Open University Malaysia)
 
Building information systems
Building information systemsBuilding information systems
Building information systems
 
What is ERP
What is ERPWhat is ERP
What is ERP
 
IBM zEnterprise System Datasheet
IBM zEnterprise System DatasheetIBM zEnterprise System Datasheet
IBM zEnterprise System Datasheet
 
Hybrid ERP Pov
Hybrid ERP PovHybrid ERP Pov
Hybrid ERP Pov
 
ERP System Implementation Benefits and Economic
ERP System Implementation Benefits and EconomicERP System Implementation Benefits and Economic
ERP System Implementation Benefits and Economic
 
Deerns Data Center Chameleon 20110913 V1.1
Deerns Data Center Chameleon 20110913 V1.1Deerns Data Center Chameleon 20110913 V1.1
Deerns Data Center Chameleon 20110913 V1.1
 

Similar to The State Of Resilience And Optimization On Ibm Power Systems

Data warehousing has quickly evolved into a unique and popular busin.pdf
Data warehousing has quickly evolved into a unique and popular busin.pdfData warehousing has quickly evolved into a unique and popular busin.pdf
Data warehousing has quickly evolved into a unique and popular busin.pdfapleather
 
Smart Analytics For The Utility Sector
Smart Analytics For The Utility SectorSmart Analytics For The Utility Sector
Smart Analytics For The Utility SectorHerman Bosker
 
Autonomous Platform with AIML Document Intelligence Capabilities to Handle Se...
Autonomous Platform with AIML Document Intelligence Capabilities to Handle Se...Autonomous Platform with AIML Document Intelligence Capabilities to Handle Se...
Autonomous Platform with AIML Document Intelligence Capabilities to Handle Se...IRJET Journal
 
datacore-1-341M4XT
datacore-1-341M4XTdatacore-1-341M4XT
datacore-1-341M4XTGary Mason
 
galileo-white-paper-tier-0
galileo-white-paper-tier-0galileo-white-paper-tier-0
galileo-white-paper-tier-0Tim Conley
 
Ericsson hds 8000 wp 16
Ericsson hds 8000 wp 16Ericsson hds 8000 wp 16
Ericsson hds 8000 wp 16Mainstay
 
Smarter Datacenter - Sanjeev Gupta
Smarter Datacenter - Sanjeev GuptaSmarter Datacenter - Sanjeev Gupta
Smarter Datacenter - Sanjeev GuptaJyothi Satyanathan
 
IBM PureFlex System: The Future of Datacenter Management
IBM PureFlex System: The Future of Datacenter ManagementIBM PureFlex System: The Future of Datacenter Management
IBM PureFlex System: The Future of Datacenter ManagementIBM India Smarter Computing
 
IBM i for Enterprise Businesses Quantifying the Value of Resilience
IBM i for Enterprise Businesses Quantifying the Value of ResilienceIBM i for Enterprise Businesses Quantifying the Value of Resilience
IBM i for Enterprise Businesses Quantifying the Value of ResilienceIBM India Smarter Computing
 
Why Infrastructure Matters for Big Data & Analytics
Why Infrastructure Matters for Big Data & AnalyticsWhy Infrastructure Matters for Big Data & Analytics
Why Infrastructure Matters for Big Data & AnalyticsRick Perret
 
An architacture for modular datacenter
An architacture for modular datacenterAn architacture for modular datacenter
An architacture for modular datacenterJunaid Kabir
 
Informix and POWER7
Informix and POWER7Informix and POWER7
Informix and POWER7Stas Kolbin
 
Beyond the Vision: Realizing the Promise of Industry 4.0
Beyond the Vision: Realizing the Promise of Industry 4.0Beyond the Vision: Realizing the Promise of Industry 4.0
Beyond the Vision: Realizing the Promise of Industry 4.0Cognizant
 
Michelle Gester Resume Slide
Michelle Gester Resume SlideMichelle Gester Resume Slide
Michelle Gester Resume Slidemmgester
 
Case Study: E&T Plastics Reduces Risk and Takes Control with NetSuite from MIBAR
Case Study: E&T Plastics Reduces Risk and Takes Control with NetSuite from MIBARCase Study: E&T Plastics Reduces Risk and Takes Control with NetSuite from MIBAR
Case Study: E&T Plastics Reduces Risk and Takes Control with NetSuite from MIBARMIBAR.net
 

Similar to The State Of Resilience And Optimization On Ibm Power Systems (20)

H1802045666
H1802045666H1802045666
H1802045666
 
Data warehousing has quickly evolved into a unique and popular busin.pdf
Data warehousing has quickly evolved into a unique and popular busin.pdfData warehousing has quickly evolved into a unique and popular busin.pdf
Data warehousing has quickly evolved into a unique and popular busin.pdf
 
Smart Analytics For The Utility Sector
Smart Analytics For The Utility SectorSmart Analytics For The Utility Sector
Smart Analytics For The Utility Sector
 
Autonomous Platform with AIML Document Intelligence Capabilities to Handle Se...
Autonomous Platform with AIML Document Intelligence Capabilities to Handle Se...Autonomous Platform with AIML Document Intelligence Capabilities to Handle Se...
Autonomous Platform with AIML Document Intelligence Capabilities to Handle Se...
 
IBM: Redefining Enterprise Systems
IBM: Redefining Enterprise SystemsIBM: Redefining Enterprise Systems
IBM: Redefining Enterprise Systems
 
datacore-1-341M4XT
datacore-1-341M4XTdatacore-1-341M4XT
datacore-1-341M4XT
 
galileo-white-paper-tier-0
galileo-white-paper-tier-0galileo-white-paper-tier-0
galileo-white-paper-tier-0
 
Ericsson hds 8000 wp 16
Ericsson hds 8000 wp 16Ericsson hds 8000 wp 16
Ericsson hds 8000 wp 16
 
zEnterprise Executive Overview
zEnterprise Executive OverviewzEnterprise Executive Overview
zEnterprise Executive Overview
 
Smarter Datacenter - Sanjeev Gupta
Smarter Datacenter - Sanjeev GuptaSmarter Datacenter - Sanjeev Gupta
Smarter Datacenter - Sanjeev Gupta
 
IBM PureFlex System: The Future of Datacenter Management
IBM PureFlex System: The Future of Datacenter ManagementIBM PureFlex System: The Future of Datacenter Management
IBM PureFlex System: The Future of Datacenter Management
 
IBM i for Enterprise Businesses Quantifying the Value of Resilience
IBM i for Enterprise Businesses Quantifying the Value of ResilienceIBM i for Enterprise Businesses Quantifying the Value of Resilience
IBM i for Enterprise Businesses Quantifying the Value of Resilience
 
Infrastructure Matters
Infrastructure MattersInfrastructure Matters
Infrastructure Matters
 
Why Infrastructure Matters for Big Data & Analytics
Why Infrastructure Matters for Big Data & AnalyticsWhy Infrastructure Matters for Big Data & Analytics
Why Infrastructure Matters for Big Data & Analytics
 
An architacture for modular datacenter
An architacture for modular datacenterAn architacture for modular datacenter
An architacture for modular datacenter
 
Informix and POWER7
Informix and POWER7Informix and POWER7
Informix and POWER7
 
NZS-2990 Made with IBM - Mobile-ready Systems of Record
NZS-2990 Made with IBM - Mobile-ready Systems of RecordNZS-2990 Made with IBM - Mobile-ready Systems of Record
NZS-2990 Made with IBM - Mobile-ready Systems of Record
 
Beyond the Vision: Realizing the Promise of Industry 4.0
Beyond the Vision: Realizing the Promise of Industry 4.0Beyond the Vision: Realizing the Promise of Industry 4.0
Beyond the Vision: Realizing the Promise of Industry 4.0
 
Michelle Gester Resume Slide
Michelle Gester Resume SlideMichelle Gester Resume Slide
Michelle Gester Resume Slide
 
Case Study: E&T Plastics Reduces Risk and Takes Control with NetSuite from MIBAR
Case Study: E&T Plastics Reduces Risk and Takes Control with NetSuite from MIBARCase Study: E&T Plastics Reduces Risk and Takes Control with NetSuite from MIBAR
Case Study: E&T Plastics Reduces Risk and Takes Control with NetSuite from MIBAR
 

The State Of Resilience And Optimization On Ibm Power Systems

  • 1. The State of Resilience and Optimization on IBM Power Systems Research Findings Based on Surveys of IBM i and AIX Users Power Sys t ems 2 0 th An niversary 1
  • 2. Contents Executive Summary _________________________________________________________________________ 1 Foreword: Power Systems, 20 Years On ________________________________________________________ 2 Report Focus _______________________________________________________________________________ 3 Research Environment and Methodology _______________________________________________________ 4 The State of Disaster Recovery Expectations ____________________________________________________ 5 Service Level Agreements ____________________________________________________________ 5 Recovery Time Objectives ____________________________________________________________ 6 Recovery Point Objectives ____________________________________________________________ 7 DR Plan Completeness _______________________________________________________________ 8 The State of Disaster Recovery Technologies ___________________________________________________ 8 Data Protection Methods _____________________________________________________________ 9 Data Replication Technologies ________________________________________________________ 11 Continuous Data Protection __________________________________________________________ 13 The State of Systems Optimization ____________________________________________________________ 14 System Management Capabilities _____________________________________________________ 15 Automation of Optimization __________________________________________________________ 16 Optimization Tools and Methods ______________________________________________________ 16 Optimization Time Requirements _____________________________________________________ 17 Optimization of Large Files and Objects ________________________________________________ 18 Summary: The State of Resilience and Optimization _____________________________________________ 19 2
  • 3. Executive Summary The AS/400 and RS/6000 platforms have evolved greatly over 20 years, and now IBM has brought them together to create the Power Systems server line. The technologies and methods for data protection and system optimization for both platforms have seen great changes as well. Even as transaction and data storage volumes have increased, ensuring that the right data protection and management practices are in place has moved up from a line-level responsibility to a core boardroom mandate. Central Issues for Executives • Ensuring that the technologies and processes currently in place will achieve the recovery time objectives (RTOs) and recovery point objectives (RPOs) of the organization is imperative. A large percentage of firms surveyed do not have appropriate technologies in place to achieve their stated goals. • Data protection and High Availability are related but still distinctly different objectives. In general, companies surveyed show increasing adoption of solutions to address both areas, but keeping data and applications continu- ously available has not been addressed as fully or consistently as protecting against catastrophic data loss. • The older focus on Disaster Recovery (recovering from fire, flood, earthquake, or other natural catastrophe) is yielding to a broader understanding of protection against all causes of business interruption. Technologies for recov- ering from and actively avoiding downtime caused by wide-area power outages, loss of telecomm services, and even accidental damage or deletion of individual files are maturing and gaining support. • Data quality—in terms of its currency, accuracy, and relevance to current business, as well as data access efficiency and productivity—is another issue that is moving front and center for executives and operational managers in all areas of the company. As data stores grow, so do the costs of the labor and downtime resulting from data mainte- nance activities. This area is ripe for automation, and a new range of technologies is emerging to fill the need. 1
  • 4. Executive Summary Next Steps • Evaluate the costs associated with downtime of any duration from any cause. • Budget for and implement technologies and processes to address the issues of data quality and availability based not just on the avoidance of potential downtime costs but also on the measureable savings that accrue from operational efficiencies and flexibility that automatically result from those solutions. • Where technologies are in place, ensure that the company’s actual ability to recover from downtime or data loss events is in fact sufficient to meet stated Service-Level Agreements (SLAs) and internal expectations. Live testing of systems and procedures is necessary, for both the training and readiness of personnel and the evaluation of current capabilities versus present and future needs. 2
  • 5. Foreword: The AS/400, 20 Years On “The value of data will be treated as an asset on the balance sheet and reported by the Chief Financial Officer while the quality of data will become a technical reporting metric and key IT performance indicator.” IBM Data Governance Council, 7 July 2008 There is little doubt that data is increasingly viewed as perhaps the single most valuable asset in any business. Quantifying that value monetarily, as suggested by IBM’s Data Governance Council, may indeed be the next step in international accounting standards. But even without putting an exact number on it, working business leaders understand intuitively the value of their data and know that they must daily address the practical, tangible issues of protecting their business information from loss or corruption and putting it to work effectively, efficiently, and profitably. Since its inception, IBM® has, of course, been at the forefront of responding to such core business requirements. And while its mainframe computers are legendary, it is clear that IBM’s introduction of personal computers and midrange servers in the 1980s had the greatest impact for the majority of businesses, the so-called mid-market or “small and medium businesses” (SMBs). The introduction of the AS/400® server in 1988 opened up a new realm of possibilities for many such companies. Powerful yet affordable and much less complex to program and manage than a mainframe system, the AS/400 enabled SMBs to compete with larger companies and to operate far more efficiently, forever raising the bar for what it took to compete in any marketplace. In the twenty remarkable years since, the sophistication of the platform and the range of business functions depending upon it have grown exponentially. Through continuous development, the AS/400 evolved into the iSeries® and then the System i™ and became capable of running not only its native OS, but also IBM’s AIX® and even Linux®, becoming over time a core computing platform for hundreds of thousands of businesses globally. 3
  • 6. Today, IBM has merged the System i server line with its AIX-based System p™ counterpart, creating the Power™ Systems server. Nevertheless, the soul of the AS/400 lives on in the IBM i operating system. And the core mission of the combined IBM i and AIX platform remains the same, with businesses of all sizes around the world depending on their IBM Power Systems servers and the data they process and store. Report Focus As part of its core mission, the Information Availability Institute (IAI) regularly surveys the IBM i and AIX customer base, seeking to understand current and developing information availability and data protection needs. And clearly, the range and sophistication of the tools and technologies available to business of all sizes to address these needs have grown right along with the market. So, at this twentieth anniversary of the introduction of the AS/400, considering our focus on information availability, we felt it would be appropriate to undertake a review of the data protection and recovery technologies and strategies that IBM i and AIX customers have adopted. We also looked into their related database and systems optimization practices. Research Environment and Methodology The data set used for this report includes the results of over a dozen surveys, conducted between July 2007 and July 2008. In total, responses were received from over 2,000 technical professionals and executives involved in the management of IBM i and AIX environments. Throughout this report, we will identify responses as pertaining to users of the IBM i and AIX operating systems. As a practical matter, under these “umbrella” identifiers, we include all prior variants of the IBM i (i5/OS, OS/400) and do not differentiate between, for example, AIX running on a legacy System i or System p server. 4
  • 7. The State of Disaster Recovery Expectations The State of Disaster Recovery Expectations To begin our study, we asked four questions about our survey participants’ perceptions of their organizations’ current readiness to handle business interruptions (planned and unplanned downtime events). 1. Are Service-Level Agreements (SLAs) important to your organization? For this question, the available responses were: “Yes, we have SLAs in place today” and “No, we don’t use SLAs at Are SLAs Important to Your Organization? this time.” Sixty-nine percent of respondents indicated that SLAs 31% were indeed a part of the environment (and performance No pressures) with which they must contend. Though business contract terms specifying performance criteria Yes were not uncommon twenty years ago, Service-Level Agreements were not a common IT issue. In today’s on-demand, right-now economy, even smaller businesses 69% are heavily dependent upon e-mail and Internet services to conduct business. Access to IT services has become an Figure 1 imperative. There is no reason to expect the prevalence of SLAs to do anything but grow. 5
  • 8. The State of Disaster Recovery Expectations 2. What is your organization’s recovery time objective (RTO) after a disaster or complete server or application failure? With this question, we expected and in fact observed a significant bias toward shorter time frames, which is certainly in line with ever-increasing SLA pressures. Overall, 45 percent said recovery within 6 hours was the mark, while 78 percent indicated that, at a minimum, a 24-hour (intra-day) recovery capability was required. (Figure 2) RTOs All Responses RTOs in IBM i Shops and AIX Shops 60% 45% 50% 50% 40% IBM i 40% 30% AIX 30% 17% 20% 16% 16% 20% 10% 7% 10% 0% 0% Less Than 6 to 12 12 to 24 24 to 48 Greater than Less 6 to 12 12 to 24 24 to 48 Greater 6 Hours Hours Hours Hours 48 Hours Than 6 Hours Hours Hours than 48 Hours Hours Figure 2 Figure 3 Within these results, comparing the responses from the IBM i shops to those from the AIX shops, there was a notably stronger bias in the AIX responses toward shorter, more aggressive recovery time requirements. (Figure 3) For example, 68 percent of AIX respondents cited less than 12 hours as the objective, compared to 56 percent in IBM i shops. 6
  • 9. The State of Disaster Recovery Expectations 3. What is your organization’s recovery point objective (RPO), expressed in time? That is, what is the maximum volume of transactions you are willing to lose as a result of a disaster or a complete server or application failure? RPOs All Responses 40% Compared to the results for the recovery time question, 35% 35% the responses for this question were somewhat more 30% evenly spread across the provided range. But data loss still 24% 25% appears to be of greater concern than is the time to resume 20% operations. Most notably, while 55 percent of respondents 18% indicated that they could accept business downtime of six 15% 12% 11% hours or more after a server or application failure, a full 59 10% percent indicated that they were unwilling to lose more than 5% a few minutes worth of transactions or operational data. 0% No Data Last Few Last Last Few Last Day Loss Minutes Hour Hours But there remains a noticeable contingent of respondents Figure 4 whose organizations are apparently not especially worried about losing many hours or even a day’s worth of online RPOs in IBM i Shops and AIX Shops data in the event of a catastrophic server failure. This may 39% 40% reflect a subset of businesses that are still comfortable with 35% relying upon manual re-entry of transactions from paper 31% IBM i records. 30% AIX 25% 25% 22% For this question, the responses from IBM i users were 19% 20% roughly similar to those of AIX users, with differences of 3 18% percent or less in most categories. 15% 13% 13% 11% 10% 10% 5% 0% No Data Last Few Last Last Few Last Day Loss Minutes Hour Hours Figure 5 7
  • 10. 4. How do you rate the completeness of your organization’s disaster recovery plan for IT systems, including testing of the DR plan? This question was asked specifically to gauge the respon- Self Assessment of DR Plan Completeness dents’ self-confidence in their DR readiness. 40% 35% For this question, we have responses from companies that use IBM i or AIX, as well as companies that use both 30% IBM i operating systems. 25% AIX 20% Both Only about 10–15 percent of the respondents had full 15% confidence (100 percent) that their DR plan was complete, 10% tested, and ready to go. About 50 percent of all respondents 5% expressed at least some doubt or concern, as they rated 0% 100% 90% 75% 50% 25% No DR Plan their confidence at 75 percent to 90 percent. But overall, the distribution of the responses between AIX and IBM i shops Figure 6 was very similar. The State of Disaster Recovery Technologies When we discuss High Availability (HA) and Disaster Recovery (DR), we are really addressing a wide range of technologies and processes, all of which are focused on protecting data from loss or corruption. For this report, we bring together results from questions that attempt to define and measure which of these technologies and processes are more or less prevalent in businesses today. Clearly, when the AS/400 was first introduced in 1988, and likewise the RS/6000 some two years later, the options for data protection were very limited. Backup to tape was clearly the predominant method. Compared to today’s standards, disk was very expensive, and disk parity (RAID) and disk-to-disk replication were in their infancy. 8
  • 11. The State of Disaster Recovery Technologies Since then, of course, many technologies have been developed, generally offering more efficient and granular management of data using journaling, logical replication, clustering, disk mirroring, continuous data protection (CDP), and more. 5. What data protection methods do you currently employ? For this question, a range of options was presented, and the Data Protection Methods in Use participants were invited to “check all that apply.” Thus the 79% Save to Tape, Stored Offsite percentages reported add up to 71% RAID (Disk Parity) more than 100 percent. 37% Mirroring Data to Second System This is a combined result for Save to Tape plus Journaling/Logging 35% IBM i and AIX shops. Several features of the results are very 34% Disk to Disk Replication clear. First, tape backup is still 34% Tape Management System very much in use. In some 10% Hot Site Subscription shops, it has become more of an adjunct technology: clearly, the OTHER 2% shops using disk-to-disk repli- 0% Nothing cation or mirroring must have contributed to the 79 percent 0% 10% 20% 30% 40% 50% 60% 70% 80% ranking of tape stored offsite. In such a case, it seems reasonable Figure 7 to state that the primary recovery plan depends upon the secondary disk, with recovery from tape being reserved for “worst-case” scenarios. However, based on these numbers, a significant percentage of organizations are still relying solely or almost entirely on tape-based methods for DR, whether tape stored offsite, a tape management system, or tape in conjunction with 9
  • 12. The State of Disaster Recovery Technologies disk-based journaling or logging. It is interesting to note that alternative tape-based options, specifically tape backup automation and tape plus journaling/logging, are reported in similar numbers as the far more sophisticated and powerful replication options. RAID disk technology is also nearly universal. It is a mature technology that requires minimal intervention. By its strong prevalence, it coexists in many of the reporting companies, alongside mirroring and replication technologies, as a fundamental element of a multi-tiered approach to data protection. But perhaps the most interesting result comes when this set of responses is compared with the earlier questions regarding RTO and RPO, as well as the estimation of DR plan completeness. Recalling, some 56 percent to 68 percent of respondents declared recovery time objectives (RTOs) being under 12 hours, and some 70 percent identified recovery point objectives (RPOs) in the range of one hour or less of data loss. In addition, self-reported DR plan completeness was very high, with roughly 65 percent saying their DR plan was 75 percent or more complete. Key Finding From the present chart, it appears that a large percentage of companies have a disconnect between their goals and perception of DR readiness and the actual state of affairs. Again, a large percentage of shops reported relying solely or predominantly on tape-based methods. Achieving intra-day recovery time with these methods is generally unlikely, and to expect tape to support RPOs of one hour or less is just not realistic. To borrow a phrase from Alan Greenspan, former Chief of the U.S. Federal Reserve, the likely reality is that the reported RPOs and RTOs, as well as the numbers for confidence in DR plan completeness, suffer from a bit of “irrational exuberance,” unless more advanced technologies are implemented to support the more aggressive objectives. 10
  • 13. The State of Disaster Recovery Technologies 6. Does your company use any of the following data replication technologies? Setting aside tape backup and RAID, in Replication Technologies Used this question we focused more closely on replication technologies in use. Once AIX None again, respondents were invited to report Logical Replication all technologies they have in use, so the i5 Flash copy percentages add up to over 100 percent. SRDF For this question, we again have PPRC responses from companies that use both Not Sure IBM i and AIX. This group provided us Clustering i5 with an especially interesting result. AIX Logical Replication + Failover Metro Mirroring First, looking only at those shops that Global Mirroring identified with one OS, the unambiguous answer “None” was strong, with that Cross Site Mirroring response exceeding 45 percent in IBM i Geographic Mirroring shops. (Figure 8) 0% 10% 20% 30% 40% 50% Figure 8 Key Finding Software-based logical replication was in use in about 25 percent of all businesses reporting, while only 5 percent indicated that they use logical replication in conjunction with automated failover (High Availability, or HA). This result is consistent with all previous reviews of shops using logical replication, based on formal surveys and informal conversations with end users and software providers. Despite the continuing development by replication software vendors of easier and more effective failover capabilities, the vast majority of end users who are using logical replication have not yet implemented the failover capability. 11
  • 14. The State of Disaster Recovery Technologies Adding to the wonder of this result is the fact that, within the IBM i market, IBM has made major efforts recently to make software-based server failover more popular and affordable through the introduction and strong promotion of low-cost Capacity Backup Unit (CBU) servers. Despite all this, the untapped potential for High Availability failover solutions remains large. Looking at the results for other replication technologies, a technological divide between IBM i users and their AIX counterparts is apparent. Flash Copy, EMC’s SRDF (Symmetrix™ Remote Data Facility) for storage network mirroring, and IBM’s PPRC (now referred to as “Metro Mirror”) all play strongly in AIX shops, but not within the IBM i community. (Note that the lag in recognition of the Metro Mirror naming is apparent in the results: while the PPRC and Metro Mirror results could logically have been combined, we have kept them separate for this report.) This difference is not unexpected. In AIX environments, clustering does not necessarily involve replication. Instead, server and application availability is maintained through “switchable” storage—that is, two servers that can attach to one set of storage (though, due to OS design restrictions, not at the same time). As a result, replication of data to a secondary site tends to be storage-system-centric, with Flash Copy, SRDF, and Metro Mirroring all fitting into that category. In contrast, within IBM i architectures, separate storage is nearly always associated with each deployed server. In this architecture, clustering involves replication between separate servers with clustering software managing failover when needed. So while clustering is a topological concept for AIX pros, it is a distinct set of server availability management software in the context of the IBM i architecture. The prevalence of storage hardware-based mirroring over long distances, or “Global Mirroring,” is lower than that of “Local Mirroring.” In general, Global Mirroring continues to be an option taken only by a smaller number of large enterprises. At the beginning of this section, we mentioned an interesting result. Within the community of companies reporting the use of both AIX and IBM i, the use of logical replication jumps, along with Flash Copy and Metro Mirroring, while the reported use of the other technologies is generally similar to the single-OS shops. From other data reviewed, we also know that these same firms more often report using other UNIX- and Linux-based applications in their IT architecture as well. 12
  • 15. The State of Disaster Recovery Technologies From our own research and from numbers provided by IBM, we know that Replication Technologies Used: Dual OS Shops Included the percentage of shops within the IBM customer base utilizing both operating None systems, though growing, has historically been in the 5–10 percent range. Taken Logical Replication together, the data suggests that there is a Flash copy small but growing group of IBM midrange customers that tend to be more aggressive SRDF in the adoption of multiple technologies to PPRC help achieve their HA and DR goals. Not Sure 7. How useful would it be if you had the Clustering i5 AIX Logical Replication + ability to quickly recover accidentally Both Failover deleted or otherwise corrupted Metro Mirroring records or objects back to any Global Mirroring specific point in time? Cross Site Mirroring This question probes for a general Geographic Mirroring reaction to the desirability of continuous data protection (CDP). A relatively new 0% 10% 20% 30% 40% 50% 60% 70% category of data protection technology, Figure 9 CDP is, in essence, a replication-based DR technology that is focused on recovering from “micro disasters,” those all-too-common events in which a single file or object is accidentally deleted or corrupted. By keeping a time-stamped record of every change made to the backup copy during real-time replication, CDP software makes it possible to recover, on demand, a copy of that file as it was just before the damage occurred or at any prior point. In addition to the advantage of a more granular recovery (that is, recovery of individual objects at any chosen point in time), the most current and advanced CDP solutions feature user interfaces that speed and simplify the recovery 13
  • 16. process, so much so that it is little more difficult than scrolling back through a DVD to replay a favorite scene in a Would CDP Be Useful to You? movie. 35% 35% Again, a preponderance of responses was positive, with 29% 30% 64 percent indicating that this would be very useful or 25% extremely so. Keep in mind that this was the response from 19% 20% IT professionals who are accustomed to the world-class reliability and stability of their Power Systems servers. But 15% 13% even the best application, OS, and hardware designs cannot 10% fully protect against human error. It is clear that easier 5% 5% file- and object-level recovery technology, such as CDP, is 0% desirable and will without a doubt be increasingly adopted Extremely Very Somewhat Rarely Not useful useful useful useful useful by IBM server customers. at all Figure 10 The State of Systems Optimization Data stores have always required maintenance and quality assurance work. That much has not changed in the twenty years since the AS/400 was introduced. But what has changed is the sheer volume of data being added annually to the average corporation’s database and the level to which those companies’ livelihoods depend upon the availability and accuracy of that data. All of the data protection technologies previously reviewed focus on ensuring the existence of data, with some amount of built-in error detection and correction being applied to the copying process. But the measures of data quality go beyond simple accuracy. For example, a million-record database, in which each record is individually accurate, can still be of low quality if the records are not ordered or keyed properly or if half of the records are in fact marked as deleted but still must be manipulated for reporting. Data stores that cause poor inter- active response or batch processing time are poor quality data, no matter how accurate the information is. Thus, rather than referring to data quality, per se, we will use the term “optimization” in order to address the wider range of data management needs. 14
  • 17. The State of Systems Optimization With so much data flowing daily, the work of keeping the databases and systems operating efficiently is a constant challenge. Just as in the realm of data protection, data and systems management tools and technologies have been developing apace with the growing challenges since the birth of the AS/400 twenty years ago. So this is another area that we wanted to explore to review how well current systems management and optimization practices are supporting the greater goals of information availability and overall business resilience. A note about the survey results we are about to discuss: for this subject, we conducted surveys only among the IBM i community. As you will see, the results are rather interesting, and we do intend to expand future work on this subject to include the AIX community. 8. Which of the following system management capabilities would be beneficial to you? We’ll begin by examining survey questions that probed for perceived needs. The full wording of the options—from which respondents could choose all that applied to them—was as follows: • Ongoing optimization of my IBM i environment • Reclaiming DASD—we’re growing close to capacity now System Optimization Desires • Improving response times for our interactive application users On-Going Optimization • Improving response times for batch processing Reclaiming DASD Essentially, the three primary benefits of optimizing files Improving Interactive Response and objects were identified as priorities by the respondents Improve Batch Time in fairly equal proportion. But the desirability of “ongoing” optimization, which implies automation and real-time 0% 10% 20% 30% 40% 50% 60% 70% 80% processing, was much more universally acknowledged. Clearly, we identified an operational pain point with this Figure 11 question. The response we received to a related though somewhat simpler question confirms automation as an important need: 15
  • 18. The State of Systems Optimization 9. Would you like to be able to automatically perform optimization and maintenance on physical and logical files, programs, queues, and spool files? On a basic up or down vote, the Yes vote for this question was 76 percent. From the strength of the vote, we surmise Would like Automated Optimization that automating optimization is a new idea—or at least a newer option that these IT pros have not likely already 24% implemented. No Based upon this, our line of questioning moved on to determining, in the absence of automation, what is currently Yes being done to optimize data in these companies. 76% 10. How do you handle ongoing maintenance Figure 12 and optimization for your IBM i systems and applications? Current Optimization Methods Respondents were allowed to identify whether more than i5/OS commands one method or tool was in use. Given its OEM nature, we In-house Written Programs expected to see IBM’s Systems Director as a common Appl-specific tools response, so it was included by name in the list of possible IBM Systems Director responses. ISV software package The use of command line invocation for optimization tasks, Outsource whether manually or as part of scripted Control Language Other (CL) programs, was quite prevalent. Given the audience for this question, we expect that in-house developed programs 0% 5% 10% 15% 20% 25% 30% 35% that utilize other than IBM OS CL scripting are included in Figure 13 the results but do not predominate. 16
  • 19. The State of Systems Optimization For both the Other and ISV categories, respondents were invited to name their alternate method or product. Director™ from Vision Solutions was identified in more than 1 percent of the responses while 40 other products, including just a few services, made up the remaining responses for these write-in votes, indicating a fragmented marketplace that has not yet matured or chosen a reigning champion. Despite the fact that we know automation is desired, Do It Yourself is still the most common modality by far. So if manual optimization is in fact an operational pain point, what are the root causes of that pain? Why is Do It Yourself not loved? The next question addresses this. 11. How often do you ensure that your IBM i environment is clean and optimized? Include time spent performing tasks such as reorganizing DASD, tracking jobs by CPU or resource usage, and optimizing and maintaining applications and physical and logical files. Given the relatively new territory in which we are working Current Optimization Frequency (for the participants as well as ourselves), we opted for the detailed question to ensure the goal of the question was 35% understood. Responses were limited to four time-frame 30% frequencies. 25% 20% Note the bias to the extremes. Not to say that two 15% completely differing camps exist, but there appears to be a 10% tendency either to make optimization a daily routine or to 5% defer it as occasional “project-level” work. 0% Daily Weekly Monthly Ad-Hoc To help explain this, we now correlate the prior two Figure 14 questions regarding methods and frequency. In other words, does how you do it affect how often you do it? Indeed, it does. Breaking out the responses into three groups, effectively by level of automation in their methods, we plotted responses against their declared frequency. 17
  • 20. The State of Systems Optimization Key Finding The results are clear. Automation enables and encourages daily application of the optimization discipline. Lack thereof influences a deferral pattern of behavior. In a similar exercise, we asked in the same survey about the impact of large files or objects on the optimization process. 12. Do you have any large files that you have not Optimization Frequency Vs Methods Used Optimization Frequency Vs Methods Used optimized because you believe that the time 50% to reorganize them might exceed your planned 50% IBM, App 40% Specific ISV Tools downtime window? IBM, App 40% Specific ISV Tools In-House Programs 30% In-House Programs CL Commands / 30% This self-classification question was limited to a Yes or No Manual CL Commands / 20% response. The result was a near tie: 48 percent said Yes, they Manual 20% avoid optimizing large files due to the downtime impact. 10% Daily Weekly Monthly Ad Hoc 10% Daily Weekly Monthly Ad Hoc Perhaps ambiguous on its own, this result gains more meaning when, as with the prior question, we overlay these Figure 15 Yes and No responses on their corresponding responses to the optimization frequency question. Large File Impact on Optimization Frequency Large File Impact on Optimization Frequency In Figure 16, we see an amplification of the extreme-biased 50% 50% result of the frequency question. Clearly, the avoidance of 40% No optimizing large files enhanced the likelihood that optimi- 40% No zation, though incomplete, would be done daily. In other Yes 30% Yes words, “keep it quick, and I’ll do it more often.” Alternately, 30% 20% dedication to inclusion of large files tended to influence a 20% decision to defer optimization altogether until large, project- 10% level windows of opportunity were available. Daily Weekly Monthly Ad Hoc 10% Daily Weekly Monthly Ad Hoc Figure 16 18
  • 21. So, while optimization is clearly understood to be necessary by most practitioners, it is certainly not viewed as painless, simple, or quick. It is, in short, a chore. And any IT task that is a chore is ripe for automation. Summary: The State of Resilience and Optimization Overall, we find that Power Systems customers continue to reflect the same values they always have. They are at once very pragmatic and yet open to change when new technologies prove themselves valuable and truly ready for deployment. The global proliferation of the AS/400 occurred not in spite of, but rather primarily because of, twenty years of constant innovation and change. And because of these same advances, business today moves and changes at a pace that makes 1988 seem like “the good old days.” Up against demands for greater operational efficiencies, faster processes, and increasingly, 24 x7 operations, businesses cannot afford to take chances with unproven or immature technologies. But these very demands for efficient, uninterrupted operations also make these same businesses ripe for adoption of newer resiliency and optimi- zation options that better protect their data and more effectively meet internal and external availability SLAs. And so we see in our data evidence of a dynamic tension, a balance under pressure. Our survey respondents are well aware of the resiliency and optimization that modern business requires and acknowledge increasingly stringent RTOs and RPOs. They also exhibit a pattern of careful and deliberate choices among the increasing number and range of data protection, availability, and optimization technologies that have become available over the past twenty years. Some technologies, such as tape backup and RAID, have become ubiquitous. Others, such as replication with failover (HA), show focused adoption within particular groups of businesses. But in other areas, legacy methods, such as relying upon CL scripts for optimizing data stores, still persist while their practitioners, clearly hungering for an easier and better way, carefully gauge the readiness of more automated options. Thus, we may confidently expect to see the adoption of all of the discussed data protection and optimization technol- ogies to accelerate within the Power Systems market, with those that are the most pragmatic and simplest to use gaining the most new mind and market share. And undoubtedly, the resiliency of businesses using Power Systems servers, and their successors, will continue to improve over the next twenty years and beyond. 19
  • 22. About the Information Availability Institute The Information Availability Institute provides research and education that helps business professionals of all disci- plines to understand, evaluate and apply information availability technologies. Drawing upon the deep resources of Vision Solutions, a leading provider of IT resiliency, recovery, and optimization technologies, as well as its technology partners and independent industry experts, the IAI is committed to identifying and communicating improvements in technologies that increase Information Availability and overall business resilience across the entire enterprise. Copyright 2008, Vision Solutions Inc. All Rights Reserved. IBM, AS/400, RS/6000, System i, System p, iSeries, pSeries, and Power Systems are trademarks or registered trademarks of International Business Machines Corporation. 20
  • 23. visionsolutions.com | info@visionsolutions | 1-949-253-6500 Information Availability Institute 21