SlideShare a Scribd company logo
1 of 32
Download to read offline
IBM Global Technology Services
October 2009




                                 Storage migrations made simple
                                 Overcoming the challenges of technology refresh
Storage migrations made simple
Page 2




                                      Executive summary
                  Contents
                                      Minimizing the impact of data migrations on business operations is a critical
                                      part of the data center manager’s job. Studies have shown that technology
        2   Executive summary
                                      refresh is the primary driver of data migration. Storage hardware and server
        4   Introduction to data
            migration                 replacement, as well as the expiration of storage equipment leases, means that
        6   Data migration software   storage managers have to move data on a regular basis. Moving data for tech-
       10   Technology refresh        nology refresh can be problematic, however, due to application availability
            examples                  requirements, incompatibilities between source and target systems, and time
       30   Summary
                                      and budget constraints. While technology refresh projects are typically sched-
                                      uled to be performed during off-hours, today’s around-the-clock environment
                                      means that applications need to stay online, even during off-hours.

                                      New software allows nondisruptive migration, meaning that applications
                                      remain online during migration, without significant performance delays. And
                                      reliable methodologies that help assess, plan, move and validate data migra-
                                      tions can enable customization, speed the process and help provide data
                                      integrity—simplifying the technology refresh process.
Storage migrations made simple
Page 3




                                          The following table presents five key factors that show how data migration
                   Highlights             software can simplify technology refresh and how IBM Softek™ Transparent
                                          Data Migration Facility (IBM TDMF®) technology can meet these needs.
      Technology refresh is the primary
      driver of data migration.
                                          Key factors               Description                      Softek TDMF capability

                                          Performance               Performance measurements         TDMF software includes a
                                                                    must take into consideration     throttling or pacing capability
                                                                    how quickly data is copied       that can speed up or slow
                                                                    from the source to target        down data movement
                                                                    and balanced against net-        depending on system
                                                                    work bandwidth and system        demands in order to easily
                                                                    overhead.                        balance migration.

                                          Roll-back capability      If something goes wrong,         Roll back can easily be
                                                                    the migration can be termi-      accomplished with TDMF
                                                                    nated and restarted, or          software, although it can be
                                                                    application processing can       problematic with some other
                                                                    continue on the source data      technologies, such as vol-
                                                                    or device.                       ume managers.

                                          Increase in volume size   Many migrations involve an       TDMF software can accom-
                                                                    increase in volume size from     modate an increase in vol-
                                                                    the source to the target.        ume size.

                                          Heterogeneous source      While host-based products        TDMF software is hardware
                                          and target hardware       support unlike storage           independent.
                                                                    devices, most array-based
                                                                    products require that the
                                                                    source and target come
                                                                    from the same vendor.

                                          Application downtime      Applications have different      TDMF software allows for
                                                                    levels of business criticality   nondisruptive data migration
                                                                    and therefore have varying       so applications can stay
                                                                    degrees of acceptable            online and continue to
                                                                    downtime.                        process data throughout the
                                                                                                     migration process.
Storage migrations made simple
Page 4




                                            Introduction to data migration
                     Highlights
                                            What drives data migration? Technology refresh, defined as replacing an array
                                            with a new one, is the major reason for moving data and most commonly
                                            occurs when:

                                            ●   The lease on a piece of storage equipment ends.
                                            ●   Data is being moved from old to new storage.
                                            ●   The storage system is being upgraded.
                                            ●   The organization has decided to standardize on a particular technology.


                                            Typically, most data centers lease their storage hardware under three-year
                                            agreements. Once the agreement ends, the hardware needs to be replaced and
                                            the data stored on it moved to new equipment. Data migration must be com-
                                            pleted before the lease expires to avoid additional monthly lease costs. In
                                            cases in which storage hardware is purchased rather than leased, older arrays
                                            that are fully depreciated can be expensive to maintain. Once again, purchase
                                            and implementation of new equipment requires migrating data from the
                                            older arrays.

                                            IT organizations justify purchase or lease of new equipment by the fact that it
                                            is less expensive to maintain, performs better and supports advanced features.
      IT organizations justify new equip-   New arrays can support larger capacities to accommodate the growth of appli-
      ment because it can accommodate       cations; have faster processing chips to deliver better performance; or have
      growth, process more quickly to       new features such as snapshot copies. Finally, newer arrays are justified to
      deliver better performance and        minimize the risk of hardware malfunction, as older arrays are perceived as
      minimize the risk of hardware         being less reliable.
      malfunction.
Storage migrations made simple
Page 5




                                          In many cases, technology refresh means not only replacing storage arrays, but
                   Highlights             also upgrading associated servers to better meet service level agreements or
                                          because the servers, like the arrays, have reached the end of their lease. In
                                          addition, storage and server capacity are acquired annually or more often to
      For most industries, estimates of   accommodate data and application growth. Estimates of data growth vary, but
      data growth typically range from    they typically range from 25 to 50 percent annually for most industries.
      25 to 50 percent annually.
                                          So every year, a typical organization acquires storage technology to replace
                                          arrays on which lease or maintenance agreements are expiring, as well as
                                          additional capacity to accommodate anticipated growth. Thus, the IT organi-
                                          zation must move data between servers and storage for technology refresh on
                                          a very regular basis. The storage mantra is: You have data, therefore you will
                                          move it.




                                           Total on Floor (TB)

                                                    New (TB)

                                               Replaced (TB)

                                              Purchased (TB)




                                          Example annual migration requirements
Storage migrations made simple
Page 6




                                             IT organizations face many challenges associated with technology refresh—
                   Highlights                particularly deciding how to deal with data growth and determining how,
                                             when and where to move data. Some of the key issues associated with tech-
      It is an ongoing challenge to decide   nology refresh include:
      how to deal with data growth and
                                             ●   Lease overlap costs or duplicate maintenance costs, when old and new
      to determine how, when and where
                                                 equipment are on the data center floor at the same time
      to move data.
                                             ●   Migration of data between arrays from different vendors, as there may be
                                                 significant incompatibilities
                                             ●   Risk of data loss or corruption that may occur if the migration is not
                                                 done properly
                                             ●   Prolonged application downtime, or even an inability to
                                                 restart applications


                                             This paper focuses on how organizations can meet these challenges by lever-
                                             aging data migration software.

                                             Data migration software
                                             Depending on the criticality of applications, the quantity of data to be moved
                                             and allowable downtime, there are a variety of tools that organizations can use
                                             to migrate data, each with its own considerations and limitations.

      Organizations can meet these chal-     Offline migration methods
      lenges by leveraging various types     Offline migration methods require that applications be taken offline during
      of data migration software.            data movement, and therefore they are suitable only when significant down-
                                             time can be tolerated. While the amount of downtime required typically
                                             depends on the quantity of data being transferred, this offline migration
                                             mechanism is not recommended for heavily used applications or those that
                                             must be accessible outside of normal business hours. Offline migration typi-
                                             cally requires manual manipulation of data or files, which can increase the
                                             risk of human error and may not scale to distributed or remote scenarios.
Storage migrations made simple
Page 7




                                          Restore from backup tapes
                   Highlights             This method involves making a backup copy of data, then taking the associ-
                                          ated arrays or servers offline to ensure that no new data is added. Then the
      Offline migration methods include   data is restored from the backup tapes to the new arrays or servers. Once
      restore from backup tapes and FTP   the restore process is complete, the systems are brought online. While
      transfer.                           this is a low-cost solution, especially as nearly all organizations already use
                                          backup software, it requires significant administrative attention and applica-
                                          tion downtime.

                                          FTP transfer
                                          This method involves manually copying files from the source systems to the
                                          target systems via File Transfer Protocol (FTP). Because it requires file-by-file
                                          movement, this method is not recommended when the data contains large
                                          numbers of individual files. FTP transfer does not provide control over the
                                          network bandwidth used for migration, which can affect other applications
                                          and users in the network environment, nor does it enable verification of the
                                          complete transfer of data.

                                          Online migration methods
                                          Online migration methods generally allow data movement while applications
                                          are up and running. Depending on the method chosen, however, these meth-
      Online migration methods include    ods can be limited to a single vendor environment. Other methods may con-
      array-based replication, volume     sume significant processor overhead, potentially resulting in application
      management or replication and       slowdown or other disruptions.
      host-based mirroring.
                                          Array-based replication
                                          While this method allows for high service level guarantees, it requires moving
                                          between similar storage devices, increasing costs and limiting the data center
                                          to a single vendor.
Storage migrations made simple
Page 8




                                             Volume management or replication
                   Highlights                Volume management is used primarily to control disk resources by mapping
                                             the logical view of storage space with the actual physical disks. While it can be
                                             used to move small amounts of data, it can be slow. This solution requires a
                                             heterogeneous storage environment over an IP network and may require the
                                             costly installation of additional software.

                                             Host-based mirroring
                                             Host-based mirroring or replication solutions generally focus on file-by-file
                                             data movement to create a secondary data copy for disaster recovery purposes.
                                             When used for data migration, this approach may put an additional burden on
                                             application servers and may require high-cost management, especially in het-
                                             erogeneous environments.

                                             Online nondisruptive migration—Softek data migration products
                                             There are a few products available in the marketplace today that were
                                             designed to provide nondisruptive data migration—meaning that data move-
      Softek TDMF software helps make        ment occurs without causing application outages or slowdowns. Softek data
      it easier to upgrade to new storage,   migration software is the proven standard for online, heterogeneous data
      improve application performance        movement, meeting the challenges of application availability and technical
      and manage information availability    compatibility between source and target storage. Softek TDMF software moves
      through the information lifecycle.     data while maintaining application availability, making it easier to upgrade to
                                             new storage, improve application performance and manage information avail-
                                             ability through the information lifecycle. So whether the organization needs to
                                             upgrade to new storage hardware (from any vendor to any vendor) or needs a
                                             more effective way to migrate data based on cost and performance, TDMF
                                             software can provide the solution. Together with Softek z/OS® Data Mobility
                                             Facility (zDMF) software for moving mainframe data at the dataset level,
                                             Softek TDMF technology provides the solution to meet a wide range of tech-
                                             nology refresh and other data migration needs.
Storage migrations made simple
Page 9




                                          An examination of real-world scenarios can demonstrate how Softek data
                   Highlights             migration products are used to simplify technology refresh:

      A discussion of real-world imple-   ●   A manufacturing company running a mission-critical Oracle customer
      mentations can illustrate how           order and tracking system on Solaris conducting local UNIX® array-to-
      Softek technology simplifies tech-       array migration
      nology refresh.                     ●   A large bank running a credit and debit transaction application on
                                              IBM z/OS conducting local mainframe array-to-array migration
                                          ●   A major savings and loan institution running an IBM DB2®,
                                              IBM CICS® and Virtual Storage Access Method (VSAM) application with
                                              high-availability requirements conducting mainframe migration with vol-
                                              ume consolidation
                                          ●   A Fortune 500 financial services firm running a mission-critical DB2
                                              data warehouse conducting multiserver UNIX array-to-array migration
                                              with consolidation
                                          ●   A Fortune 1000 bank running a Sybase financial application conducting a
                                              global migration to new storage over distance
                                          ●   An insurance company with a mission-critical claims processing
                                              application on Oracle conducting a global migration to new servers and
                                              new storage
                                          ●   A Fortune 500 bank running a key enterprise compliance management
                                              application conducting a local Microsoft® Windows® array-to-
                                              array migration
Storage migrations made simple
Page 10




                                           Technology refresh examples
                   Highlights
                                           The detailed descriptions of the scenarios that follow show how Softek
                                           capabilities can meet technology refresh needs and streamline technology
                                           refresh projects.

      Softek software capabilities can     Local UNIX array-to-array migration
      meet technology refresh needs        In this example, a manufacturing company running a mission-critical Oracle
      and streamline technology refresh    customer order and tracking system on Solaris needed to move three terabytes
      projects.                            (TB) of legacy data from an old storage array to a new storage array.

                                           The challenges that the company faced were as follows:

      In the first example, Softek soft-    ●   Limited downtime – Downtime was limited to four hours on the weekend.
      ware helped a manufacturing com-     ●   Large volume of data – Application storage spanned 10 300 GB volumes.
      pany move 3TB of legacy data from    ●   Increase in volume size –The planned capacity growth required an
      an old storage array to a new one,       increase in volume size during migration.
      without significant downtime.
                                           The company considered the pros and cons of several different migration
                                           options, including:

                                           ●   Restore from backup tapes – This option would have required more than
                                               four hours to copy the data, exceeding application downtime restrictions.
                                           ●   Sun Solstice Volume Manager – This would not support the increase in
                                               volume size.
                                           ●   Array-based replication – This option would have been expensive to
                                               install, and the company did not plan to use it following the migration. In
                                               addition, firmware upgrades required on the legacy arrays to support the
                                               current array-based replication version would have added downtime and
                                               complexity to the project.
                                           ●   Semantic Veritas Volume Replicator (VVR) – This option would have
                                               required installing the prerequisite Veritas Volume Manager.
Storage migrations made simple
Page 11




                                          Softek TDMF technology was chosen because the asynchronous, host-based
                  Highlights              migration was cost-effective, able to work with disparate platforms, did not
                                          require changes to the source environment and could accommodate the
                                          increased volume size in the target environment. The benefits of the TDMF
                                          solution were that the Oracle application’s storage volumes were augmented,
                                          enabling continued expansion of capacity. In addition, the migration was com-
                                          pleted without significant downtime to this mission-critical application. Most
                                          important, the storage technology upgrade was transparent to the application’s
                                          end users.

      Most important, the storage tech-   Softek solution: Local UNIX array-to-array migration with Softek TDMF solution
      nology upgrade was transparent      1.   Softek TDMF technology was installed on the host prior to the weekly
      to users.                                scheduled downtime and configured to map the source and target
                                               devices. A script was written to unmount and remount the source devices
                                               during the weekend outage. The script was run just after the weekly
                                               backups and took less than 30 seconds to run, so the scheduled down-
                                               time was not affected.
                                          2.   The TDMF solution started the copy operation once applications are
                                               back online. Copy ran slowly in background so as not to significantly
                                               affect the operation of the application.
                                          3.   All volumes were synchronized within 48 hours.
                                          4.   Switchover was performed without service outage. Old volumes were left
                                               in place while performance of new volumes was validated.
                                          5.   Old volumes were removed from configuration.
                                          6.   TDMF software was left on the system and used to move two volumes
                                               nondisruptively within the new storage array to resolve performance
                                               problems caused by pathing issues in the new hardware.
Storage migrations made simple
Page 12




                                                                                   Solaris Server running Oracle
                   Highlights                                                               application




                                                                        Legacy



                                                                           15 minutes downtime          15 minutes downtime




                                                  Older arrays installed                                                      New Arrays installed
                                                                                                 48 hours




                                             Local UNIX array-to-array migration



                                             Local mainframe array-to-array migration
                                             In this scenario, a large Canadian bank running a credit and debit transaction
                                             application on the IBM z/OS platform was moving from legacy storage to
                                             newer storage arrays.

      A financial institution cannot afford   The challenges the bank faced included the following:
      downtime when moving from
                                             ●     No application downtime allowed—The application was a key revenue
      legacy storage to newer storage
                                                   driver, requiring around-the-clock access. The projected 18 hours of down-
      arrays.
                                                   time to install and configure new arrays and complete migration would
                                                   violate corporate IT policy and cost thousands of dollars in lost revenue.
                                             ●     Large number of volumes—Four hundred volumes had to be moved from
                                                   the old to new storage array.
                                             ●     Budget constraints—The migration budget did not include the anticipated
                                                   need for outside consulting resources with migration expertise.
Storage migrations made simple
Page 13




                                            In this case, Softek TDMF technology was the only option considered,
                   Highlights               because no other solution could accomplish the migration without
                                            requiring downtime.

      In the case of a large bank migrat-   Using the Softek TDMF solution, the bank’s migration project was
      ing to new storage arrays, Softek     completed on schedule and required no outside resources so the budget
      TDMF was the only option consid-      was not affected. And because no application performance impact or outages
      ered because no other solution        were experienced, the bank could continue to generate revenue during
      could perform the migration with-     the migration.
      out requiring downtime.
                                            Softek solution: Local mainframe array-to-array migration
                                            1.   Softek TDMF software was installed nondisruptively on the host.
                                            2.   Storage administrators, without formal training, used examples in the
                                                 Softek manual to perform TDMF initialization, activation and copy tasks.
                                            3.   In the first week, administrators migrated 50 percent of volumes to target
                                                 storage arrays with no performance degradation. Migration took place
                                                 during peak periods of activity because Softek TDMF software has a
                                                 dynamic throttling capability that speeds up or slows down migration as
                                                 application requirements change.
                                            4.   Refreshes were performed periodically so that updates made to source
                                                 volume during the copy phase were made to target volume, ensuring
                                                 synchronization between source and target.
                                            5.   Administrators migrated the final 50 percent of volumes over the second
                                                 week, with still no application impact.
                                            6.   When final synchronization had taken place, Softek TDMF software
                                                 completed the swap operation to redirect the mainframe I/O to target
                                                 volumes, which became primary volumes. Switchover was performed
                                                 without service outage.
Storage migrations made simple
Page 14




                                            7.    Backout option was available in case a failure occurs during any phase. If
                   Highlights                     needed, original source volume contained all the write operations per-
                                                  formed during the migration.
                                            8.    Old volumes were removed from configuration.



                                                                                                       Credit and debit transaction
                                                                                                       application




      This chart depicts the bank’s local                                              IBM mainframe

      mainframe array-to-array migration.




                                                      Old storage array                                                New storage array


                                            Local mainframe array-to-array migration
Storage migrations made simple
Page 15




                                             Local mainframe migration with volume consolidation
                   Highlights                A major savings and loan institution had an older locally attached storage
                                             array under strain that it was replacing with a new locally attached storage
                                             array. The institution was running DB2 and CICS VSAM applications with
                                             very high availability requirements.

                                             The key migration challenges were as follows:

      A savings and loan company faced       ●   Converting data between volume sizes—The project required moving
      migration challenges such as per-          MOD 3 arrays onto MOD 3s, and MOD 3 arrays onto MOD 9s at both
      sonnel constraints and strict avail-       volume and dataset levels.
      ability requirements.                  ●   Limited downtime—The only permitted system downtime was
                                                 Sunday mornings.
                                             ●   Personnel constraints—There were limited personnel available to perform
                                                 the migration.
                                             ●   Complex project—Due to the complexity of the migration and the personnel
                                                 constraints, the estimated duration of the project was at least
                                                 two weeks.


                                             The savings and loan company evaluated several migration options:

                                             ●   Manual methods—This option was considered too labor intensive, espe-
                                                 cially with the “overworked and understaffed” customer resource base.
                                                 Avoiding bandwidth impacts also would be difficult.
                                             ●   Array-based replication—This option could not be used as the project
                                                 involved migrating MOD 3s to MOD 9s.
Storage migrations made simple
Page 16




                                             A combination of Softek TDMF and zDMF software was chosen because of
                    Highlights               the products’ ability to migrate data nondisruptively, handle the resizing
                                             of MODs, and move specific data at the dataset level. With the combination of
                                             TDMF and zDMF, the project was completed ahead of schedule (60 hours
      After evaluating several migration     estimated, 55 hours actual), with data migration constituting 38 hours of the
      methods, a savings and loan com-       total time. This was considerably shorter than anticipated, and the migration
      pany chose Softek TDMF and zDMF        was performed while the mainframe was in production, with no impact to
      software due to their ability to       end users.
      migrate data nondisruptively, resize
                                             Softek solution: Local mainframe migration with volume consolidation
      MODs and move specific data at
                                             1.   TDMF and zDMF software was nondisruptively installed on IBM Z800
      the dataset level.
                                                  mainframe and verified by the implementation team.
                                             2.   The team mapped source and target volume migration for TDMF migra-
                                                  tion. As part of the process, TDMF software was used to migrate a single
                                                  source MOD 3 to a MOD 9, thereby establishing the target MOD 9 into
                                                  the existing storage management subsystem (SMS) environment and
                                                  eliminating any SMS setup requirements for the new MOD 9 volumes.
                                             3.   The team mapped the remaining MOD 3 to MOD 9 migration, which
                                                  was accomplished using Softek zDMF software. The mapping docu-
                                                  mented the target-volume SMS storage groups and storage class. This
                                                  also identified any volumes that were not under SMS control.
                                             4.   Softek TDMF migration was initiated. Over the course of 10 hours
                                                  (including verification), the implementation team migrated
                                                  200 MOD 3 to 200 MOD 3 and 240 MOD 3 to 240 MOD 9. This
                                                  entire migration was completed transparently during production hours.
                                             5.   The implementation team set up Softek zDMF migration by building
                                                  source and target dataset migration groups (460 source volumes going to
                                                  240 target volumes at the dataset level).
Storage migrations made simple
Page 17




                                           6.    Softek zDMF migration was executed over a 28-hour period (submission
                   Highlights                    of group migrations, monitoring progress and verification results) and no
                                                 application impact was reported during this period.
                                           7.    Scheduled off-hours bounce of all database applications took place after
                                                 migration, and the total duration of the outage for all applications was
                                                 less than one hour.




                                                                                  DB2 and CICS VSAM applications




                                                                                               IBM Z800




      This chart depicts the array-to-                                                240 MOD3 to 240 MOD9

      array migration with consolidation
      enabled by the Softek software.
                                                                                      240 MOD3 to 240 MOD9




                                                                                  460 source volumes to 240 target
                                                                                      volumes at dataset level




                                                                  Older arrays                                       New arrays


                                           Local array-to-array migration with consolidation
Storage migrations made simple
Page 18




                                          Multiserver UNIX array-to-array migration with consolidation
                   Highlights             A Fortune 500 financial services firm had a mission-critical DB2 data
                                          warehouse (24 terabyte (TB) DB2, 10TB supporting files) on seven
                                          IBM AIX® 5.1 server platforms with the storage allocated to nine different
                                          storage arrays, some more than five years old.

                                          The firm faced these key migration challenges:

                                          ●   Storage growth—Storage capacity grew from 4TB to 30TB in three years,
      A financial services firm struggled       with storage added in a demand-driven, rather than a planned, fashion.
      with excessive storage growth and   ●   Locating storage—Storage administrators were unable to precisely
      other related challenges.               locate storage.
                                          ●   Complex environment—The system could be upgraded or changed
                                              only with difficulty, resulting in numerous end-user complaints about
                                              system performance.
                                          ●   Relocating data—A new storage array was purchased to improve perform-
                                              ance by migrating and reconfiguring volumes.
                                          ●   Source and target incompatibilities—The firm was unable to perform
                                              migration due to the complexity of the environment; this created incom-
                                              patibilities between the source and target storage arrays, so the new array
                                              sat unused for two months on the data center floor.


                                          The firm evaluated several different migration options:

                                          ●   Offline backup and restore from tape—This option was rejected due to
                                              time constraints.
                                          ●   Operating system synchronization tools—This option was rejected due to
                                              the inability to control migration start and end times.
                                          ●   Array-based replication—This was not an option because of the incompati-
                                              bilities between source and target storage.
                                          ●   AIX server-native Logical Volume Manager mirroring—This was
                                              rejected because Volume Manager was too slow and was not configured
                                              for mirroring.
Storage migrations made simple
Page 19




                                            Softek TDMF UNIX (IP) software was chosen based on its ability to migrate
                     Highlights             between disparate platforms and its flexibility in working with various logical
                                            definitions. The benefit of the TDMF solution is that the data migration could
      A Fortune 500 financial services       be performed in a challenging environment well within scheduled windows.
      firm chose Softek TDMF UNIX (IP)       The firm was finally able to take advantage of its new hardware, which
      software for its migration based on   enabled it to run queries four times more quickly with the new array, improve
      its ability to migrate between dis-   data layout and greatly simplify administration. Most important, end-user
      parate platforms and its flexibility   complaints about performance were eliminated almost entirely. In addition,
      in working with various logical       the firm was no longer paying lease charges for unused or outdated hardware.
      definitions.                           The Softek implementation methodology helped avoid manual errors and
                                            used onsite resources efficiently.

                                            Softek solution: Multiserver UNIX array-to-array migration with consolidation
                                            1.   In the premigration stage, Softek worked with the storage vendor to per-
                                                 form comprehensive testing and proof of concept to prove the viability of
      The Softek implementation                  the migration strategy. The firm elected to perform migration over sched-
      methodology helped avoid manual            uled weekend downtime, with an estimated 24 hours for total migration.
      errors and used onsite resources      2.   In the migration stage, the migration team was given the system at
      efficiently.                               8 p.m. on Saturday night; it installed Softek TDMF software on seven
                                                 AIX hosts in less than 15 minutes.
                                            3.   The migration process was initiated with migration configuration in loop-
                                                 back. The actual migration started at 12 a.m. and ended at 4 a.m., mov-
                                                 ing 22 TB of data in four hours.
                                            4.   As part of the migration process, the implementation team resized physi-
                                                 cal partitions on volume groups, improved the layout of the volumes on
                                                 the new array, and resized the IBM journaled file system (JFS) logs.
Storage migrations made simple
Page 20




                                 5.    The system was handed back at 3 p.m. on Sunday, well ahead of sched-
                                       ule, for preliminary testing. The DB2 data warehouse started correctly
                                       and the verification script launched.
                                 6.    The firm performed extensive testing, and at the end of the scheduled
                                       application stoppage, the system went into full production.
                                 7.    At the next scheduled downtime, the old source arrays were taken out of
                                       service and sent back to the leaseholder.




                                                                            DB2 data warehouse




                                                                              AIX 5.1 servers




                                                                                                 4 hours
                                                                                                  22TB




                                                                                                           New array
                                             Old arrays


                                 Multiserver migration with consolidation
Storage migrations made simple
Page 21




                                           Global migration to new storage over distance
                   Highlights              A Fortune 1000 bank running a Sybase financial application was relocating
                                           four servers from a New Jersey operations center to a New York City opera-
      A bank needed help relocating four
                                           tions center, changing out the legacy storage arrays to newer arrays.
      servers to another state.
                                           The bank’s key migration challenges were as follows:

                                           ●   Increased storage demands and internal consolidation—These factors drove
                                               the technology refresh.
                                           ●   Expiration of storage lease—The New Jersey storage needed to be returned
                                               to the leaseholder.
                                           ●   Hardware move—Physical servers had to be moved via courier.
                                           ●   Data move over distance—Data had to be moved from the New Jersey stor-
                                               age area network (SAN) to the New York City SAN.
                                           ●   Limited downtime—The only allowable outage was from Friday night to
                                               Saturday morning.


                                           The bank reviewed several migration options:

                                           ●   Offline migration—Restore from tape after physically moving the servers
                                               was possible but would have required complete shutdown of application
                                               servers over a 48-hour period. Availability requirements made this
                                               option impossible.
                                           ●   FTP transfer—The lack of bandwidth control, inability to verify the com-
                                               plete transfer of data and the requirement for file-by-file movement
                                               prompted the rejection of this option.
                                           ●   VERITAS Volume Replicator—This option required the installation of
                                               VERITAS Volume Manager on the source and target machines.
                                           ●   Hardware-based mirroring—This option was not possible because the
                                               source and target arrays were dissimilar.
Storage migrations made simple
Page 22




                                          Softek’s TDMF UNIX (IP) software was chosen for its ability to work with
                   Highlights             multiple operating systems and perform fast, controllable transfers.

      A Fortune 1000 bank chose Softek    The migration allowed the bank to realize economies of scale and increase
      TDMF UNIX (IP) software for its     administrative control. In addition, the increased storage capacity allowed the
      migration based on its ability to   bank to more fully utilize the Sybase application in support of key operations.
      work with multiple operating sys-
                                          Softek solution: Global migration to new storage over distance
      tems and perform fast transfers.
                                          1.   In the target environment, all new storage was defined, with the bank
                                               opting to use “swing server” to perform the migration. Data for the
                                               New Jersey servers was allocated to the swing server, which served as a
                                               proxy during the migration.
                                          2.   At 5 p.m. on Friday, the applications were taken offline and Softek
                                               TDMF was installed on the New Jersey servers.
                                          3.   Migration was set up from the four servers to one target and was initi-
                                               ated. The complete, full refresh took two hours and involved moving
                                               2.2 TB over the bank’s wide area network (WAN). Upon completion, the
                                               Softek TDMF solution maintained synchronization between source and
                                               target environment.
                                          4.   The migration was completed and verification testing was performed
                                               on data.
                                          5.   The New Jersey servers were shut down, physically moved to New York
                                               City and installed at the bank’s site.
                                          6.   In the target environment, the storage was rezoned from the swing server
                                               to the relocated servers.
Storage migrations made simple
Page 23




                                            7.    The servers were brought up and tested, and applications were brought
                   Highlights                     up and tested. At 6 a.m. Saturday, the application was put back
                                                  into production.
                                            8.    At the next scheduled outage, the New Jersey storage array was taken
                                                  offline and removed for return to leaseholder.


                                                                                       Sybase applications
                                                        New Jersey                                                        New York



                                                                                                                      Target environment




      The Softek solution enabled a                                                                          Swing
                                                                                                             Server
      rapid, security-rich migration from
      the source to the target.




                                                        Old array                                                         New array

                                            Global migration to new storage over distance
Storage migrations made simple
Page 24




                                            Global migration to new servers and new storage
                    Highlights              An insurance company was running a mission-critical claims processing appli-
                                            cation on Oracle. It was upgrading from legacy servers running Solaris 8 and
      An insurance company needed
                                            Veritas Filesystem/Solstice Disksuite to new servers running Solaris 9 and
      help to maintain availability while
                                            Veritas Volume Manager. Six TB (allocated 2TB per server) on an older disk
      migrating a mission-critical claims
                                            array were being replaced by a new array.
      processing application.
                                            The insurance company faced these key migration challenges:

                                            ●   Limited downtime—Only four hours downtime per week were permitted for
                                                any application.
                                            ●   Hardware move constraints—Only one server could be moved at a time to
                                                avoid risk to the application infrastructure.
                                            ●   Compatibility of new storage with legacy servers—There were insufficient
                                                connections available to directly attach new storage to legacy servers, and
                                                it was risky to install new device drivers on legacy servers.


                                            The migration options that were considered included the following:

                                            ●   Offline migration—This would have resulted in multiple downtime
                                                instances, each exceeding 12 hours.
                                            ●   Array-based replication—This option could not be used due to dissimilar
                                                legacy and target storage, and because disk subsystems were incompatible.
                                            ●   Veritas Volume Replicator—This option would have required the installa-
                                                tion of Veritas Volume Manager on source servers.
                                            ●   Fabric-based appliance replication—This was rejected because of the risk
                                                of reconfiguring the SAN.
                                            ●   EMC Recovery Point—This was rejected due to the requirement that mir-
                                                rors be set up and created on the host system. Such an arrangement was
                                                unacceptable given the changes involved and the associated disruption.
Storage migrations made simple
Page 25




                                               Softek TDMF UNIX (IP) software was chosen as the least risky option
                    Highlights                 because no system reboots were required. The migration was performed with-
                                               out requiring a reboot of any critical service, continuous application availabil-
      An insurance company chose
                                               ity was maintained during data migration, and the migration was performed
      Softek TDMF UNIX (IP) software
                                               without end users experiencing any loss or significant degradation in service.
      because it was the least risky
      option, requiring no reboots.            Softek solution: Global migration to new servers and new storage
                                               1.   In the initial phase, configurations were pre-created and user-
                                                    customizable scripts were written to unmount, replace the vfstab file
                                                    and remount file systems.
                                               2.   Softek TDMF software was installed just prior to weekly shutdown with
                                                    no disruption. Each server is configured in turn, with a total elapsed time
                                                    of 15 minutes for TDMF installation and configuration.
                                               3.   A full refresh from source server A to target server A was conducted over
                                                    the course of a week. Big asynchronous buffer (BAB) absorbed peaks in
      Not only did the migration not                write activity on legacy servers to minimize CPU usage and prevent high
      require a reboot of any critical serv-        I/O load.
      ice, but it also provided continuous     4.   New versions of Oracle and other software preinstalled on target server A
      application availability and no               were tested. Testing involved receiving multiple application-consistent
      loss or degradation of service for            versions of production disks on a daily basis. To avoid having to refresh
      end users.                                    from the production disks every time, checkpoint and a chaining config-
                                                    uration were used.
                                               5.   At the completion of the testing, journal wrote to target volumes to
                                                    ensure minimal data transfer on resynchronization.
Storage migrations made simple
Page 26




                                        6.       During the next weekend’s outage, applications on target server A were
                  Highlights                     brought up and pointed to the new storage volumes. Source server A was
                                                 taken out of service.
                                        7.       The process was repeated for source servers B and C over the next
                                                 two weeks.
                                        8.       During the next scheduled outage, the older storage array was taken out
                                                 of service.




                                                                                          Oracle applications


                                                                         Source                                           Target
                                                                       environment                                      environment




                                              Source     Source
                                             Server C   Server B

                                                                                              Checkpoint

      This chart shows how the insur-                                          Source
                                                                                                                    Target
                                                                               Server A                            Server A
      ance company’s global migration
      was executed.



                                                                                                   Journal checkpoint
                                                                                                         area




                                                                   Old array                                                  New arrays




                                        Global migration to new servers and storage
Storage migrations made simple
Page 27




                                 Local Windows array-to-array migration
                                 A Fortune 500 bank had 5.8TB of data on two servers for a key enterprise
                                 compliance management application based on Microsoft SQL. The bank
                                 wanted to move from an older locally attached storage array to a new locally
                                 attached storage array.

                                 The key migration challenges were as follows:

                                 ●   Adding new storage—The goal was to free up existing storage and imple-
                                     ment new faster, cheaper storage.
                                 ●   Limited downtime—The application had a limited downtime window from
                                     12 a.m. to 6 a.m. Saturday morning and from 12 a.m. to 2 a.m. Tuesday
                                     morning—but it was estimated that the full migration would take a week.
                                 ●   Reconfiguration of a large number of volumes—There were 30 volumes to
                                     be moved, creating potential configuration issues.


                                 The bank considered these options:

                                 ●   Restore from tape backups—This was not possible due to application avail-
                                     ability requirements.
                                 ●   EMC Open Migrator—This was initially selected but failed during an early
                                     migration test.
                                 ●   File-level migration and replication—This was considered but found to be
                                     too expensive and difficult to configure for users lacking expert-level
                                     implementation experience.
Storage migrations made simple
Page 28




                                            Softek TDMF Windows (IP) software was chosen because of its ease of use,
                    Highlights              price and ability to maintain continuous application availability during
                                            data migration.
      A Fortune 500 bank chose Softek
      TDMF Windows (IP) software for its    Softek solution: Local Windows array-to-array migration
      ease of use, price and ability to     1.   During scheduled Saturday downtime, Softek TDMF software was
      maintain continuous application            installed on the production server. Target volumes were connected to the
      availability during data migration.        volume and disk manager, and the system was rebooted to allocate the
                                                 BAB buffer (RAM) and register target volume at volume and disk man-
                                                 ager. Installation took 10 minutes per server. Application was restarted at
                                                 the end of scheduled downtime.
                                            2.   Migration groups were configured on source and target by the implemen-
                                                 tation team. The team, with offsite Softek support, created mount points
                                                 to resolve issues related to insufficient drive letters caused by the num-
                                                 ber of volumes to be migrated.
                                            3.   Softek TDMF full refresh was initiated in loopback configuration. Full
                                                 refresh took approximately 24 hours and was performed online without
                                                 any application impact.
                                            4.   With Softek TDMF operation in normal mode, the team validated the
                                                 data migrated to the new storage array by using the TDMF software’s
                                                 checkpoint function.
Storage migrations made simple
Page 29




                                         5.    During Tuesday downtime, the application was stopped and source vol-
                  Highlights                   umes were removed. The target volumes were renamed, and the applica-
                                               tion was placed back into production using new arrays.
                                         6.    Old arrays were decommissioned.




      The local Windows array-to-array
      migration was a success.                                                      Production server
                                                                         24 hours                       24 hours



                                                                                      Checkpoint




                                                      Old arrays                                                   New arrays


                                         Local Windows array-to-array migration
Storage migrations made simple
Page 30




                                 Summary
                                 For the IT manager, technology refresh is regular, continuous and problem-
                                 atic, unless data migration software is used to simplify and streamline
                                 the process.

                                 The scenarios presented in this paper demonstrate how IBM Softek data
                                 migration software can be leveraged to streamline technology refresh projects.
                                 Above and beyond what most other products offer, Softek data migration soft-
                                 ware provides nondisruptive, flexible and purpose-built solutions to address
                                 the complex challenges of technology refresh.

                                 With Softek solutions, applications remain online and continue to process data
                                 throughout the migration process. Softek TDMF software is hardware inde-
                                 pendent, accommodates increases in volume size, adjusts to system demands
                                 and has roll-back capability.
Notes
For more information                                                             © Copyright IBM Corporation 2009
                                                                                   IBM Global Services
For more information about IBM Softek solutions for technology refresh, visit:
                                                                                   Route 100
ibm.com/services/datamobility                                                      Somers, NY 10589
                                                                                   U.S.A.
                                                                                   Produced in the United States of America
                                                                                   October 2009
                                                                                   All Rights Reserved
                                                                                   IBM, the IBM logo, ibm.com, AIX, CICS, DB2,
                                                                                   Softek, TDMF and z/OS are trademarks or
                                                                                   registered trademarks of International Business
                                                                                   Machines Corporation and other companies in
                                                                                   the United States, other countries, or both. If
                                                                                   these and other IBM trademarked terms are
                                                                                   marked on their first occurrence in this
                                                                                   information with a trademark symbol (® or ™),
                                                                                   these symbols indicate U.S. registered or
                                                                                   common law trademarks owned by IBM at the
                                                                                   time this information was published. Such
                                                                                   trademarks may also be registered or common
                                                                                   law trademarks in other countries. A current list
                                                                                   of IBM trademarks is available on the Web at
                                                                                   “Copyright and trademark information” at
                                                                                   ibm.com/legal/copytrade.shtml
                                                                                   Microsoft and Windows are trademarks of
                                                                                   Microsoft Corporation in the United States,
                                                                                   other countries, or both.
                                                                                   UNIX is a registered trademark of The Open
                                                                                   Group in the United States and other countries.
                                                                                   Other product, company or service names may
                                                                                   be trademarks or service marks of others.
                                                                                   References in this publication to IBM products
                                                                                   or services do not imply that IBM intends to
                                                                                   make them available in all countries in which
                                                                                   IBM operates.




                                                                                   SDW03012-USEN-00

More Related Content

What's hot

LTE Testing - Network Performance, Security, and Stability at Massive Scale
LTE Testing - Network Performance, Security, and Stability at Massive ScaleLTE Testing - Network Performance, Security, and Stability at Massive Scale
LTE Testing - Network Performance, Security, and Stability at Massive ScaleIxia
 
Smarter infrastructure with the new IBM Pure Flex System
Smarter infrastructure with the new IBM Pure Flex SystemSmarter infrastructure with the new IBM Pure Flex System
Smarter infrastructure with the new IBM Pure Flex SystemCOMMON Europe
 
Rd&t aa ms data sheet [v1]
Rd&t aa ms data sheet [v1]Rd&t aa ms data sheet [v1]
Rd&t aa ms data sheet [v1]Luigi Tommaseo
 
The bits bytes and business benefits of securing your mq environment and mess...
The bits bytes and business benefits of securing your mq environment and mess...The bits bytes and business benefits of securing your mq environment and mess...
The bits bytes and business benefits of securing your mq environment and mess...Leif Davidsen
 
InfoSphere streams_technical_overview_infospherusergroup
InfoSphere streams_technical_overview_infospherusergroupInfoSphere streams_technical_overview_infospherusergroup
InfoSphere streams_technical_overview_infospherusergroupIBMInfoSphereUGFR
 
Using ibm mq in managed file transfer environments final
Using ibm mq in managed file transfer environments finalUsing ibm mq in managed file transfer environments final
Using ibm mq in managed file transfer environments finalLeif Davidsen
 
IBM Managed File Transfer Portfolio - IBMImpact 2014
IBM Managed File Transfer Portfolio - IBMImpact 2014IBM Managed File Transfer Portfolio - IBMImpact 2014
IBM Managed File Transfer Portfolio - IBMImpact 2014Leif Davidsen
 
Data Center Automation - Erwin Van Kruining
Data Center Automation - Erwin Van KruiningData Center Automation - Erwin Van Kruining
Data Center Automation - Erwin Van KruiningHPDutchWorld
 
Reporter for IBM TSM data sheet 2.7
Reporter for IBM TSM data sheet 2.7Reporter for IBM TSM data sheet 2.7
Reporter for IBM TSM data sheet 2.7peterpijpelink
 
InfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUX
InfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUXInfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUX
InfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUXIBMInfoSphereUGFR
 
Zenon The integrated solution
Zenon The integrated solutionZenon The integrated solution
Zenon The integrated solutionCopa-Data UK
 
3433 IBM messaging security why securing your environment is important-feb2...
3433   IBM messaging security why securing your environment is important-feb2...3433   IBM messaging security why securing your environment is important-feb2...
3433 IBM messaging security why securing your environment is important-feb2...Robert Parker
 
Ugif 04 2011 france ug04042011-jroy_part1
Ugif 04 2011   france ug04042011-jroy_part1Ugif 04 2011   france ug04042011-jroy_part1
Ugif 04 2011 france ug04042011-jroy_part1UGIF
 
Floorvision Brochure
Floorvision BrochureFloorvision Brochure
Floorvision BrochureFides Sales
 
Res Software In Healthcare
Res Software In HealthcareRes Software In Healthcare
Res Software In Healthcarejckirby
 

What's hot (20)

LTE Testing - Network Performance, Security, and Stability at Massive Scale
LTE Testing - Network Performance, Security, and Stability at Massive ScaleLTE Testing - Network Performance, Security, and Stability at Massive Scale
LTE Testing - Network Performance, Security, and Stability at Massive Scale
 
A Large European Telecommunications Company
A Large European Telecommunications Company A Large European Telecommunications Company
A Large European Telecommunications Company
 
Smarter infrastructure with the new IBM Pure Flex System
Smarter infrastructure with the new IBM Pure Flex SystemSmarter infrastructure with the new IBM Pure Flex System
Smarter infrastructure with the new IBM Pure Flex System
 
Rd&t aa ms data sheet [v1]
Rd&t aa ms data sheet [v1]Rd&t aa ms data sheet [v1]
Rd&t aa ms data sheet [v1]
 
The bits bytes and business benefits of securing your mq environment and mess...
The bits bytes and business benefits of securing your mq environment and mess...The bits bytes and business benefits of securing your mq environment and mess...
The bits bytes and business benefits of securing your mq environment and mess...
 
InfoSphere streams_technical_overview_infospherusergroup
InfoSphere streams_technical_overview_infospherusergroupInfoSphere streams_technical_overview_infospherusergroup
InfoSphere streams_technical_overview_infospherusergroup
 
Using ibm mq in managed file transfer environments final
Using ibm mq in managed file transfer environments finalUsing ibm mq in managed file transfer environments final
Using ibm mq in managed file transfer environments final
 
IBM Managed File Transfer Portfolio - IBMImpact 2014
IBM Managed File Transfer Portfolio - IBMImpact 2014IBM Managed File Transfer Portfolio - IBMImpact 2014
IBM Managed File Transfer Portfolio - IBMImpact 2014
 
Radware Alteon VA for the IBM PureFlex System
Radware Alteon VA for  the IBM PureFlex SystemRadware Alteon VA for  the IBM PureFlex System
Radware Alteon VA for the IBM PureFlex System
 
Data Center Automation - Erwin Van Kruining
Data Center Automation - Erwin Van KruiningData Center Automation - Erwin Van Kruining
Data Center Automation - Erwin Van Kruining
 
Reporter for IBM TSM data sheet 2.7
Reporter for IBM TSM data sheet 2.7Reporter for IBM TSM data sheet 2.7
Reporter for IBM TSM data sheet 2.7
 
InfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUX
InfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUXInfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUX
InfoSphere Streams Technical Overview - Use Cases Big Data - Jerome CHAILLOUX
 
Zenon The integrated solution
Zenon The integrated solutionZenon The integrated solution
Zenon The integrated solution
 
Firstcomm construction of a DR plan
Firstcomm construction of a DR planFirstcomm construction of a DR plan
Firstcomm construction of a DR plan
 
3433 IBM messaging security why securing your environment is important-feb2...
3433   IBM messaging security why securing your environment is important-feb2...3433   IBM messaging security why securing your environment is important-feb2...
3433 IBM messaging security why securing your environment is important-feb2...
 
Ugif 04 2011 france ug04042011-jroy_part1
Ugif 04 2011   france ug04042011-jroy_part1Ugif 04 2011   france ug04042011-jroy_part1
Ugif 04 2011 france ug04042011-jroy_part1
 
Floorvision Brochure
Floorvision BrochureFloorvision Brochure
Floorvision Brochure
 
Floor Vision Brochure
Floor Vision BrochureFloor Vision Brochure
Floor Vision Brochure
 
IBM PROTECTIER: FROM BACKUP TO RECOVERY
IBM PROTECTIER: FROM BACKUP TO RECOVERYIBM PROTECTIER: FROM BACKUP TO RECOVERY
IBM PROTECTIER: FROM BACKUP TO RECOVERY
 
Res Software In Healthcare
Res Software In HealthcareRes Software In Healthcare
Res Software In Healthcare
 

Similar to Storage Migration Made Simple

A Cost-Effective Integrated Solution for Backup and Disaster Recovery
A Cost-Effective Integrated Solution for Backup and Disaster RecoveryA Cost-Effective Integrated Solution for Backup and Disaster Recovery
A Cost-Effective Integrated Solution for Backup and Disaster Recoveryxmeteorite
 
Implementing nondisruptivedata migrations for UNIX usingTDMF technology.
Implementing nondisruptivedata migrations for UNIX usingTDMF technology.Implementing nondisruptivedata migrations for UNIX usingTDMF technology.
Implementing nondisruptivedata migrations for UNIX usingTDMF technology.IBM India Smarter Computing
 
Cloud migration
Cloud migrationCloud migration
Cloud migrationRaj Raj
 
Velostrata cloud migration --Whitepaper
Velostrata cloud migration --WhitepaperVelostrata cloud migration --Whitepaper
Velostrata cloud migration --WhitepaperAbhishek Sood
 
IBM consolidation and relocation webinar
IBM consolidation and relocation webinarIBM consolidation and relocation webinar
IBM consolidation and relocation webinarHerb Hernandez
 
Workflow and Collaboration: Working Faster, Smarter, Cheaper
Workflow and Collaboration: Working Faster, Smarter, CheaperWorkflow and Collaboration: Working Faster, Smarter, Cheaper
Workflow and Collaboration: Working Faster, Smarter, CheaperOnFrame Ltd
 
Solution magazine 2012_final_nl
Solution magazine 2012_final_nlSolution magazine 2012_final_nl
Solution magazine 2012_final_nlTTEC
 
NTT i3 Point of View: Network Infrastructure Elasticity
NTT i3 Point of View:  Network Infrastructure ElasticityNTT i3 Point of View:  Network Infrastructure Elasticity
NTT i3 Point of View: Network Infrastructure ElasticityNTT Innovation Institute Inc.
 
Choosing a Desktop Virtualization (VDI) Partner
Choosing a Desktop Virtualization (VDI) Partner Choosing a Desktop Virtualization (VDI) Partner
Choosing a Desktop Virtualization (VDI) Partner AnuntaTech
 
Communicating Virtualization to Non-IT Audiences
Communicating Virtualization to Non-IT AudiencesCommunicating Virtualization to Non-IT Audiences
Communicating Virtualization to Non-IT AudiencesAkweli Parker
 
The Importance of Cloud Management for Networks
The Importance of Cloud Management for NetworksThe Importance of Cloud Management for Networks
The Importance of Cloud Management for NetworksWestbase.io
 
Cto’s guide to sdn, nfv and vnf
Cto’s guide to sdn, nfv and vnfCto’s guide to sdn, nfv and vnf
Cto’s guide to sdn, nfv and vnfPaulo R
 

Similar to Storage Migration Made Simple (20)

Best Practices for Migration
Best Practices for MigrationBest Practices for Migration
Best Practices for Migration
 
Best Practices for Migration
Best Practices for MigrationBest Practices for Migration
Best Practices for Migration
 
A Cost-Effective Integrated Solution for Backup and Disaster Recovery
A Cost-Effective Integrated Solution for Backup and Disaster RecoveryA Cost-Effective Integrated Solution for Backup and Disaster Recovery
A Cost-Effective Integrated Solution for Backup and Disaster Recovery
 
Implementing nondisruptivedata migrations for UNIX usingTDMF technology.
Implementing nondisruptivedata migrations for UNIX usingTDMF technology.Implementing nondisruptivedata migrations for UNIX usingTDMF technology.
Implementing nondisruptivedata migrations for UNIX usingTDMF technology.
 
Softek TDMF z/OS extended distance migration.
Softek TDMF z/OS extended distance migration.Softek TDMF z/OS extended distance migration.
Softek TDMF z/OS extended distance migration.
 
How to Migrate Without Downtime
How to Migrate Without DowntimeHow to Migrate Without Downtime
How to Migrate Without Downtime
 
Implementing Softek zDMF technology.
Implementing Softek zDMF technology.Implementing Softek zDMF technology.
Implementing Softek zDMF technology.
 
Cloud migration
Cloud migrationCloud migration
Cloud migration
 
Velostrata cloud migration --Whitepaper
Velostrata cloud migration --WhitepaperVelostrata cloud migration --Whitepaper
Velostrata cloud migration --Whitepaper
 
Enterprise network management
Enterprise network managementEnterprise network management
Enterprise network management
 
IBM consolidation and relocation webinar
IBM consolidation and relocation webinarIBM consolidation and relocation webinar
IBM consolidation and relocation webinar
 
Workflow and Collaboration: Working Faster, Smarter, Cheaper
Workflow and Collaboration: Working Faster, Smarter, CheaperWorkflow and Collaboration: Working Faster, Smarter, Cheaper
Workflow and Collaboration: Working Faster, Smarter, Cheaper
 
On premise vs cloud server
On premise vs cloud serverOn premise vs cloud server
On premise vs cloud server
 
8.cloud migration
8.cloud migration8.cloud migration
8.cloud migration
 
Solution magazine 2012_final_nl
Solution magazine 2012_final_nlSolution magazine 2012_final_nl
Solution magazine 2012_final_nl
 
NTT i3 Point of View: Network Infrastructure Elasticity
NTT i3 Point of View:  Network Infrastructure ElasticityNTT i3 Point of View:  Network Infrastructure Elasticity
NTT i3 Point of View: Network Infrastructure Elasticity
 
Choosing a Desktop Virtualization (VDI) Partner
Choosing a Desktop Virtualization (VDI) Partner Choosing a Desktop Virtualization (VDI) Partner
Choosing a Desktop Virtualization (VDI) Partner
 
Communicating Virtualization to Non-IT Audiences
Communicating Virtualization to Non-IT AudiencesCommunicating Virtualization to Non-IT Audiences
Communicating Virtualization to Non-IT Audiences
 
The Importance of Cloud Management for Networks
The Importance of Cloud Management for NetworksThe Importance of Cloud Management for Networks
The Importance of Cloud Management for Networks
 
Cto’s guide to sdn, nfv and vnf
Cto’s guide to sdn, nfv and vnfCto’s guide to sdn, nfv and vnf
Cto’s guide to sdn, nfv and vnf
 

More from IBM India Smarter Computing

Using the IBM XIV Storage System in OpenStack Cloud Environments
Using the IBM XIV Storage System in OpenStack Cloud Environments Using the IBM XIV Storage System in OpenStack Cloud Environments
Using the IBM XIV Storage System in OpenStack Cloud Environments IBM India Smarter Computing
 
TSL03104USEN Exploring VMware vSphere Storage API for Array Integration on th...
TSL03104USEN Exploring VMware vSphere Storage API for Array Integration on th...TSL03104USEN Exploring VMware vSphere Storage API for Array Integration on th...
TSL03104USEN Exploring VMware vSphere Storage API for Array Integration on th...IBM India Smarter Computing
 
A Comparison of PowerVM and Vmware Virtualization Performance
A Comparison of PowerVM and Vmware Virtualization PerformanceA Comparison of PowerVM and Vmware Virtualization Performance
A Comparison of PowerVM and Vmware Virtualization PerformanceIBM India Smarter Computing
 
IBM pureflex system and vmware vcloud enterprise suite reference architecture
IBM pureflex system and vmware vcloud enterprise suite reference architectureIBM pureflex system and vmware vcloud enterprise suite reference architecture
IBM pureflex system and vmware vcloud enterprise suite reference architectureIBM India Smarter Computing
 

More from IBM India Smarter Computing (20)

Using the IBM XIV Storage System in OpenStack Cloud Environments
Using the IBM XIV Storage System in OpenStack Cloud Environments Using the IBM XIV Storage System in OpenStack Cloud Environments
Using the IBM XIV Storage System in OpenStack Cloud Environments
 
All-flash Needs End to End Storage Efficiency
All-flash Needs End to End Storage EfficiencyAll-flash Needs End to End Storage Efficiency
All-flash Needs End to End Storage Efficiency
 
TSL03104USEN Exploring VMware vSphere Storage API for Array Integration on th...
TSL03104USEN Exploring VMware vSphere Storage API for Array Integration on th...TSL03104USEN Exploring VMware vSphere Storage API for Array Integration on th...
TSL03104USEN Exploring VMware vSphere Storage API for Array Integration on th...
 
IBM FlashSystem 840 Product Guide
IBM FlashSystem 840 Product GuideIBM FlashSystem 840 Product Guide
IBM FlashSystem 840 Product Guide
 
IBM System x3250 M5
IBM System x3250 M5IBM System x3250 M5
IBM System x3250 M5
 
IBM NeXtScale nx360 M4
IBM NeXtScale nx360 M4IBM NeXtScale nx360 M4
IBM NeXtScale nx360 M4
 
IBM System x3650 M4 HD
IBM System x3650 M4 HDIBM System x3650 M4 HD
IBM System x3650 M4 HD
 
IBM System x3300 M4
IBM System x3300 M4IBM System x3300 M4
IBM System x3300 M4
 
IBM System x iDataPlex dx360 M4
IBM System x iDataPlex dx360 M4IBM System x iDataPlex dx360 M4
IBM System x iDataPlex dx360 M4
 
IBM System x3500 M4
IBM System x3500 M4IBM System x3500 M4
IBM System x3500 M4
 
IBM System x3550 M4
IBM System x3550 M4IBM System x3550 M4
IBM System x3550 M4
 
IBM System x3650 M4
IBM System x3650 M4IBM System x3650 M4
IBM System x3650 M4
 
IBM System x3500 M3
IBM System x3500 M3IBM System x3500 M3
IBM System x3500 M3
 
IBM System x3400 M3
IBM System x3400 M3IBM System x3400 M3
IBM System x3400 M3
 
IBM System x3250 M3
IBM System x3250 M3IBM System x3250 M3
IBM System x3250 M3
 
IBM System x3200 M3
IBM System x3200 M3IBM System x3200 M3
IBM System x3200 M3
 
IBM PowerVC Introduction and Configuration
IBM PowerVC Introduction and ConfigurationIBM PowerVC Introduction and Configuration
IBM PowerVC Introduction and Configuration
 
A Comparison of PowerVM and Vmware Virtualization Performance
A Comparison of PowerVM and Vmware Virtualization PerformanceA Comparison of PowerVM and Vmware Virtualization Performance
A Comparison of PowerVM and Vmware Virtualization Performance
 
IBM pureflex system and vmware vcloud enterprise suite reference architecture
IBM pureflex system and vmware vcloud enterprise suite reference architectureIBM pureflex system and vmware vcloud enterprise suite reference architecture
IBM pureflex system and vmware vcloud enterprise suite reference architecture
 
X6: The sixth generation of EXA Technology
X6: The sixth generation of EXA TechnologyX6: The sixth generation of EXA Technology
X6: The sixth generation of EXA Technology
 

Recently uploaded

My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxOnBoard
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?XfilesPro
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAndikSusilo4
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 

Recently uploaded (20)

My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Maximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptxMaximizing Board Effectiveness 2024 Webinar.pptx
Maximizing Board Effectiveness 2024 Webinar.pptx
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Azure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & ApplicationAzure Monitor & Application Insight to monitor Infrastructure & Application
Azure Monitor & Application Insight to monitor Infrastructure & Application
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 

Storage Migration Made Simple

  • 1. IBM Global Technology Services October 2009 Storage migrations made simple Overcoming the challenges of technology refresh
  • 2. Storage migrations made simple Page 2 Executive summary Contents Minimizing the impact of data migrations on business operations is a critical part of the data center manager’s job. Studies have shown that technology 2 Executive summary refresh is the primary driver of data migration. Storage hardware and server 4 Introduction to data migration replacement, as well as the expiration of storage equipment leases, means that 6 Data migration software storage managers have to move data on a regular basis. Moving data for tech- 10 Technology refresh nology refresh can be problematic, however, due to application availability examples requirements, incompatibilities between source and target systems, and time 30 Summary and budget constraints. While technology refresh projects are typically sched- uled to be performed during off-hours, today’s around-the-clock environment means that applications need to stay online, even during off-hours. New software allows nondisruptive migration, meaning that applications remain online during migration, without significant performance delays. And reliable methodologies that help assess, plan, move and validate data migra- tions can enable customization, speed the process and help provide data integrity—simplifying the technology refresh process.
  • 3. Storage migrations made simple Page 3 The following table presents five key factors that show how data migration Highlights software can simplify technology refresh and how IBM Softek™ Transparent Data Migration Facility (IBM TDMF®) technology can meet these needs. Technology refresh is the primary driver of data migration. Key factors Description Softek TDMF capability Performance Performance measurements TDMF software includes a must take into consideration throttling or pacing capability how quickly data is copied that can speed up or slow from the source to target down data movement and balanced against net- depending on system work bandwidth and system demands in order to easily overhead. balance migration. Roll-back capability If something goes wrong, Roll back can easily be the migration can be termi- accomplished with TDMF nated and restarted, or software, although it can be application processing can problematic with some other continue on the source data technologies, such as vol- or device. ume managers. Increase in volume size Many migrations involve an TDMF software can accom- increase in volume size from modate an increase in vol- the source to the target. ume size. Heterogeneous source While host-based products TDMF software is hardware and target hardware support unlike storage independent. devices, most array-based products require that the source and target come from the same vendor. Application downtime Applications have different TDMF software allows for levels of business criticality nondisruptive data migration and therefore have varying so applications can stay degrees of acceptable online and continue to downtime. process data throughout the migration process.
  • 4. Storage migrations made simple Page 4 Introduction to data migration Highlights What drives data migration? Technology refresh, defined as replacing an array with a new one, is the major reason for moving data and most commonly occurs when: ● The lease on a piece of storage equipment ends. ● Data is being moved from old to new storage. ● The storage system is being upgraded. ● The organization has decided to standardize on a particular technology. Typically, most data centers lease their storage hardware under three-year agreements. Once the agreement ends, the hardware needs to be replaced and the data stored on it moved to new equipment. Data migration must be com- pleted before the lease expires to avoid additional monthly lease costs. In cases in which storage hardware is purchased rather than leased, older arrays that are fully depreciated can be expensive to maintain. Once again, purchase and implementation of new equipment requires migrating data from the older arrays. IT organizations justify purchase or lease of new equipment by the fact that it is less expensive to maintain, performs better and supports advanced features. IT organizations justify new equip- New arrays can support larger capacities to accommodate the growth of appli- ment because it can accommodate cations; have faster processing chips to deliver better performance; or have growth, process more quickly to new features such as snapshot copies. Finally, newer arrays are justified to deliver better performance and minimize the risk of hardware malfunction, as older arrays are perceived as minimize the risk of hardware being less reliable. malfunction.
  • 5. Storage migrations made simple Page 5 In many cases, technology refresh means not only replacing storage arrays, but Highlights also upgrading associated servers to better meet service level agreements or because the servers, like the arrays, have reached the end of their lease. In addition, storage and server capacity are acquired annually or more often to For most industries, estimates of accommodate data and application growth. Estimates of data growth vary, but data growth typically range from they typically range from 25 to 50 percent annually for most industries. 25 to 50 percent annually. So every year, a typical organization acquires storage technology to replace arrays on which lease or maintenance agreements are expiring, as well as additional capacity to accommodate anticipated growth. Thus, the IT organi- zation must move data between servers and storage for technology refresh on a very regular basis. The storage mantra is: You have data, therefore you will move it. Total on Floor (TB) New (TB) Replaced (TB) Purchased (TB) Example annual migration requirements
  • 6. Storage migrations made simple Page 6 IT organizations face many challenges associated with technology refresh— Highlights particularly deciding how to deal with data growth and determining how, when and where to move data. Some of the key issues associated with tech- It is an ongoing challenge to decide nology refresh include: how to deal with data growth and ● Lease overlap costs or duplicate maintenance costs, when old and new to determine how, when and where equipment are on the data center floor at the same time to move data. ● Migration of data between arrays from different vendors, as there may be significant incompatibilities ● Risk of data loss or corruption that may occur if the migration is not done properly ● Prolonged application downtime, or even an inability to restart applications This paper focuses on how organizations can meet these challenges by lever- aging data migration software. Data migration software Depending on the criticality of applications, the quantity of data to be moved and allowable downtime, there are a variety of tools that organizations can use to migrate data, each with its own considerations and limitations. Organizations can meet these chal- Offline migration methods lenges by leveraging various types Offline migration methods require that applications be taken offline during of data migration software. data movement, and therefore they are suitable only when significant down- time can be tolerated. While the amount of downtime required typically depends on the quantity of data being transferred, this offline migration mechanism is not recommended for heavily used applications or those that must be accessible outside of normal business hours. Offline migration typi- cally requires manual manipulation of data or files, which can increase the risk of human error and may not scale to distributed or remote scenarios.
  • 7. Storage migrations made simple Page 7 Restore from backup tapes Highlights This method involves making a backup copy of data, then taking the associ- ated arrays or servers offline to ensure that no new data is added. Then the Offline migration methods include data is restored from the backup tapes to the new arrays or servers. Once restore from backup tapes and FTP the restore process is complete, the systems are brought online. While transfer. this is a low-cost solution, especially as nearly all organizations already use backup software, it requires significant administrative attention and applica- tion downtime. FTP transfer This method involves manually copying files from the source systems to the target systems via File Transfer Protocol (FTP). Because it requires file-by-file movement, this method is not recommended when the data contains large numbers of individual files. FTP transfer does not provide control over the network bandwidth used for migration, which can affect other applications and users in the network environment, nor does it enable verification of the complete transfer of data. Online migration methods Online migration methods generally allow data movement while applications are up and running. Depending on the method chosen, however, these meth- Online migration methods include ods can be limited to a single vendor environment. Other methods may con- array-based replication, volume sume significant processor overhead, potentially resulting in application management or replication and slowdown or other disruptions. host-based mirroring. Array-based replication While this method allows for high service level guarantees, it requires moving between similar storage devices, increasing costs and limiting the data center to a single vendor.
  • 8. Storage migrations made simple Page 8 Volume management or replication Highlights Volume management is used primarily to control disk resources by mapping the logical view of storage space with the actual physical disks. While it can be used to move small amounts of data, it can be slow. This solution requires a heterogeneous storage environment over an IP network and may require the costly installation of additional software. Host-based mirroring Host-based mirroring or replication solutions generally focus on file-by-file data movement to create a secondary data copy for disaster recovery purposes. When used for data migration, this approach may put an additional burden on application servers and may require high-cost management, especially in het- erogeneous environments. Online nondisruptive migration—Softek data migration products There are a few products available in the marketplace today that were designed to provide nondisruptive data migration—meaning that data move- Softek TDMF software helps make ment occurs without causing application outages or slowdowns. Softek data it easier to upgrade to new storage, migration software is the proven standard for online, heterogeneous data improve application performance movement, meeting the challenges of application availability and technical and manage information availability compatibility between source and target storage. Softek TDMF software moves through the information lifecycle. data while maintaining application availability, making it easier to upgrade to new storage, improve application performance and manage information avail- ability through the information lifecycle. So whether the organization needs to upgrade to new storage hardware (from any vendor to any vendor) or needs a more effective way to migrate data based on cost and performance, TDMF software can provide the solution. Together with Softek z/OS® Data Mobility Facility (zDMF) software for moving mainframe data at the dataset level, Softek TDMF technology provides the solution to meet a wide range of tech- nology refresh and other data migration needs.
  • 9. Storage migrations made simple Page 9 An examination of real-world scenarios can demonstrate how Softek data Highlights migration products are used to simplify technology refresh: A discussion of real-world imple- ● A manufacturing company running a mission-critical Oracle customer mentations can illustrate how order and tracking system on Solaris conducting local UNIX® array-to- Softek technology simplifies tech- array migration nology refresh. ● A large bank running a credit and debit transaction application on IBM z/OS conducting local mainframe array-to-array migration ● A major savings and loan institution running an IBM DB2®, IBM CICS® and Virtual Storage Access Method (VSAM) application with high-availability requirements conducting mainframe migration with vol- ume consolidation ● A Fortune 500 financial services firm running a mission-critical DB2 data warehouse conducting multiserver UNIX array-to-array migration with consolidation ● A Fortune 1000 bank running a Sybase financial application conducting a global migration to new storage over distance ● An insurance company with a mission-critical claims processing application on Oracle conducting a global migration to new servers and new storage ● A Fortune 500 bank running a key enterprise compliance management application conducting a local Microsoft® Windows® array-to- array migration
  • 10. Storage migrations made simple Page 10 Technology refresh examples Highlights The detailed descriptions of the scenarios that follow show how Softek capabilities can meet technology refresh needs and streamline technology refresh projects. Softek software capabilities can Local UNIX array-to-array migration meet technology refresh needs In this example, a manufacturing company running a mission-critical Oracle and streamline technology refresh customer order and tracking system on Solaris needed to move three terabytes projects. (TB) of legacy data from an old storage array to a new storage array. The challenges that the company faced were as follows: In the first example, Softek soft- ● Limited downtime – Downtime was limited to four hours on the weekend. ware helped a manufacturing com- ● Large volume of data – Application storage spanned 10 300 GB volumes. pany move 3TB of legacy data from ● Increase in volume size –The planned capacity growth required an an old storage array to a new one, increase in volume size during migration. without significant downtime. The company considered the pros and cons of several different migration options, including: ● Restore from backup tapes – This option would have required more than four hours to copy the data, exceeding application downtime restrictions. ● Sun Solstice Volume Manager – This would not support the increase in volume size. ● Array-based replication – This option would have been expensive to install, and the company did not plan to use it following the migration. In addition, firmware upgrades required on the legacy arrays to support the current array-based replication version would have added downtime and complexity to the project. ● Semantic Veritas Volume Replicator (VVR) – This option would have required installing the prerequisite Veritas Volume Manager.
  • 11. Storage migrations made simple Page 11 Softek TDMF technology was chosen because the asynchronous, host-based Highlights migration was cost-effective, able to work with disparate platforms, did not require changes to the source environment and could accommodate the increased volume size in the target environment. The benefits of the TDMF solution were that the Oracle application’s storage volumes were augmented, enabling continued expansion of capacity. In addition, the migration was com- pleted without significant downtime to this mission-critical application. Most important, the storage technology upgrade was transparent to the application’s end users. Most important, the storage tech- Softek solution: Local UNIX array-to-array migration with Softek TDMF solution nology upgrade was transparent 1. Softek TDMF technology was installed on the host prior to the weekly to users. scheduled downtime and configured to map the source and target devices. A script was written to unmount and remount the source devices during the weekend outage. The script was run just after the weekly backups and took less than 30 seconds to run, so the scheduled down- time was not affected. 2. The TDMF solution started the copy operation once applications are back online. Copy ran slowly in background so as not to significantly affect the operation of the application. 3. All volumes were synchronized within 48 hours. 4. Switchover was performed without service outage. Old volumes were left in place while performance of new volumes was validated. 5. Old volumes were removed from configuration. 6. TDMF software was left on the system and used to move two volumes nondisruptively within the new storage array to resolve performance problems caused by pathing issues in the new hardware.
  • 12. Storage migrations made simple Page 12 Solaris Server running Oracle Highlights application Legacy 15 minutes downtime 15 minutes downtime Older arrays installed New Arrays installed 48 hours Local UNIX array-to-array migration Local mainframe array-to-array migration In this scenario, a large Canadian bank running a credit and debit transaction application on the IBM z/OS platform was moving from legacy storage to newer storage arrays. A financial institution cannot afford The challenges the bank faced included the following: downtime when moving from ● No application downtime allowed—The application was a key revenue legacy storage to newer storage driver, requiring around-the-clock access. The projected 18 hours of down- arrays. time to install and configure new arrays and complete migration would violate corporate IT policy and cost thousands of dollars in lost revenue. ● Large number of volumes—Four hundred volumes had to be moved from the old to new storage array. ● Budget constraints—The migration budget did not include the anticipated need for outside consulting resources with migration expertise.
  • 13. Storage migrations made simple Page 13 In this case, Softek TDMF technology was the only option considered, Highlights because no other solution could accomplish the migration without requiring downtime. In the case of a large bank migrat- Using the Softek TDMF solution, the bank’s migration project was ing to new storage arrays, Softek completed on schedule and required no outside resources so the budget TDMF was the only option consid- was not affected. And because no application performance impact or outages ered because no other solution were experienced, the bank could continue to generate revenue during could perform the migration with- the migration. out requiring downtime. Softek solution: Local mainframe array-to-array migration 1. Softek TDMF software was installed nondisruptively on the host. 2. Storage administrators, without formal training, used examples in the Softek manual to perform TDMF initialization, activation and copy tasks. 3. In the first week, administrators migrated 50 percent of volumes to target storage arrays with no performance degradation. Migration took place during peak periods of activity because Softek TDMF software has a dynamic throttling capability that speeds up or slows down migration as application requirements change. 4. Refreshes were performed periodically so that updates made to source volume during the copy phase were made to target volume, ensuring synchronization between source and target. 5. Administrators migrated the final 50 percent of volumes over the second week, with still no application impact. 6. When final synchronization had taken place, Softek TDMF software completed the swap operation to redirect the mainframe I/O to target volumes, which became primary volumes. Switchover was performed without service outage.
  • 14. Storage migrations made simple Page 14 7. Backout option was available in case a failure occurs during any phase. If Highlights needed, original source volume contained all the write operations per- formed during the migration. 8. Old volumes were removed from configuration. Credit and debit transaction application This chart depicts the bank’s local IBM mainframe mainframe array-to-array migration. Old storage array New storage array Local mainframe array-to-array migration
  • 15. Storage migrations made simple Page 15 Local mainframe migration with volume consolidation Highlights A major savings and loan institution had an older locally attached storage array under strain that it was replacing with a new locally attached storage array. The institution was running DB2 and CICS VSAM applications with very high availability requirements. The key migration challenges were as follows: A savings and loan company faced ● Converting data between volume sizes—The project required moving migration challenges such as per- MOD 3 arrays onto MOD 3s, and MOD 3 arrays onto MOD 9s at both sonnel constraints and strict avail- volume and dataset levels. ability requirements. ● Limited downtime—The only permitted system downtime was Sunday mornings. ● Personnel constraints—There were limited personnel available to perform the migration. ● Complex project—Due to the complexity of the migration and the personnel constraints, the estimated duration of the project was at least two weeks. The savings and loan company evaluated several migration options: ● Manual methods—This option was considered too labor intensive, espe- cially with the “overworked and understaffed” customer resource base. Avoiding bandwidth impacts also would be difficult. ● Array-based replication—This option could not be used as the project involved migrating MOD 3s to MOD 9s.
  • 16. Storage migrations made simple Page 16 A combination of Softek TDMF and zDMF software was chosen because of Highlights the products’ ability to migrate data nondisruptively, handle the resizing of MODs, and move specific data at the dataset level. With the combination of TDMF and zDMF, the project was completed ahead of schedule (60 hours After evaluating several migration estimated, 55 hours actual), with data migration constituting 38 hours of the methods, a savings and loan com- total time. This was considerably shorter than anticipated, and the migration pany chose Softek TDMF and zDMF was performed while the mainframe was in production, with no impact to software due to their ability to end users. migrate data nondisruptively, resize Softek solution: Local mainframe migration with volume consolidation MODs and move specific data at 1. TDMF and zDMF software was nondisruptively installed on IBM Z800 the dataset level. mainframe and verified by the implementation team. 2. The team mapped source and target volume migration for TDMF migra- tion. As part of the process, TDMF software was used to migrate a single source MOD 3 to a MOD 9, thereby establishing the target MOD 9 into the existing storage management subsystem (SMS) environment and eliminating any SMS setup requirements for the new MOD 9 volumes. 3. The team mapped the remaining MOD 3 to MOD 9 migration, which was accomplished using Softek zDMF software. The mapping docu- mented the target-volume SMS storage groups and storage class. This also identified any volumes that were not under SMS control. 4. Softek TDMF migration was initiated. Over the course of 10 hours (including verification), the implementation team migrated 200 MOD 3 to 200 MOD 3 and 240 MOD 3 to 240 MOD 9. This entire migration was completed transparently during production hours. 5. The implementation team set up Softek zDMF migration by building source and target dataset migration groups (460 source volumes going to 240 target volumes at the dataset level).
  • 17. Storage migrations made simple Page 17 6. Softek zDMF migration was executed over a 28-hour period (submission Highlights of group migrations, monitoring progress and verification results) and no application impact was reported during this period. 7. Scheduled off-hours bounce of all database applications took place after migration, and the total duration of the outage for all applications was less than one hour. DB2 and CICS VSAM applications IBM Z800 This chart depicts the array-to- 240 MOD3 to 240 MOD9 array migration with consolidation enabled by the Softek software. 240 MOD3 to 240 MOD9 460 source volumes to 240 target volumes at dataset level Older arrays New arrays Local array-to-array migration with consolidation
  • 18. Storage migrations made simple Page 18 Multiserver UNIX array-to-array migration with consolidation Highlights A Fortune 500 financial services firm had a mission-critical DB2 data warehouse (24 terabyte (TB) DB2, 10TB supporting files) on seven IBM AIX® 5.1 server platforms with the storage allocated to nine different storage arrays, some more than five years old. The firm faced these key migration challenges: ● Storage growth—Storage capacity grew from 4TB to 30TB in three years, A financial services firm struggled with storage added in a demand-driven, rather than a planned, fashion. with excessive storage growth and ● Locating storage—Storage administrators were unable to precisely other related challenges. locate storage. ● Complex environment—The system could be upgraded or changed only with difficulty, resulting in numerous end-user complaints about system performance. ● Relocating data—A new storage array was purchased to improve perform- ance by migrating and reconfiguring volumes. ● Source and target incompatibilities—The firm was unable to perform migration due to the complexity of the environment; this created incom- patibilities between the source and target storage arrays, so the new array sat unused for two months on the data center floor. The firm evaluated several different migration options: ● Offline backup and restore from tape—This option was rejected due to time constraints. ● Operating system synchronization tools—This option was rejected due to the inability to control migration start and end times. ● Array-based replication—This was not an option because of the incompati- bilities between source and target storage. ● AIX server-native Logical Volume Manager mirroring—This was rejected because Volume Manager was too slow and was not configured for mirroring.
  • 19. Storage migrations made simple Page 19 Softek TDMF UNIX (IP) software was chosen based on its ability to migrate Highlights between disparate platforms and its flexibility in working with various logical definitions. The benefit of the TDMF solution is that the data migration could A Fortune 500 financial services be performed in a challenging environment well within scheduled windows. firm chose Softek TDMF UNIX (IP) The firm was finally able to take advantage of its new hardware, which software for its migration based on enabled it to run queries four times more quickly with the new array, improve its ability to migrate between dis- data layout and greatly simplify administration. Most important, end-user parate platforms and its flexibility complaints about performance were eliminated almost entirely. In addition, in working with various logical the firm was no longer paying lease charges for unused or outdated hardware. definitions. The Softek implementation methodology helped avoid manual errors and used onsite resources efficiently. Softek solution: Multiserver UNIX array-to-array migration with consolidation 1. In the premigration stage, Softek worked with the storage vendor to per- form comprehensive testing and proof of concept to prove the viability of The Softek implementation the migration strategy. The firm elected to perform migration over sched- methodology helped avoid manual uled weekend downtime, with an estimated 24 hours for total migration. errors and used onsite resources 2. In the migration stage, the migration team was given the system at efficiently. 8 p.m. on Saturday night; it installed Softek TDMF software on seven AIX hosts in less than 15 minutes. 3. The migration process was initiated with migration configuration in loop- back. The actual migration started at 12 a.m. and ended at 4 a.m., mov- ing 22 TB of data in four hours. 4. As part of the migration process, the implementation team resized physi- cal partitions on volume groups, improved the layout of the volumes on the new array, and resized the IBM journaled file system (JFS) logs.
  • 20. Storage migrations made simple Page 20 5. The system was handed back at 3 p.m. on Sunday, well ahead of sched- ule, for preliminary testing. The DB2 data warehouse started correctly and the verification script launched. 6. The firm performed extensive testing, and at the end of the scheduled application stoppage, the system went into full production. 7. At the next scheduled downtime, the old source arrays were taken out of service and sent back to the leaseholder. DB2 data warehouse AIX 5.1 servers 4 hours 22TB New array Old arrays Multiserver migration with consolidation
  • 21. Storage migrations made simple Page 21 Global migration to new storage over distance Highlights A Fortune 1000 bank running a Sybase financial application was relocating four servers from a New Jersey operations center to a New York City opera- A bank needed help relocating four tions center, changing out the legacy storage arrays to newer arrays. servers to another state. The bank’s key migration challenges were as follows: ● Increased storage demands and internal consolidation—These factors drove the technology refresh. ● Expiration of storage lease—The New Jersey storage needed to be returned to the leaseholder. ● Hardware move—Physical servers had to be moved via courier. ● Data move over distance—Data had to be moved from the New Jersey stor- age area network (SAN) to the New York City SAN. ● Limited downtime—The only allowable outage was from Friday night to Saturday morning. The bank reviewed several migration options: ● Offline migration—Restore from tape after physically moving the servers was possible but would have required complete shutdown of application servers over a 48-hour period. Availability requirements made this option impossible. ● FTP transfer—The lack of bandwidth control, inability to verify the com- plete transfer of data and the requirement for file-by-file movement prompted the rejection of this option. ● VERITAS Volume Replicator—This option required the installation of VERITAS Volume Manager on the source and target machines. ● Hardware-based mirroring—This option was not possible because the source and target arrays were dissimilar.
  • 22. Storage migrations made simple Page 22 Softek’s TDMF UNIX (IP) software was chosen for its ability to work with Highlights multiple operating systems and perform fast, controllable transfers. A Fortune 1000 bank chose Softek The migration allowed the bank to realize economies of scale and increase TDMF UNIX (IP) software for its administrative control. In addition, the increased storage capacity allowed the migration based on its ability to bank to more fully utilize the Sybase application in support of key operations. work with multiple operating sys- Softek solution: Global migration to new storage over distance tems and perform fast transfers. 1. In the target environment, all new storage was defined, with the bank opting to use “swing server” to perform the migration. Data for the New Jersey servers was allocated to the swing server, which served as a proxy during the migration. 2. At 5 p.m. on Friday, the applications were taken offline and Softek TDMF was installed on the New Jersey servers. 3. Migration was set up from the four servers to one target and was initi- ated. The complete, full refresh took two hours and involved moving 2.2 TB over the bank’s wide area network (WAN). Upon completion, the Softek TDMF solution maintained synchronization between source and target environment. 4. The migration was completed and verification testing was performed on data. 5. The New Jersey servers were shut down, physically moved to New York City and installed at the bank’s site. 6. In the target environment, the storage was rezoned from the swing server to the relocated servers.
  • 23. Storage migrations made simple Page 23 7. The servers were brought up and tested, and applications were brought Highlights up and tested. At 6 a.m. Saturday, the application was put back into production. 8. At the next scheduled outage, the New Jersey storage array was taken offline and removed for return to leaseholder. Sybase applications New Jersey New York Target environment The Softek solution enabled a Swing Server rapid, security-rich migration from the source to the target. Old array New array Global migration to new storage over distance
  • 24. Storage migrations made simple Page 24 Global migration to new servers and new storage Highlights An insurance company was running a mission-critical claims processing appli- cation on Oracle. It was upgrading from legacy servers running Solaris 8 and An insurance company needed Veritas Filesystem/Solstice Disksuite to new servers running Solaris 9 and help to maintain availability while Veritas Volume Manager. Six TB (allocated 2TB per server) on an older disk migrating a mission-critical claims array were being replaced by a new array. processing application. The insurance company faced these key migration challenges: ● Limited downtime—Only four hours downtime per week were permitted for any application. ● Hardware move constraints—Only one server could be moved at a time to avoid risk to the application infrastructure. ● Compatibility of new storage with legacy servers—There were insufficient connections available to directly attach new storage to legacy servers, and it was risky to install new device drivers on legacy servers. The migration options that were considered included the following: ● Offline migration—This would have resulted in multiple downtime instances, each exceeding 12 hours. ● Array-based replication—This option could not be used due to dissimilar legacy and target storage, and because disk subsystems were incompatible. ● Veritas Volume Replicator—This option would have required the installa- tion of Veritas Volume Manager on source servers. ● Fabric-based appliance replication—This was rejected because of the risk of reconfiguring the SAN. ● EMC Recovery Point—This was rejected due to the requirement that mir- rors be set up and created on the host system. Such an arrangement was unacceptable given the changes involved and the associated disruption.
  • 25. Storage migrations made simple Page 25 Softek TDMF UNIX (IP) software was chosen as the least risky option Highlights because no system reboots were required. The migration was performed with- out requiring a reboot of any critical service, continuous application availabil- An insurance company chose ity was maintained during data migration, and the migration was performed Softek TDMF UNIX (IP) software without end users experiencing any loss or significant degradation in service. because it was the least risky option, requiring no reboots. Softek solution: Global migration to new servers and new storage 1. In the initial phase, configurations were pre-created and user- customizable scripts were written to unmount, replace the vfstab file and remount file systems. 2. Softek TDMF software was installed just prior to weekly shutdown with no disruption. Each server is configured in turn, with a total elapsed time of 15 minutes for TDMF installation and configuration. 3. A full refresh from source server A to target server A was conducted over the course of a week. Big asynchronous buffer (BAB) absorbed peaks in Not only did the migration not write activity on legacy servers to minimize CPU usage and prevent high require a reboot of any critical serv- I/O load. ice, but it also provided continuous 4. New versions of Oracle and other software preinstalled on target server A application availability and no were tested. Testing involved receiving multiple application-consistent loss or degradation of service for versions of production disks on a daily basis. To avoid having to refresh end users. from the production disks every time, checkpoint and a chaining config- uration were used. 5. At the completion of the testing, journal wrote to target volumes to ensure minimal data transfer on resynchronization.
  • 26. Storage migrations made simple Page 26 6. During the next weekend’s outage, applications on target server A were Highlights brought up and pointed to the new storage volumes. Source server A was taken out of service. 7. The process was repeated for source servers B and C over the next two weeks. 8. During the next scheduled outage, the older storage array was taken out of service. Oracle applications Source Target environment environment Source Source Server C Server B Checkpoint This chart shows how the insur- Source Target Server A Server A ance company’s global migration was executed. Journal checkpoint area Old array New arrays Global migration to new servers and storage
  • 27. Storage migrations made simple Page 27 Local Windows array-to-array migration A Fortune 500 bank had 5.8TB of data on two servers for a key enterprise compliance management application based on Microsoft SQL. The bank wanted to move from an older locally attached storage array to a new locally attached storage array. The key migration challenges were as follows: ● Adding new storage—The goal was to free up existing storage and imple- ment new faster, cheaper storage. ● Limited downtime—The application had a limited downtime window from 12 a.m. to 6 a.m. Saturday morning and from 12 a.m. to 2 a.m. Tuesday morning—but it was estimated that the full migration would take a week. ● Reconfiguration of a large number of volumes—There were 30 volumes to be moved, creating potential configuration issues. The bank considered these options: ● Restore from tape backups—This was not possible due to application avail- ability requirements. ● EMC Open Migrator—This was initially selected but failed during an early migration test. ● File-level migration and replication—This was considered but found to be too expensive and difficult to configure for users lacking expert-level implementation experience.
  • 28. Storage migrations made simple Page 28 Softek TDMF Windows (IP) software was chosen because of its ease of use, Highlights price and ability to maintain continuous application availability during data migration. A Fortune 500 bank chose Softek TDMF Windows (IP) software for its Softek solution: Local Windows array-to-array migration ease of use, price and ability to 1. During scheduled Saturday downtime, Softek TDMF software was maintain continuous application installed on the production server. Target volumes were connected to the availability during data migration. volume and disk manager, and the system was rebooted to allocate the BAB buffer (RAM) and register target volume at volume and disk man- ager. Installation took 10 minutes per server. Application was restarted at the end of scheduled downtime. 2. Migration groups were configured on source and target by the implemen- tation team. The team, with offsite Softek support, created mount points to resolve issues related to insufficient drive letters caused by the num- ber of volumes to be migrated. 3. Softek TDMF full refresh was initiated in loopback configuration. Full refresh took approximately 24 hours and was performed online without any application impact. 4. With Softek TDMF operation in normal mode, the team validated the data migrated to the new storage array by using the TDMF software’s checkpoint function.
  • 29. Storage migrations made simple Page 29 5. During Tuesday downtime, the application was stopped and source vol- Highlights umes were removed. The target volumes were renamed, and the applica- tion was placed back into production using new arrays. 6. Old arrays were decommissioned. The local Windows array-to-array migration was a success. Production server 24 hours 24 hours Checkpoint Old arrays New arrays Local Windows array-to-array migration
  • 30. Storage migrations made simple Page 30 Summary For the IT manager, technology refresh is regular, continuous and problem- atic, unless data migration software is used to simplify and streamline the process. The scenarios presented in this paper demonstrate how IBM Softek data migration software can be leveraged to streamline technology refresh projects. Above and beyond what most other products offer, Softek data migration soft- ware provides nondisruptive, flexible and purpose-built solutions to address the complex challenges of technology refresh. With Softek solutions, applications remain online and continue to process data throughout the migration process. Softek TDMF software is hardware inde- pendent, accommodates increases in volume size, adjusts to system demands and has roll-back capability.
  • 31. Notes
  • 32. For more information © Copyright IBM Corporation 2009 IBM Global Services For more information about IBM Softek solutions for technology refresh, visit: Route 100 ibm.com/services/datamobility Somers, NY 10589 U.S.A. Produced in the United States of America October 2009 All Rights Reserved IBM, the IBM logo, ibm.com, AIX, CICS, DB2, Softek, TDMF and z/OS are trademarks or registered trademarks of International Business Machines Corporation and other companies in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at “Copyright and trademark information” at ibm.com/legal/copytrade.shtml Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Other product, company or service names may be trademarks or service marks of others. References in this publication to IBM products or services do not imply that IBM intends to make them available in all countries in which IBM operates. SDW03012-USEN-00