CIBER creates next-generation IT infrastructure solution for SAP hosting services
Upcoming SlideShare
Loading in...5

Like this? Share it with your network


CIBER creates next-generation IT infrastructure solution for SAP hosting services



CIBER Managed Services GmbH built a dynamic Cloud Infrastructure for SAP landscapes, based on a combination of IBM server, storage, database, and system management software. The new storage ...

CIBER Managed Services GmbH built a dynamic Cloud Infrastructure for SAP landscapes, based on a combination of IBM server, storage, database, and system management software. The new storage infrastructure, which consists of the IBM XIV Storage System and IBM SAN Volume Controller, offers individual service classes to suit different customer needs, maximizing operational efficiency and minimizing expenses. The SAP application landscapes run on both IBM Power Systems servers and IBM System x Blade Server technologies.

Visit to 'Follow' the official Twitter handle of IBM India Smarter Computing.



Total Views
Views on SlideShare
Embed Views



0 Embeds 0

No embeds



Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
Post Comment
Edit your comment

CIBER creates next-generation IT infrastructure solution for SAP hosting services Document Transcript

  • 1. IBM SAP International Competence Center CIBER creates next-generation IT infrastructure solution for SAP hosting services
  • 2. “Through the 100 percent virtualization you gain a dynamic infrastructure and you get the ability for an easy billing system.” Carl-Philipp Müller Lead Sales Operations Services CIBER Managed Services GmbH“XIV is simply amazing. The usage of XIV real time copy, which is able to copy many terabytes of data very fast, reduces the downtime for provisioning drastically. The main focus as a service provider is the sector of customer satisfaction, which is especially improved by the usage of the new XIV system.” Markus Peltz Data center Manager CIBER Managed Services GmbH
  • 3. CIBER creates next-generation IT infrastructuresolution for SAP hosting servicesAbout this paperCIBER Managed Services GmbH built a dynamic Cloud Infrastructure for SAP landscapes, based on a combination of IBM server,storage, database, and system management software. The new storage infrastructure, which consists of the IBM XIV Storage Systemand IBM SAN Volume Controller (SVC), offers individual service classes to suit different customer needs, maximizing operationalefficiency and minimizing expenses. The SAP application landscapes run on both IBM Power Systems servers and IBM System xBlade Server technologies. ter nce Cen IB M SA P Intern ational Compete “IBM was chosen as a partner, because of the very good long- n neratio term experience with them. next-ge creates solution for CIBER Especially their integrated ructure IT infrast service s concepts and their highly SAP h osting skilled consultants for very special challenges, plus the capability to implement the required standards within time and budget convinced us to do this project with IBM.” Mats Johansson, Head of Operations, CIBER Managed Services GmbH
  • 4. Customer Objectives • Installed six IBM System x3650 M2 systems, powered by• Provide a highly scalable and dynamic infrastructure to host quad-core 2.26 GHz Intel Xeon Processor L5520 series customer-oriented SAP landscapes for small- and medium- processors, running Novell SUSE Linux Enterprise Server sized businesses in a private cloud environment that will 10 and 11 as well as Windows Server 2003 and 2008 support the future growth of the business • Implemented a next generation three service class• Establish high-performance infrastructure, featuring storage solution based on IBM SAN Volume Controller 5.x, transparent and easy billing models for high customer IBM XIV Storage System and IBM System Storage DS3400 satisfaction • Implemented IBM Tivoli Storage Manager and two IBM• Reduce CIBER’s IT operational costs without sacrificing System Storage TS3500 tape library systems, each with service quality five LTO4 tape drives, 260 slots, and about 200 cartridges• Operate a complete range of SAP Business Suite (migration speed to tape of 350 GB/h). components on an integrated and shared storage infrastructure and powered by either IBM Power servers or Customer Benefits IBM System x BladeServer technology depending on • Ability to provide faster and more flexible and scalable customer requirements SAP hosting services to businesses, with 99.9 percent• Introduce reliable and comprehensive backup, resilience, virtualization and improved Service Level Agreements. and disaster recovery solutions • Improved business continuity and higher availability even• Increase the speed of new SAP application provisioning, to across two locations, using IBM SVC storage virtualization help respond faster to business requests. and the IBM XIV Storage System • Reduced workload for IT staff through simplified setup andIBM Solution administration of the XIV Storage Systems• Worked with IBM and SVA, an IBM Premier Business Partner, • Reduced operating costs with improved service quality to design and implement a highly flexible and cost-efficient supported by three levels of storage service classes, an infrastructure and a next-generation storage solution for SAP integrated and virtualized storage architecture, and new in only four months server hardware• Set up two IBM Power 560 servers, each with two POWER6 • Reduced time for provisioning and deployment of new processors with four cores, and two IBM Power 750 servers, systems from weeks to hours with the new storage solution each with four POWER7 processors with eight cores, running based on IBM XIV technology, using the XIV Snapshot SAP applications on IBM AIX in about 40 LPARs, sharing functionality and the SVC FlashCopy functionality. processor resources and direct mappings of LPARs to • Improved database performance with DB2 by a factor of LUNs. The two POWER7 machines provide 170,000 SAPS eight in online operations and process 12,500 sales order positions per hour between • Achieved higher level of automation in database them environment• Installed two BladeCenter H, both with six HS22 • Gained disk space savings and reduced data growth by BladeServers powered by quad-core 2.40 GHz Intel Xeon deploying DB2 compression and the reclaimable Storage L5530 processors, and four HS22 Blade servers powered by features (reduced size of tablespaces from about 1 TB six-core 2.60 GHz Intel Xeon X5640 processors, running down to 300 MB for SAP NetWeaver Business Warehouse) VMware vSphere 4, forming several SAP clusters and • The BladeCenter technology allows an option to upgrade hosting guest operating systems Novell SUSE Linux online to current BladeServer models, such as HX5 and Enterprise Server 10 and 11 as well as Windows Server 2003 also offers hot swap technology for blades to ensure high and 2008 availability with the BladeCenter Open Fabric Manager, if• DB2 for Linux, UNIX and Windows is the most appropriate needed. database platform to support the SAP applications at CIBER 4
  • 5. About CIBERBackground, starting point and objectivesCIBER is a full service IT partner founded in 1974 and Application Services provide comprehensive SAP-functionalheadquartered in Denver, USA. It employs more than 8,500 staff and business process-related support. With Applicationsat 85 locations in 18 countries, and generates annual revenues of Services, CIBER supports customers in their daily business.about $1.037 billion. CIBER specializes in implementing and Furthermore Application Services support the continuoussupporting complex SAP and similar solutions for a broad improvement process. Additionally, CIBER renders SAPcustomer base in multiple industry sectors. Software Support for all SAP Software Maintenance customers. For these customers, the CIBER support organization works as an integral part of the Global SAP support organization. Service Management ensures comprehensive and reliable service delivery. CIBER’s customers benefit from the efficiency of individually assigned Service Teams delivering the agreed services. A dedicated Service Manager coordinates the deliveryMore than 400 of CIBER’s total of 1,300 SAP consultants work for of the agreed services, provides transparent reporting of allCIBER Germany, which has particular expertise in retail and activities and KPIs, and represents the customer and their needsconsumer products, chemicals and pharmaceuticals, inside the CIBER service organization.automotive industry, and financial services. With more than 20years of SAP solution implementation experience, CIBERGermany achieved sales of €55 million in 2009.CIBER Managed Services GmbH is based in Freiburg,Germany, and was established in January 2010 to provide SAPapplication and operation services for small- and medium-sizedbusinesses from its two data centers, with more than 120experienced consultants.The Managed Services business specializes in post-implementation-services, designed to preserve the initialinvestments that customers make in their SAP implementations. Figure 1: CIBER ServicesManaged Services consist of Operations Services, ApplicationServices, Software Support and comprehensive Service As a VMware Solution Provider with a special expertise in SAPManagement. implementations, CIBER has competencies and proven processes in architecture and sizing, and also in deploymentOperations Services provide customers with a full range of SAP and analyzing complex virtualized SAP landscapes.system maintenance capabilities, covering the provision andoperation of modern data centers, the necessary ITinfrastructure, and the administration and maintenance of SAPand IT-related applications. 5
  • 6. Initial IT environmentIn order to offer operation services for SAP as a cloud provider, full service desk based on ITIL® V3. The CIBER tool and SAPCIBER Managed Services needed to build up two completely Solution Manager enable the creation of a virtual server (eithernew data centers. The new and flexible technologies allow using VMware vSphere 4 technology on IBM System x or usingCIBER to satisfy growing customer needs. As a future service, LPARs on IBM Power servers), the installation of the operatingCIBER wants to implement a self-service portal to allow system, assignment of the LUNs for storage and the deploymentcustomers to request SAP services. Subsequently, the of the SAP applications. The CIBER team needed next tonecessary server capacity, operating system, applications and consider the best infrastructure to support this business could be provisioned and charged back automatically.This would keep costs low and enable CIBER to serve smaller With very positive experience of IBM System x and IBM Powerclients cost-effectively with enterprise-class solutions. Systems servers, CIBER chose to continue on the same strategic path, and selected IBM XIV Storage Systems with IBM SANCIBER selected SAP Solution Manager and its own CIBER Volume Controller to address performance, high availabilitySolution Suite to provide the central interface, which includes a scenarios, and premium support for data center management. Redundant FC connectionFigure 2: SAP private cloud 6
  • 7. Business challenges and project objectivesThe thinking behind the technology strategy was based on the If an additional Java Stack is needed, this is installed in aview that although customer workload was growing separate LPAR. The largest SAP environment provides up tocontinuously, the nature of the demand was highly volatile. 170,000 SAPS in a total of 20 instances, processing up to 12,500Providing an industry-standard IT services solution with server sales order positions per hour. On customer request thecapacity sold in fixed amounts would not deliver the kind of environment is set up as a Power HA for AIX cluster to supportflexibility that customers wanted, and CIBER wanted to create a high availability of logical partitions for business critical systemssolution that could scale up and down in performance – and in a two-node cluster with automatic failover.allow customers to pay on a more cost-effective usage basis. Continuing the theme of continuous availability, CIBER uses LiveAs a starting point, CIBER needed an infrastructure capable of Partition Mobility, available on Power servers with POWER6hosting 120 SAP instances with about 8,000 SAP users, and up processors and upwards. Live Partition Mobility enables theto 20 systems for one customer in a private cloud environment. migration of entire running AIX partitions and hosted applicationsThe customers are offered free choice among different operating from one physical server to another without disrupting servicessystems and platforms, from IBM AIX on IBM Power Systems to and loads. Combined with LPARs, SAN Volume Controller andSUSE Linux Enterprise Server or Windows Server on IBM other virtualization technologies, Live Partition Mobility willSystem x BladeServer technology. While CIBER recommends further enhance CIBER’s ability to respond to customerthat its customers use IBM DB2 for Linux, UNIX and Windows, demands.some customers run MaxDB, Oracle, and MS SQL Serverdatabases. The infrastructure is capable of running all these Alongside the scale-up scale-down flexibility for individualoperating systems and databases, and the CIBER team can customers, CIBER planned for overall systems growth that wouldsupport all of these systems. equip them to respond to the total business demand. The solutions must therefore be able to expand in capacity as aCIBER operates the complete range of SAP ERP software whole, while preserving the ability to offer each customer exactlycomponents, as well as SAP applications such as Supplier the right services.Relationship Management (SRM), SAP ERP Human CapitalManagement (HCM), Advanced Planning and Optimization Knowledge of new customer contracts, the customer queue,(APO), Customer Relationship Management (CRM), SAP and planned growth predicted that the infrastructure at theNetWeaver Business Warehouse (BW) and SAP NetWeaver current data centers would reach capacity in less than sixPortal. Additionally, CIBER offers its own solutions based on SAP months. CIBER planned to build the new data center in less thanAll-in-One software, including Rapid Retail, QuickWear, four months to allow for sufficient transition time and maintain theFabricated Metals, Industrial Machinery and Components, delivery of high service levels for its SAP hosting customers.Aerospace and Defense, and CIBER Solution Suite, a newintuitive front-end for SAP Solution Manager. Each SAP instanceruns in its own LPAR. 7
  • 8. Technical solutionServer architectureWorking with SVA and IBM, the CIBER team designed and Ultimately, however, CIBER’s clients select the platform: eitherimplemented a highly flexible and fully virtualized environment, Power Systems and AIX or System x and Linux or Windows,capable of hosting almost every kind of SAP application depending on the combination of reliability, scalability andlandscape. predicted workload.SVA, an IBM Premier Business Partner, provided implementationservices. SVA installed the SAN Volume Controller, XIV, x3650 IBM System x and IBM BladeCenterand BladeCenters. Ten SVA and IBM technicians completed the CIBER runs IBM BladeCenter H chassis featuring IBMimplementation on time and on budget in a six-week period – BladeServer HS22, each of them powered by two 2.40during part of which one of the data centers did not have a fully GHz quad-core Intel Xeon Processor E5530 seriesfunctioning electricity supply. processors and four HS22 Blade servers powered by hexa-core Intel Xeon Processor X5640 series processorsIn essence, everything is virtualized – the servers, storage and at 2.6 GHz. The blades run multiple virtual servers –network. When an application grows in workload and functional collectively around 500 systems – using a combination ofreach, its processes are distributed among multiple virtual VMware vSphere 4 as hypervisor, and Novell SUSE Linuxmachines to ensure performance is maintained, using either Enterprise Server, and Windows Server as the SAPVMware virtual machines on System x or logical partitions platform.(LPARs) on Power servers. VMware delivers the freedom to befully supported for SAP production environments on both Linux CIBER uses IBM System x3650 M2 machines poweredand Windows operating system and multiple x86-Hardware. by 2.26 GHz quad-core Intel Xeon Processor L5520 series processors. These x3650 M2 servers provideVMware virtual machines, whereby each allows at most 8 virtual infrastructure services, running Novell SUSE LinuxCPUs and 255 GB RAM, are smaller than the virtual machines Enterprise Server 10 and 11, as well as Microsoftavailable in LPARs, which support maximum of 256 virtual CPUs Windows 2003 and 2008. These servers run withoutand 1 TB RAM. When applications grow, this scale-out virtualization, and monitor the virtualized systems withdistribution of processes happens earlier on System x than on applications such as IBM Director, cloud monitoringPower servers. tools, and SAP monitoring applications.The result is that CIBER has gathered a great deal of experience IBM Power Systemsin the scale-out of SAP applications, particularly on System x. CIBER uses two IBM Power 560 and two IBM Power 750Examples include separation of database and application server servers, running the IBM AIX operating system and IBM(that is, moving from two-tier to three-tier configurations), DB2 for Linux, UNIX and Windows. Both Power 750separation into multiple application servers, and separation of systems are equipped with four POWER7 processorsSAP Central Services. The SAP Central Services include the with 8 cores each and 512 GB of memory. The IBM Powerunique SAP application system services, including enqueue 560 servers are equipped with two POWER6 processorsserver and message server. with 4 cores each and 128 GB of memory. The servers each host around 40 logical partitions (LPARs). 8
  • 9. Data center 1 Data center 2 RESOURCE POOL Non Non SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP Win/MaxDB Linux/DB2 Non Win/Oracle Win/MS SQL SAP SAP SAP Intel/DB2 SAP SAP SAP SAP Intel/DB2 SAP ERP 6.0 ERP 6.0 SAP SAP SAP ERP 6.0 SAP SAP ERP 6.0  SAP SAP SAP Non Non SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP SAP ESX ESX ESX ESX ESX <<<  ESX HA  /  VMWare  Vmotion >>> ESX ESX ESX ESX ESX LPAR LPAR LPAR LPAR LPAR PowerVM LPAR LPAR LPAR LPAR LPAR Mirrored vDisks Direct Mapping Direct Mapping Productive non productive non productive 1 TB 2.5 TB 2.5 TB SVC MDISK SVC MDISK SAP CRM SAP ERP  SAP  BI DEV SAP EP DEV SAP SolMan D SAP NW QA SAP ERP P SAP .. … …Figure 3: High Availability Concept and storage cloud operating systemIBM BladeCenter and System x landscapes Virtualization using VMware in the Intel processor-based systemsFor many customers, CIBER provides SAP hosting services on Almost all applications, perhaps 99.9 percent, on the IntelIBM System x BladeServers. processor-based platforms are virtualized using VMware vSphere 4. The only exceptions are monitoring and systemsFor systems powered by Intel processors, CIBER follows a rule, management applications.based on experience: There is an optimum relationship betweenprocessor capacity consumed and memory required, which The Blade Servers host guest operating systems such as Novellmeans that more memory does not necessarily increase the SUSE Linux Enterprise Server 10 and 11, as well as Microsoftperformance of the SAP applications hosted on that server. Windows Server 2003 and 2008.CIBER found that 8 GB memory per core is sufficient. In thefuture, CIBER may upgrade the blades with IBM BladeServer For the System x servers, CIBER recommends the LinuxHX5 technology. operating system to customers for the following reasons:Provisioning of new SAP instances is completed using VMware • Lower license coststemplates, making it fast and easy to set up standardized • Linux installation can be configured to comprise just thesystems ready for immediate customer deployment. Additional software components needed, creating a low-footprinttools such as TSM backup agents, monitoring agents, and operating system with relatively low maintenancespecial SAP configurations are already integrated for quick requirements (Windows includes many softwaredeployment. components not actually required by the applications, increasing the operating system footprint and increasing theCIBER uses VMware vCenter Converter (also named patch requirements).vConverter) to automate physical to virtual machine conversions • CIBER believes that Linux Logical Volume Manager (LVM) isas well as conversions between virtual machine formats. In more flexible than the Microsoft Logical Disk Manager; forparticular, the converter is used to migrate native physical example, Linux LVM allows data replication (mirroring) atsystems into CIBER’s virtual environments. server level 9
  • 10. The conversion takes place either at the customer site or in For disaster tolerance and disaster recovery capabilities, as wellCIBER’s central data center. CIBER uses Acronis True Image to as for high availability across locations, CIBER implemented ancreate a backup image of the customer’s application systems enterprise-class storage design. It consists mainly of the IBMenvironment and transport the image files from the client’s site to SAN Volume Controller (SVC) and the IBM XIV Storage System.the data center, which eliminates the need for risky physical The SVC has been set up with the Split I/O Group design tomovement of hardware from place to place. achieve high availability even if one location fails completely.Once customer systems have been virtualized, CIBER uses In 2011, CIBER plans to deploy VMware vCloud Director dataVMware Virtual Symmetric Multi-Processing (SMP) to enable a center management software, which pools virtual infrastructuresingle virtual machine to use multiple physical processors resources and delivers them to users as a catalog-basedsimultaneously. This allows CIBER to maximize utilization of its service. The target users are internal consultants who administerphysical processor resources, and provide the virtual machines the local data center systems.with the capacity required easily and quickly. CIBER also plans to implement VMware vCenter Chargeback,With the applications and servers hosted by CIBER, the next which logs resource requests and consumption and enablesquestion is how to deliver them to the customers. VMware View is usage-based chargeback and accounting for hosted databuilt on VMware vSphere for Desktops. CIBER runs its own data center management and administration applications using Customer 1VMware View virtualized desktops. VMware vCloud DirectorFor data storage, security and management, CIBER uses CIBER Solution Suite Catalogs SecurityVMware vStorage VMFS (virtual machine storage file system), a Win/MaxDB ERP 6.0 Linux/ DB2 BS7 Linux/SQL BIhigh-performance cluster file system optimized for VMwarevirtual machines. A VMware virtual machine stores the contents Datacenter Configuration(Gold) VMware vShield Datacenter Configuration (Silver)of a virtual machine’s hard disk drive in a virtual disk file with theextension .vmdk (virtual machine disk). The vmdk specificationdescribes and documents the virtual machine environment, andhow the contents of the hard disk drives is stored. CIBER uses.vmdk files rather than storing the virtual disks on raw devices to VMware VMware vCenter Server vCenter Serverensure isolation of the data stored in separate virtual disks. VMware vSphere VMware vSphereVMware Storage vMotion enables Live Migration of .vmdk files – Figure 4: Providing and consuming IT as a servicein other words, a .vmdk file can be moved from one location toanother even while it is in use. This ability helps CIBER tominimize downtime during disk array migrations and storageupgrades, or when the virtual machines require larger-capacitystorage devices. 10
  • 11. IBM Power Systems landscapesTypically, for larger customers CIBER hosts SAP ERP and SAP The VIOS provides full virtual paths from each LPAR to theNetWeaver applications on IBM Power systems. For existing switched fabric in the data center. Switched fabric networkclients, CIBER has two IBM Power 560 and two IBM Power 750 topology allows nodes to connect with each other via one orservers, running the IBM AIX operating system and IBM DB2 for more network switches, which provides both high total capacityLinux, UNIX and Windows. and a high degree of resilience if a network switch fails.LPARs are subsets of a computer’s hardware resources, CIBER has assigned a separate LPAR for storage management,virtualized as a separate computer using the hypervisor. A with a dedicated Converged Network Adapter to supportphysical machine can be partitioned into multiple LPARs, each concurrent LAN (TCP/IP) and SAN (FCoE, iSCSI) traffic over ahosting a separate AIX operating system. The hypervisor shared 10 Gb Ethernet link. CIBER currently uses only TCP/IPassigns a specific range of virtual processors to each of the and iSCSI protocols, and wants to be ready for FCoE in theLPARs. CIBER does not configure dedicated assignments of future.processors, and shares uncapped processor resources acrossall the LPARs. PowerHA for AIX (previously named High Availability Cluster Multiprocessing HACMP) provides high availability of logical partitions (LPARs) in a two-node cluster by way of automatic failover. When one server node goes down, the other server node takes over. Depending on clients’ requirements, most production systems and some of the quality assurance systems running on AIX use PowerHA to ensure continuous availability.For large SAP systems, CIBER prefers to use POWER CIBER uses IBM Virtual I/O Server (VIOS) to enable the sharingtechnology and virtualization over VMware vSphere. This is for of physical I/O resources between client logical partitions withintwo reasons: first, because AIX LPARs can scale to higher total the server. The total physical bandwidth can be allocated in fixedprocessor and memory limits; and second, because AIX amounts to each server, or policies set to enable full capacity toenables much higher processor utilization. By using AIX LPARs, be used by high-priority workload at peak times.the SAP application can grow much larger before it is necessaryto scale-out over multiple servers.The migration from IBM POWER5 to POWER6 and POWER7 waswithout any problems, CIBER simply connected the new serversto the SAN storage system and restarted the new servers and theSAN storage system. 11
  • 12. Storage architectureCIBER implemented an enterprise-class storage solution, based At the core of the storage landscape are two IBM XIV model A14on two IBM XIV enterprise storage systems, IBM SAN Volume storage systems, each equipped with 79 TB storage. The XIVController (SVC) as Split I/O Group, IBM System Storage DS3400 systems act as the principal SAP application data storage.for the SVC quorum disk, and IBM Tivoli Storage Manager. The CIBER can handle almost three-fold storage growth as customerstorage infrastructure has been designed to provide a data volumes grow. In practice, Tivoli Storage Manager enablescombination of performance and resilience, as well as the ability sophisticated management of data, moving archive and lessto allocate storage volumes to multiple customers exactly as their active data onto tape, to help reduce the need to expand diskneeds dictate with the least possible administration and systems.expense. CIBER evaluated different solutions and chose XIVtechnology because of better IO performance, improved CIBER implemented the two XIV systems, located at the primaryadministrative handling, and easier maintenance support than and secondary data centers. XIV technology offers high,its competitors. consistent performance and hotspot-free service due to mass parallelism and the distribution of logical volumes across all hard disks in the system, eliminating distribution planning. Datacenter 1 Datacenter 2 Cisco Nexus 5020 Cisco Nexus 5020 1 5 9 13 17 21 25 29 33 37 1 5 9 13 17 21 25 29 33 37 SLOT2 SLOT2 PS1 PS1 2 6 10 14 18 22 26 30 34 38 2 6 10 14 18 22 26 30 34 38 STAT STAT ` ` 3 7 11 15 19 23 27 31 35 39 3 7 11 15 19 23 27 31 35 39 L1 MGMT 0 L1 MGMT 0 PS2 PS2 SLOT3 SLOT3 10GE LAN Backbone 10GE LAN Backbone L2 MGMT 1 CONSOLE 200-240v-6A L2 MGMT 1 CONSOLE 200-240v-6A 4 8 12 16 20 24 28 32 36 40 50~60Hz 4 8 12 16 20 24 28 32 36 40 50~60Hz Cisco Nexus 5020 Cisco Nexus 5020 1 5 9 13 17 21 25 29 33 37 1 5 9 13 17 21 25 29 33 37 SLOT2 SLOT2 PS1 PS1 2 6 10 14 18 22 26 30 34 38 2 6 10 14 18 22 26 30 34 38 STAT STAT ` ` 3 7 11 15 19 23 27 31 35 39 3 7 11 15 19 23 27 31 35 39 L1 MGMT 0 L1 MGMT 0 PS2 PS2 SLOT3 SLOT3 L2 MGMT 1 CONSOLE 200-240v-6A L2 MGMT 1 CONSOLE 200-240v-6A 4 8 12 16 20 24 28 32 36 40 50~60Hz 4 8 12 16 20 24 28 32 36 40 50~60Hz BladeCenter H 1 2 3 4 5 6 7 8 9 10 11 12 13 14 BladeCenter H 1 2 3 4 5 6 7 8 9 10 11 12 13 14 System Stor age 1 2 3 4 5 6 7 8 9 10 11 12 13 14 SVC Node TotalStor age Storage Engine 336 1 2 3 4 5 6 7 8 9 10 11 12 13 14 Bladecenter H 01 9 8 7 6 5 4 3 2 1 2498-B24 2498-B24 74 32 64 22 4 Y LPP US R EWOP 54 12 44 02 34 91 24 81 14 8 GB FC Backbone 0 0 71 4 4 04 1 1 61 5 5 2 2 93 6 6 51 3 3 83 7 7 41 73 3 Y LPP US R EWOP 31 8 8 12 12 1 2 3 4 5 6 7 8 9 10 63 21 9 9 13 13 53 10 10 47 14 14 11 23 43 11 11 15 15 46 01 22 POWE R SU PPL Y 4 33 45 Dark Fiber 9 16 16 21 20 20 23 44 8 17 17 20 21 21 13 18 18 43 22 22 7 19 03 19 19 42 23 23 6 18 92 41 5 2 Y LPP US R EWOP 17 82 40 4 16 72 39 3 15 62 38 2 14 52 37 POWE R SU PPL Y 3 1 13 42 36 0 12 35 11 34 1 + 3 Y LPPUS R EWOP 2 + 4 Y LPPUS R EWOP 10 33 9 1 Y LPP US R EWOP 32 8 31 7 30 6 29 5 POWE R SU PPL Y 2 28 4 FC 850nm 27 3 26 2 25 1 24 0 FC CWDM FC CWDM POWER SUPPLY 4 + 2 POWER SUPPLY 3 + 1 POWE R SU PPL Y 1 01 9 8 7 6 5 4 3 2 1 74 32 2498-B24 2498-B24 64 22 4 Y LPP US R EWOP 54 12 44 02 34 91 24 81 14 71 04 D 61 93 0 0 4 4 51 1 2 3 4 5 6 7 8 9 10 83 1 1 BladeCenter H 5 5 41 73 2 2 3 Y LPP US R EWOP 6 6 Dark Fiber 31 47 63 3 3 23 7 7 21 46 1 2 3 4 5 6 7 8 9 10 11 12 13 14 22 POWE R SU PPL Y 4 53 45 8 8 11 12 12 21 43 44 9 9 13 13 01 20 33 10 10 14 14 9 43 23 19 11 11 15 15 8 42 XIV Storage 2 18 13 41 16 16 7 20 20 17 03 40 17 17 6 21 21 16 92 18 18 5 39 22 22 2 Y LPP US R EWOP 82 15 19 19 4 38 23 23 14 72 37 POWE R SU PPL Y 3 3 13 62 36 2 12 152 35 42 11 0 34 10 33 BladeCenter H 9 32 1 + 3 Y LPPUS R EWOP 2 + 4 Y LPPUS R EWOP 8 XIV Storage 1 FC 850nm 31 1 2 3 4 5 6 7 8 9 10 11 12 13 14 7 1 Y LPP US R EWOP 30 6 29 5 POWE R SU PPL Y 2 8 GB FC Backbone 28 4 0 1 2 3 4 5 6 7 8 9 10 11 27 3 26 2 25 1 24 1 2 3 4 5 6 7 8 9 10 11 12 13 14 0 1 2 System x3650 M2 3 4 POWER SUPPLY 4 + 2 POWER SUPPLY 3 + 1 0 1 2 3 4 5 6 7 8 9 10 11 POWE R SU PPL Y 1 0 1 2 3 4 5 6 7 8 9 10 11 1 2 System x3650 M2 3 4 1 2 System x3650 M2 3 4 0 1 2 3 4 5 6 7 8 9 10 11 633 enign E egarotS ega rotS lato T 0 1 2 3 4 5 6 7 8 9 10 11 1 2 System x3650 M2 SVC Node 3 4 1 2 3 4 5 6 7 8 9 10 11 12 13 14 1 2 System x3650 M2 3 4 0 1 2 3 4 5 6 7 8 9 10 11 Datacenter 3 Infrastructure Mgmt 1 2 System x3650 M2 Bladecenter H 3 4 Infrastructure Mgmt System Stor age 2498-B24 0 4 1 5 2 6 3 7 8 12 9 13 10 14 11 15 16 20 17 21 18 22 19 23 Infrastrukturserver Power 750 D3 D4 D5 D6 D7 D8 D9 D10 Infrastrukturserver Power 750 FC CWDM D3 D4 D5 D6 D7 D8 D9 D10 0 4 1 5 2 6 3 7 8 12 9 13 10 14 11 15 16 20 17 21 18 22 19 23 24 28 25 29 26 30 27 31 32 36 33 37 34 38 35 39 0 4 1 5 2 6 3 7 8 12 9 13 10 14 11 15 16 20 17 21 18 22 19 23 24 28 25 29 26 30 27 31 32 36 33 37 34 38 35 39 2498-B40 2498-B40 560 560 System Stor age 1 4 5 8 9 12 DS3400 Quorum Power 750 Power 750 Fiberchannel Single Mode Fiberchannel Multi Mode Dark Fiber Local Area NetworkFigure 5: Data center landscapeWorking with the service partner Netzwerktechnik Röver, CIBER The XIV system is controlled through an intuitive graphical userimplemented a redundant and geographically separated metro interface (GUI), and a powerful command line interface (CLI) fordata center connection based on CWDM technology. All storage complex scripting. Training on XIV systems usage is usually amirroring is performed through multiplexed Dark Fiber with a matter of hours rather than weeks, saving costs and speedingbandwidth of 60 GBit/s, which can be scaled up to 300 GBit/s. time to full production. 12
  • 13. The very high I/O, reliability and availability performance is The storage landscape is completed with two IBM Systemenabled by a grid-based controller and disk architecture with Storage TS3500 tape library systems, each with five LTO-4active-active component redundancy, which enables non- drives, 260 slots and about 200 cartridges. These systemsdisruptive hot-swapping of hardware and firmware. XIV systems provide a data transfer speed of 350 GB per hour.provide incremental scaling from partial to full rack, with 27-79TB usable, and with every capacity increase the performance Database architecturescales linearly. Automatic re-distribution of volumes ensures that For CIBER, DB2 for Linux, UNIX and Windows is the mostthe high performance and fast access continues even as data appropriate database platform to support the SAP applications.volumes grow. There is no tuning necessary, and the XIV system Small and medium-sized businesses tend to underestimate theirdoes not need to tune itself during operation. data growth, and easily reach sizes where DB2 offers significant advantages, such as Deep Compression that helps to reduceUsing the SVC’s FlashCopy function and XIV point-in-time copy the database size and data growth.CIBER clones SAP systems as customers request newinstances. Combined with automated SAP post-processing, DB2 also offers close integration with Tivoli Storage Manager,CIBER is able to create a completed cloned SAP instance in providing a comprehensive backup solution that protects DB2about 30 minutes. XIV Snapshot gives CIBER the ability to and related data reliably and cost-effectively.respond to customer demands in ways and at a speed that evenin recent years would have been impossible to achieve. The new index compression feature within DB2 is the next step to improve database performance and reduce storage costs. InIn selecting XIV systems, a new technology for the CIBER team, addition, compression for temporary tables for SAP systems isthey soon discovered that only three hours’ training was needed activated ‘under the cover’ to reduce disk costs. DB2, comparedto understand the easy-to-use XIV system’s graphical interface, with other database compression algorithms, can handle datacompared with older systems that had taken weeks to fully learn and indexing more efficiently. CIBER experienced a(redundant). compression rate in the high double-digit area, and performance improvements of 60 percent with DB2.The DS3400 storage system serves two purposes:• As a storage device to host the active quorum disk (tie Besides performance, DB2 also makes administration tasks breaker) for the SVC clusters easier and faster by offering a high level of automation with Self• As a storage pool for the TSM server Tuning Memory Management, Automatic Storage, automatic runstats, and Real Time Statistics.CIBER uses IBM Tivoli Storage Manager, running in a separateLPAR on the Power servers, to manage backup, archive and For example, CIBER uses the autoresize functionality so thatrestore. A dedicated physical 10 Gbps Ethernet adapter allows tablespaces can enlarge themselves if needed, while thedata transfer to run on fully virtualized end-to-end connections Container Management is completed manually to preserve apowered by Nexus switches from Cisco, connecting to the IBM certain degree of control over the data management by theSystem Storage TS3500 tape library. This arrangement offers database administrators.very fast system backup and restore processes while ensuringthat the data traffic does not impact production systems. 13
  • 14. Automatic provisioning of SAP with Cloud servicesAutomatic reorganization offers time-saving advantages for CIBER’s ultimate goal is to deliver Cloud services to itsdatabase administrators, because it checks if a reorganization of customers, which means being able to provision, upgrade anddata and indices is needed and if so, the Reorg utility is clone SAP instances very quickly using automated systems.automatically called and reorganizes the data and indices in thebackground. CIBER also plans to use the reclaimable storage Defining customer requirements will become an interactive, facefeature for its SAP NetWeaver Business Warehouse to reduce to face activity, and once requirements have been defined, thethe tablespaces from about 1 TB down to 300 MB SAP landscapes will be provisioned automatically.With the new tablespace option of reclaimable storage, The Service Request Tool is the “CIBER Solution Suite”, whichintroduced in DB2 version 9.7, it is now much easier to reduce CIBER developed in-house, based on SAP Solution Manager.the size of the tablespace and return unused space to the file The backend (workflows) were developed in ABAP, while CIBERsystem, including unused space below the High-Water Mark uses Adobe Flex™ (Fx) as GUI front end. This tool enables the(HWM). CIBER SAP Consultant simply to select the correct SAP instance template, and then kick off the automated provisioning.DB2 Migration: Opportunities for optimizationIt is possible to activate compression features during a SAP CIBER used the standard OS tools, such as NIM & NIS (Networkmigration project to DB2, which eliminates the need for Installation Manager & Services), to install the operating system.subsequent compression tasks. To clone SAP instances, CIBER uses XIV point-in-time copy.To do so, CIBER used the “Sampled” option, which comes with CIBER clones (snapshots) the entire SAP system, including EXE,the R3Load Version 7. This option causes every ‘N’th row of the DATA, and LOG files, while keeping the SID. The new clone istarget table to be loaded first, followed by a reorg to create the started in its own VLAN segment and will be automaticallyCompression Dictionary based on the data loaded. The count of reconfigured and customized. This ensures that the new clonedata used for the sampling process is provided by the with the same SID does not interfere with the existing SAPenvironment variables DB6LOAD_SAMPLING_FREQUENCY landscape.and DB6LOAD_MAX_SAMPLE_SIZE. Subsequently, R3load isrestarted to load the rest of the table in a compressed format. Because CIBER does not need to install the SAP instance, there are no pre- or post-processing steps, and a new clone canTransition to Unicode therefore be provisioned and made available within 30 minutes.If Unicode is required on the target solution, then recommendedpractice is to perform the DB2 migration in conjunction with an “IBM has brought in major contribution toSAP software upgrade and/or Unicode conversion in a single the quick success of CIBER – to developproject. This combination eliminates redundant project tasks, such a high customer rate within such akeeping the cost of the migration as low as possible. Around 90 short timeframe.”percent of the Unicode conversion steps are also part of the DB2migration process. By combining the two processes, both costs Stefan Rother Lead Infrastructure Servicesand workload can be reduced, eliminating duplication of effort. CIBER Managed Services GmbH 14
  • 15. Project achievementsPerformance improvementsThe new SAP infrastructure allows CIBER to improve efficiency CIBER plans to take advantage of Active Memory Expansion,for its SAP managed services business significantly by offering a available on Power servers with POWER7 processors andsolution that scales in performance and capacity, while upwards, which employs memory compression technology toproviding a very cost-effective model. transparently compress in-memory data, allowing more data to be placed into memory and thus expanding the memoryThe virtualization capabilities of the storage and server capacity of POWER7 systems. Utilizing Active Memoryinfrastructure allow CIBER to offer customers a very flexible Expansion can improve system utilization and increase aservice with real end-to-end virtualization, able to scale up system’s throughput.quickly in times of peak workload and back again as required.For example, being able to clone a SAP system inside 30 CIBER plans to roll out IBM DB2 Deep Compression and Rowminutes, or to activate another 1 TB of storage on the XIV system Compression features on all of its systems, and deploy IBM Tivoliwithin an hour, mean that CIBER can cope with almost any Provisioning Manager and IBM Tivoli FlashCopy to enhancecustomer demand. The result is that CIBER can offer “pay as you data security and performance.grow” SAP hosting as software as a service (SaaS) backed by apowerful cloud infrastructure that encourages customers to For improved data center management and new services,make the leap without having to predict workload or commit to CIBER plans to apply VMware vCloud Director in 2011. vCloudspecific infrastructure spending. Director is a data center management software, which pools virtual infrastructure resources and delivers them to users as aThe combined performance improvements available from the catalog-based service. For cost models that are customized forIBM Power servers, IBM System x BladeServers, and IBM accounting of resource requests and consumption, CIBER willstorage infrastructure have led to increased user satisfaction. implement VMware vCenter Chargeback.Many customers have noticed greatly improved response timesfor online operation of the DB2 database – in some casesrecording an eight-fold improvement. The enhanced responsetimes contribute to increased user productivity, and help buildthe case for using hosted SAP applications rather than in-house,as CIBER is able to make the kind of technology investment thatmight be out of reach of a single customer. “We recommend the DB2 database for new customers who start with SAP, because DB2 is very cost-effective and brings performance benefits and DB2 and SAP simply fit together.” Holger Stasch SAP Senior Consultant CIBER Managed Services GmbH 15
  • 16. © Copyright IBM Corp. 2010 All Rights Reserved.Authors IBM Deutschland GmbHMarkus Fehling, IBM, D – 71137 Ehningen ibm.comElke Hartmann-Bakan, IBM, Produced in GermanyFrank Neumann, IBM, IBM, the IBM logo,, i5/OS, DB2, Domino,Carsten Siegler, IBM, FlashCopy, Lotus, Notes, POWER, POWER4,Hans-Achim Muscate, VMware, POWER5, POWER6, System i, System x, and Tivoli are trademarks of International BusinessMarkus Peltz, CIBER, Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their firstFor more information occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S.To learn more about the solutions from IBM and SAP, visit: registered or common law trademarks owned by IBM at the time this information was Such trademarks may also be registered or common law trademarks in other countries. A current list of other IBM trademarks is available onFor more information about SAP products and services, contact the Web at: shtmlan SAP representative or visit: UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a trademark of Linus Torvalds in theFor more information about IBM products and services, contact United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo arean IBM representative or visit: trademarks of Microsoft Corporation in the United States, other countries, or both. Other company, product or service names may be trademarks, orFor more information about CIBER products and services, service marks of a CIBER representative or visit: This brochure illustrates how IBM customers may be using IBM and/or IBM Business Partner technologies/services. Many factors have contributed to the results and benefits described.Contacts IBM does not guarantee comparable results. All Markus Fehling, information contained herein was provided by the featured customer/s and/or IBM Business Markus Peltz, Partner/s. IBM does not attest to its accuracy. All customer examples cited represent how some customers have used IBM products and theFor feedback and further questions please contact the IBM SAP results they may have achieved. Actual environmental costs and performanceInternational Competency Center via characteristics will vary depending on individual customer configurations and conditions. This publication is for general guidance only. Photographs may show design models. SPC03307-DEEN-00 (December 2010)