Next Gen Data Center
Implementing Network Storage
with Server Blades, Clustering, Virtualization




Anil Vasudeva
Principal Analyst & President
anil@imexresearch.com
                                                 IMEX
                                                 RESEARCH.COM
408-268-0800
  ©2003-2006 IMEX Research All rights Reserved
                                                       IMEX
End to End IT Infrastructure                                                                with HA & Security

                            xSP         IntrDet
                                  VPN                                 Enterprise
                              WebServices App.Server
                                                     DBServers
       IntrDet                                                        Layer 3 Layer 4-7 Layer 2                      Stg Fibre
                                                                     Switches Switches Switches                      Switches
                                                                     (Routers)


Supplier/Partner                                   ISP
                                                                                                                         IntrDet


                              ISP           Internet           ISP
                                                   Core
                              Edge                  Optical
                                                  Networking   ISP
                                                   Access
                                    ISP
                                                                                                                         IntrDet

 Remote Office                                      ISP
                                                                           Caching, Proxy,        Application,HA,            Database,
                                                                            FW, SSL, IDS,         File/Print, ERP,          Middleware,
                                                                            DNS, LB, Web          Security, SCM,            Data Mgmt
                                                                              Servers              CRM Servers                Servers

                                              Cable Modem                      Tier-1                 Tier-2                   Tier-3
                                                     DSL                  Edge Computing           Applications              Data Bases
                                                  MP3 VOD
                 Cellular                                             Directory     Security            Policy             Management
     Wireless                           Home Networks
                                                                                      Software OS Platform
    ©2003-2006 IMEX Research All rights Reserved
                                                                                                                         IMEX
DC Mgmt Nightmares

        Servers                            Win 5-10%, SMP 20-35%, MF 30-50%
           Utilization                                                             80+%

         Servers                                15-30
   Servers/Admin                                                                       300+
                                           1
 Application
Application/Server                                                          20
                                                 30-45% Disk, 20-40% Tape
        Storage
           Utilization
                                                                                    75+%

                                       1TB
         Storage                                                                      100TB
   Terabytes/DBA

  MIS Alerts                                                     20-40
Urgent Alerts/Day                                4-5
    System                                                     HAL- 3 (99.9%)
  Availability
                                                                            HAL- 5 (99.999%)
 ©2003-2006 IMEX Research All rights Reserved
                                                                                       IMEX
Market Segments by Applic./Workloads
                                                   OLTP
                Transaction
   10 K         Processing
                                                  eCommerce

                                                            Data          DSS                 (RAID - 0, 3)
                       (RAID - 1, 5, 6)
    1K                                                   Warehousing
 IOPs                                                                     Visual DB
(Latency)

   100                                                             Scientific Computing   NIC
                                                                                          NIC
                                                                                Imaging
                    TPC
    10                                                                       Reference Data         Streaming
                                                                                                    Streaming
                                                     HPC
                                                                                      Audio/Video
     1
          1                                   5               10                50        100                 500
     *IOs per sesond for a required response time ( ms)            MB/sec
          ©2003-2006 IMEX Research All rights Reserved
                                                                                                       IMEX
Consolidated Data Center
                            xSP
                                  VPN
                                        IntrDet
                                                                      Enterprise
                              WebServices App.Server
                                                     DBServers
       IntrDet




Supplier/Partner                                   ISP                             Switches: Layer 4-7,
                                                                                  Layer 2, 10GbE, FC Stg
                              ISP           Internet           ISP
                                                   Core                                                                  FC/
                              Edge                  Optical
                                                  Networking                                                             IPSAN
                                                               ISP
                                                   Access
                                    ISP
 Remote Office                                      ISP               Caching, Proxy,                      Database,
                                                                     FW, SSL, IDS, DNS,                    Middleware, Data
                                                                      LB, Web Servers                      Mgmt Servers
                                                                      Tier-1
                                                                      Tier-1         Application,HA,              Tier-3
                                                                      Edge           File/Print, ERP,
                                                                      Edge                                      Data Base
                                              Cable Modem            Servers         SCM, CRM Servers
                                                                      Apps                                       Servers
                                                     DSL                               Tier-2 Apps
                                                  MP3 VOD
                 Cellular                                            Directory     Security         Policy           Management
     Wireless                           Home Networks                               Software OS Platform
    ©2003-2006 IMEX Research All rights Reserved
                                                                                                                    IMEX
Blade Infrastructure:Local Area Grid (LAG©)
                                                                              Management Modules Remote Mgmt+KVM over IP

                                               Midplane                              Networking: Gbit Ethernet Switches
                                                W/Connectors                                  Storage: IP NAS or FC SAN
                                               To Blades & Back
                                                                                              Switch
                                                                                                  Cooling N+1Fans/Cooling Modules
               Processor Blades                    Modules

                   (6-24 typically)                                                                       Power: N+1Power Supplies


     Blade
     Control
     Panel

    USB Ports,
   CD/Floppy I/F




                                                                                                   ~ GbE Switch supports
                                                                                                   Trunking/Port Aggregation
                                                                                                   Flow Control
                                                                                     Gbit          QoS Packet Prioritization
                                                                          Memory   Ethernet        SNMP/RMON
                                                                  Systems             I/F
                                                       Micro-             DDR w                    IGMP/BOOTP/TFTP
                                                                  Monitor
                                                     Processors            ECC                     ……
                                                                                                  © 2003-06 IMEX Research
                                                                  Module




©2003-2006 IMEX Research All rights Reserved
                                                                                                                                     IMEX
Blade Servers: Vendor Positioning Index
(As of 31 March 2005 - See IMEX Blade Servers Industry Report 2006 for latest data)
         Strategy (Potential)




                                                                                      IBM


                                         Fujitsu Siemens



                                                Linux                            HP
                                Hitachi                           Intel
                                               Networx




                                                                                            © 2003-05 IMEX Research
                                      NEC
                                                           Dell
                                Nexcom      Tatung                Rackable Sys
                                  Sun
                                            Penguin         Appro         Egenera

                                    HPC Syst   Verari
©2003-2006 IMEX Research All rights Reserved

                                                     Delivery (Execution)                                             IMEX
TCO Savings & ROI
                               3 Year TCO Savings
                                                                                TCO Savings in..
                               Rack vs. Blade Servers
                                                                                                OPEX
                   100%                                                                                    Staff/
                                                                                                          Support
                                                                                Maintenance/               25%
                   80%                                                           Downtime
                                                                                    54%
                                                                                                           Facilities/
  % Contribution




                   60%                                                                                      Power
                                     67%             OPEX                                                    21%

                   40%
                                                                    46%                        CAPEX
                                                                                                       Networking
                                                                                                          19%
                   20%                                                             Servers
                                     33%                                            46%                       Storage
                                                    CAPEX           25%                                    Infrastructure
                                                                                                                13%
                    0%
                                1                                                                            SW
                          Rack Servers                          Blade2Servers                           Infrastructure
                                                                                                             22%
                     ©2003-2006 IMEX Research All rights Reserved
Data: IMEX Research 2005                                                                                   IMEX
The rapid rise of Clusters in HPC




                                                                                        Rise of Cluster Computing

                                                                                      350




                                               # Clustered Computers in Top 500.org
                                                                                      300
                                                                                      250

                                                                                      200
                                                                                      150

                                                                                      100
                                                                                      50
                                                                                        0




                                                                                            1999e

                                                                                                    2000

                                                                                                           2001

                                                                                                                  2002

                                                                                                                         2003

                                                                                                                                2004e
©2003-2006 IMEX Research All rights Reserved
                                                                                                                         IMEX
HPC – From Academia to Wall St to Hollywood

                         High Performance                                             Entertainment
                         High Performance Commercial Bioinformatics Decision-Support Entertainment
                                           Commercial BioInformatics Decision
                                                                                     Audio/Video OnDemand
                            Computing
                            Computing     Visualization
                                           Visualization               Support Syst Audio/Video On Demand
                                                                        Systems
Data: IMEX Research & Panasas




                                  100+ Teraflops                        Rendering (Texture & Polygons)   Data rate & capacity
                                  Throughput = 100All rights Reserved
                                                            GB/s        Throughput = 1.2 GB/s            Throughput : DSL/Cable
                                   ©2003-2006 IMEX Research
                                                                                                                 IMEX
                                                                                                           ©2004--05 IMEX Research.com
Implementing Virtualization

      Client                                          At Various Levels
 Workstations
                                                      Microprocessor
         LAN
    Ethernet
                                                      – Intel VT, AMD-Pacifica
     Switches                                         OS
                                                      - zOS, pOS, UNIX, Windows, Linux
 Application &
   DB Servers                                         - IBM, HP, Sun, VMWare, Xen, SWSoft
          SAN
                                                      File System
    GbE or FC                                         - DFS
     Switches
                                                      Networking
Storage Arrays                                        - Multiport
                                                      Storage
                                                       - Host, SAN, Controller
                                                      - In-Band, Out-of-Band Management

       ©2003-2006 IMEX Research All rights Reserved
                                                                                    IMEX
TCO Savings with Virtualization
                                               995 Servers Pre VZ 78 VZ Servers
                        $16,000


                        $14,000
                                                         Provisioning
                                                          Downtime
                        $12,000
                                                            Disaster Recovery
    Cost over 3 years




                                                                DC Real Estate
                        $10,000
                                                                      Power & Cooling
                         $8,000                                         Network
                                                                          SAN
                         $6,000                                            Hardware
                                                                         VZ SW & Supp
                         $4,000


                         $2,000


                           $-
©2003-2006 IMEX Research All rights Reserved
                                               w/o VZ                      w VZ         IMEX
Storage Virtualization – the next Frontier
Clients
                                                         Storage VZ Implemented at Different Levels
   LAN                                                              Host         SAN                     Cntrllr.
                                                          Out-of-   Symantec,    EMC, Fujitsu
                                                          Band      StorageAge
Servers
                                                          In-Band                Cloverleaf, DataCore,   HDS, NetApp,
                                                                                 IBM, FalconStor         Sun

   SAN
                                                         Storage VZ Must Have Features
                                                         • Scale Non-Disruptively in Capacity
Storage                                                  • Snapshot Point-In-Time across Stg.devices
                                                         • Remote Replication across Heterogeneous Stg. Devices
                                                         • Policy Based Non-Disruptive Data Migration between
                                                           Heterogeneous Stg Systems & Between Stg Tiers
                                                         • Centralized Mgmt of all Stg.VZ under Single Image
                                                         • Support Tiered Storage
                                                         • Volume Management for Multivendor Stg. Systems
                                                         • Common Set of Tools: Provisioning, Mgmt & Replication



          ©2003-2006 IMEX Research All rights Reserved
                                                                                                            IMEX
Economics of Virtualization
                   Virtualization results in overall cost reduction 35-60%
                   Storage VZ alone has produced ~20% cost reductions
                           Savings achieved through Storage Virtualization
                     1000
                                                                       Total Svgs
                       900
                                                                        - 21%/yr.
                       800                                     SAN
Expenses/Year $K




                       700                                     Admin                - 19%
                       600
                       500                                     SW
                                                                                    - 16%
                       400
                       300
                       200                                     HW
                                                                                    - 24%
                       100
                            0
                                                 w /o Stg VZ            w Stg VZ
              ©2003-2006 IMEX Research All rights Reserved
                                                                                            IMEX
The Next Gen Data Center

                                                                            Automation
                                                                            Automatically Maintains
                                                                            Application Service
                                                                            Level Objectives
                                                       Provisioning
                                                       Provisions the Resources
                                                       Required to Deliver a
                                                       Business Service

                              Virtualization
                              Pools Resources. Allocates,
                              Monitors, and Meters the
                              Usage of Pooled Resources
 Integration
Integrates physical infrastructure using
standardized devices for CAPSIMS:
Cost, Availability, Performance, Scalability, Inter-
operability, manageability & Security


   ©2003-2006 IMEX Research All rights Reserved
                                                                                             IMEX
Future: Storage Management on a chip

                         Host Services Integration                                                 Storage
                                                                                                   Provisioning
File system monitoring                         Storage provisioning       Win, LINUX, Solaris      Layer


                               SAN Management
     Management                    Management of           MultiPath IO Supp        Security
                                                                                                   SAN
      Console                       iSCSI HBAs               and Failover      (iSNS, CHAP, SRP)   Management
                                                                                                   Layer
        Virtualization                         Mirroring      Snapshot          Fail-Over

                                     iSCSI Target Management                                       Device
               LVM, Error Handling, SCSI Daemon, API Interoperability
                                                                                                   Service
                                                                                                   Layer
                    HW Acceleration: TOE, iSCSI Offload, IPsec




©2003-2006 IMEX Research All rights Reserved
                                                                                                     IMEX
Next Gen Data Center
  Implementing Network Storage
   with Server Blades, Clustering, Virtualization
                                For updated full set of slides
                                                      email
                                               anil@imexresearch.com
                                                  Anil Vasudeva
                                                   (408) 268-0800
                                       www.imexresearch.com

©2003-2006 IMEX Research All rights Reserved
                                                                       IMEX
TCO Savings with Virtualization
                                               995 Servers Pre VZ 78 VZ Servers



                                                       Provisioning
                                                         Downtime
                                                            Disaster Recovery
            Cost over 3 years




                                                                 DC Real Estate
                                                                       Power & Cooling
                                                                         Network
                                                                            SAN
                                                                             Hardware
                                                                             VZ SW & Supp




©2003-2006 IMEX Research All rights Reserved
                                         w/o VZ                               w VZ          IMEX

Next Gen Data Center Implementing Network Storage with Server Blades, Clustering, Virtualization

  • 1.
    Next Gen DataCenter Implementing Network Storage with Server Blades, Clustering, Virtualization Anil Vasudeva Principal Analyst & President anil@imexresearch.com IMEX RESEARCH.COM 408-268-0800 ©2003-2006 IMEX Research All rights Reserved IMEX
  • 2.
    End to EndIT Infrastructure with HA & Security xSP IntrDet VPN Enterprise WebServices App.Server DBServers IntrDet Layer 3 Layer 4-7 Layer 2 Stg Fibre Switches Switches Switches Switches (Routers) Supplier/Partner ISP IntrDet ISP Internet ISP Core Edge Optical Networking ISP Access ISP IntrDet Remote Office ISP Caching, Proxy, Application,HA, Database, FW, SSL, IDS, File/Print, ERP, Middleware, DNS, LB, Web Security, SCM, Data Mgmt Servers CRM Servers Servers Cable Modem Tier-1 Tier-2 Tier-3 DSL Edge Computing Applications Data Bases MP3 VOD Cellular Directory Security Policy Management Wireless Home Networks Software OS Platform ©2003-2006 IMEX Research All rights Reserved IMEX
  • 3.
    DC Mgmt Nightmares Servers Win 5-10%, SMP 20-35%, MF 30-50% Utilization 80+% Servers 15-30 Servers/Admin 300+ 1 Application Application/Server 20 30-45% Disk, 20-40% Tape Storage Utilization 75+% 1TB Storage 100TB Terabytes/DBA MIS Alerts 20-40 Urgent Alerts/Day 4-5 System HAL- 3 (99.9%) Availability HAL- 5 (99.999%) ©2003-2006 IMEX Research All rights Reserved IMEX
  • 4.
    Market Segments byApplic./Workloads OLTP Transaction 10 K Processing eCommerce Data DSS (RAID - 0, 3) (RAID - 1, 5, 6) 1K Warehousing IOPs Visual DB (Latency) 100 Scientific Computing NIC NIC Imaging TPC 10 Reference Data Streaming Streaming HPC Audio/Video 1 1 5 10 50 100 500 *IOs per sesond for a required response time ( ms) MB/sec ©2003-2006 IMEX Research All rights Reserved IMEX
  • 5.
    Consolidated Data Center xSP VPN IntrDet Enterprise WebServices App.Server DBServers IntrDet Supplier/Partner ISP Switches: Layer 4-7, Layer 2, 10GbE, FC Stg ISP Internet ISP Core FC/ Edge Optical Networking IPSAN ISP Access ISP Remote Office ISP Caching, Proxy, Database, FW, SSL, IDS, DNS, Middleware, Data LB, Web Servers Mgmt Servers Tier-1 Tier-1 Application,HA, Tier-3 Edge File/Print, ERP, Edge Data Base Cable Modem Servers SCM, CRM Servers Apps Servers DSL Tier-2 Apps MP3 VOD Cellular Directory Security Policy Management Wireless Home Networks Software OS Platform ©2003-2006 IMEX Research All rights Reserved IMEX
  • 6.
    Blade Infrastructure:Local AreaGrid (LAG©) Management Modules Remote Mgmt+KVM over IP Midplane Networking: Gbit Ethernet Switches W/Connectors Storage: IP NAS or FC SAN To Blades & Back Switch Cooling N+1Fans/Cooling Modules Processor Blades Modules (6-24 typically) Power: N+1Power Supplies Blade Control Panel USB Ports, CD/Floppy I/F ~ GbE Switch supports Trunking/Port Aggregation Flow Control Gbit QoS Packet Prioritization Memory Ethernet SNMP/RMON Systems I/F Micro- DDR w IGMP/BOOTP/TFTP Monitor Processors ECC …… © 2003-06 IMEX Research Module ©2003-2006 IMEX Research All rights Reserved IMEX
  • 7.
    Blade Servers: VendorPositioning Index (As of 31 March 2005 - See IMEX Blade Servers Industry Report 2006 for latest data) Strategy (Potential) IBM Fujitsu Siemens Linux HP Hitachi Intel Networx © 2003-05 IMEX Research NEC Dell Nexcom Tatung Rackable Sys Sun Penguin Appro Egenera HPC Syst Verari ©2003-2006 IMEX Research All rights Reserved Delivery (Execution) IMEX
  • 8.
    TCO Savings &ROI 3 Year TCO Savings TCO Savings in.. Rack vs. Blade Servers OPEX 100% Staff/ Support Maintenance/ 25% 80% Downtime 54% Facilities/ % Contribution 60% Power 67% OPEX 21% 40% 46% CAPEX Networking 19% 20% Servers 33% 46% Storage CAPEX 25% Infrastructure 13% 0% 1 SW Rack Servers Blade2Servers Infrastructure 22% ©2003-2006 IMEX Research All rights Reserved Data: IMEX Research 2005 IMEX
  • 9.
    The rapid riseof Clusters in HPC Rise of Cluster Computing 350 # Clustered Computers in Top 500.org 300 250 200 150 100 50 0 1999e 2000 2001 2002 2003 2004e ©2003-2006 IMEX Research All rights Reserved IMEX
  • 10.
    HPC – FromAcademia to Wall St to Hollywood High Performance Entertainment High Performance Commercial Bioinformatics Decision-Support Entertainment Commercial BioInformatics Decision Audio/Video OnDemand Computing Computing Visualization Visualization Support Syst Audio/Video On Demand Systems Data: IMEX Research & Panasas 100+ Teraflops Rendering (Texture & Polygons) Data rate & capacity Throughput = 100All rights Reserved GB/s Throughput = 1.2 GB/s Throughput : DSL/Cable ©2003-2006 IMEX Research IMEX ©2004--05 IMEX Research.com
  • 11.
    Implementing Virtualization Client At Various Levels Workstations Microprocessor LAN Ethernet – Intel VT, AMD-Pacifica Switches OS - zOS, pOS, UNIX, Windows, Linux Application & DB Servers - IBM, HP, Sun, VMWare, Xen, SWSoft SAN File System GbE or FC - DFS Switches Networking Storage Arrays - Multiport Storage - Host, SAN, Controller - In-Band, Out-of-Band Management ©2003-2006 IMEX Research All rights Reserved IMEX
  • 12.
    TCO Savings withVirtualization 995 Servers Pre VZ 78 VZ Servers $16,000 $14,000 Provisioning Downtime $12,000 Disaster Recovery Cost over 3 years DC Real Estate $10,000 Power & Cooling $8,000 Network SAN $6,000 Hardware VZ SW & Supp $4,000 $2,000 $- ©2003-2006 IMEX Research All rights Reserved w/o VZ w VZ IMEX
  • 13.
    Storage Virtualization –the next Frontier Clients Storage VZ Implemented at Different Levels LAN Host SAN Cntrllr. Out-of- Symantec, EMC, Fujitsu Band StorageAge Servers In-Band Cloverleaf, DataCore, HDS, NetApp, IBM, FalconStor Sun SAN Storage VZ Must Have Features • Scale Non-Disruptively in Capacity Storage • Snapshot Point-In-Time across Stg.devices • Remote Replication across Heterogeneous Stg. Devices • Policy Based Non-Disruptive Data Migration between Heterogeneous Stg Systems & Between Stg Tiers • Centralized Mgmt of all Stg.VZ under Single Image • Support Tiered Storage • Volume Management for Multivendor Stg. Systems • Common Set of Tools: Provisioning, Mgmt & Replication ©2003-2006 IMEX Research All rights Reserved IMEX
  • 14.
    Economics of Virtualization Virtualization results in overall cost reduction 35-60% Storage VZ alone has produced ~20% cost reductions Savings achieved through Storage Virtualization 1000 Total Svgs 900 - 21%/yr. 800 SAN Expenses/Year $K 700 Admin - 19% 600 500 SW - 16% 400 300 200 HW - 24% 100 0 w /o Stg VZ w Stg VZ ©2003-2006 IMEX Research All rights Reserved IMEX
  • 15.
    The Next GenData Center Automation Automatically Maintains Application Service Level Objectives Provisioning Provisions the Resources Required to Deliver a Business Service Virtualization Pools Resources. Allocates, Monitors, and Meters the Usage of Pooled Resources Integration Integrates physical infrastructure using standardized devices for CAPSIMS: Cost, Availability, Performance, Scalability, Inter- operability, manageability & Security ©2003-2006 IMEX Research All rights Reserved IMEX
  • 16.
    Future: Storage Managementon a chip Host Services Integration Storage Provisioning File system monitoring Storage provisioning Win, LINUX, Solaris Layer SAN Management Management Management of MultiPath IO Supp Security SAN Console iSCSI HBAs and Failover (iSNS, CHAP, SRP) Management Layer Virtualization Mirroring Snapshot Fail-Over iSCSI Target Management Device LVM, Error Handling, SCSI Daemon, API Interoperability Service Layer HW Acceleration: TOE, iSCSI Offload, IPsec ©2003-2006 IMEX Research All rights Reserved IMEX
  • 17.
    Next Gen DataCenter Implementing Network Storage with Server Blades, Clustering, Virtualization For updated full set of slides email anil@imexresearch.com Anil Vasudeva (408) 268-0800 www.imexresearch.com ©2003-2006 IMEX Research All rights Reserved IMEX
  • 18.
    TCO Savings withVirtualization 995 Servers Pre VZ 78 VZ Servers Provisioning Downtime Disaster Recovery Cost over 3 years DC Real Estate Power & Cooling Network SAN Hardware VZ SW & Supp ©2003-2006 IMEX Research All rights Reserved w/o VZ w VZ IMEX