Strategies for Finding and Unlocking the Hidden Capacity in Your Data Center Infrastructure Peter A. Panfil Vice President and General Manager Liebert AC Power Emerson Network Power

Strategies for Finding and Unlocking the Hidden Capacity in Your Data Center Infrastructure

Peter A. Panfil

Vice President and General Manager Liebert AC Power

Emerson Network Power

Strategies for Finding and Unlocking the Hidden Capacity in Your Data Center Infrastructure Sizing data center power and cooling systems can feel like buying shoes for a fast-growing teenager: choose the size that fits today and you’ll be replacing a perfectly good pair of shoes in two months. Fortunately, data center power and cooling systems are proving to be surprisingly adaptable. This session will help you determine how much “flex” exists within your data center infrastructure. We’ll show you how to assess the hidden capacity in your power and cooling systems and review strategies for unlocking this hidden capacity. Whether you’re evaluating if your current facility can carry you into the future, or planning a new facility, this session will give you new insight into sizing – and growing – power and cooling capacity.

Sizing data center power and cooling systems can feel like buying shoes for a fast-growing teenager: choose the size that fits today and you’ll be replacing a perfectly good pair of shoes in two months.

Fortunately, data center power and cooling systems are proving to be surprisingly adaptable. This session will help you determine how much “flex” exists within your data center infrastructure. We’ll show you how to assess the hidden capacity in your power and cooling systems and review strategies for unlocking this hidden capacity.

Whether you’re evaluating if your current facility can carry you into the future, or planning a new facility, this session will give you new insight into sizing – and growing – power and cooling capacity.

Agenda Market dynamics Assessing power and cooling capacities Infrastructure management: Real-time visibility into capacity Unlocking capacity by enhancing energy efficiency Sizing power and cooling equipment for changing capacities Power and cooling solutions for unpredictable capacity growth Summary

Market dynamics

Assessing power and cooling capacities

Infrastructure management: Real-time visibility into capacity

Unlocking capacity by enhancing energy efficiency

Sizing power and cooling equipment for changing capacities

Power and cooling solutions for unpredictable capacity growth

Summary

Market Dynamics

Data Center Environment Key Trends From Fall 2005 to Today *Data Center Users’ Group Survey

Data Center Environment Key Trends From Fall 2005 To Today *Data Center Users’ Group Survey

Market Requirements / Product Requirements Higher Density solutions Variable capacity Energy Efficiency More control of the whole Data Center Free cooling solutions Optimized efficiency operating modes Modular data center Higher sensible load Server technology continues to push more power but is also more efficient. Effective use of floor space. Server loads vary greatly and fans now ramp with server temperature Energy the current buzz – but is the real way to get more power to IT In the future, we will need to connect IT resources with infrastructure Large jumps in energy efficiency Cost effective means to grow on demand With higher density, the sensible load becomes an even higher proportion

Higher Density solutions

Variable capacity

Energy Efficiency

More control of the whole Data Center

Free cooling solutions Optimized efficiency operating modes

Modular data center

Higher sensible load

Server technology continues to push more power but is also more efficient. Effective use of floor space.

Server loads vary greatly and fans now ramp with server temperature

Energy the current buzz – but is the real way to get more power to IT

In the future, we will need to connect IT resources with infrastructure

Large jumps in energy efficiency

Cost effective means to grow on demand

With higher density, the sensible load becomes an even higher proportion

Product Requirements / Product Offerings Higher Density solutions Variable capacity Energy Efficiency More control of the whole Data Center Free cooling solutions Optimized efficiency operating modes Modular data center Higher sensible load Liebert XD cooling New containment systems Liebert NX and NXL UPS, MPX Rack PDU Liebert DS with Digital Scroll and EC fans New Liebert CRR Liebert XD, EC fans, Digital Scroll Liebert NX and NXL UPS TP1 rated PDU transformers Infrastructure Management – managing all the assets in the Data Center w/Aperture Liebert DS UPS with Intelligent Eco Mode Bundled solutions offerings Liebert XD – 100% sensible, Digital Scroll with EC fan

Higher Density solutions

Variable capacity

Energy Efficiency

More control of the whole Data Center

Free cooling solutions Optimized efficiency operating modes

Modular data center

Higher sensible load

Liebert XD cooling

New containment systems Liebert NX and NXL UPS, MPX Rack PDU

Liebert DS with Digital Scroll and EC fans New Liebert CRR

Liebert XD, EC fans, Digital Scroll Liebert NX and NXL UPS TP1 rated PDU transformers

Infrastructure Management – managing all the assets in the Data Center w/Aperture

Liebert DS UPS with Intelligent Eco Mode

Bundled solutions offerings

Liebert XD – 100% sensible, Digital Scroll with EC fan

Assessing power and cooling capacities

Design audit Inventory of data center equipment Standardization of maintenance procedures to comply with IEEE/NETA standards and manufacturers’ recommendations Standardization of reliability processes i.e. power quality, disaster recovery and root cause, short circuit & coordination Verification of accurate one-line diagrams per NFPA 70E Evaluation of redundancy of critical systems Creates a baseline for subsequent audit and maintenance activities

Inventory of data center equipment

Standardization of maintenance procedures to comply with IEEE/NETA standards and manufacturers’ recommendations

Standardization of reliability processes i.e. power quality, disaster recovery and root cause, short circuit & coordination

Verification of accurate one-line diagrams per NFPA 70E

Evaluation of redundancy of critical systems

Creates a baseline for subsequent audit and maintenance activities

Load bank testing Scope of Work Application of a full load for a full 2-hour period If applicable, building load shall be permitted to serve as part or total load – supplemented by load bank of sufficient size to equal 100 percent of nameplate kW rating of the EPS Exercise cooling system Accumulated carbon deposits burned off, if applicable Removal of unburned fuel / oil Benefits Confirms generator output of specified kW Operational assurance Facilitates capacity expansion Regulatory compliance NFPA 110:6-4.2 “…emission standards”

Scope of Work

Application of a full load for a full 2-hour period

If applicable, building load shall be permitted to serve as part or total load – supplemented by load bank of sufficient size to equal 100 percent of nameplate kW rating of the EPS

Exercise cooling system

Accumulated carbon deposits burned off, if applicable

Removal of unburned fuel / oil

Benefits

Confirms generator output of specified kW

Operational assurance

Facilitates capacity expansion

Regulatory compliance

NFPA 110:6-4.2 “…emission standards”

Electrical assessment Perform a single point of failure analysis to identify critical failure points in your power infrastructure Determine capacity of all switchgear from the main to mission-critical PDUs Determine current being drawn through all UPS equipment and breakers from the main to mission-critical PDUs Perform analysis comparing measured current and power rating for all breakers from the main to mission-critical PDUs as well as any imbalances; note any areas of concern Determine kW and KVA loading on each UPS and compare to rating of UPS Evaluate the rated capacity of each generator versus UPS rated capacity ratings and note if generator full load rating is <150% of UPS rating Determine load per rack/PDU

Perform a single point of failure analysis to identify critical failure points in your power infrastructure

Determine capacity of all switchgear from the main to mission-critical PDUs

Determine current being drawn through all UPS equipment and breakers from the main to mission-critical PDUs

Perform analysis comparing measured current and power rating for all breakers from the main to mission-critical PDUs as well as any imbalances; note any areas of concern

Determine kW and KVA loading on each UPS and compare to rating of UPS

Evaluate the rated capacity of each generator versus UPS rated capacity ratings and note if generator full load rating is <150% of UPS rating

Determine load per rack/PDU

Computational fluid dynamics Demonstrate the air flow characteristics of a raised floor Better understand why hot spots are present See effects of under floor obstructions on air flow View heat-related risks in your facility

Demonstrate the air flow characteristics of a raised floor

Better understand why hot spots are present

See effects of under floor obstructions on air flow

View heat-related risks in your facility

To view this presentation in its entirety, visit: http://w.on24.com/r.htm?e=135505&s=1&k=B64D9D4FE238521C32C282319625B6F1&partnerref=eTV

What is data center infrastructure management? Data centers consist of multiple interrelated subsystems Can be overwhelmingly complex for any but the smallest facilities Objective is to deliver services at a targeted service level Service Level Agreement (SLA) implies targets for availability and performance Management of a large data center to the SLA at optimum cost can become intractable One approach is to break down the task into smaller, manageable domains The Data Center Physical Infrastructure (servers, storage, rack space) and the Critical Facilities (power, cooling) each comprise multiple domains There is an opportunity to bridge the gap between the IT Physical Infrastructure, Critical Facilities and Data Center Service Management to optimize the data center

Data centers consist of multiple interrelated subsystems

Can be overwhelmingly complex for any but the smallest facilities

Objective is to deliver services at a targeted service level

Service Level Agreement (SLA) implies targets for availability and performance

Management of a large data center to the SLA at optimum cost can become intractable

One approach is to break down the task into smaller, manageable domains

The Data Center Physical Infrastructure (servers, storage, rack space) and the Critical Facilities (power, cooling) each comprise multiple domains

There is an opportunity to bridge the gap between the IT Physical Infrastructure, Critical Facilities and Data Center Service Management to optimize the data center

Scenario 1- Capacity view Facility IT SiteScan Aperture VISTA Deploy hardware without exceeding power, space, or cooling capacity VISTA shows available capacity for a proposed change SiteScan provides real-time data on power and cooling capacity  

Scenario 2- Capacity planning Facility IT SiteScan IT Management Application Aperture VISTA Assess available capacity and needs for future, and plan required power and cooling capacity upgrades VISTA displays past and projected capacity requirements SiteScan provides real-time and historical usage data IT management provides IT asset utilization data   

Bridging IT and facilities Critical infrastructure monitoring Provides visibility into current state Supports analysis and planning Data center service management Controlled procedures for moves, adds and changes Accurate, current view of data center configuration Manages dependencies between Critical Infrastructure and IT Physical Infrastructure Data center infrastructure management Merges monitoring and management across domains Delivers holistic services at a targeted service level Provides actionable reporting on availability and performance

Critical infrastructure monitoring

Provides visibility into current state

Supports analysis and planning

Data center service management

Controlled procedures for moves, adds and changes

Accurate, current view of data center configuration

Manages dependencies between Critical Infrastructure and IT Physical Infrastructure

Data center infrastructure management

Merges monitoring and management across domains

Delivers holistic services at a targeted service level

Provides actionable reporting on availability and performance

Unlocking capacity by enhancing energy efficiency

Emerson Network Power presents Energy Logic Emerson Network Power approach to reducing data center energy consumption Sequential roadmap that starts with IT equipment and moves through to support infrastructure Emphasis is on cascade of savings Based on research and modeling Provides quantified savings and an estimated ROI Frees up power, cooling and space capacity without compromising availability or flexibility

Emerson Network Power approach to reducing data center energy consumption

Sequential roadmap that starts with IT equipment and moves through to support infrastructure

Emphasis is on cascade of savings

Based on research and modeling

Provides quantified savings and an estimated ROI

Frees up power, cooling and space capacity without compromising availability or flexibility

The ‘Cascade’ effect 1 Watt saved at the server component level results in cumulative savings of about 2.84 Watts in total consumption

Energy Logic: Cascade savings strategies

Total Energy Logic savings with all 10 strategies applied

Unoptimized data center layout

Optimized data center layout 65% space freed up from optimization from 5,000 sq. ft. to 1,768 sq. ft.

Address space, power and cooling constraints

Sizing power and cooling equipment for changing capacities

Considerations for sizing power Set an initial density target – either watts per sq ft or kW per rack A good starting point is kW per rack kW per rack x10 is approximately the watts/sq ft req’d 12kW per rack results in 120 watts/sq ft Another method is using floor tiles 3500W per floor tile equates to about 90W per sq ft 3500W per floor tile equates to 1 ton of cooling per floor tile 3500W per floor tile equates to between 6 and 8 kW per rack Size the incoming feed for growth – 2x is a good start Power system architecture Eliminate single points of failure and improve online maintainability Investigate alternate high availability bus and dist configurations Consider scalable power (and cooling solutions) that can easily keep up with unpredictable growth

Set an initial density target – either watts per sq ft or kW per rack

A good starting point is kW per rack kW per rack x10 is approximately the watts/sq ft req’d 12kW per rack results in 120 watts/sq ft

Another method is using floor tiles 3500W per floor tile equates to about 90W per sq ft 3500W per floor tile equates to 1 ton of cooling per floor tile 3500W per floor tile equates to between 6 and 8 kW per rack

Size the incoming feed for growth – 2x is a good start

Power system architecture

Eliminate single points of failure and improve online maintainability

Investigate alternate high availability bus and dist configurations

Consider scalable power (and cooling solutions) that can easily keep up with unpredictable growth

Eliminate Single Points of Failure and Improve Online Maintainability Electrical Dist. Panel Electrical Dist. Panel Rack 4 Electrical Dist. Panel Rack 1 Rack 2 Rack 3  = Single Point of Failure Eliminated Dual bus redundant module UPS, with maintenance bypass Redundant electrical distribution Smart rack PDUs (eliminates excess cabling under the floor and improves air flow) Dual power supplies per server     UPS A1 UPS A2  UPS B1 UPS B2 

Dual bus redundant module UPS, with maintenance bypass

Redundant electrical distribution

Smart rack PDUs (eliminates excess cabling under the floor and improves air flow)

Dual power supplies per server

High availability power configurations Catcher Dual Bus Does not require complex switchgear STS does the power tie Maximum Loading (N-1)/N For 4x1000 kVA=3000 kVA Max Load Dual Corded Dual Bus Requires custom switchgear for power tie Maximum Loading N/2 For 4x1000 kVA=2000 kVA Max Load UPS 1 UPS 2 PDU PDU STS STS UPS 3 UPS 4 PDU PDU STS STS Interleaved Dual Bus Does not require complex switchgear STS does the power tie Maximum Loading N/2 For 4x1000 kVA=2000 kVA Max Load UPS 1 UPS 2 UPS 3 UPS 4 PDU PDU PDU PDU STS STS STS STS UPS 1 UPS 2 UPS 3 Catcher STS STS STS PDU PDU PDU

System Efficiencies Distribution Voltages Today Emerging 2 – 3% Efficiency Improvement 480VAC RDC UPS Rack 480/277V 480/277V 480VAC RDC UPS Rack 415/240V 415/240V 480VAC UPS PDU Rack 480V 208/120V 480VAC UPS PDU Rack 480V 240/139V 600VAC UPS PDU Rack 600V 208/120V 415VAC RDC UPS Rack 415/240V 415/240V

Considerations for sizing cooling IT loads have a large variation in cooling and airflow requirements Virtualization, power management, new equipment Need to match cooling capacity with the IT load Eliminates over cooling and improves cooling efficiency with reduced cycling Use optimal set points Proper cold aisle temperature – adjust room set point (68°F to 70°F) Raise the chilled water temperature above 45°F Review ASHRAE guidelines Consider a thermal assessment to help jump start the process

IT loads have a large variation in cooling and airflow requirements

Virtualization, power management, new equipment

Need to match cooling capacity with the IT load

Eliminates over cooling and improves cooling efficiency with reduced cycling

Use optimal set points

Proper cold aisle temperature – adjust room set point (68°F to 70°F)

Raise the chilled water temperature above 45°F

Review ASHRAE guidelines

Consider a thermal assessment to help jump start the process

Baseline strategies for cooling efficiency: Seal the data center environment Cooling can be lost through floors, walls and ceilings Keep doors closed at all times Use a vapor seal to isolate the data center atmosphere

Cooling can be lost through floors, walls and ceilings

Keep doors closed at all times

Use a vapor seal to isolate the data center atmosphere

Baseline strategies for cooling efficiency: Optimize airflow Rack arrangement Hot-aisle/cold-aisle Place CRAC units perpendicular to hot aisles

Rack arrangement

Hot-aisle/cold-aisle

Place CRAC units perpendicular to hot aisles

Baseline strategies for cooling efficiency: Optimize airflow Cable management Overhead cabling Expansion channels Bring power closer to equipment Increase voltage of IT equipment Air containment Perforated tiles should only be used in cold aisles Use blanking panels to fill open spaces in racks Use cabling grommets to fill open spaces around cables

Cable management

Overhead cabling

Expansion channels

Bring power closer to equipment

Increase voltage of IT equipment

Air containment

Perforated tiles should only be used in cold aisles

Use blanking panels to fill open spaces in racks

Use cabling grommets to fill open spaces around cables

Power solutions for unpredictable capacity growth

Unpredictable growth requires an adaptive architecture Scale for Capacity 80 kVA 40 kVA 60 kVA + Concurrently Maintainable Data Center Fault-Tolerant Data Center Redundant- Component Data Center S+S Dual Bus N+1 Centralized Bypass 1+N Distributed Bypass 1+1 Redundancy Configure for Availability Or Capacity

Power scalability options protect initial investment Add modules to a Fault-Tolerant Configuration Add modules to a Redundant-Component Configuration Add capacity to installed modules 100% Initial Capacity 150% Potential Capacity Capacity Capacity Redundancy + Future Capacity or Availability Expansion Future Expansion Future Expansion Future Expansion

The ultimate in scalability Imagine a growing family buys a five bedroom home for the price of a three bedroom home When they need the space, they obtain the keys to the additional rooms

Imagine a growing family buys a five bedroom home for the price of a three bedroom home

When they need the space, they obtain the keys to the additional rooms

Softscale technology makes it possible Enabled by advances in UPS design that optimizes the UPS efficiency curve, allowing allows the UPS to operate with the same high efficiency at 50 percent utilization as it does at 100 percent utilization Allows smaller data centers to take advantage of the higher reliability and lower cost per kilowatt of a large UPS compared to a smaller UPS Brings availability, flexibility, and efficiency to medium-sized data centers

Enabled by advances in UPS design that optimizes the UPS efficiency curve, allowing allows the UPS to operate with the same high efficiency at 50 percent utilization as it does at 100 percent utilization

Allows smaller data centers to take advantage of the higher reliability and lower cost per kilowatt of a large UPS compared to a smaller UPS

Brings availability, flexibility, and efficiency to medium-sized data centers

The Liebert NX with Softscale True online, double-conversion UPS provides protection against the full range of power irregularities Allows paralleling of UPS modules for capacity or redundancy Highly efficient during normal operation and in Eco-mode, saving energy dollars Provides a cost-effective growth solution with Softscale technology

True online, double-conversion UPS provides protection against the full range of power irregularities

Allows paralleling of UPS modules for capacity or redundancy

Highly efficient during normal operation and in Eco-mode, saving energy dollars

Provides a cost-effective growth solution with Softscale technology

Increased capacity via phone Purchase Softscale upgrade Liebert representative visits the site to ensure proper wiring and breaker sizing Customer Engineer visits the site and uses a software key to quickly and easily increase UPS output capacity Grow your UPS capacity from 40 to 60 or 80kVA, or 80 to 100 or 120kVA without adding hardware Capacity

Purchase Softscale upgrade

Liebert representative visits the site to ensure proper wiring and breaker sizing

Customer Engineer visits the site and uses a software key to quickly and easily increase UPS output capacity

Grow your UPS capacity from 40 to 60 or 80kVA, or 80 to 100 or 120kVA without adding hardware

System growth Capacity growth achieved through Softscale and paralleling Growth through Softscale technology 40kVA -> 60kVA -> 80kVA 80kVA -> 100kA -> 120kVA Growth through system paralleling Parallel up to 3 modules for capacity + 1 for redundancy 80kVA + 80kVA + 80kVA = 240kVA capacity 80kVA + 80kVA + 80kVA +80kVA = 240kVA redundant 40 kVa Module 80 kVa Module Enabled by Softscale

Capacity growth achieved through Softscale and paralleling

Growth through Softscale technology

40kVA -> 60kVA -> 80kVA

80kVA -> 100kA -> 120kVA

Growth through system paralleling

Parallel up to 3 modules for capacity + 1 for redundancy

80kVA + 80kVA + 80kVA = 240kVA capacity

80kVA + 80kVA + 80kVA +80kVA = 240kVA redundant

Cooling solutions for unpredictable capacity growth

Liebert XD System: A flexible solution to high heat densities Offers floor-mount, floor space saving rack-mount and ceiling-mount cooling module configurations Can cool more than 30 kW per rack Offers multiple configurations Pumped refrigerant-based cooling modules Liebert XDH Liebert XDO Liebert XDV Pumped refrigerant-based pumping and chiller units Liebert XDC Liebert XDP Water-based cooling modules and racks Liebert XDK-W Liebert XDR-W Water-based pumping unit Liebert XDP-W

Offers floor-mount, floor space saving rack-mount and ceiling-mount cooling module configurations

Can cool more than 30 kW per rack

Offers multiple configurations

Pumped refrigerant-based cooling modules

Liebert XDH

Liebert XDO

Liebert XDV

Pumped refrigerant-based pumping and chiller units

Liebert XDC

Liebert XDP

Water-based cooling modules and racks

Liebert XDK-W

Liebert XDR-W

Water-based pumping unit

Liebert XDP-W

“ Plug and play” expansion offers flexible growth plan Requires little or no floor space Complements Liebert precision cooling units Allows adaptive and scalable expansion (“pay as you grow”) without interruption of cooling operations Provides models to suit data center needs, mounting on, above or between the racks Provides an excellent solution for spot and zone cooling of high heat density equipment Liebert XDH Liebert XDO Liebert XDV

Requires little or no floor space

Complements Liebert precision cooling units

Allows adaptive and scalable expansion (“pay as you grow”) without interruption of cooling operations

Provides models to suit data center needs, mounting on, above or between the racks

Provides an excellent solution for spot and zone cooling of high heat density equipment

Liebert XD extreme density cooling solves XD heat loads XDV 10kW XDO 20kW CRAC 5-6kW XDH 20 & 30kW Up to 40kW per rack

Summary Assess your environment to understand opportunities and constraints Leverage infrastructure management to monitor and manage domains Enhance energy efficiency to free up capacity Properly size power and cooling equipment for changing capacities Consider scalable power and cooling solutions that can easily keep up with unpredictable growth

Assess your environment to understand opportunities and constraints

Leverage infrastructure management to monitor and manage domains

Enhance energy efficiency to free up capacity

Properly size power and cooling equipment for changing capacities

Consider scalable power and cooling solutions that can easily keep up with unpredictable growth

Time Warner Cable Case study, approx. 10 slides

Case study, approx. 10 slides

Questions? Contact Information: Peter A. Panfil 975 Pittsburgh Drive Delaware, OH 43015 Office: 740-833-8665 [email_address]

Contact Information:

Peter A. Panfil 975 Pittsburgh Drive Delaware, OH 43015 Office: 740-833-8665 [email_address]