To better understand the need for managing rack airflow and the impact of leakage, consider the example of a rack consuming 1400 CFM. The following is measured data from Oracle’s Austin Data Center as outlined in the ASHRAE High Density Data Center Case Studies and Best Practices publication. On the left, you see the pressure profile in a cabinet with a passive chimney. Note the belly of high pressure that forms at the center of the rack. Of the 1400 CFM being consumed, only 1040 CFM is escaping out of the top of the rack. The remaining 360 CFM or 26% of the total airflow is leaking into the data center through gaps in the cabinet. This leakage contaminates the data center environment and limits the ability to raise the supply air temperature. A missing blanking panel would be catastrophic as the hot air leakage would increase dramatically and would leak directly back to the inlet of the IT equipment On the right, an active fan is placed at the top of the rack but the airflow is not controlled. In this case, the pressure profile indicates a slight negative pressure in the cabinet and the rack is consuming 240 CFM (17%) more than is required by the servers. Under partial load conditions, this bypass airflow can be a tremendous waste. As an example, this same system with half the current load would be bypassing 940 CFM or an over-supply of 2.3 times the required airflow.
Let’s begin by explaining what we mean by managed cooling distribution. First off, it is an intelligent air management system, not spot cooling. In other words, rather than take a band aid approach to solving hot spots by placing additional and unnecessary air conditioning directed at the hot spots, we remove the underlying cause of the hot spots and allow the precision cooling units to do their job more effectively. We do this by first providing physical separation of the hot exhaust and cold supply air and then dynamically scaling the airflow in each rack to match the IT load. In addition, CRACs or AHUs can be controlled to achieve Unity Cooling; the 1:1 matching of cooling supply to IT demand. Another benefit of a managed cooling system is the ability to monitor and record in real time the cooling performance of each rack in the data center. And finally, as with any mission critical system, there is no single point of failure and the system is fully redundant.
For more information, please see the following literature and support. Leads are available on the TTN website.
So, how does it work? The SiteX EC System captures the hot exhaust air in the cabinet through the use of a solid rear door and solid side panels. The airflow is directed through the top of the rack via a duct or chimney system in which two redundant, hot swappable fans are located. These energy efficient DC fans come in three rated capacities: 10, 20 & 30 kW. (point out the very low energy consumption for the amount of cooling provided – example: 43 W @ 8 kW and 152 W @ 16 kW) What is unique about the EC system is the way in which the fans are controlled. The fans dynamically scale to the IT equipment load through the use of a pressure based control scheme. A “zero pressure” environment is created in the cabinet by exactly matching the EC fan flow rate to the server flow rate in the rack. This provides a safe environment for the operation of the IT equipment and prevents leakage, as is as is common with passive chimney systems, or bypass air entering the cabinet caused by over-sized fans as with active containment without control. Included in the EC system is the ability to monitor and report in real time the cooling capacity of every rack in the data center. This includes alarm notification through email or SNMP traps and historical trending for capacity planning. Data center operators can now plan data center expansion based not only on available “U-space” and available power, but on available cooling capacity in the rack. Finally, the Opengate system easily integrates with existing BMS software.
Data Center Cooling Optimization Solutions With Ner I Os, 10 09 - Presentation Transcript
Infrastructure Optimizations Solutions Cooling Optimization Strategies Weaving Services and Products Into Best Practices and Solutions Greg A Stover Senior Vice President NER Data Products, Inc. Partnering for Success! We will start @ 1:03PM EST
iOS – The next generation from NER
Infrastructure Optimization Solutions (iOS) Turnkey Infrastructure Optimization Solutions (iOS) from NER provide significant savings and efficiency gains for most data centers of varying size and density.
Our proven process identifies and remediates constraints through a wide range of solutions designed to solve today’s nagging infrastructure issues.
We take the guess-work out of efficiency and capacity challenges through advanced tools and processes that Measure, Model, Monitor, Plan, and Manage for optimization within any data center infrastructure.
Issues driving change
Information Growth continues (56% per year)
Consolidation and Virtualization projects dominate IT
Power consumption and costs have exploded
Budgets are extremely tight
Waxman-Markey energy cap-and-trade bill
Issues driving change – Cooling Efficiency Moving quickly up the priority List!
Accountability is on the Horizon
- Availability has been all that's mattered
- Most of you haven’t paid the electric bill (facilities does)
- Data Centers have been like the CIA (budget?)
Efficiency has been a want to have!
Now it is a “Need to Have!”
Issues driving change (cont.)
Government stepping In
- EPA report to Congress identified Data Centers/IT as a significant problem
- Data Center carbon footprint to exceed airlines in 2010
- Expect voluntary Energy Star guidelines with reduction goals for now
- Expect efficiency measurement metrics, benchmarking will be important
- Obama’s “Cap & Spend” – Accountability is imminent!
Inefficiency will cost!
- Energystar adopts PUE metric 1 st and now EUE!
- US Department of Energy launches Data Center
Energy Efficiency Awareness Training Certificate
Programs and Save Energy now program
Market Trends – DOE to CEO’s Get focused on Data Center Power Use
Market Trends (cont)
Market Trends (cont)
Market Trends (cont)
Market Trends (cont)
Market Trends (cont)
Market Trends (cont)
Market Trends (cont)
Issues driving change
THE STANDARDS ARE COMING, THE STANDARDS ARE COMING!
(Green Grid, Uptime Institute, European Union, Google & Microsoft, DC Pulse, Vendors)
PUE = Power Usage Effectiveness = Total Facility Power / IT Equipment Power
Of the total power being delivered, how much is being used by IT gear?
DCiE = Data Center infrastructure Efficiency = IT equipment power / Total Facility Power x 100%
A DCiE value of 33% (equivalent to a PUE of 3.0) suggests that the
IT equipment consumes 33% of the power in the data center
CADE = Corporate Average Data Center Efficiency = Facility Efficiency (FE) x Asset Efficiency (AE)
How well does your IT & Facilities investment convert Energy to useful work?
CUE = Cooling Usage Effectiveness =
IT Load x 3.413=BTU’s/12,000= Tons of Cooling required/Tons Cooling capacity = Overcooling
Other newly released DCeP (TGG) & PPE (Gartner)
Optimization Prioritization (there choices are many)
What are your options? What can you do? EPA report shares Top 50
Implement Virtualization
Deploy high efficiency Servers
Deploy high efficiency Storage –
Enable Power management features
Deploy high efficiency PDU’s ( higher voltage AC or Moderate voltage DC)
Right size Power Distribution
Deploy high efficiency UPS Technology
Deploy high efficiency chiller pumps
Deploy high efficiency CRAC units
Deploy Variable Speed Drives
Use airside/waterside economizers – Where climate permits
Direct liquid cooling (Water or other dialectic liquid)
In Row Cooling
Hot and/or Cold Aisle Containment
Containers
Build a new Data Center
Many are Disruptive, Labor intensive, Expensive!
Pick carefully
Something huge has Changed!
End-Users use to know what they want! & Tell you what they wanted and/or needed!
Today they don’t know! They are looking for help! They need a true consultant to help them thru these difficult times and uncharted waters!
This is a great opportunity for us/you to bring value!
Where is the greatest potential return? Lot’s of ways to say the same thing! APC Version Chatsworth EYP Version
What’s important? How do I prioritize?
30% improvement in infrastructure energy efficiency from improved airflow management Airflow is the single infrastructure improvement that can be done without disruption Page 9 of EPA Final Report EPA Data Center Report Said:
Cooling Realities – It’s often not a supply problem Floor Tile Gymnastics & CFD Modeling Reference: ASHRAE Journal Article – Designing Better Data Centers, December 2007 EPA-Uptime Institute conference material
Mixing of hot exhaust with cold supply air causes hot spots
On average, only 40% of available cooling is utilized due to bypass and over-provisioning to eliminate hot spots
Typically, air is supplied well below ASHRAE standards in attempt to control temperature
Despite this gross over-supply (2.5x), 10% of racks still experience hot spots
Getting air where it needs to be when it needs to be there is key
Cooling capacity and rack heat density is not the issue
It’s a cooling and airflow distribution problem!…
Cooling Infrastructure Optimization We know the problems – What do you do?
Again - Your Options are many
We know what spins the electric Meter? We will focus on Cooling!
Over provisioning & Hot Spots – You probably have one or the other or both
Remove out of rack equipment (put it in a rack or get it out of the rack rows)
Raise Set points on Crac/h (1 degree = 4% savings, Chillers & Adjust humidity settings
(Might want to model 1 st and/or install monitoring tools)
Rumor has it that manufacturers of these solutions now recommend containment as well Supplemental Air – Close Coupled/In-Row
Considerations
In the Row
- Infrastructure requirements
- Leak detection
- MTBF = ???? Untested
- Cost
Supplemental for Air Management Solution Liebert XDO and XDV DX Systems Refrigerant based systems for supplemental cooling of HD loads - Above the Rack - Infrastructure additions - Leak detection - Cost
Liquid Cooling Solutions
Considerations
Infrastructure requirements
Leak detection
load
Cost – benefit
WHY?
The Progression of Hot & Cold Air separation towards containment perfection!
Containment – Another Frontier Separate Supply Air from Exhaust Air People have to work here Ride Thru time is limited due to Lower volume Pressurization? Stratification? Leakage People have to work here Leakage Cold Aisle Isolation Hot Aisle Isolation 75 ºF 75 ºF 105 ºF 105 ºF
Curtains/row containment – Hot or Cold
Considerations
Aesthetics
Fire Codes – no stds.
Fire/smoke detection
Fire Suppression costs
Insurance Issues
Pressurization
Blanking Panel exposure
Fusible link
maintenance
Hot Aisles & Humans
RACK RACK RACK RACK RACK RACK Three Containment Models
Walls
Curtains
Usually in drop ceiling sites
Hot or Cold Aisle Containment
Stovepipe
Curtains or Panels
Typically in open grid ceiling sites
Hot or Cold Aisle Containment
Used when site has structural or fire safety constraints
Cap
Panels
For both drop ceiling and open grid ceiling sites
Usually Cold Aisle Containment
If in-row cooling, then Hot Aisle Containment
Polargy Confidential
Site: 2000 square foot, high density site Problem: High energy bills, hot air recirculation under racks. Containment: Cold aisle containment with panels and strip curtains on aisle ends. Contained two cold aisle. Blanking panels and Air Dam Foam under racks. Cooling: Available cooling: 200 tons Average cooling load: 150 tons Average IT load: 350 kW Cooling required for 330kW: 103 tons Excess cooling: 47 tons Savings: CRAC reduction 1 CRAC turned off, 2 put in standby Annual Savings: $30,000 validated by PG&E Investment: $18,000 Rebate: $9,000 rebate from PG&E Payback Period: 4.0 months Polargy Containment Case Study
Cabinet/Chimney/Rack Exhaust Ducting Room air available for any rack Reference: ASHRAE Journal Article – Designing Better Data Centers, December 2007 105 ºF 75 ºF
Rack Heat Containment – Seams to be front runner!
Heat maintained in individual rack
Placement not restricted to aisle
Exhaust duct increases pressure drop – additional fan required
Similar restrictions to fire protection and lighting
Allows raising supply air without concern for working environment
Why Manage Airflow in Rack Containment Example of an IT rack consuming 1400 CFM Reference: ASHRAE High Density Data Centers Case Studies and Best Practices 45 RACK PRESSURE U-HEIGHT PRESSURE (In. H 2 O) 40 35 30 25 20 15 10 5 -.02 0 .02 .04 .08 .06 RACK SIDE VIEW 69.2 ºF 69.2 ºF 71.6 ºF SLIGHTLY NEGATIVE PRESSURE Non Managed: 1640 CFM airflow exhaust represents 240 CFM bypass (17%) 45 RACK PRESSURE U-HEIGHT PRESSURE (In. H 2 O) 40 35 30 25 20 15 10 5 -.02 0 .02 .04 .08 .06 RACK SIDE VIEW 69.4 ºF 71.8 ºF 73.0 ºF HIGH POSITIVE PRESSURE 83.6 ºF Passive duct: 1040 CFM airflow exhaust represents 360 CFM leakage (26%) missing blanking panels would be catastrophic
PRESSURE in the RACK Produces Unpredictable Results Reference: 7x24 Exchange Conference Boca Raton 2008, David Moss Rumor has HP will weigh in soon! Dell on server thermal issues from hot air recirculation due to downstream pressure on server fans
High Density Solution to 30 kW / Rack Using Standard Precision Cooling What is Managed Cooling Distribution?
Intelligent airflow management system – is NOT supplemental (spot) cooling !
Provides physical separation of hot exhaust and cold supply air – eliminates hot spots
Dynamically scales to rack loads up to 10, 20,30 kW
Unity Cooling TM – match cooling supply 1:1 to IT demand (Exhaust CFM matches Server CFM)
Provides real time monitoring of cooling performance within each rack
Fully redundant with no single point of failure
Attach chassis to rack top, drop in fan host Slide in redundant fan cartridges, slide on exhaust duct, trim ceiling around entire row Attach to Any Rack - Easy as 1.2.3. Quick installation for 24 inch/600mm wide and 30 inch /750mm wide rack standards
IT Waste heat removed from rack top using dynamically controlled fans Opengate SiteX EC Containment Cooling: How Does It Work?
Solid rear door and side panels capture IT exhaust air within the rack, ducting provides return air path
A “zero pressure” environment is maintained inside cabinet - fans speed up or slow down to match server airflow. No air leaks in or out.
Highly efficient DC fans – rack energy consumption offset by CRAC fan power savings
Software suite reports rack cooling capacity and airflow demand for controlling CRAC/H fans
pressure sensor 10, 20 & 30 kW Versions Available
A: All IT exhaust heat has a direct return path B: Supply air temperature is raised toward ASHRAE limit C: All cool air that is delivered is available for the IT load D: IT load is divorced from cooling source locations E: Cool supply air delivery method is flexible F : Ride thru times are improved A B C D E Cooling Distribution Points Gain Control: Stability, Efficiency and IT Flexibility Facility can be designed from day one with no need to worry about IT load changes or additions
Intelligent/Managed/Adaptive Air Movement & distribution mgt./delivery (Managed - Room Scale)
VFD’s & VSD’s Systems ( A case for managing Airflow Distribution vs Volume)
Considerations
Zone Cooling – Macro
Not all units are retro-fitable
Still cooling entire room to hottest rack/row
RLE Environet – wired or Wireless Sensors, tied to CRAC/H’s w/VFD’s
Intelligent/Managed Distribution
Floor tiles and Return System (AdaptiveCool)
Considerations
Adaptive Cooling – Micro
Intelligent/managed delivery & return
Optimal on raised floors only
HT-100 HT-300 HT-500
Always-On
Constant Speed
880 CFM
Fits Under Standard Perf. Tile
Three-Speed Manual Control
High, Medium, Low, and Off
1200 CFM
Fits Under Standard Perf. Tile
Thermostatically Controlled
Supplied with Two Temperature Sensors
1200 CFM
Can be Networked to AdaptivCool™ Monitoring & Control System
Fits Under Standard Perf. Tile
Hot Spot Elimination
AdaptivCool™ Room Scale Intelligent Cooling (RSIC) provides thermal and airflow management through a patented network of intelligent active air-movers, sensors, and network hubs, controlled the AdaptivCool™ Cooling Resource Manager.
The RSIC system automatically adjusts airflow based on real-time temperature changes in the data center.
INTELLIGENT AIR MOVERS RS485 NETWORK INTELLIGENT RETURNS COOLING RESOURCE MANAGER VPN 24x7 REMOTE MONITOR LONWORKS BACNET SNMP E-Mail SMS SENSOR NETWORK CRAC UNITS Developing a customized active airflow distribution and cooling resource solution based on the results of the CFD analysis The Solution
How RSIC Works X X 1 ) Under-floor and overhead airmovers eliminate hotspots and ensure that the right amount of air is delivered at the rack level to keep equipment cool. CRAC set points can now safely be raised. 2) Redundant cooling can now be safely placed in hot standby. Extra cooling is available on demand, but is not consuming energy unless it is needed. 3) Return air temperatures across all CRAC units are evened out, resulting in less CRAC humidity fighting. x
How RSIC Works CRAC Failure ZONE 4 ZONE 1 x Reserve CRAC Unit(s) Automatically Turns On During a severe rise in temperature and/or a CRAC failure, the RSIC system will automatically turn on a redundant unit and rebalance airflow across the room to ensure adequate cooling is maintained at the rack level. CRAC 01 CRAC 02 CRAC 03 CRAC 04 CRAC 05 CRAC 06 CRAC 07 CRAC 08 CRAC 09 CRAC 10 CRAC 11
Easy to use Dashboard
Real time environmentals
Zone of Influence
Cooling management
CRAC shedding (energy saving)
CRAC failure management
Web enabled
3 Tiers of redundancy
Trending, alarms, history
Interface to BACnet™, Lon™, SNMP and others
Cooling Resource Manager
Baseline “thermal & airflow profile” of MHCP’s data center (CFD)
Permanent on-site real time visual display of thermal conditions
Initial report of before/after energy savings
Remote monitoring of thermal conditions and trends
Alarms for specified out-of-normal conditions
Automatic re-starts when needed for any CRAC/H’s placed in reserve
Monthly reports tracking energy savings, # of alarms, solution recommendations, etc.
Quarterly reports highlighting thermal trends and forecasting any upcoming needs for additional cooling capacity,
Updated CFD thermal & airflow profiles quarterly or semi-annually based on the pace of change in your data center . . . plus . . .
The Service
No longer cooling the whole room to the hottest hotspot (Allows CRAC set-points to be raised, which equates to an efficiency gain)
Humidification / dehumidification costs reduced
Reduced mixing of warm and cold air, resulting in higher Δ T across the CRAC units = more efficient cooling.
Warm air returned directly to CRAC units, cold air delivered directly to racks, at the right time, in the right amount
Redundant cooling available, but not wasting energy
Environment is Safely Optimized!
After R-S-I-C Installation
A-Cool Highlights
Simultaneous and independent control of several locations/Zones in your Data Center
Narrow temperature distribution between racks
Enables raising CRAC/H temp (1°F = 4% savings)
Load balancing of CRAC/H s (Humidity control)
Reduce active CRAC/Hs (hot standby)
Increase operational headroom
Use for failure safety (availability), additional server load (Watts/sqft) or Op-Ex savings ($$$)
Works perfectly with hot/cold aisle containment
Before After
Results in this Data Center:
Real-Time Dynamic Airflow and Temperature Control
24 x 7 Thermal Monitoring and Alarming
Annual Energy Savings of $55,000 (or 24% reduction)
Trending and Reporting of Thermal Conditions in the Data Center
Annual Energy Savings of $35,000 (24% savings in cooling energy)
Trending and Reporting of Thermal Conditions in the Data Center
Active user interface
Rack Intake Temperatures do NOT Exceed 77° F
Top-of Rack Intake Temps -- Before Top-of Rack Intake Temps -- After “ The AdaptivCool solution has shown us major improvements in cooling. Everything they promised us came true.” 71 F 72 F 78 F 70 F 72 F 74 F Constraints: Example #2 Under 69 F 69-72 F 73-77 F 78-82 F Over 82 F
AdaptivCool - Results Summary for MHCP
Results for MHCP include:
A reduction in the cost to cool the upper room by as much as 46% and the lower room by as much as 52%!
A reduced electrical demand of 3,736 MWH Hours per year!
At $0.07 per kilowatt hour, that equates to a savings of $261,500 per year! Plus expected $150k from Chiller efficiency
A total of 20 CRAC units (8 units in the lower room, and 12 in the upper room) can be placed in “Dynamic Redundancy”, allowing MHCP to have redundant cooling without those units constantly consuming energy!
Alternatively, a continuous IT load of 426 KW can be safely added to these rooms!
Who do you call on?
Facilities IT and/or Facilities
Energy Manager/CZAR, Energy Engineer
Corporate Real Estate VP/Manager
People with the word “Infrastructure” in their title
Critical facilities Manager
Corporate Sustainability Manager
IT & DC Ops.
Know this before you call us! Foundational Questions: How many square ft is your primary Data Center? Raised Floor or Slab? Cooling Tonnage (# of CRAC/Hs, tonnage of each)? Is cooling delivered thru raised floor? Other, Please explain? Do you currently have N+1 redundant cooling? Is that a requirement? Do your CRAC/H/s have VFD's? What is your UPS Capacity? What is your actual IT Load? Do you measure PUE? Any other Data Center efficiency metric? Do you have capacity concerns? Cooling? Power? Electrical Cost - What do you pay per KW? Do you have a greening initiative? Do you have any hot spots? And/or any other thermal challenges? What is the #1 project/concern for IT today? What is the #1 project/concern that facilities is trying to accomplish with/for IT? Engage your NER RSM
What’s your CUE? (Cooling Utilization Efficiency)
Things to remember when it comes to cooling and energy measurement process.
One size doesn’t fit all
This is the Reality of today’s market!
If it doesn’t:
improve productivity
allow you to do more with less
allow you to do more with what you have
show a real/measureable ROI
They DON’T NEED IT!
They won’t BUY IT!
The Polite ones actually inadvertently waste your time!
NER Data Products, Inc Infrastructure Optimization Solutions Data Center Greening Strategies We believe: Efficiency Optimization is not an event, it’s a process! Cooling Efficiency Optimization is the # 2 opportunity to save in the Data Center Infrastructure Efficiency Optimization is Green by default! Green is $Green$ - Find ways to improve sustainability and efficiency
Find Industry related information & Articles Users – Please join our Group
0 comments
Post a comment