The document presents a 2007 study comparing conventional raised floor cooling systems with close coupled cooling technology for data centers. It outlines the advantages of close coupled cooling, such as improved energy efficiency and the ability to handle high-density IT loads, while discussing various cooling options and trends. The study emphasizes cost savings in energy and real estate, as well as the necessity for adaptive infrastructure in modern data centers.

1. 2007 Data Center Cooling Study: Comparing Conventional Raised Floors with Close Coupled Cooling Technology November 14, 2007 Presented By:

2. Speakers and Sponsor Daniel Kennedy, Solution Center Coordinator for Rittal Corp. Degreed Electrical Engineer with a concentration in power systems Over 4 Years Experience with Design and Implementation of data center facilities Project Engineer for Rittal’s closed-coupled liquid cooling systems in North America Jennifer Osborn , Data Center Infrastructure Consultant for DirectNET 5 Years Experience in data center planning and management Professional portfolio includes over 250 clients, including Fortune 100 organizations Successfully managed over 25 enterprise implementations, including deployment, training, and support

3. Agenda Power: The Change Agent of Today’s Data Center A Review of Your Cooling Options An In-Depth Assessment of Close Coupled Cooling: 2007 Data Center Cooling Study 7 Things to Consider before Making a Cooling Investment Q&A

4. Data Center Development Trends Today Future Automation Assetmanagement Energy-Efficiency Virtualisation Physical / logical Security Adaptive Infrastructure Remote Management Fuel cell technology Wireless Sensors Cooling / Power Components Solutions Cost intensive Infrastructure: None adaptive High energy consumption - People-intensive Island-character Local managed - Lights-on Wired Components Solutions Cost-effective Infrastructure: Adaptive Low energy consumption Automated Shared IT Remote managed - Lights-off - Wireless

5. Inside the Data Center Floor Systems Cable Plant Structured Wiring Cable Routing Ladder Rack Cable Tray Climate Control CRAC, CRAH Security Access Control Video & Biometrics Power Direct, UPS, EDG‘s Outside Service OC-XXX, Telco Enclosures

6. The Issue Optimized air circulation cannot be achieved without significant facility changes The high costs for energy and climate management increase TCO. New methods and technologies must be defined for the increased climate control requirements.

7. Cooling Trends: Where is it Headed?

8. Space Comparison: White Space vs. Mechanical Space Floor Area Required in Data Center Rising load density of IT areas Solutions for High Density Areas needed Cooling solutions with air/water heat exchangers TODAY TOMORROW Mechanical Space 40% White Space 60% Mechanical Space 60% White Space 40% Source: Internal estimation Rittal 2007

9. Cooling Trends: The Way Forward

10. Cooling Options: A Tutorial Close Coupled Cooling Rear Door Air Cooled Supplemental In Row Solutions Active Air 0 2 10 15 20 28 35 40 kW Chip + Enclosure Cooling

11. Cooling Options: Air Cooled Ways to Cool – Where they are Used Air cooled Cabinet in a traditional hot aisle / cold aisle arrangement Air Cooled 0 2 10 15 20 28 35 40 kW

12. Cooling Options: Rear Door Ways to Cool – Where they are Used Rear Door type units are a lower capacity supplemental cooling system Allow user to bring air return temperatures from dense cabinets down to inlet temperatures (70F) Can be deployed along with CRAC units to bring the hot aisle temperatures down on struggling units 0 2 10 15 20 28 35 40 kW Rear Door

13. Cooling Options: Active Air Ways to Cool – Where they are Used Active Air solutions Rely on current cooling capacity to handle the load, but more effectively return it to the CRAC units Provides no actual cooling capacity, utilizes drop ceiling if present as a return path to CRAC unit 0 2 10 15 20 28 35 40 kW Active Air

14. Cooling Options: Supplemental In Row Ways to Cool – Where they are Used Supplemental In Row Solutions / Above Row Provide cold air and heat removal from typical hot aisle / cold aisle arrangement Supplements the CRAC unit much like rear door units, typically, but not always of greater capacity Supplemental In Row Solutions 0 2 10 15 20 28 35 40 kW

15. Cooling Options: Close Coupled Cooling Ways to Cool – Where they are Used Close Coupled Cooling – Closed Loop Provides cooling regardless of room conditions Performs all the functions of the CRAC unit, but brings the cooling directly to the cabinet itself Creates microclimate that exist only inside the rack Close Coupled Cooling 0 2 10 15 20 28 35 40 kW

16. Cooling Options: Chip-Level Ways to Cool – Where they are Used Chip + Enclosure cooling Deployed in ultra dense environments, using customized servers Typically not for commercial deployment Aimed at research environments that can benefit from ultra dense clusters 0 2 10 15 20 28 35 40 kW Chip + Enclosure Cooling

17. Cooling Options: Visuals Open Systsem (supplemental cooling) Closed System (less than 10% Heat to the room) CPU (Chip) Cooling Combined Solution

18. Determining an Approach Hot/Cold Aisle Configuration? Is it possible in your data center If not rear door solutions maybe ideal What is the Current Density of your Rack? < 15kW - Supplemental System Supplemental systems can provide cooling were needed on a hotspot basis > 15kW – Close Coupled System Can remove all heat being produced by the system, leaving nothing to chance in the ambient environment

19. The Concept: LCP Plus Touch screen

20. Differentiating Closed Couple Cooling + = LCP Server Cabinet High-Performance Solution top view HEX

21. Differentiating Closed Couple Cooling HEX fan alternative 2 top view

22. Cooling: Redundancy Considerations L C P M1 M2 M3 L C P L C P L C P

23. Cooling: LCP Extend For pre-deployed racks

24. Cooling: Supplemental Solutions Cold aisle Cold aisle

25. TCO: Real Estate Cost Analysis Real Estate Savings $129,617 $195, 946

26. TCO: Real Estate Cost Analysis Available 40KW, 3 rack space with LCP 20KW 30 – 40 KW common 40KW 10 rack sp. 4KW 4KW 4KW 4KW 4KW 4KW 4KW 4KW 4KW 4KW 4KW L C P L C P 20KW Available 40+KW, 2 rack space L C P L C P 30 – 40 KW

27. TCO: Energy Cost Analysis Energy Savings Excellent - $69K Average - $128K Poor - $302K

28. Cooling: Total Cost of Ownership Allowing for warmer water temperatures, while still maintaining high density loads could save a great deal of money using conventional chillers Depending on the operational condition of the chiller plant, the numbers below could be realized annually on an installation of less than 70 close couple cooled cabinets!

29. Cooling: Total Cost of Ownership Real Estate savings Having the ability to cool dense loads allows for server consolidation into a single rack, or adoption of denser server technologies such as blades Running costs Closed coupled cooling allows for multiple savings in regards to energy Lower fan energy costs Lower lighting cost for smaller, more dense data center Lower chilled water plant costs Evaporative and dry free coolers

30. Cooling: Total Cost of Ownership Freecooler Low noise Chiller Pump Heatrecovery Pump- station Buffertank Emergency water building airconditioning Chiller options

31. Evaporative or Dry Coolers vs. Chiller Plant Typical Chiller plants provide chilled water at <45F, which is then past to the CRAC units in the data center Raising this water temperature lowers operating cost, but the cooling solution must be able to handle the warmer water while providing the same amount of cooling Close coupled cooling allows for high density installations, while using water as warm as 70F! This warm water temperature allows for more hours each year where evaporative or dry air side economizers / coolers can be used lower operating cost, by reduced electricity usage

32. Chiller Example – California With a load of 28kW per cabinet, and with an ASHRAE allowable intake temperature to the servers of 77F, we can use water as warm as 70F, which can be realized whenever the Wet Bulb temperature is below 63F. In Oakland this is the case over 97% of the year!

33. Chiller Example: Major Metropolitan Areas

34. Comparison with Traditional Methods - PUE Typical data centers range from 3.0-1.6, the lower the number the better PUE = (Total input Power to Data Center / Total IT Load) Example: Total Mechanical Load including chillers, UPS units, etc. ~ 216 kW Total IT Load at 108 kW PUE = 216 kW / 108 kW = 2.0 PUE Even small LCP+ systems, without economizers, result in a PUE of 1.54!

35. The Green Impact The EPA estimates that at the current data center growth rate that we will need 10 new power plants before 2012 just to support IT growth! http://www.energystar.gov/index.cfm?c=prod_development.server_efficiency_study The use of close coupled cooling results in less energy loss in moving the air through the data center, saving fan energy, as well as reduces the cost to produce chilled water. This can result in significant energy usage reduction to cool the IT load, the place where the biggest impact can be seen today.

36. A Look Back… Now Then

37. Drawbacks of Closed Couple If you are using water cooled CRAH units, then its already there! The technology has been around for better than 50 years. As densities rose in the 70s with TTL logic, water was required, with the advent of CMOS, it went away, but our densities are back where water is needed. Bringing the cooling to the rack offers major advantages! Mainframes in these data centers were cooled via water, direct to the chips!

38. 7 Top Cooling Considerations Focus on complete data center cooling designs Provide complete cooling redundancy Include a comprehensive monitoring and alarm system at all component levels Understand The Complete Facility Hot/cold aisle – common aisle for exhaust Placement of vented or cutout floor tiles Air flow paths Consider alternate cabinet configurations Supplemental Cooling Systems Close Couple Cooling Energy-efficient, cost –effective way Group common products together Develop component installation standards Plan for new cooling solutions

40. Q&A To Receive a Copy of Today’s Presentation: [email_address]