The Open Compute Project data center project team has been working on creating a Colocation facilities guide and quality checklist to assist colocation operators and their tenants with understanding the requirements needed to enable the smooth and trouble free deployment of Open Racks in data centers.
Mark Dansie's talk covered some of the real world challenges that many colocation facilities will face when needing to take delivery of heavy pre-built Open Racks, and included an overview of the various sub systems, their attributes and the parameters that have been included in the check list.
For more information contact mark.dansie@inflectiontech.net
2. Agenda
1. Background & Key Objective
2. Guidelines
• Definitions, Acronyms, Abbreviations & Units of Measuement
• Data Center Access
• Architectural
• Cooling
• Electrical Systems
• Telecommunications Cabling Infrastructure, Pathways & Spaces
• Appendices
3. Checklist for an OCP Rack
4. Questions?
3. Open Compute Rack Types
Open Rack v2.0 CG-OpenRack-19 Project Olympus
4. Definitions, Acronyms, Abbreviations
and Units of Measurement
OR Open Rack
OU OpenU is the Open Rack equivalent of the rack
mount spacing found in an EIA-310 19” rack.
1 OU = 48mm vs 1 RU = 44.5mm
Out Of Band (OOB) Is the use of a dedicated channel typically
Ethernet for managing network switches, servers
and storage devices.
PDU (V2) The AC power distribution unit is designed to
accept an input voltage of 3-phase WYE wiring
230/400VAC RMS voltage (4 wires + ground).
The five wires will be split into two outputs via a
terminal block, which will then be terminated via a
Positronic connector with a custom over-molding.
There will be no fuses or other secondary safety
devices
7. Architectural: White Space
White Space slab to slab and ceiling heights
Ceiling slab
Floor slab
Optimum
Min 4.5 m
Acceptable
Min 3.1 m
Acceptable
Min 3.1 m
Access floor
Access ceiling
900 mm to
450 mm
8. Architectural: Floor Loading
Spreader plates can be used to
increase rolling load capacity
A full OCP rack can weigh more
than traditional IT equipment
15. OCP Web Links and more
information
Ask
Mark Dansie
+44 7986 502896
mark.dansie@inflectiontech.ne
t
Website
http://www.opencompute.org/
Data Center Project Wiki
http://www.opencompute.org/wiki/Data_Center
Colo Facility Guidelines for OCP Racks v1.0
https://tinyurl.com/y9byx7ya
Colo Facility Guidelines – Checklist v1.0
https://tinyurl.com/ya3tuy3r
Data Center Project Mailing List
http://lists.opencompute.org/mailman/listinfo/opencompute-
datacenter
Background / Key Objective
OCP IT Gear in Open Racks an OCP Data Center project – sub project was formed and tasked to produce a guidelines and quality checklist document that would be used as an aid for the operators of colocation data centers and their tenants to understand the requirements that will be required to enable the smooth and trouble free deployment of Open Racks.
The initial project work has been focused on considering the needs of an European colo facility that will need to accommodate an Open Rack V2 weighing 500 kg and with an IT load of 6.6kw this will help us to quickly publish a MVP document & checklist.
Open Rack v2.0
600mm typical, but can vary
Standard: ~1048mm
Shallow: ~ 762mm
Height variable usually 42U
500 - 1400kg
21”
48mm
OpenU (OU)
primarily front only
3 phase AC rack PSU to 12V or 48 VDC busbar distribution
optional
in-rack Li-ion
Typically 3 phase AC
230/ 400 VAC
front to back
CG-OpenRack-19
600mm
1200mm
Height - variable
Weight variable 500 - 1500kg
19”
Standard EIA-310
44.45mm (1.752”)
Standard EIA-310
primarily front only
3 phase AC rack PSU to 12VDC busbar distribution
optional
in-rack Li-ion
3 phase AC
90 - 264VAC
front to back
Project Olympus
Any Standard EIA-310 rack
Any Standard EIA-310 rack
Any Standard EIA-310 rack
Weight TBD
19”
Standard EIA-310
44.45mm (1.752”)
Standard EIA-310
primarily front only
3 phase PSU internal to server
optional
in-server Li-ion
3 phase AC
230/ 400 VAC
front to back
An aide-memoire for those new to Open Compute abbreviation, terms etc
Clearances
Racks having to be unpacked outside of the loading dock because there wasn’t sufficient height to get them into the loading dock.
MUST HAVE
ACCEPTABLE - Access routes from loading dock to Goods in Area (Storage) delivery pathway 2.7m High x 1.2m -Wide unobstructed access and threshold free
OPTIMUM - 2.7m High x 2.4m Wide x 2.4 m Deep - unobstructed access and threshold free
CONSIDERATION
NICE TO HAVE – PALLET RAMP
The rack packaging came without a ramp and the colo operator was unprepared for this so the rack had to be gently titled and slid off the pallet to get it on the slab.
NICE TO HAVE -
Delivery
Tell the story of the recent project where the Open Rack was delivered on a truck without a tail lift without safety rails and the ramp titled over when it was lowered and four people had to steady the rack it as it was lowered to stop it toppling over.
Tell the story of the door frame height into white space not being high enough as a ramp finished at the threshold of the door, the engineers then decided to use a crow bar between the top of the rack and the cabinet to raise the height of the door frame.
Delivery pathway to the white space
MUST HAVE
ACCEPTABLE- Ramps - Gradient1:12
OPTIMUM - None
ACCEPTABLE - Lift / Elevator Weight Loading1500kg
OPTIMUM - Lift / Elevator Weight Loading 3000kg
Discuss Considerations
Loading dock
Goods in area
Unboxing / Staging area
Unacceptable and acceptable ramp construction
Door frame heights
Floor protection e.g. spreader plates
White Space
MUST HAVE
Acceptable - White Space finished floor to ceiling height 3.1m
OPTIMUM - White Space finished floor to ceiling height 4.5m
Discuss Considerations
Door frame heights
Slab to slab heights
Access floor used for cooling or not
Floor loads – rolling loads use of spreader plates
Ramp gradients
Rails
Floor Loading
MUST HAVE
Acceptable White Space access floor uniform load 7.17 kn/m2
732 kg/m2 (150 lb/ft2)(7.17 kn/m2)
Acceptable White Space access floor rolling load 5.56 kn/m2
567Kg (1250lb) (5.56kn)
OPTIMUM White Space access floor uniform load 111.97 kn/m2
1221 kg/m2 (250 lb/ft2) (11.97 kn/m2)
OPTIMUM - White Space access floor rolling load 6.67 kn/m2
680Kg (1500 lb) (6.67kn)
Story
Tell the story of the floor strengthening works that had to be carried out during my current fit out project.
Tell the story re: rolling load specification of the access floo within the corridors outside of the white space were insufficient therefore spreader plates had to be used, this increased the installation time and cost of the project.
The access floor load specification was greater than the slab floor load specification and as the white space was on the 2nd floor additional steel supports had to be installed within the access floor void, which delayed the project.
Cooling
Discuss Considerations
ACCEPTABLE -HAC/ CAC
OPTIMAL - HAC
MUST HAVE - Rack airflow direction (front to back)
MUST HAVE - Rack inlet temperature temp set point to Ashrae recommended
MUST HAVE – Blanking Plates
MUST HAVE - Delta T of 12
Electrical Distribution
Discuss Considerations
OPTIMAL/ CONSDIERATION - Non Central, upstream UPS to the rack with the supply taken from the input of the UPS distribution board–
ACCEPTABLE - Central, upstream UPS to the rack
MUST HAVE - Single phase AC voltage nominal range 180V – 264V is the tolerable range
CONSIDERATION - Monitoring the health of the power shelf BBU (Li-ion batteries)
MUST HAVE - 3 phase 16A
CONSIDERATION - 3 phase 32A
MUST HAVE - 6.6KW
CONSIDERATION - 12.5kW – 32A
CONSIDERATION - Genset startup time
Pathways & Telecommunications
Discuss Considerations
Pathways
Can network connections be routed from overhead pathways to the front of the rack
Can network and power connections be routed from the access floor to the top of the rack
Can power and network connections be moved from the rear to the front of the rack
Leaf-Spine
Optimised east-west
Efficiency - A key OCP tenant is efficient design.
power delivery and conversion
thermal efficiency, p
platform performance (per-W for example)
reducing overall infrastructure costs
.
Scale - OCP contributions must be scale-out ready.
The technology is designed with the right supporting features to allow for its maintenance in large scale deployments.
Openness- OCP encourages open source contribution
comply with a set of already existing open interfaces open source contribution as possible.
Providing a solution compatible with already existing OCP contributions
Impact - New OCP contributions must create meaningful positive impact within the OCP ecosystem.
This can be attained by introducing efficiency gains, introducing new technologies and products that are valuable
for scale out computing, creating a multiplier effect by building on top of already existing OCP solutions, and enabling
a more robust supply chain by contributing alternative compatible solutions.
Detailed Quality Checklist with guidance notes
Simple Quality Checklist for auditing purposes