2. Data Center Design
2
Contents
1. Characteristics of an Outstanding Design
2. Guidelines for Planning a Data Center
3. Data Center Structures
4. Raised Floor Design and Deployment
5. Design and Plan against Vandalism
6. Modular Cabling Design
7. Points of Distribution
8. ISP Network Infrastructure
9. ISPW
AN Links
10. Data Center Maintenance
4. Data Center Design
4
Characteristics of an Outstanding Design
The following are some features for design of an outstanding data center:
• Design must be simple
• Design must be scalable
• Design must be modular
• Design must be flexible
5. Data Center Design
5
Design Must be Simple
• To make the work simpler for those using the facility, all cables, circuit breakers, servers, storage
devices, network ports, and power outlets must be labeled.
• The grid location of the tile must be kept online so it can be readily accessed by others.
• It is also simple to service or replace existing hardware.
6. Data Center Design
6
Design Must be scalable
• The design, once finalized, must work for any size of data center— 50,000, 5,000, or even 500
square feet.
7. Data Center Design
7
Design Must be Modular
Ancient Greeks, Romans, and Zoroastrians built large complex structures using small, manageable
units that could be designed and manufactured easily. Data centers must also be constructed with
small building blocks that can further be divided into smaller blocks for higher granularity.
8. Design Must be Flexible
It is impossible to predict the technical requirements for the data center which is 10 years old. To build
a successful data center for long-term use, it must be easy to upgrade and to change layout or
components.
8
Data Center Design
10. Guidelines for Planning a Data Center
Following is a list of the key guidelines for design, construction, and deployment of a data center:
1. Plan in advance
2. Plan for the worst
3. Plan for growth
4. Simplify your design
5. Plan for changes
6. Label all equipment, especially cables and ports
10
Data Center Design
11. Guidelines for Planning a Data Center
1. Plan in advance
The sooner you start planning, the quicker you will discover potential problems and have
time to think of and implement solutions. It removes the “Oops, I didn’t see this coming!”
factor. A man in my neighborhood once told me, “I am not afraid of getting hit by the truck
racing toward my face. I am afraid of ones racing toward my back.”
2. Plan for the worst- At least you will have thought of solutions to any impending problems
3. Plan for growth- The data center most probably will be in use longer than originally
planned. Relocation is cumbersome and companies do not relocate unless absolutely
necessary.
11
Data Center Design
12. Guidelines for Planning a Data Center
1. Simplify your design- If it is complicated, changes will take more time and money and
cause financial losses and emotional upheaval.
2. Plan for changes-Design must be modular and flexible to accommodate changes and
growth
3. Label all equipment, especially cables and ports-Maintenance and adding servers or
devices will take less time. More importantly, they will be less likely to create
unwarranted problems.
12
Data Center Design
14. Data Center Design
14
Data Center Structures
Data Center Structure describes the essential elements within each data center. The essential
elements are:
• No-Raised or Raised Floor
• Aisles
• Ramp
• Compulsory Local Building Codes
15. Data Center Design
15
No-Raised or Raised Floor
No-raised floors are common in ISP and co-location (CoLo) data centers that have cages for different
customers. These have no subfloor space for cables or air conditioning, but they have certain
advantages. The wire-fenced cages go from floor to ceiling and each cage is rented to a customer.
17. Data Center Design
17
No-Raised or Raised Floor
A raised floor has about 2 feet of space (called plenum) below the tiles. The space provides a good
mechanism for network cabling, power distribution, and air conditioning.All cables are neatly arranged
along wire ways and cable trays in the subfloor plenum. For these advantages, a number of modern ISP
and CoLo data centers have raised floors.
18. Data Center Design
18
Aisles
Aisles refer to the space between two rows of racks.Aisles and open spaces around the corners and walls
need to be wide enough to move racks and large heavy equipments. There must be enough space to
remove and roll out a broken rack and roll in a new rack.
19. Data Center Design
19
Ramp
Ramp is the most common and practical way to get equipment in or out of a data center. The ramp must
support the weight of the equipment, people, and mechanical devices used to lift the equipment. Ramps
that must support heavy weights are made of poured concrete.
20. Data Center Design
20
Compulsory Local Building Codes
The local city authorities have codes that must be met by the design. Also, the insurance companies
require the data center to adhere to certain specifications that would decrease the extent of damage by
natural disasters.
22. 31
being accidentally unplugged or kicked around by data-center people.
Data Center Design
Raised Floor Design and Deployment
Araised floor is constructed on a grounded framework of vertical pedestals and stretchers that support
floor tiles . The space below the tiles is called the plenum. The raised floor provides the following:
• Aplace for the equipment to sit. The tiles must be strong enough to support the weight of the
equipment.
• Grounding for the equipment.
• Ameans to channel cold air from the HVAC (heating, ventilation, and air conditioning) units
throughout the plenum in an optimal manner and direct it up to the data center to cool the
equipment.
• A place to route network cables and power outlets and cables for equipment on the tiles. Since
they are under the floor tiles, the data center looks less congested. The cables are also safe from
23. Data Center Design
23
Plenum
The word plenum (pronounced PLEH-num) means “full” in Latin. It is the space between the data center
subfloor and the floor tiles, and is usually between 11⁄2 to 2 feet in height. The HVAC (Heating,
Ventilation, and Air Conditioning ) must be capable of pressurizing the plenum. The open structure in the
plenum contains a floor grid system (pedestals and stringers) that must be strong enough to support the tiles
and maximum expected weight on the tiles, HVAC units, dollies, forklifts, and people in the data center.
The plenum contains the power outlets and network cables for equipment in the racks.
24. Data Center Design
24
Floor Tiles
The raised floor consists of tiles or floor panels that provide a supporting base for the racks and
equipment. They are generally 2-feet squares. Tiles are usually made up of metals such as cast aluminum.
You must choose tiles whose maximum load specifications exceed your requirements. Cast aluminum
tiles can support a load of up to 1,500 pounds, even if they have a 50 percent pass through. Tiles made of
concrete or compressed wood can support only up to 500 pounds and, therefore, should be avoided.
26. Data Center Design
26
Equipment Weight and Tile Strength
One of the central issues impacting data center design is the weight, power, and cooling requirements of
the equipment located therein.
1. Point load
2. Static load
27. Data Center Design
27
Point Load
Most equipment or racks sit on four rollers, casters, or feet. The load on any one of these four feet is
called point load.
Example
An IBM p690 server weighing 2,600 pounds has a point load of 650 pounds on each of its feet. If its
feet rest on 1 square inch, the tile must be capable of bearing 650 pounds on 1 square inch without
deflection of more than 1 or 2 mm.
28. Data Center Design
28
Static Load
The sum of all point loads on the tile. If each of two racks with point loads of 700 pounds per feet have
one foot on a particular tile, that tile will be subjected to a total of 1,400 pounds. The tile must therefore be
rated for 1,400 pounds of static load.
29. Data Center Design
29
Electrical Wire Ways
A wire way is a long metal box containing electrical wiring and power outlets for equipment. It is
usually located below the tiles or panels. The power cords from servers and devices in the data center
are routed through cutouts in the tiles to these power outlets. The outlets are, in turn, connected by
electrical wiring to circuit breakers and subpanels. Alternatively, you can run power cables directly
from each breaker to the floor. But this would create two problems: They obstruct air flow in the
plenum, and they create a mess of the cables.
30. Data Center Design
30
Cable Trays
• Cable trays help reduce the cable mess.
• They are U-shaped wire baskets that usually run parallel to the wire ways and contain the length
of the cables.
• The cable lengths snake along the cable tray to the power outlets.
• Cable trays are not necessary but are useful.
• The cable tray should not be placed very close to the bottom of the raised floor tile.
32. Data Center Design
32
Design and Plan against Vandalism
• The data center must be selected in a building or neighborhood where it is easy to control access.
• Check for existing doors, windows, or ventilators that open to the outside and uncontrolled areas.
• The design must include various monitoring devices. Install surveillance cameras at various
locations, especially at entrances, such that they record the facial view of those entering the area.
• Motion detectors and alarms must be installed at various locations. If data-center space is shared
with other companies, each company must have separate areas with physical barriers.
33. Data Center Design
33
Design and Plan against Vandalism
When designing a data center, plan ahead. New factors unfold and must be resolved before starting the
construction phase. Keep the design simple. It is easy to set up and manage. Root causes of problems are
easy to identify and resolve. Following are some hints:
1. The design must be modular
2. Label everything
3. Document everything
4. Isolate cables
5. Use cast aluminum tiles
34. Data Center Design
34
The design must be modular
• Use patch panels for Cat5 and fiber connections.
• Segment the data center with sets and keep them independent of each other.
• Each set must have its infrastructure equipment in a single rack called the point of distribution
(POD).
35. Data Center Design
35
Label Everything
• This includes ports, cable ends, and devices.Also, label the physical grid locations in the data center.
• If the north-south side is labeled with alphabets, the east-west side must be labelled as numbers.
36. Data Center Design
36
Document everything
• This includes device details, location, and software components.
• Equipment location in the data center must be documented online.
38. Data Center Design
38
Use cast aluminum tiles
They are strong and will be able to handle increasing weights of future equipment and densely packed
racks.
40. Data Center Design
40
Modular Cabling Design
Aset of racks contains servers, terminal servers, and so forth that need Cat5 fiber cable connections.
There are two ways to do this:
• Cable hosts directly to the switch ports.
• Use patch panels.
42. Data Center Design
42
Points of Distribution
A point of distribution (POD) is a rack with devices, network switches, terminal servers, and patch
panels that together provide the infrastructure required for a number of racks filled with servers and
storage.
PODs allow you to group cables and networking equipment required for a set of racks into a single
manageable location.
43. Data Center Design
43
Points of Distribution
APoints of Distribution (POD) rack contains the following three items:
1. Cross-Patch Ports
2. Network Terminal Servers
3. Network Sub Switches
44. Data Center Design
44
Cross-Patch Ports
Cat5 and fiber connections can be cross-patched.
The POD has several ports that are wired to ports in the network room.
Each port in a POD must be labelled with the same identifier as its corresponding port in the
network room.
45. Data Center Design
45
Network Terminal Servers
Aterminal server is a device on the network that allows you to log in to a server’s console port,
which is usually a serial port.
The terminal server is sometimes known as a port master.
46. Data Center Design
46
Network Sub Switches
Small switches used to connect servers to a certain network, such as the administrative or backup
network, can be located inside a POD. These switches must be connected to the master switch via a
link with higher bandwidth than the sub switch-to-host links.
48. Data Center Design
48
No-Raised or Raised Floor
Access to the Internet is provided by an Internet service provider (ISP) such as UUNet,AT&T, Sprint,
and Nippon Telegraph and Telephone (NTT). There are two components that an ISP provides:
1. ISP Network infrastructure
2. ISPW
AN links
50. Data Center Design
50
Network Operations Center (NOC)
• The network operations center (NOC) is a dedicated facility staffed with people who monitor the
availability of all devices and services within the data center and respond to any data-center problems.
• ANOC serves as a central logging point for all alarms and a location for evaluating the present status
of the data center.
51. Data Center Design
51
Network Monitoring
• Acritical requirement for data centers is the ability to proactively monitor the availability of all server
and network resources.
• Network monitoring gathers real-time data and classifies it into performance issues and outages.
• Performance issues are used to predict the need for future scaling of the environment.
• Outages are alerted to on-call staff as a page or an urgent phone call from the NOC.
52. Data Center Design
52
Simple Network Monitoring Protocol (SNMP)
• Simple network monitoring protocol (SNMP) is the most helpful tool in resource monitoring.
• It lets you discover what resources are out there and their status.
• It is used to send information about the health of resources to a central collection host.
• It enables various tools to organize incoming information in a logical and graphical manner.
• SNMP is a protocol that runs over user datagram protocol (UDP).
53. Data Center Design
53
In-Band and Out-of-Band Monitoring
• In-band monitoring: In-band monitoring is the capability to change system status through the
existing network infrastructure.
• Out-of-band monitoring: Out-of-band monitoring is the capability to control systems not through
existing network infrastructure but via a different data network or via a dial-in capability for
individual devices.
54. Data Center Design
54
In-Band and Out-of-Band Monitoring
Besides monitoring the devices, servers, and storage subsystems, several other data center–wide features
must be monitored, such as:
• Power from the utility provider
• UPS status and usage
• Generator status and usage
• Leak detection from HVAC and air ducts and from liquid in the HVAC units
• Temperature in the data center
• Relative and absolute humidity in the data center
• Intrusion in the facility
55. Data Center Design
55
Data-Center Physical Security
• Acritical component of server and data security is the security of the data center itself.
• All entry points and doors to the data center must be controlled by card readers or persons who are
physically present to monitor and restrict access of those entering the data center.
56. Data Center Design
56
Types of Data Centers
There are two types of data centers:
1. Co-location (CoLo) data centers
2. Managed-hosting data centers
57. Data Center Design
57
Co-Location (CoLo) Data Centers
Hundreds or thousands of customers pass or visit a co-location data center each day. It is therefore
vital to control and monitor the visits and list of people who have access to the data center. Despite all
precautions and security, visitors can damage other customers’equipment.
58. Data Center Design
58
Managed-Hosting Data Centers
In a secure managed-hosting data center, only a few employees have access to the data center.
Customers do not have badges or passes to go inside. If they wish to go inside, they must be escorted
and given temporary badges. Large groups of visitors are not allowed to go in. Most of these data
centers use a biometric system to control access. The advantage of these systems is that the activity is
logged, it is not possible to use someone else’s card to go in, and any employees who are no longer
entitled to go inside the data center can be instantly removed.
59. Data Center Design
59
Summary
It is important to get the design right because retrofitting a data center is too expensive and unwieldy.
Adata-center design must be simple to modify and manage, scalable to accommodate the future needs
without any changes, and modular and flexible so upgrades can be made if necessary.
Common structures within a data center are raised floor, aisles, floor tiles, subfloor plenum and ceiling
plenum, electrical wire ways, and cable trays.
All equipment, cable ends, and grid locations must be labelled in an orderly manner.
All cable connections must be well labelled.
Internet access from ISPs must be redundant and reliable.
Network monitoring makes it possible to be a proactive network or system administrator.
60. Data Center Design
60
Assignment Questions
1. Explain the characteristics of an outstanding design of a data center.
2. Explain the key guidelines for design, construction and deployment of a data center.
3. Why is it necessary to have raised flooring in a data center?
4. What is the role of NOC in a data center?
5. Write a note on SNMP.
61. Data Center Design
Topics URL Notes
Characteristics of an
Outstanding Design
https://searchsqlserver.techtarget.com/featur
e/Characteristics-of-an-outstanding-data-
center-design
This link explains about
Characteristics of an Outstanding
Design of data center.
Guidelines for Planning
a Data Center
https://searchsqlserver.techtarget.com/featur
e/Characteristics-of-an-outstanding-data-
center-design
This link explains the some
guideline that should be followed
to design a datacenter.
Raised Floor Design and
Deployment
https://www.esds.co.in/blog/raised-floors-in-
data-centers/#sthash.VSso4Hvw.dpbs
This link define the use of tiles,
raised floor design and
deployment.
Simple Network
Management Protocol
https://www.techopedia.com/definition/5473
/simple-network-management-protocol-snmp
This link explain the SNMP and its
role in ISP and its working.
Types of Data Centers
https://www.netmagicsolutions.com/blog/ma
naged-hosting-vs-colocation-choose-the-right-
mix-for-your-business
This link explain the Managed and
Collocation data center.
Document Links
61
62. Data Center Design
Topics URL Notes
Floor plan
https://www.youtube.com/watch?v=
xs3Yp3ISlEc
This link explain the Floor plan for Data
center design.
Raised floor
https://www.youtube.com/watch?v=
mF8OKQFzS-Y
This link describe the essential elements
within each data center
Data Center Maintenance
https://www.youtube.com/watch?v=
cb4r3Fa71bA
This link describe the guideline of Data
Center Maintenance
ISP Infrastructure
https://www.youtube.com/watch?v=
HBrN22B-1-Y
This link describe the ISP Infrastructure
and its role in data center.
WAN
https://www.youtube.com/watch?v=
KWFdC-or4F0
This link explain the WAN.
Video Links
62
63. Data Center Design
63
EBook's Links
Topics URL Page Number
Characteristics of an
Outstanding Design
http://www.voiceip.com.ua/lit/Jayaswal%20K.%20%20Administering%20Da
ta%20Centers[c]%20Servers,%20Storage,%20And%20Voice%20over%20IP
%20(2005)(en).pdf
Page No 37
Guidelines for Planning a Data
Center
http://www.voiceip.com.ua/lit/Jayaswal%20K.%20%20Administering%20Da
ta%20Centers[c]%20Servers,%20Storage,%20And%20Voice%20over%20IP
%20(2005)(en).pdf
Page No 38
Data Center Structures
http://www.voiceip.com.ua/lit/Jayaswal%20K.%20%20Administering%20Da
ta%20Centers[c]%20Servers,%20Storage,%20And%20Voice%20over%20IP
%20(2005)(en).pdf
Page No 39 to page No 41
Raised Floor Design and
Deployment
http://www.voiceip.com.ua/lit/Jayaswal%20K.%20%20Administering%20Da
ta%20Centers[c]%20Servers,%20Storage,%20And%20Voice%20over%20IP
%20(2005)(en).pdf
Page No 42 to Page No 49
Network Infrastructure in a
Data Center
http://www.voiceip.com.ua/lit/Jayaswal%20K.%20%20Administering%20Da
ta%20Centers[c]%20Servers,%20Storage,%20And%20Voice%20over%20IP
%20(2005)(en).pdf
Page No 51 to Page NO 60
Data Center Maintenance
http://www.voiceip.com.ua/lit/Jayaswal%20K.%20%20Administering%20Da
ta%20Centers[c]%20Servers,%20Storage,%20And%20Voice%20over%20IP
%20(2005)(en).pdf
Page No 61 to Page No 66