Microsoft PowerPoint - TIA-942 Datacenter Infrastructure Standard
Upcoming SlideShare
Loading in...5
×
 

Microsoft PowerPoint - TIA-942 Datacenter Infrastructure Standard

on

  • 2,509 views

 

Statistics

Views

Total Views
2,509
Views on SlideShare
2,509
Embed Views
0

Actions

Likes
2
Downloads
164
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Microsoft PowerPoint - TIA-942 Datacenter Infrastructure Standard Microsoft PowerPoint - TIA-942 Datacenter Infrastructure Standard Presentation Transcript

  • Telecommunications Infrastructure Standard for Data Centers ANSI/TIA-942 Chris DiMinico cdiminico@ieee.org IEEE 802.3 HSSG MC Communications
  • Data Center Standards ANSI/TIA-942 Telecommunications Infrastructure Standard for Data Centers Co-chairs: Chris DiMinico & Jonathan Jew Published 2005 – available through TIA at www.tiaonline.org ANSI/NECA/BICSI-002 Data Center Design and Implementation Best Practices co-chairs: Jonathan Jew & John Kacperski best practices – complements TIA-942 – 2007 target IEEE 802.3 HSSG
  • Who Developed TIA-942? Developed by the TIA TR-42.1.1 Network Distribution Nodes subcommittee as Project No. 3-0092 Participants included: Architecture & Engineering Firms Consultants End Users Manufacturers IEEE 802.3 HSSG
  • Purpose of TIA-942 Encourage early participation of telecom designers in data center design process Fill a void by providing standards for planning of data centers, computer rooms, server rooms, and similar spaces. The standard encompasses much more than just telecommunications infrastructure. Close to half of the technical content deals with facility specifications. IEEE 802.3 HSSG
  • Purpose of TIA-942 Define a standard telecommunications infrastructure for data centers Structured cabling system for data centers using standardized architecture and media Accommodates a wide range of applications (LAN, WAN, SAN, channels, consoles) Accommodates current and future protocols (e.g., 10+ GbE ) Replaces unstructured point-to-point cabling that uses different cabling for different applications IEEE 802.3 HSSG
  • Purpose of TIA-942 Specifications for data center telecommunications pathways and spaces Recommendations on media and distance for applications over structured cabling Establish a standard for data center tiers to replace several proprietary standards. The TIA data center tier standard is: • A tool to evaluate existing data centers • A tool to communicate design requirements IEEE 802.3 HSSG
  • Unstructured Cabling A B C D E F G H I J K L M N O P Q R S T U V W X Y Z AA AB AC AD AE AF AG AH AI AJ AK AL AM AN AO AP AQ AR AS Heater - A/C Heater - A/C Heater - A/C 1 STORAGE POMONA FI L E F IL E FIL E POMONA DESK CABINET F IL E TABLE TABLE A/C UNIT CABI NET CABINET CABINET CABINET A/C UNIT C D ROM HP 247-7589 SCANNER PRINTER 2 #7 #6 TABLE AT &T He ater - A/C DEFINIT Y CONS OLE ROU TE R UNIT CI SCO 3 N ETW OR K N ETW OR K N ETWORK CABINET 4 CABINET H8 CABINET E7 IBM CAB NETW OR K NETWORK A6 CABINET CABINET NETWORK HALON NETWOR K NETWOR K NETWOR K NETWORK NE TWORK NE TWORK NE TWORK CAB INE T CABINET C ABINET CAB INE T C ABINET C6 CABI NET CABI NET CABI NET N ETW OR K NETWORK N ETW ORK B7 N ETW OR K PANEL I7 I8 I6 I4 NETWORK IBM I5 I3 I2 I1 CABINET CABINET CABINET CABINET 5 C ABINET DESK H7 G7 F6 IBM N ETWOR K A5 E6 3745-A11 NETW OR K CABINET 3746-900 CABINET N ETW ORK C5 B6 N ETW OR K N ETWOR K NETWORK CABINET CABINET C ABINET NETWORK CABINET 6 H6 G6 F5 C ABINET NETW OR K N ETWOR K A4 F/X E5 IBM CABINET CABINET 247-7543 NETWORK N ETW ORK C4 B5 N ETW OR K NETWORK 3745-41D CABINET C ABINET NETWORK IBM CABINET CABIN ET 7 H5 G5 F4 C ABINET E4 3745-17A NETW OR K CABINET N ETWOR K CABINET A3 HALON ABORT NETWORK C3 B4 N ETW OR K HALON NETWORK N ETW ORK CABIN ET CABINET RELEASE TAPE RACK CABIN ET C ABINET NETWORK IBM TAPE RACK G4 8 H4 F3 C ABINET E3 SAA 3745-L13 NETW OR K CABINET N ETWOR K CABINET A2 NETWORK NETWORK N ETW ORK CABIN ET C2 B3 PA C BELL C ABI NE T POMONA CABIN ET C ABINET NETWORK D2 NETWORK A/C UNIT CABIN ET A1 G3 F2 C ABINET NETW OR K 9 H3 E2 CABINET N ETWOR K CABINET #8 SAA NETWORK LAN C1 B2 NETWORK CABIN ET CABIN ET CABINET NETWORK CABIN ET D1 G2 F1 C ABINET H2 N ETWOR K 10 E1 CABINET B1 IBM NETWORK NETWORK CABIN ET CABIN ET IBM S-390 G1 IBM H1 11 DASD DASD R34 12 247-7538 13 LOCKER INSTALL A CABLE WHEN YOU NEED IT 3174 3174 3174 3174 3174 3174 14 STORAGE LIEBERT STORAGE CABINET CABINET CABINET CABINET CABINET CABINET IBM TABLE PDU -C IBM (SINGLE-USE, UNORGANIZED CABLING) TAPE RACK CABINET CABINET AS -400 AS-400 STORAGE C ABINE T 15 16 IEEE 802.3 HSSG
  • Structured Cabling A B C D E F G H I J K L M N O P Q R S T U V W X Y Z AA AB AC AD AE AF AG AH AI AJ AK AL AM AN AO AP AQ AR AS Heater - A/C Heater - A/C Heater - A/C 1 STORAGE POMONA FIL E FIL E FIL E POMONA DESK CABINET FILE TABLE TABLE A/C UNIT CABINET CABINET CABINET CABINET A/C UNIT CD ROM HP 247-7589 SCANN ER PRINTER 2 #7 #6 TABLE AT&T DEFINITY Heater - A/C CON SOLE ROUTE R UNIT CISCO 3 NETWORK FIBER MDF COPPER NETWORK IBM 3745s NETWOR K 4 CABINET & CORE C ABINET MDF C ABINET IBM H8 NETWORK NETWORK A6 E7 CAB C ABINET NETWO K CABINET NE TWORK NE TWORK NE TWORK H ALON NETWORK NETWORK NETWORK R NETWORK CAB INE T CABI NET CABIN ET CAB IN ET C6 C ABI NET CABINET CABINET C ABINET NETWORK NETWORK NETWOR K B7 NETWOR K PANEL IDF I8 I7 I6 I4 N ETWORK I5 I3 I2 I1 C ABINET CABINET C ABINET IBM C ABINET 5 F6 CABINET DESK H7 G7 IBM NETWORK A5 E6 3745-A11 NETWORK C ABINET CABINET 3746-900 B6 NETWORK NETWORK NETWOR K C5 NETWOR K CABIN ET C ABINET N ETWORK C ABINET C ABINET F/X 6 IDF H6 G6 F5 CABINET E5 IBM NETWORK C ABINET NETWORK CABINET A4 247-7543 N ETWOR K C4 B5 NETWOR K N ETWOR K NETWORK 3745-41D C ABINET C ABINET CABIN ET N ETWORK IBM C ABINET 7 H5 G5 F4 CABINET E4 3745-17A NETWORK C ABINET NETWORK CABINET A3 H ALON ABORT NETWORK C3 B4 NETWOR K H ALON N ETWOR K NETWORK CABIN ET N ETWORK C ABINET RELEASE T APE RACK TAPE RACK C ABINET CABIN ET IBM 8 H4 G4 F3 CABINET E3 SAA 3745-L13 NETWORK C ABINET NETWORK CABINET A2 NETWORK NETWORK CABINET C2 B3 N ETWOR K PAC B ELL C A BIN ET POMONA CABIN ET CABIN ET N ETWORK D2 A/C UNIT C ABINET A1 G3 F2 CABINET NETWORK 9 H3 E2 IDF C ABINET IDF NETWORK CABINET #8 SAA Mainframe N ETWOR K C ABINET NETWORK CABIN ET LAN CABINET N ETWORK C ABINET D1 C1 B2 10 H2 G2 F1 CABINET E1 NETWORK IDF CABINET B1 IDF IBM N ETWOR K NETWORK IBM IBM S-390 IDF IDF C ABINET H1 IDF IDF CABIN ET G1 11 DASD DASD R34 12 247-7538 13 STRUCTURED CABLING SYSTEM (ORGANIZED, LOC KER 3174 3174 3174 3174 3174 3174 14 LIEBERT CABINET CABINET CABINET CABINET CABINET CABINET REUSABLE, FLEXIBLE CABLING) T ABLE STORAGE PDU- C STORAGE IBM IBM TAPE RACK CABINET CABINET AS-400 AS-400 S TOR AGE C AB IN ET 15 16 IEEE 802.3 HSSG
  • Design Elements Cabling Design Facility Design Network Design Informative annex’s: Provide best practices Annex A - Cabling Design Considerations Annex B- Telecommunications infrastructure administration Annex C-Access provider information Annex D- Coordination of equipment plans with other engineers Annex E- Data center space considerations Annex F- Site selection IEEE 802.3 HSSG
  • Design Elements Cabling Design: Copper and fiber cabling performance Connectors, cables, distribution hardware Cabling distances Space management Facility Design: Data center sizing Power distribution methodologies Pathways and spaces HVAC, security, operations, and administration. Flexibility, scalability, reliability and space management IEEE 802.3 HSSG
  • Design Elements Network Design: Support of legacy systems Enable rapid deployment of new and emerging technologies such as 10 GbE and 10+ GbE copper and fiber applications. IEEE 802.3 HSSG
  • Relationship of Spaces BUILDING SITE BUILDING SHELL GENERAL OFFICE TELECOM ROOMS & OFFICE BUILDING SPACE EQUIPMENT ROOMS SUPPORT SPACE for spaces outside data center DATA CENTER SUPPORT ENTRANCE DATA CENTER STAFF ROOM(S) ELECTRICAL & OFFICES MECHANICAL ROOMS OPERATIONS TELECOM ROOM(S) STORAGE ROOMS CENTER for data center & LOADING DOCKS support spaces COMPUTER ROOM IEEE 802.3 HSSG
  • Data Center Topology Entrance Room Entrance Carriers Active Equip Carriers Facility interconnect Offices, Operations Center, Support Rooms Secondary Entrance Room Active Equip Active Equip Carriers interconnect MC MC interconnect Carriers Back bone Cabling HC IC IC HC HC IC HC IC Zone Horizontal Distribution Cabling interconnect interconnect interconnect interconnect Active Equip Active Equip Active Equip Storage Area Active Equip Devices Data Center IEEE 802.3 HSSG
  • TIA-942 Spaces Entrance Room (ER) - location of interface with campus and carrier entrance facilities Main Distribution Area (MDA) – location of main cross-connect (MC) Horizontal Distribution Area (HDA) – location of horizontal cross-connect (HC) Zone Distribution Area (ZDA) – location of zone outlet (ZO) or consolidation point (CP) Equipment Distribution Area (EDA) – location of equipment cabinets and racks IEEE 802.3 HSSG
  • Data Center Cabling Main MC MC Distribution Area Backbone Cabling Horizontal Horizontal Cabling HC IC HC IC Distribution Area Zone interconnect Distribution Area Equipment interconnect interconnect Active Equip Distribution Active Equip Active Equip Area Horizontal cabling is the cabling from the horizontal cross-connect (in the main distribution area or horizontal distribution area) to the outlet in the equipment distribution area or zone distribution area. IEEE 802.3 HSSG
  • Horizontal and Backbone Cabling Recognized Cables: a) 100-ohm twisted-pair cable (ANSI/TIA/EIA-568- B.2), category 6 recommended (ANSI/TIA/EIA- 568-B.2-1) b) multimode optical fiber cable, either 62.5/125 micron or 50/125 micron (ANSI/TIA/EIA-568-B.3), 50/125 micron 850 nm laser optimized multimode fiber is recommended (ANSI/TIA-568-3-1) c) singlemode optical fiber cable (ANSI/TIA/EIA- 568-B.3) d) 75-ohm (734 and 735 type) coaxial cable (Telcordia Technologies GR-139-CORE) IEEE 802.3 HSSG
  • Horizontal cabling distances The maximum horizontal distance is 90 m independent of media type. The maximum channel distance including equipment cords is 100 m. The maximum cabling distance in a data center not containing a horizontal distribution area is: 300 m for an optical fiber channel including equipment cords. 100 m for copper cabling including equipment cords. IEEE 802.3 HSSG
  • Backbone Cabling Includes cabling from MDA to ER, HDA Optional cabling between HDAs allowed Maximum backbone cable lengths depend on applications to be supported Centralized optical fiber cabling supported with interconnect, splice, or pull-through at the HDA Star topology with no intermediate cross- connects Various topologies permit redundancy and flexibility to support various data center sizes IEEE 802.3 HSSG
  • Computer Room & Entrance Room Requirements Min clear height of 2.6m/8.5 ft Min door size 1m/3ft wide 2.13/7ft high Min dist floor loading 7.2 kPA/150lbf/ft2, recommended min 12 kPA/250 lbf/ft2 20 degrees C to 25 degrees C 40% to 55% relative humidity (reduces ESD) Any sprinkler systems must be pre-action system Common bonding network (CBN) – equipotential ground reference IEEE 802.3 HSSG
  • Main Distribution Area Location of Main Cross-Connect (MC), the central point of distribution for data center structured cabling system Centrally located to avoid exceeding maximum distance restrictions (typically for E- 1s, E-3s, T-1s and T-3s) Install separate racks for Fiber, UTP, and coaxial cable distribution IEEE 802.3 HSSG
  • Horizontal Distribution Area Location of Horizontal Cross-Connect (HC), the distribution point for cabling to equipment distribution area Distribution LAN, SAN, KVM switches and console servers located in HDA MDA may also include an HC for nearby equipment distribution area Number of HDAs depends on the density of cabling and the size of the data center IEEE 802.3 HSSG
  • Horizontal Distribution Area The capacity of the cable tray system and the size of the cross-connect creates practical limits on the size of the HC Guideline is maximum of 2,000 4-pair UTP or coax cable terminations per HDA Arrange patch bays to minimize patch cable lengths and to simplify cable management Separate racks for fiber, UTP, and coax Locate switches and patch panels to minimize patch cord lengths IEEE 802.3 HSSG
  • Zone Distribution Area Rack, cabinet, or under floor enclosure that houses a zone outlet (ZO) or consolidation point (CP) ZO - structured cabling termination for floor-standing equipment that cannot accept patch panels (e.g. mainframes and large servers). CP - intermediate termination point (e.g. cabling to areas where floor plan is uncertain or dynamic) No cross-connects within the ZDA No active equipment shall be located in the ZDA Maximum of 144 connections in a ZDA Maximum of one ZDA within a horizontal cable run IEEE 802.3 HSSG
  • Equipment Cabinets Front rails of cabinets must be recessed to provide adequate room for patch cables and wire managers Recommend 1-to-1 ratio of patching to cable management Arrange switches and patch panels to minimize patching between cabinets & racks Perforated tiles at front of cabinets One edge of cabinets placed at edge of tile IEEE 802.3 HSSG
  • Raised Floor Better appearance than overhead cabling. Allows higher power densities, better control of cooling, and more flexibility in location of cooling equipment Most stand-alone computer systems are designed for cabling from below Coordinate under floor cabling with mechanical & electrical engineers Recommend wire basket cable trays in hot aisles for telecom cabling IEEE 802.3 HSSG
  • Example of Wire Basket Cable Trays For Cabling Under Raised Floor 24" RAISED FLOOR TILE 1.375" DIVIDER 18" 9" 5" COPPER 4" FIBER CABLING SUPPORT STRUT 1" 12" 18" 36" 5" COPPER 4" FIBER CABLING SUPPORT STRUT 1" Open Area 13.5" 24" On Center IEEE 802.3 HSSG
  • Overhead Cable Trays Less expensive than raised floor systems Cable trays can be attached to the top of racks and cabinets (if they are uniform in height) Cable trays suspended from the ceiling provides more flexibility for supporting cabinets/racks of various heights and for adding and removing cabinets/racks. Cable trays can be installed with several layers Coordinate location with lighting, ducts, overhead conduits, overhead power distribution IEEE 802.3 HSSG
  • Overhead Cable Tray Example 3 Layer cable tray system: Bottom layer – signal Middle layer – power Top layer – fiber Signal Reference Grid in brackets attached to lower layer of trays Fiber patch cables may be in fiber duct attached to threaded rods IEEE 802.3 HSSG
  • Infrastructure Administration Informative annex with TIA-606-A standards compliant labeling scheme for all components. Labeling scheme extended for use in data centers Cabinets and racks labeled by location using tile grid or row/position identifiers All cabinets, racks, patch panels, cables, and patch cords should be labeled IEEE 802.3 HSSG
  • Labeling Example "X" COORDINATE AA AB AC AD AE AF AG AH AI AJ AK AL AM AN AO AP AQ AR AS AT AU AV AW AX AY AZ BA BB BC BD 01 02 Cat 6 x 24 03 04 05 06 RIGHT FRONT 07 CORNER CABINET AQ03 08 CABINET AJ05 09 10 11 12 13 "Y" COORDINATE Patch Panel for 24 Cat 6 from 1st Panel in Cab AJ05 to 2nd Panel in Cab AQ03 AJ05-A to AQ03-B Ports 01-24 01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 A A IEEE 802.3 HSSG
  • Site Selection Informative annex with guidelines for selection of a site for a data center Architectural Electrical Mechanical Telecommunications Security Other IEEE 802.3 HSSG
  • Facilities Specifications & Tiers Informative annex with general architectural, structural, electrical, mechanical, and telecommunications recommendations requirements Annex includes detailed architectural, security, electrical, mechanical, and telecommunications recommendations for each Tier Recommended specifications by tier are a uniform way to rate aspects of a data center design and are a starting point for initiating design requirements with qualified architects and engineers IEEE 802.3 HSSG
  • Data Center Tiers Tier 1 – basic data center no redundancy Tier 2 – redundant components Single distribution path with redundant components Tier 3 – concurrently maintainable Multiple distribution paths with only one active Tier 4 – fault tolerant Multiple active distribution paths IEEE 802.3 HSSG
  • Redundant Topologies Carriers Carriers Carriers Carriers Secondary Primary Customer Customer Maintenance Hole Maintenance Hole (Tier 1 and higher) (Tier 2 and higher) Tie r3 Tier 1 Tier 3 2 Data Center Tier Primary Entrance Tier 3 Secondary Room Entrance Room (Tier 1 and higher) (Tier 3 and higher) Tie r4 Tier 1 Tier 4 Offices, Operations Center, Support r3 Rooms Tie Secondary Dist Main Dist Area Telecom Room Tier 4 Area (Tier 1 and higher) (Optional for Tier 4) Computer Room Horiz Dist Area Optional Horiz Dist Area Horiz Dist Area Cabling Zone Dist Area Equip Dist Equip Dist Equip Dist Area Area Area IEEE 802.3 HSSG
  • Data Center Tiers Higher tiers correspond to higher availability, but also have higher construction costs Data Center can have different tier ratings for different portions of its infrastructure (architectural, security, mechanical, electrical, telecommunications) The overall rating for the data center is equal to the lowest tier rating Capacity of systems may need to be upgraded to maintain tier rating as data center load increases Human error and operating procedures have a major impact on availability IEEE 802.3 HSSG
  • Conclusion TIA-942 is the first standard to specifically addresses data center infrastructure. Primarily a telecom infrastructure standard, but about half of the content deals with facility requirements. Provides a flexible and manageable structured cabling system using standard media. Builds on existing standards, when applicable Guidelines on a wide range of subjects useful to someone designing or managing a data center. An official tiering standard for determining the quality of a center. A way to objectively compare one center with another. IEEE 802.3 HSSG