Telecommunications Infrastructure Standard for Data Centers Tutorial

(1)

Telecom m unications Infrastructure

Standard for Data Centers

802.3 Tutorial

Prepared by: Jonathan Jew - J&M Consultants and

Chris DiMinico - MC Communications - Co-chairs TR42.1.1

(2)

TR42: Data Center Standard

PN-3-0092 PN-3-0092

Telecommunications Infrastructure Standard Telecommunications Infrastructure Standard

for Data Centers for Data Centers

Draft 2.0 Draft 2.0 July 9, 2003 July 9, 2003

(3)

Customer Premise Internet Data Center Local Loop -service provided Service provider - Distribution Node -Central Office Service Provider Backbone •Customer lease Customer Premise Internet Data Center DATA/Voice Infrastructure Local Loop -service provided Home SOHO Home SOHO

Telecommunication Infrastructure

Service provider - Distribution Node -Central Office Enterprise _Enterprise • Data Center

• EFM- Access Networks

(4)

(5)

(6)

n Network infrastructure required to drive web hosted Internet applications.

(7)

Service Provider Distribution Node- Central Office

(8)

Switch File Servers Firewall WAN Router Internet Web Servers Email Servers Application Servers Backbone Switch / Router 1 Gb/s 10 Gb/s 100 Mb/s 10 Mb/s 1 Gb/s DWDM Infrastructure Remote Enterprise 10 Gb/s -Internet Data Center -Computer Room 1 Gb/s Equipment Room 10 Gb/s 10 Gb/s SAN 10 Gb/s LAN WAN

(9)

Cable Element Customer Premises ISO/IEC 11801-TIA

Data Center Central Office

Equipment Room

Horizontal Cabling

≤≤100 meters ≤≤100 meters ≤≤100 meters NA

Equipment-to-Equipment

≤≤100 meters ≤≤100 meters 30 meter

Cabling Topologies and Distances

(10)

Who is Developing the Standard

n

n The standard is being developed by the TIA/TR42_{The standard is being developed by the TIA/TR42}

Engineering Committee - subcommittee-TR-42.1.1 Engineering Committee - subcommittee-TR-42.1.1

Network Distribution Nodes - Project No. 3-0092 Network Distribution Nodes - Project No. 3-0092

n

n Participants include:_{Participants include:} u

u Architecture & Engineering Firms_{Architecture & Engineering Firms}

u

u Consultants_Consultants

u

u End Users_{End Users}

u

u Manufacturers_{Manufacturers}

n

n The standard will become TIA-942_{The standard will become TIA-942}

n

(11)

Status of the Standard

n

n 2₂ndnd draft released for industry ballot July 2003._{draft released for industry ballot July 2003.}

n

n Draft posted to IEEE _{Draft posted to IEEE}website_website

n

n Ballot comments to be resolved October 2003._{Ballot comments to be resolved October 2003.}

n

n Liaison with other standards organizations (IEEE,_{Liaison with other standards organizations (IEEE,}

CENELEC, BICSI, ISO,ASHRE) CENELEC, BICSI, ISO,ASHRE)

n

n Liaison with data center industry organizations_{Liaison with data center industry organizations}

(7X24 Exchange,Uptime Institute) (7X24 Exchange,Uptime Institute)

n

n Liaison with network and computer equipment_{Liaison with network and computer equipment}

manufacturers manufacturers

n

(12)

Purpose of the Standard

n

Enabling planning for data centers to occur

_{Enabling planning for data centers to occur}

earlier in the building development process

(architectural, facilities, and IT).

n

Fill a void by providing standards for

_{Fill a void by providing standards for}

planning of data centers, computer rooms,

server rooms, and similar spaces.

n

The standard encompasses much more than

_{The standard encompasses much more than}

just telecommunications infrastructure.

n

Close to half of the technical content deals

_{Close to half of the technical content deals}

with facility specifications.

(13)

Purpose of the standard

n

n Specifications for data center telecommunications_{Specifications for data center telecommunications}

cabling, pathways and spaces cabling, pathways and spaces

n

n Recommendations on media and distance and_{Recommendations on media and distance and}

restrictions for data center applications over restrictions for data center applications over

structured cabling system (TIA 232, TIA 561, T1, structured cabling system (TIA 232, TIA 561, T1,

E1, T3, E3, 1 & 10 Gigabit Ethernet, Fibre E1, T3, E3, 1 & 10 Gigabit Ethernet, Fibre

Channel) Channel)

n

n Establish a standard for data center tiers to replace_{Establish a standard for data center tiers to replace}

several proprietary standards. The TIA data center several proprietary standards. The TIA data center

tier standard is: tier standard is:

•

• A tool to evaluate existing data centersA tool to evaluate existing data centers

•

(14)

TR42.1 Study Group: Telecommunications Cabling

Infrastructure for Network Distribution Nodes

Scope:

Develop cabling topology, recognized mediaDevelop cabling topology, recognized media types, cabling requirements, and requirements for types, cabling requirements, and requirements for

pathways & spaces for

pathways & spaces for data centersdata centers

n

n Cabling Design_{Cabling Design}

n

n Network Design_{Network Design}

n

n Facility Design_{Facility Design}

n

(15)

Cabling Design:

n

n Copper and fiber cabling performance_{Copper and fiber cabling performance}

n

n Connectors, cables, distribution hardware_{Connectors, cables, distribution hardware}

n

n Cabling distances_{Cabling distances}

n

n Space management_{Space management}

Facility Design:

n

nData center sizing_{Data center sizing}

n

nPower distribution methodologies_{Power distribution methodologies}

n

nPathways and spaces_{Pathways and spaces}

n

nHVAC, security, operations, and administration._{HVAC, security, operations, and administration.}

n

nFlexibility, scalability, reliability and space management_{Flexibility, scalability, reliability and space management}

Design Elements:

(16)

Network Design: Network Design:

n

nSupport legacy systems_{Support legacy systems}

n

n_{Enable rapid deployment of new technologies such}_{Enable rapid deployment of new technologies such}

as the emerging 10 Gb/s applications.

Design Elements:

(17)

Normative:

n

n_{Clause 5.}_{Clause 5.}_{cabling spaces - definitions}_{cabling spaces - definitions}

n

nClause 6._{Clause 6.} Data center cabling _{Data center cabling}

–

–definitionsdefinitions

–

–topology topology

–

–recognized mediarecognized media

–

–redundancyredundancy

n

n_{Clause 7.}_{Clause 7.}_{Data Center Cabling Pathways}_{Data Center Cabling Pathways}

Overview of key elements - Normative

(18)

Informative:

n

nClause 8:_{Clause 8:} Redundancy_Redundancy

n

nAnnex:_Annex:

–

–application distancesapplication distances

–

–administrationadministration

–

–carrier informationcarrier information

–

–site selectionsite selection

–

–infrastructure tieringinfrastructure tiering

–

–design examplesdesign examples

Overview of key elements - Informative

(19)

Cabling elements Cabling elements n nCross-connect_{Cross-connect} n nInterconnect_Interconnect Distribution Areas Distribution Areas n

nMain Distribution Area -MDA_{Main Distribution Area -MDA}

n

nHorizontal Distribution Area -HDA_{Horizontal Distribution Area -HDA}

n

nZone Distribution Area - ZDA_{Zone Distribution Area - ZDA}

n

n_{Equipment Distribution Area -EDA}_{Equipment Distribution Area -EDA}

n

nEntrance Room_{Entrance Room}

Distribution Areas - Spaces for cabling elements

(20)

Purpose of the standard

n

n Define a standard telecommunications_{Define a standard telecommunications}

infrastructure for data centers infrastructure for data centers

n

n Structured cabling system for data centers using_{Structured cabling system for data centers using}

standardized architecture and media standardized architecture and media

n

n Accommodates a wide range of applications_{Accommodates a wide range of applications}

(LAN, WAN, SAN, channels, consoles) (LAN, WAN, SAN, channels, consoles)

n

n Accommodates current and known future_{Accommodates current and known future}

protocols (10 Gigabit Ethernet) protocols (10 Gigabit Ethernet)

n

n Replaces unstructured point-to-point cabling that_{Replaces unstructured point-to-point cabling that}

uses different cabling for different applications uses different cabling for different applications

(21)

Relationship of Spaces

BUILDING SITE DATA CENTER DATA CENTER ELECTRICAL & MECHANICAL ROOMS SUPPORT STAFF OFFICES OPERATIONS CENTER STORAGE ROOMS & LOADING DOCKS

BUILDING SHELL GENERAL OFFICE SPACE OFFICE BUILDING SUPPORT SPACE ENTRANCE ROOM(S)

TELECOM ROOMS & EQUIPMENT ROOMS

for spaces outside data center

COMPUTER ROOM

TELECOM ROOM(S) for data center support spaces

(22)

Data Center Telecommunications Spaces

Entrance Room

(Carrier Equip & Demarcation)

Carriers

Horiz Dist Area

(LAN/SAN/KVM Switches )

Equip Dist Area

(Rack/Cabinet)

Computer Room

Horiz Dist Area

Zone Dist Area Offices,

Operations Center, Support Rooms

Telecom Room

(Office & Operations Center LAN switches)

Optional Backbone Cabling Main Dist Area

(Routers, Backbone LAN/SAN Switches, PBX, M13 Muxes)

Horiz Dist Area

Equip Dist Area

(Rack/Cabinet)

Equip Dist Area

(Rack/Cabinet)

(23)

TIA-942 Spaces

n

Entrance Room (ER) - location of interface

_{Entrance Room (ER) - location of interface}

with campus and carrier entrance facilities

n

Main Distribution Area (MDA) – location

_{Main Distribution Area (MDA) – location}

of main cross-connect (MC)

n

Horizontal Distribution Area (HDA) –

_{Horizontal Distribution Area (HDA) –}

location of horizontal cross-connect (HC)

n

Zone Distribution Area (ZDA) – location of

_{Zone Distribution Area (ZDA) – location of}

zone outlet (ZO) or consolidation point (CP)

n

Equipment Distribution Area (EDA) –

_{Equipment Distribution Area (EDA) –}

location of equipment cabinets and racks

(24)

Entrance Room

Carriers

Horiz Dist Area

Equip Dist Area

(Rack/Cabinet)

Computer Room

Horiz Dist Area

Telecom Room

Main Dist Area

Horiz Dist Area

Equip Dist Area

(Rack/Cabinet)

Equip Dist Area

(Rack/Cabinet)

Carriers

Backbone cabling

Horizontal cabling Horizontal cabling Horizontal cabling

Horizontal cabling

Backbone cabling Backbone

cabling Horizontal cabling

(25)

Distributed Topology with Multiple ERs

Primary Entrance

Room

Carriers

Horiz Dist Area

Equip Dist Area

(Rack/Cabinet)

Computer Room

Horiz Dist Area

Carriers _Carriers

Telecom Room

Carriers

Secondary Entrance Room

Main Dist Area

Horiz Dist Area

Equip Dist Area

(Rack/Cabinet)

Equip Dist Area

(Rack/Cabinet)

Equip Dist Area

(Rack/Cabinet) Backbo ne cab ling Bac kbon e ca blin g B a_c k_b o n_e c_a b lin g B ac_kb on_e ca blin_g Bac kbon e cabl ing B a c k b o n e c a b li n g Backbone cabling Backbone cabling B a c k b o n e c a b lin g Horizontal cabling Horizontal cabling Horizontal cabling Horizontal cabling Horizontal cabling Horizontal cabling

(26)

Backbone Topology

n

n Includes cabling from MDA to ER, HDA, TR_{Includes cabling from MDA to ER, HDA, TR}

n

n Optional cabling between HDAs allowed_{Optional cabling between HDAs allowed}

n

n Maximum backbone cable lengths based on_{Maximum backbone cable lengths based on}

applications distances applications distances

n

n Centralized optical fiber cabling supported with_{Centralized optical fiber cabling supported with}

interconnect, splice, or pull-through at the HDA interconnect, splice, or pull-through at the HDA

n

n Star topology with no intermediate cross-connects_{Star topology with no intermediate cross-connects}

n

n Various topologies permit redundancy and_{Various topologies permit redundancy and}

flexibility to support various data center sizes flexibility to support various data center sizes

(27)

Horizontal Topology

n

Defined as cabling from horizontal cross-

_{Defined as cabling from horizontal}

cross-connect (HC) to the equipment distribution

connect (HC) to the equipment distribution

area (EDA)

n

Star topology with termination on HC in

_{Star topology with termination on HC in}

HDA or MDA

n

(28)

Horizontal and Backbone Cabling

n

Recognized Cables:

_{Recognized Cables:}

F a) 100-ohm twisted-pair cable

(ANSI/TIA/EIA-568-B.2), category 6 recommended (ANSI/TIA/EIA-568-B.2-1)

F b) multimode optical fiber cable, 50/125 micron

(ANSI/TIA/EIA-568-B.3) and 62.5/125 micron or 50/125 micron (ANSI/TIA/EIA-568-B.3)

F c) singlemode optical fiber cable

(ANSI/TIA/EIA-568-B.3)

F d) 75-ohm (734 and 735 type) coaxial cable

(29)

Carrier Circuit Lengths in Data Centers

Maximum cable lengths for common circuits: Maximum cable lengths for common circuits:

n

n E-1’_E-1’s over 24 AWG Cat 5/5e/6 UTP:s over 24 AWG Cat 5/5e/6 UTP:

532 ft (152 m) -

532 ft (152 m) - 16.4 ft (5 m) per patch panel 16.4 ft (5 m) per patch panel

n

n T-1’_T-1’s over 24 AWG Cat 5/5e/6 UTP:s over 24 AWG Cat 5/5e/6 UTP:

731 ft (223 m) - 16.4 ft (5 m) per patch panel

n

n E-3’s over 734 coax:_{E-3’s over 734 coax:}

618 ft (188m) – 19.8 ft (6 m) per patch panel

n

n T-3’s over 734 coax:_{T-3’s over 734 coax:}

513 ft (156m) – 15.4 ft (4.7 m) per patch panel

Distances are from carrier demarcation point to Distances are from carrier demarcation point to end equipment and assume no customer DSX. end equipment and assume no customer DSX.

(30)

Carrier Circuit Lengths in Data Centers

n

n Common data center configurations include 6_{Common data center configurations include 6}

patch panels: 1 in ER, 2 in MDA, 2 in HDA, and 1 patch panels: 1 in ER, 2 in MDA, 2 in HDA, and 1

in the EDA in the EDA

n

n Cat 3 instead of Cat 5 reduces circuit lengths for_{Cat 3 instead of Cat 5 reduces circuit lengths for}

T-1s and E-1s significantly T-1s and E-1s significantly

n

n 735 coax (mini-coax) reduces circuit lengths for_{735 coax (mini-coax) reduces circuit lengths for}

T-3s, E-1s, and E-3s significantly T-3s, E-1s, and E-3s significantly

n

n Circuit length restrictions may :_{Circuit length restrictions may :} u

u _{require additional ERs,}_{require additional ERs,}

u

u limit location of telecom equipment,_{limit location of telecom equipment,}

u

(31)

Computer Room Requirements

n

n Similar to Equipment Room reqts from TIA-569_{Similar to Equipment Room reqts from TIA-569}

n

n Min clear height of 2.6m/8.5 ft_{Min clear height of 2.6m/8.5 ft}

n

n Min door size 1m/3ft wide 2.13/7ft high_{Min door size 1m/3ft wide 2.13/7ft high}

n

n Min dist floor loading 7.2 kPA/150lbf/ft_{Min dist floor loading 7.2 kPA/150lbf/ft}22,_,

recommended min 12 kPA/250 lbf/ft recommended min 12 kPA/250 lbf/ft22

n

n Dedicated HVAC system preferred_{Dedicated HVAC system preferred}

n

n 20₂₀ooC to _C 25₂₅ooC_C

n 40% to 55% relative humidity (reduces ESD) n Signal reference grid –equipotential ground

reference and reduces stray high frequency signals

(32)

Entrance Room

n

Demarcation to carriers

_{Demarcation to carriers}

n

Telecom Entrance & Campus Conduits

_{Telecom Entrance & Campus Conduits}

n

Carrier Racks

_{Carrier Racks}

u

u Coordinate power and space requirements with_{Coordinate power and space requirements with}

each carrier each carrier

u

u Provide either AC or DC power to carriers._{Provide either AC or DC power to carriers.}

u

u If ER only has AC power, carriers install DC_{If ER only has AC power, carriers install DC}

power from rectifiers to their racks & cabinets power from rectifiers to their racks & cabinets

n

Plywood for protectors

_{Plywood for protectors}

u

u Not required if no copper entrance cables or if_{Not required if no copper entrance cables or if}

carrier will install protectors on frames or racks carrier will install protectors on frames or racks

(33)

Entrance Room

n

ER may be inside data center but, location

_{ER may be inside data center but, location}

outside data center provides best security

n

ER may be consolidated with MDA

_{ER may be consolidated with MDA}

n

ER requires the same redundancy for power

_{ER requires the same redundancy for power}

and cooling as the computer room space

n

Locate ER to avoid exceeding maximum

_{Locate ER to avoid exceeding maximum}

cable lengths for circuits

n

Cabling distances for carrier circuits may

_{Cabling distances for carrier circuits may}

dictate multiple ERs in large data centers

(34)

Main Distribution Area

n

Location of Main Cross-Connect (MC), the

_{Location of Main Cross-Connect (MC), the}

central point of distribution for data center

structured cabling system

n

Centrally located to avoid exceeding

_{Centrally located to avoid exceeding}

maximum distance restrictions (typically for

E-1s, E-3s, T-1s and T-3s)

n

Install separate racks for Fiber, UTP, and

_{Install separate racks for Fiber, UTP, and}

coaxial cable distribution

(35)

Main Distribution Area

n

n Data center size may dictate use of Cat 5e or 6_{Data center size may dictate use of Cat 5e or 6}

UTP for Fractional T-1, E-1, T-1, ISDN PRI UTP for Fractional T-1, E-1, T-1, ISDN PRI

n

n Copper-pair cabling for LAN backbone cabling (in_{Copper-pair cabling for LAN backbone cabling (in}

smaller data centers) and out-of-band management smaller data centers) and out-of-band management

using Cat 5e or 6 UTP using Cat 5e or 6 UTP

n

n AT&T 734-type 75 ohm coaxial cable for E-1,_{AT&T 734-type 75 ohm coaxial cable for E-1,}

E-3, T-3 cabling (two coax per circuit) E-3, T-3 cabling (two coax per circuit)

n

n Multimode and Single-mode fiber cabling for OC-_{Multimode and Single-mode fiber cabling for}

OC-3, OC-12, OC-48, MAN, LAN & SAN backbone. 3, OC-12, OC-48, MAN, LAN & SAN backbone.

(36)

Horizontal Distribution Area

n

Location of Horizontal Cross-Connect

_{Location of Horizontal Cross-Connect}

(HC), the distribution point for cabling to

equipment distribution area

n

Distribution LAN, SAN, KVM switches

_{Distribution LAN, SAN, KVM switches}

and console servers located in HDA

n

MDA may also include an HC for nearby

_{MDA may also include an HC for nearby}

equipment distribution area

n

Number of HDAs depends on the density of

_{Number of HDAs depends on the density of}

cabling and the size of the data center

(37)

Horizontal Distribution Area

n

n The capacity of the cable tray system and the size_{The capacity of the cable tray system and the size}

of the cross-connect creates practical limits on the of the cross-connect creates practical limits on the

size of the HC size of the HC

n

n Guideline is maximum of 2,000 4-pair UTP or_{Guideline is maximum of 2,000 4-pair UTP or}

coax cable terminations per HDA coax cable terminations per HDA

n

n Arrange patch bays to minimize patch cable_{Arrange patch bays to minimize patch cable}

lengths and to simplify cable management lengths and to simplify cable management

u

u Separate racks for fiber, UTP, and coax_{Separate racks for fiber, UTP, and coax}

u

u Locate switches and patch panels to minimize_{Locate switches and patch panels to minimize}

patch cord lengths patch cord lengths

(38)

Zone Distribution Area

n

n Rack, cabinet, or under floor enclosure that houses_{Rack, cabinet, or under floor enclosure that houses}

a zone outlet (ZO) or consolidation point (CP) a zone outlet (ZO) or consolidation point (CP)

n

n ZO - structured cabling termination for floor-_{ZO - structured cabling termination for}

floor-standing equipment that cannot accept patch standing equipment that cannot accept patch

panels (e.g. mainframes and large servers). panels (e.g. mainframes and large servers).

n

n CP - intermediate termination point (e.g. cabling_{CP - intermediate termination point (e.g. cabling}

to areas where floor plan is uncertain or dynamic) to areas where floor plan is uncertain or dynamic)

n

n No cross-connects within the ZDA_{No cross-connects within the ZDA}

n

n No active equipment shall be located in the ZDA_{No active equipment shall be located in the ZDA}

n

n Maximum of 144 connections in a ZDA_{Maximum of 144 connections in a ZDA}

n

n Maximum of one ZDA within a horizontal cable_{Maximum of one ZDA within a horizontal cable}

run run

(39)

Equipment Racks & Cabinets

n

n Cabinets and racks should be arranged in an_{Cabinets and racks should be arranged in an}

alternating pattern (with fronts of rows of alternating pattern (with fronts of rows of

cabinets/racks facing each other) to create hot and cabinets/racks facing each other) to create hot and

cold aisles cold aisles

n

n Cold aisles are front of racks/cabinets – if there is_{Cold aisles are front of racks/cabinets – if there is}

a raised floor, PDU cables are run here on the slab. a raised floor, PDU cables are run here on the slab.

n

n Hot aisles are rear of racks/cabinets – cable trays_{Hot aisles are rear of racks/cabinets – cable trays}

for telecom cabling are typically placed here. for telecom cabling are typically placed here.

n

(40)

CABINETS CABINETS CABINETS

HOT AND COLD EQUIPMENT AISLES

PREFORATED TILES PREFORATED TILES TELECOM CABLE TRAYS TELECOM CABLE TRAYS FRONT

POWER CABLES POWER CABLES

FRONT FRONT

(41)

Equipment Racks & Cabinets

n

n Equipment is mounted in racks & cabinets from_{Equipment is mounted in racks & cabinets from}

the front – provide adequate clearance for the front – provide adequate clearance for

installation of equipment (minimum of 3 feet, 4 installation of equipment (minimum of 3 feet, 4

feet is recommended). feet is recommended).

n

n Cabinets should be aligned with one edge along_{Cabinets should be aligned with one edge along}

the edge of the floor tile. the edge of the floor tile.

n

n Arrange cabinets and racks on raised floor to_{Arrange cabinets and racks on raised floor to}

permit tiles along the front and rear of the cabinets permit tiles along the front and rear of the cabinets

to be lifted to be lifted

n

n Floor tile cuts should be no larger than necessary_{Floor tile cuts should be no larger than necessary}

to minimize air pressure loss. to minimize air pressure loss.

(42)

Equipment Cabinets

n Front rails of cabinets

must be recessed to

provide adequate room for patch cables and wire

managers

n Adequate space for cable

management

n Arrange switches and

patch panels to minimize patching between cabinets & racks

n Perforated tiles at front of

cabinets

n One edge of cabinets

(43)

Raised Floor

n

More flexible cooling with raised floor than

_{More flexible cooling with raised floor than}

ducted air

n

Most stand-alone computer systems are

_{Most stand-alone computer systems are}

designed for cabling from below

n

Coordinate under floor cabling with

_{Coordinate under floor cabling with}

mechanical & electrical engineers

n

Recommend wire basket cable trays in hot

_{Recommend wire basket cable trays in hot}

aisles for telecom cabling

(44)

Example of Wire Basket Cable Trays

For Cabling Under Raised Floor

24" On Center

RAISED FLOOR TILE

SUPPORT STRUT 36" 24" 4" 9" FIBER 5" SUPPORT STRUT 18" COPPER CABLING 4" 13.5" DIVIDER FIBER 5" 18" COPPER CABLING 12" 1.375" 1" 1" Open Area

(45)

Under Floor Space

Example

n

n Color-coded PDU_{Color-coded PDU}

cables in hot aisles cables in hot aisles

each cabinet fed from each cabinet fed from

2 PDUs 2 PDUs

n

n Locking electrical_{Locking electrical}

receptacles NEMA receptacles NEMA

L5-20R L5-20R

n

n Signal Reference Grid_{Signal Reference Grid}

(SRG) using bare (SRG) using bare copper conductor copper conductor

n

n Each cabinet bonded_{Each cabinet bonded}

to SRG to SRG

(46)

Overhead Cable Trays

n

n Less expensive than raised floor systems_{Less expensive than raised floor systems}

n

n Cable trays can be attached to the top of racks and_{Cable trays can be attached to the top of racks and}

cabinets (if they are uniform in height) cabinets (if they are uniform in height)

n

n Cable trays suspended from the ceiling provides_{Cable trays suspended from the ceiling provides}

more flexibility for supporting cabinets/racks of more flexibility for supporting cabinets/racks of

various heights and for adding and removing various heights and for adding and removing

cabinets/racks. cabinets/racks.

n

n Cable trays can be installed with several layers_{Cable trays can be installed with several layers}

n

n Coordinate location with lighting, ducts, overhead_{Coordinate location with lighting, ducts, overhead}

conduits, overhead power distribution conduits, overhead power distribution

(47)

Overhead Cable Tray Example

3 Layer cable tray system: 3 Layer cable tray system:

n

n Bottom layer – copper_{Bottom layer – copper}

n

n Middle layer – fiber_{Middle layer – fiber}

n

n Top layer – power_{Top layer – power}

n

n Signal Reference Grid in_{Signal Reference Grid in}

brackets attached to brackets attached to lower layer of trays lower layer of trays

n

n Fiber patch cables may_{Fiber patch cables may}

be in fiber duct attached be in fiber duct attached

to threaded rods to threaded rods

(48)

Infrastructure Administration

n

Informative annex with TIA-606-A

_{Informative annex with TIA-606-A}

standards compliant labeling scheme for all

components.

n

Labeling scheme extended for use in data

_{Labeling scheme extended for use in data}

centers

n

Cabinets and racks labeled by location

_{Cabinets and racks labeled by location}

using tile grid or row/position identifiers

n

All cabinets, racks, patch panels, cables,

_{All cabinets, racks, patch panels, cables,}

and patch cords should be labeled

(49)

Facilities Specifications & Tiers

n

n Informative annex with general architectural,_{Informative annex with general architectural,}

structural, electrical, mechanical, and structural, electrical, mechanical, and

telecommunications recommendations telecommunications recommendations

requirements requirements

n

n Annex includes detailed architectural, security,_{Annex includes detailed architectural, security,}

electrical, mechanical, and telecommunications electrical, mechanical, and telecommunications

recommendations for each Tier recommendations for each Tier

n

n Recommended specifications by tier are a uniform_{Recommended specifications by tier are a uniform}

way to rate aspects of a data center design and are way to rate aspects of a data center design and are

a starting point for initiating design requirements a starting point for initiating design requirements

with qualified architects and engineers with qualified architects and engineers

(50)

Redundant Topologies

Primary Entrance Room (Tier 1 and higher)

Horiz Dist Area

Equip Dist Area Computer

Room

Horiz Dist Area Zone Dist Area

Offices, Operations Center, Support Rooms Telecom Room Optional Cabling

Main Dist Area (Tier 1 and higher)

Horiz Dist Area

Equip Dist Area Equip Dist Area Secondary Entrance Room (Tier 3 and higher)

Secondary Dist Area (Optional for Tier 4)

Carriers

Primary Customer Maintenance Hole (Tier 1 and higher)

Secondary Customer Maintenance Hole (Tier 2 and higher)

Tier 1 Tier 3 Tier 1 _{Tier 4} Tier 3 Tier 2 Tier 4 Tier 3 Tier 4

Carriers Carriers Carriers

Data Center

(51)

Conclusion

§

TIA-942 is the first standard that specificallyTIA-942 is the first standard that specifically addresses data center infrastructure.

addresses data center infrastructure.

§

Primarily a telecom infrastructure standard, butPrimarily a telecom infrastructure standard, but about half of the content deals with facility

about half of the content deals with facility requirements.

requirements.

§

Provides a flexible and manageable structuredProvides a flexible and manageable structured cabling system using standard media.

cabling system using standard media.

§

Builds on existing standards, where applicableBuilds on existing standards, where applicable

§

Guidelines on a wide range of subjects useful toGuidelines on a wide range of subjects useful to someone designing or managing a data center. someone designing or managing a data center.

§

An official tiering standard for determining theAn official tiering standard for determining the quality of a center

quality of a center. . A way to objectively compareA way to objectively compare

one center with another. one center with another.