Liquid Cooling Solutions for DATA CENTERS - R.M.IYENGAR BLUESTAR LIMITED.

(1)

(2)

Presentation Goals & Outline

• Power Density – Where we have

been- where we are now - where

we are going

• Limitations of Air Cooling – Air

Distribution, Effectiveness and

Heat Removal

(3)

Common Data Center Scene

(4)

(5)

IT Equipment Trends

*from The Uptime Institute (http://207.201.136.39/TUIpages/whitepapers/tuiheat1.0.html)

(6)

Issues in the Data Center

(7)

Are We Hitting the Wall?

• “The failure rate at the top third of the rack is three

times greater than at the bottom.”

–Mr. Kenneth Brill, Executive Director: The Uptime

Institute, March 2003 DataCenter Dynamics

Conference

)

• The wall is at 3.5 KW/Cabinet (with raised floor)

• Without raised floor, 2.5 KW/Cabinet max.

(8)

How Do We Remove the Heat?

Water

• Water has 3500 times more heat

capacity than air by volume

Air

(9)

Overhead Air Distribution

• Limitations to capacity due to duct size /

space constraints

(10)

Underfloor Air Distribution

• Increased floor depth for higher flows

• Limitation of perforated tiles (400 cfm =

+- 4 kW/rack)

• UF obstructions

• Air Misdistribution – underfloor

velocity/static pressure

(11)

(12)

Above floor Plumes

Rack total airflow: 350cfm

Max inlet temp: 16

C/61

F

Rack total airflow: 700cfm

Max inlet temp:

18 C/64

F

(13)

Underfloor Plumes

1 kW / Cabinet – 24” Raised Floor

Column

(14)

HVAC Effectiveness

• Bypass Airflow

• Air Distribution Efficiency

(15)

ASHRAE Standards

Key Points of ASHRAE TC9.9

– Equipment Environmental Specifications

– Equipment Room Airflow

– Standardize Measuring / Monitoring Points

– Equipment Airflow Protocol Syntax

(16)

ASHRAE

Standards

(17)

The New Paradigm

Extraction

Versus

(18)

(19)

POINTS TO CONSIDER

• Effective for standard racks up to 6 KW only

• No cabinet doors.

• Cable management behind servers in “hot”

aisle.

• Limit air bypass – use rack blanking panels and

seal all floor cutouts.

• Limit mixing between hot and cold aisles.

– Partition panels above racks and doors at aisle

ends.

(20)

Rack Cooling–

Unit Options

• Down flow Units

• Centrifugal fan drive

• EC fan drive

• With DX system

(21)

(22)

Heat Density

0

5

10

15

20

25 Cabinet

Pre P3 Processor P3 Mobile Blade P4

Single Processor

1U

P4 Blades/P4

Multi-Processor 1U & 2U

Server

NextGen Ultra

Dense Blade &

(23)

(24)

Background to the Need for

Water Cooling

• Rising heat densities

• Limitations of air cooling

(25)

COOLING SYSTEMS CLOSER TO THE LOAD

.

Mounting the cooling modules as close as possible to

the source of heat—such as placing them directly

(26)

OPEN COOLING ARCHITECTURE

(27)

Closed cooling architecture

Closed architecture systems involve

extraction of room air in server rack

cabinets that are completely sealed from

room air and environmental conditions. In a

closed design, air is circulated through the

electronics and passes through a

(28)

Rack Cooling– Unit

Options

• CDU Cooling Distribution Unit

(29)

CDU with Rear Door Heat

exchanger

• Heat removal at source, rejected to water not room

• Rear door heat exchangers on back of high heat load cabinets

without taking up any floor space

• High density racks can be added without need to upgrade CRAC

units

• Easily retrofitted as high density racks added

• Eliminates low air temp setpoints to compensate for high density

racks

• Only relatively small chilled water plant required

(30)

Data Racks & Rear Door Heat

Exchangers

• Industry Standard Data

Racks

• 600 wide 20kW Cooling

• 800 wide 30kW Cooling

• 6 Hot Swap Fans

• Retro-fittable to other

Racks

•Without swap fans for

(31)

“

Typical Installations

(32)

“

System Concept

External chiller

Rear Door Heat Exchangers

Up to 6 racks

(or 12 racks at lower loads)

(33)

Minimal Thermal Impact Server Implementation using

CDU & Rear Door Heat Exchangers

(34)

(35)

(36)

CDU

–

Cooling Distribution Unit

CDU120/150 Main Components

•120 to 150kW (409,450 –

511,815 BTU/Hr) capacity.

•Serves 1 to 6 rear door

heat exchangers (RDHx).

•380-480v 50/60Hz global

operation (+220v option).

•Run/Standby pumps.

•Run/Standby control

valves.

•Energy saving pump

speed control.

•240L/M (63.4 GPM) flow

capacity (40L/M per

RDHx).

•Dew point control.

•Inbuilt manifold system

with flow balancing.

•Quick release, self

sealing connections for

data rack hoses.

(37)

“

Hose Connections

–

Process (to RDHx)

Primary Chilled Water Connections (1.1/2” Hose tails)

Secondary Circuit Rack Return Connections (3/4” Hose tails)

Secondary Circuit Rack Flow Connections (3/4” Hose tails)

Secondary Circuit

Connection:

• Quick release

couplings

for clean efficient

installation

• Fool-proof input and

output connections

• Tidy hose arrangement

(38)

C h ill ed W a ter Flo w / Retur n Heat Exchanger Rack 3 Rack 2 Flow Control Filter Control Valves Rack 4 Rack 5 Rack 6 Rack 3 Rack 4 Rack 5 Rack 6 40L/M 40L/M 40L/M 40L/M 40L/M T1

#

Redundant 2-way valve

# # Redundant pump

Priming Pump P3 Filter Fill point Temp (T3) & Hum Sensor Air Eliminator Flowmeter Controller & Display D istr ibu tion manif o lds Q u ick R e le a s e C ouplings Level Sensor

.

Rack 1 40L/M Bypass Valve Air Eliminator Pump P1 Pump P2 # # PS1 PS2 Speed Control PS3 PS4 T2b T2a TITLE

CDU PIPE SCHEMATIC

DRG. No.

A3NAD371

Iss.

A

DATE 18/05/07 DR’N DSM C h ill ed W a ter Flo w / Retur n Heat Exchanger Rack 3 Rack 2 Flow Control Filter Control Valves Rack 4 Rack 5 Rack 6 Rack 3 Rack 4 Rack 5 Rack 6 40L/M 40L/M 40L/M 40L/M 40L/M T1 T1

#

Redundant 2-way valve

# # Redundant pump

Priming Pump P3 Filter Fill point Temp (T3) & Hum Sensor Temp (T3) & Hum Sensor Air Eliminator Flowmeter Controller & Display D istr ibu tion manif o lds Q u ick R e le a s e C ouplings Level Sensor

..

Rack 1 40L/M Bypass Valve Air Eliminator Pump P1 Pump P2 # # PS1 PS1 PS2PS2 Speed Control Speed Control PS3 PS3 PS4PS4 T2b T2a T2a TITLE