Data Center Planning
PUE Overview
Steve Carter, Americas Managing Principal
Charles Prawdzik Jr., Project Manager
HP Critical Facility Services
Early Planning Yields Best Results
Interdependencies
Data Center Power Usage Effectiveness
Optimizing Reliability and Efficiency
6 30 July 2009 6 30 July 2009
Data Center Economics Have Changed
Cost of physical space was a
primary consideration in data
center design.
Cost of power and cooling has
risen to prominence.
Electrical/mechanical
infrastructure makes up 75% of
cost of a new datacenter.
Data center managers now must
prioritize investment in efficient
power and cooling systems to
lower the total cost of operating
(TCO) their facilities.
Belady, C., “In the Data Center, Power and Cooling Costs More than IT Equipment it Supports”, Electronics Cooling Magazine (Feb 2007)
University of Utah Cooling Options
PUE and Costs are ROM estimates (±30%) based on the proposed systems and are for
reference / comparative purposes only. Detailed analysis would be required to discover
actual PUE and Costs.
Cooling
Option
System Description
Initial
Purchase
Cost
Total
Load
PUE
Annual
Operating
Cost
($0.10/kWh
)
Return on Investment
(compared to Option 1)
1
Conventional chilled water
system without economizers.
Air delivery by raised floor
mounted CRAH units and
liquid cooling systems.
$8,382,500 3,318 kW 1.75
$2,906,570
N/A
2
Conventional chilled water
system with waterside
economizers.
Air delivery by raised floor
mounted CRAH units and
liquid cooling systems
$8,638,250 3,122 kW 1.64
$2,734,870
18 months
3
Conventional chilled water
system.
Air delivery by rooftop AHUs
with outdoor air economizers
$10,325,000 3,089 kW 1.63
$2,705,960
8 months
9 years
4
Conventional chilled water
system.
Air delivery by rooftop AHUs
with evaporative cooling
systems.
Project: Client: Purpose: Date:
Data Center Master Planning
University of Utah
Mechanical Cooling Options and PUE Comparison July 7, 2009
Page 1 of 5 5K3-UU001
!
University of Utah Data Center
Mechanical System Options for Day One Conditions - PUE
Comparison
The options below are based on preliminary design concepts for Day One operations of the new data center. Generation of the Basis of Design is in progress and the concepts are subject to change.
Data Center Day One Configuration
Total area
White Space = 10,000 SF IT Support area = 7,500 SF Common Area = 7,500 SF Total Area = 25,000 SF
White Space Heat Loads
Enterprise Core
5,000 SF x 150 W/SF = 750 kW IT Load = 213 tons HPC
4,000 SF @ 1 mW + 1,000 SF @ 150 kW = 1,150 kW IT Load = 327 tons
Combined Enterprise Core and HPC
1,900 kW total IT x 110% = 2,090 kW total cooling = 594 tons (Salt Lake City elevation)
Piping Systems
Chiller Plant = Tier 3 Enterprise Core = Tier 3 HPC = Tier 1
IT Support = Tier 3 Common = Tier 1
Cooling Options
Cooling Option 1: Conventional chilled water system without economizers. Air delivery by raised
floor mounted CRAH units and liquid cooling systems. Chiller Plant
! 2- 600 ton chillers/towers/pumps, pre-piped in modular containers. Variable primary flow. All motors premium eff. & VFD, chillers VFD. Complete digital control system & programming. Fire detection & suppression. (assumes there is at least 600 kW load, day one)
! 2- 10,000 gallon horizontal aboveground chilled water storage tanks.
! Aboveground headers with double supply & return piping loops underground to building. All Tier 3.
! Fire water system from building to plant with detection & alarm. ! Make-up water system with chem. treatment.
Page 2 of 5 5K3-UU001 Enterprise Core (Tier 3) 5,000 SF
! 9- 50 nominal ton CRAH units (N+20%). 30” RAF. No ceiling. ! Tier 3 piping distribution.
! VESDA ! FM200
! Pre-action sprinklers. HPC (Tier 1) 5,000 SF
! 8- 50 nominal ton CRAH units (N). Assumes 250 tons conventional cooling. 48” RAF. Provide drop ceiling with hot aisle containment back to CRAH units.
! 12- 25 kW liquid cooled cabinets, 2- CDUs, specialized piping. Assumes 80 tons liquid cooling. ! Tier 1 piping distribution.
! VESDA ! FM200
! Pre-action sprinklers.
IT infrastructure support rooms (Tier 3) 7,500 SF ! 8- 20 nominal ton CRAH units.
! Tier 3 piping distribution. ! VESDA
! FM200
! Pre-action sprinklers. Common areas 7,500 SF
! 2- chilled water RTUs with economizer. ! VAV system + ductwork.
! Data Center waste heat recovery AHU + duct system. ! Wet sprinklers
Cooling option 2: Conventional chilled water system with waterside economizers. Air delivery by
raised floor mounted CRAH units and liquid cooling systems. Reduces chiller plant operation by 30%. Same as Option 1 except chiller modules have waterside economizers & necessary piping.
Cooling Option 3: Conventional chilled water system. Air delivery by rooftop AHUs with outdoor air
economizers. Reduces chiller plant operation by 60%. Chiller Plant
! 2- 600 ton chillers/towers/pumps, pre-piped in modular containers. Variable primary flow. All motors premium eff. & VFD, chillers VFD. Complete digital control system & programming. Fire detection & suppression. (assumes there is at least 600 kW load, day one)
! 2- 10,000 gallon horizontal aboveground chilled water storage tanks.
! Aboveground headers with double supply & return piping loops underground to building. All Tier 3.
! Fire water system from building to plant with detection & alarm. ! Make-up water system with chem. treatment.
Page 3 of 5 5K3-UU001
EYP Mission Critical Facilities®, Inc., 200 West Adams Street, Suite 2750, Chicago, IL 60606 (312) 846-8500 www.hp.com/go/eypmcf
Enterprise Core (Tier 3) 5,000 SF
! 3- 150 ton rooftop AHUs (N+1) with chilled water coils and O/A economizers. No RAF. Provide drop ceiling and hot aisle containment.
! Make-up water system with chem. treatment.
! Supply distribution header duct with branches to cold aisles. ! Tier 3 piping distribution to roof.
! VESDA ! FM200
! Pre-action sprinklers. HPC (Tier 1) 5,000 SF
! 2- 150 ton rooftop AHUs (N) with chilled water coils and O/A economizers. Assumes 250 tons conventional cooling. No RAF. Provide drop ceiling with hot aisle containment back to rooftop units.
! Make-up water system with chem. treatment.
! Supply distribution header duct with branches to cold aisles. Join to E-Core header. ! Tier 1 piping distribution on roof.
! 12- 25 kW liquid cooled cabinets, 2- CDUs, specialized piping. Assumes 80 tons liquid cooling. ! Tier 1 piping distribution.
! VESDA ! FM200
! Pre-action sprinklers.
IT infrastructure support rooms (Tier 3) 7,500 SF ! Duct distribution from rooftop units. ! VESDA
! FM200
! Pre-action sprinklers. Common areas 7,500 SF
! 2- chilled water RTUs with economizer. ! VAV system + ductwork.
! Data Center waste heat recovery AHU + duct system. ! Wet sprinklers
Cooling Option 4: Conventional chilled water system. Air delivery by rooftop AHUs with evaporative
cooling systems. Reduces chiller plant operation by 90%. Chiller Plant
! 2- 600 ton chillers/towers/pumps, pre-piped in modular containers. Variable primary flow. All motors premium eff. & VFD, chillers VFD. Complete digital control system & programming. Fire detection & suppression. (assumes there is at least 600 kW load, day one)
! Make-up water system with chem. treatment.
! 2- 10,000 gallon horizontal aboveground chilled water storage tanks.
! Aboveground headers with double supply & return piping loops underground to building. All Tier 3.
! Fire water system from building to plant with detection & alarm.
Page 4 of 5 5K3-UU001 Enterprise Core (Tier 3) 5,000 SF
! 3- 150 ton rooftop AHUs (N+1) with chilled water coils and evaporative cooling system. No RAF. Provide drop ceiling and hot aisle containment.
! Make-up water system with chem. treatment.
! Supply distribution header duct with branches to cold aisles. ! Tier 3 piping distribution to roof.
! VESDA ! FM200
! Pre-action sprinklers. HPC (Tier 1) 5,000 SF
! 2- 150 ton rooftop AHUs (N) with chilled water coils and evaporative cooling system. Assumes 250 tons conventional cooling. No RAF. Provide drop ceiling with hot aisle containment back to rooftop units.
! Make-up water system with chem. treatment.
! Supply distribution header duct with branches to cold aisles. Join to E-Core header. ! Tier 1 piping distribution on roof.
! 12- 25 kW liquid cooled cabinets, 2- CDUs, specialized piping. Assumes 80 tons liquid cooling. ! Tier 1 piping distribution.
! VESDA ! FM200
! Pre-action sprinklers.
IT infrastructure support rooms (Tier 3) 7,500 SF ! Duct distribution from rooftop units. ! VESDA
! FM200
! Pre-action sprinklers. Common areas 7,500 SF
! 2- chilled water RTUs with economizer. ! VAV system + ductwork.
! Data Center waste heat recovery AHU + duct system. ! Wet sprinklers
Page 5 of 5 5K3-UU001
EYP Mission Critical Facilities®, Inc., 200 West Adams Street, Suite 2750, Chicago, IL 60606 (312) 846-8500 www.hp.com/go/eypmcf
Cooling Options Cost Comparison
Cooling
Option System Description Initial Purchase Cost Total Load PUE
Annual Operating Cost ($0.10/kWh) Return on Investment (compared to Option 1) 1 Conventional chilled water system without economizers. Air delivery by raised floor mounted CRAH units and liquid cooling systems.
$8,382,500 3,318 kW 1.75 $2,906,570 N/A
2
Conventional chilled water system with waterside
economizers. Air delivery by raised floor mounted CRAH units and liquid cooling systems $8,638,250 3,122 kW 1.64 $2,734,870 18 months 3 Conventional chilled water system. Air delivery by rooftop AHUs with outdoor air economizers $10,325,000 3,089 kW 1.63 $2,705,960 8 months 9 years 4 Conventional chilled water system. Air delivery by rooftop AHUs with evaporative cooling systems.
$11,225,000 2,661 kW 1.4 $2,331,040 5 years
PUE and Costs are ROM estimates (±30%) based on the proposed systems and are for reference / comparative purposes only. Detailed analysis would be required to discover actual PUE and costs.
Note that due to the Tier 3 requirement for the Enterprise Core area, the chiller plant is retained at full size regardless of the outdoor air economizer and evaporative cooling systems. A system with a smaller chilled water plant would be less sustainable but would save considerable initial cost.