Next Generation Power Distribution for the High-Density Datacenter

(1)

Next Generation Power Distribution for

the High-Density Datacenter

George Wasielewski

Eaton/Powerware Power Quality Products and Services Dallas Enhance (IT)

(2)

Agenda

• Background: US Green Building Council and

LEED Overview

• LEED Certification for Electrical Infrastructure

Improvement

• Top 10 Ways to Save Money in the Datacenter

• New generation Power Quality/Distribution

Products for the High-Density Datacenter

(3)

Sustainability: a win-win approach

• The green movement is

everywhere. But why?

• Buildings play a key role in

our environment and in your bottom line.

• Cost savings (TCO) to users • Government regulation and

incentives

• Effective use of resources/ Social responsibility

(4)

What exactly is sustainability?

• People: the health and comfort of

employees/users in your building: Social responsibility

• Planet: total health, environmental

stewardship, reducing greenhouse gasses, making things lighter/smaller, recycling

• Profit: the financial advantage

to keep the business healthy for the continued benefit of the

People and Planet; Government incentives, regulations

There are many ways to define

sustainability. Simply remember

(5)

(6)

(7)

The USGBC: An Overview

The LEED Green Building Rating

System™ is the “nationally accepted

benchmark for the design,

construction, and operation of high

performance green buildings. LEED

gives building owners and operators

the tools they need to have an

immediate and measurable impact

on their buildings’ performance.

(8)

(9)

(10)

(11)

(12)

(13)

Levels of LEED Ratings

Green Buildings

worldwide are certified

with a voluntary,

consensus-based

rating system.

USGBC has four

levels of LEED.

(14)

(15)

(16)

(17)

(18)

(19)

(20)

(21)

immediate

(22)

(23)

(24)

Additional Construction Costs for LEED-certified buildings

Conventional Building Cost (100%)

Average for offices and schools, based on 40 buildings

Additional Cost

PLATINUM

(2 buildings)

GOLD

(9 buildings)

SILVER

(21 buildings)

CERTIFIED

(8 buildings)

6.8%

2.2%

1.9%

.66%

(25)

(26)

(27)

Going Green

Going green—using natural resources and energy wisely while reducing the impact of human activity on the environment—means more than just being environmentally responsible. It’s good business, too.

Save Energy Protect the Environment Automatic Transfer Switches 9

Energy Efficient and Harmonic Mitigating Transformers

4

Variable Frequency Drives and Soft Starters

3

Pow-R-Command Lighting Control

1

Power Xpert

Software and Meters

5

Energy Audits

6

Power Factor Correction Capacitors and Filters

7 Uninterruptible Power Systems 2 Paralleling Switchgear 8 Busway 15 13 Circuit Breakers 10 Integrated Facilities Systems 11 Integrated Power Assemblies 14 Medium Voltage Switchgear Refurbishing Services 12 6 9 4 3 8 1 5 7 2 15 13 10 11 14 12

(28)

A Typical Datacenter

Server Racks Network Storage Telcom/datacom closet Utility Room/Electrical/ Utility Room/Electrical/ Switchgear/

Switchgear/XfmrXfmr/Sub/Sub--feedfeed

Gen/UPS/Battery

End

End--row power row power distribution/RPD distribution/RPD CRAC Control room Raised floor Under-floor cableway Busway Surveillance/Security/ Access control Telcom/IPT Static Switch Static Switch PDU PDU Save Energy Protect the Environment

(29)

Where does all the energy go in the DC

(30)

A Very Expensive Space Heater

(31)

Where is Datacenter Power Consumed

Pay twice:

For the power consumed And again to remove the heat.

(32)

Data Points

• >50% of power entering a typical data center is

used to cool the loads.

• A 1MW DC uses 177,000,000 KWhr over its 10

year life span.

• That power costs $17,000,000.00 at $.10/KWhr

• 1MW = 4300 cars worth of C.

• 1000 cars worth is wasted due to poor design.

• DOE estimates 4M cars worth of C can be saved

by 2015 with improved DC design.

• Equals the energy consumed by 1.8M US homes.

Protect the Environment Save

(33)

Datacenter Trends

• Consolidation

• Blade servers

• High-performance servers

• Increasing power and heat loads

• Increasing power densities

• Improvements in redundancy/availability

• Tier III/IV

Protect the Environment Save Energy

(34)

Important Ways to Green

in the Datacenter

• Turn Off, Virtualize and Consolidate

• Turn on CPU power management feature.

• Use IT equipment with high-efficiency power supplies.

•

• Use high

Use high

-

efficiency electrical infrastructure;

Uninterruptible Power Supplies (UPS

Uninterruptible Power Supplies (UPS’

’), transformers

), transformers

etc.

•

• Adopt high-

Adopt high

-power distribution; 208Y to the

power distribution; 208Y to the

enclosure.

• Adopt best practices for datacenter cooling.

• Conduct an energy audit of datacenter.

• Prioritize actions to reduce energy consumption.

(35)

The Legacy Datacenter Electrical

Infrastructure

• Utility and Gen Set

• Switchgear

• UPS

• 480V PDU, xfmr, single and two pole circuits.

(36)

Datacenter Infrastructure

Efficiency Gains-UPS

• Traditional DC/facility designed with large/centralized

UPS’ providing conditioned power to entire enterprise.

• Legacy systems ~90-94% efficient; sounds good right?

• Redundancy = 2 complete systems.

• Each side runs <50% load.

• Incremental efficiency improvements translate to big

savings in electrical costs.

• 94%Æ97% @ 60KW N+1 • Assuming $.10/ KWhr • >$6,000.00 annual savings Protect the Environment Save Energy

(37)

State of the Art UPS

Technologies

• Increased reliability

• Improved electrical efficiency, input current harmonic distortion (THD) and power factor. • Scalability- Hot Sync

• Redundancy Options- Inherent, N+1, 2N • Installation/serviceability and testing

(38)

UPS Scalability

(39)

Serviceability

(40)

Installation

(41)

Metering/Monitoring

(42)

Legacy Power

Distribution in DC

This… Leads to this…

• PDU resides on perimeter of DC floor or in utility room. • Significant cabling runs required

• Double if loads are dual corded. • Reduces air flow/cooling efficiency

Whips = 1 per circuit

(43)

Improved Distribution

Scheme

• PDU powers PDR at end-row. • One feed from PDU.

• MAC’s are managed w/in the DC.

• Less cabling/cable management required.

• Improved cooling efficiency, fewer cables interfering with air-flow.

• TP1 compliant Xfmrs can be installed.

• Improves efficiency 1-2% over entire loading range (30-50%)

• ROI realized w/in 6 years of deployment.

(44)

Improved Distribution

Scheme: Dual Corded Loads

• Using 208/120V PDR

• Single and two pole circuits • For dual corded loads

• Improves MAC’s managed at

the row-level.

(45)

High-Density Datacenter

Power Distribution

• Using 208Y/120V Dual InputDual Input PDR

PDR

• Highly efficient use of space • Configured w/ 8 panel boards

• 12-42 poles ea. • Rated 225-800A.

• 208Y/120 to the individual racks.

• Reduces total wiring by 25%. • Simplified cabling improves air

flow and cooling efficiency.

• Improves MAC’s managed at

(46)

PDU

Benefits

•

• Improved electrical and cooling Improved electrical and cooling efficiency

efficiency; TP1 xfmr/air flow.

•

• Smaller footprint; conserves valuable Smaller footprint

DC real estate.

•

• Greater flexibility; add panel boards or Greater flexibility

sub-feed; MAC’s managed at the row.

•

• Requires fewer cables; shorter runs. Requires fewer cables

Saves resources (less Cu), installation and materials costs.

•

• Improved manageability; Improved manageability

comprehensive metering and monitoring available, branch circuit monitoring via Web IP/SNMP/Modbus TCP etc.

•

• Improved maintenance; front access Improved maintenance

reduces floor space required for service.

(47)

Product Definition

What is an ePDU?

Enclosure based power distribution unit

• AKA - power strips, PDUs, or surge strips

ePDUs are designed specifically for the

mission critical IT environment

• High density configurations • UL certified components • Fault tolerant engineering

Vertical units for the 0U space

Horizontal units for the EIA 19” space

(48)

Powering Servers

Today

Model Watts Model Watts Spec. Watts Servers Blades Density

Dell PE1850 550W PE2850 700W 15A / 120V 1,500W 4

20A / 120V 1,900W 6 HP DL360 460W DL560 550W 30A / 120V 2,900W 8 20A / 208V 3,300W 10 IBM X336 585W X346 640W 30A / 208V 5,000W 15 20A / 3P 5,700W 17 Sun X4100 550W X4200 550W 40A/208V 6,600W 20 30A / 3P 8,600W 25 1+

Rated (Average) 536W 610W 60A / 208V 10,000W 29 2+ High

60A / 3P 17,000W 2 - 3

Actual (Average ~320W ~370W 80A / 3P 23,000W 4

100A /3P 36,000W 6

Brand Servers vs. Power

Ultra Mid-Range Standard 1U Server 2U Server

The HP ‘C’ blade server and Cisco Switches can consumes 4,600W.

(49)

Power Delivery

Improvements: 208Y

• 3Y PDU deliver ~2X power using same size conductors.

• 3Y ePDU’s deliver 73% more power w/ 50% increase in conductor size. Protect the Environment Save Energy

(50)

ePDU

Functionality

• Basic- Reliable and economical power

distribution

• Metered- Easy-Read LED displays

monitors Amperage at the circuit level

•

Monitored-• Remotely monitor the amperage of each circuit

• Via Serial (MO) or Ethernet (MI)

• Switched

• Remote receptacle level control • Remote monitoring

• Managed

• Managment down to the receptacles level, monitor and control

• Robust firmware and onboard processing capabilities. Power Delivery Vertical or horizontal configurations Standard- <4kW, 15-30A Mid-Range- 4-10kW, 15-40A High-Range- 10-15kW, 30-60A Ultra High-Range- 15-36kW, 60A

80-100A variations are also available.

(51)

High-Density

ePDU Benefits

Protect the Environment Save Energy

(52)

The Greener

Pasture

Save Energy Protect the Environment BiCSi Apr 08 Green Benefits: • Raise DC Infrastructure eff. 50-70%

• Elim. 400 cars worth of C

for a typical 1MW DC

• Red. Elect. Cost $1.7M

Over 10 years.

• Free 20% DC power and

(53)

The Efficient Datacenter

Power Chain

• Utility/Gen Set • Switchgear

• UPS w/ dual DC sources/battery plant and flywheel • 480V PDU with dual input A/B and TP1 xfmr.

• Static Switch A/B selector. • 208Y PDR

• 208Y Rack mounted Automatic Transfer Switch (ATS) • 208Y/120 Rack mounted Power Distribution Units (ePDU)