Data Center
Energy Efficiency
Opportunities
What Managers Should Know
Mike Walker
President, AlterAction Inc.
(An ENERGY STAR Technical Support Contractor)
Who are we?
•
Work on behalf of EPA’s ENERGY STAR
program as “technical support contractors”
•
3 core areas of expertise:
– Large scale “human behavior change”
– IT management & consulting
– Energy efficiency, sustainability
•
Vendor/product/solution neutral
State Electronics Challenge
•
Promotes lifecycle stewardship of computers &
imaging equipment
—
Buying green
—
Operating efficiently
•
Power management
•
Extending product life
•
Reducing paper usage
—
Managing responsibly
SEC Best Practices
Use
•
Establish & promote policy/directive for power
management & paper use reduction
•
Ensure ENERGY STAR “sleep” function enabled on
all computers & monitors
– Power down features imaging equipment
•
Extend life of equipment
•
Ensure double-sided printing features used on 75%
We are here today because
data centers...
1.
Consume a lot of energy
– Energy consumption grew:
• 200% from 2000-5
• 36% from 2006-10
– 2% of electricity in US
2.
Can be made far more
efficient
– Efficient data centers can
Server rooms/closets in
commercial buildings
Typical office building:
23%
of annual energy costs
High efficiency office building:
40-50%
Savings remain untapped…
Split incentives
Risk aversion
Some solutions require new
expertise
Presentation Goals
1.
Identify drivers of energy costs
2.
Provide non-technical overview of measures
3.
Empower managers to spot opportunities
Server rack vs. barbecue grill
• Industrial Light & Magic deployed 84 blade servers/rack. Just 1 rack…
– Uses 28 kW
– Requires 8 tons of cooling per rack
– Heat equivalent to 4 Weber Spirit gas grills
vs.
Data center energy savings: 3
areas of opportunity
1.
IT equipment
2.
Airflow management
Eliminating unused servers &
systems
• Opportunity: – 8-10% of servers performing no useful function • Why?– Good at provisioning, not so much at decommissioning
• Solution?
– Take inventory
– Identify, remove comatose servers
• Eliminating one server can save $2500/year in energy, software licensing, & maintenance costs
Consolidating lightly utilized
servers
• Due to traditional one workload, one box approach
– More than 90% of all x86 servers run at <12% utilization
– Typical server runs at < 6% utilization
• Four smarter approaches:
– Combine apps onto a single server/operating system instance
– Reduce redundancy by clustering servers
– Downsize application portfolio
What is a “virtual machine?”
•
Software that simulates
server hardware & OS
•
Allows for multiple
concurrent OS instances
on a single “box”
•
Improves scalability,
reduces downtime, and
enables faster
Virtualization, cont.
• Cuts energy consumption by 10-40% • Ubiquitous: – 92% of large data centers – 37% of small data centers• BUT…not all systems
Virtualization reduces total
cost of ownership
• SWIC had 35 physical servers • Virtualization effort led to 35 virtual machines on 4 virtual hosts (physical servers)Right-size new servers
•
Are you fully utilizing what’s already deployed?
•
Avoid “oversizing”
– Don’t buy a tour bus when the workload calls for golf
cart
Data storage – more efficient
technology
•
Lower speed disk drives, smaller drive
platters
•
Massive array of idle disks (MAID)
– Only those disk drives in active use are
spinning at any given time
•
Solid state storage (SSDs)
– No mechanical parts
– Startup (OS) disks are good candidates
•
Tape
MAIDData Storage Resource
Management (SRM) tools
• Deduplication removes duplicate files
• Automated provisioning improves storage utilization
• Thin provisioning provides just-enough, just-in-time storage
• Tiered Storage matches storage technology to access
What is a Uninterruptable
Power Supply (UPS) system?
• Provides power until emergency generators come on line • Corrects for power surges, voltage drops, and frequency distortions
Exelon: UPS Change Improves
Efficiency & Redundancy
• Increasing “load
factor” boosts efficiency
• Example: Exelon
– Before: two 1000 kVA UPSs in parallel run at low load
– After: four smaller
(750 kVA) UPSs run at higher load
ENERGY STAR certified data
center products
Large network equipment
Storage Uninterruptible Power Supplies (UPS)
New ES servers can consume
54% less power
ENERGY STAR qualified
servers
•
Eligible servers:
– Blade, multi-node, rack-mounted, and pedestal
– ≤ 4 processor sockets per server (or blade/node)
•
Requires:
– Efficient power supplies
– Low power draws when server is at “idle”
– Advanced power management features
– Server Efficiency Rating Tool (SERT) test results
– Capabilities to measure real time power use,
ES servers made by leading
manufacturers
ENERGY STAR certified data
storage requirements
•
Efficient power supplies and variable
speed fans
•
Making available thin provisioning, data
de-duplication, lossless compression, and
delta snapshots
•
Reporting on energy consumption under
different operating conditions
Save energy with ENERGY
STAR qualified UPSs
•
ES qualified UPSs cut
energy losses by 33 - 55%
•
Different UPS types
available:
– Modular UPSs (pictured)
maximize the “load factor”
– Traditional “double
conversion” UPSs
Data center energy savings: 3
areas of opportunity
1.
IT equipment
2.
Airflow management
Raised floor environment
Proper hot aisle/cold aisle
orientation can save 5-12%
Cold aisle containment further
reduces mixing
•
Some hot air is
still mixing with
cold air
•
Containment
can save:
Airflow management
strategies
Properly located and sized vented tiles & diffusers Grommets minimize air leaks in raised floor systems Variable Speed fan Drives (VSDs) in CRACs Adequately sized return plenum or ceiling height Adequately sized supply Appropriate pressure in underfloor supply plenums; no obstructions Rigid enclosures (“containment”)
eliminate mixing Hot aisle / cold aisle layout
Airflow management devices:
blanking panels
•
Maintain the
separation of hot
and cold air in a
rack
•
A single 12”
blanking panel
can yield 1-2%
energy savings
Airflow management devices:
floor grommets
•
Improve cooling
efficiency by sealing
areas where cables
enter & exit plenums
(e.g., a raised floor)
•
Less leakage helps
direct more cold air to
the equipment that
Airflow management devices:
structured cabling
QTS conducted an extensive
air flow assessment
•
Removed obstructions to vented tiles, (e.g.,
cabling)
•
Closed vented tiles that were not in use
•
Installed self–sealing grommets
•
Used vinyl covers to seal gaps in doors, pipes
and windows
Variable Speed Drives (VSDs)
•
CRAC fans use 5-10%
total data center energy
•
Fan/pump power varies
with the cube of speed
•
Translation: 1/2 the
speed uses 1/8 the
power
VSD considerations
•
Reduced fan speed in retrofits can cause
condensation and freezing on the coils
– New CRACs with VSDs have digital compressors that slow down with fan speed
•
VSDs can affect
power quality w/
harmonics
– eBay needed 16 225-KVA harmonic mitigating transformerseBay installed VSDs on 83
CRAH units
Data center energy savings: 3
areas of opportunity
1.
IT equipment
2.
Airflow management
Turn up the heat!
•
Server inlet temps as low
as 55°F??? That’s old
school!
•
In 2008, ASHRAE
recommended 64 to 81°F
•
Save 3% to 5% in energy
costs for every 1°F
Today’s servers can stand the
heat. Safe operating ranges:
•
Sun Blade (40° to 90°F)
•
Dell Blade (50° to 95°F)
•
IBM Blade (50° to 95°F)
Raising server inlet temps:
considerations
• Can produce hot spots if not
monitored properly
• Internal server fans may
automatically turn on, raising energy costs
• Data centers with VSDs
benefit the most
• Uncomfortable working
Humidity control in the past
•
Tight relative humidity (RH)
tolerances leads to:
– CRAC #1 reads RH as too high:
• Over-cools air to remove moisture and then reheats to bring temp back up
– Results in CRAC #2 reading RH as
too low:
• Adds moisture by generating steam and cools air to bring temp back down
Solving humidity issues
•
Use dew point (DP) instead of RH to
measure humidity
•
Maintain broader ASHRAE recommended
humidity range (42 to 59 degrees °F DP)
•
Use adiabatic humidification technologies
–
Misters, foggers, ultrasonic
eBay: ½ year payback with
ultrasonic humidification
Consideration: ultrasonic humidifiers require de-ionized water
Free cooling with a water-side
economizer
• Evaporative cooling of tower produces chilled water • Heat exchanger used to bypass mechanical chiller • Downside: high capital costs • Added securityFree cooling with an air-side
economizer
Exhaust Air 85°F Outside Air 65°FIn milder climates, outside air can be used for most of the year (SFO: all but ~10 days annually!)
Hours of air-side economizer
use per year
Info available on
energystar.gov/lowcarbonit
•
Non-technical
descriptions
•
Impartial
information about
– Costs – Savings – Implementation considerationsTop 12 Data Center Opportunities
1. Virtualization of Servers
2. Decommissioning of Unused Servers
3. Consolidation of Lightly Utilized Servers
4. Data Storage Opportunities 5. Efficient Equipment Purchase 6. Hot Aisle/Cold Aisle Arrangement 7. Containment/Enclosures
8. Variable Speed Drives
9. Housekeeping: Blanking Panels, Cabling and Gaps
10. Server Inlet Temperature and Humidity Adjustments
11. Air Side Economizer 12. Water Side Economizer
Utilities often help pay for
energy saving measures
Utility Programs Vir tu aliz at io n EN ER GY S TA R Se rv er Mas siv e A rray o f Id le D isk s Un in te rru pt ib le Po we r S up pl y Ch ille rs / C oo lin g To we rs Th er m al E ner gy St or ag e St or ag e Co ns ol id at io n Air flo w Va ria bl e Fr eq uen cy D riv e Air -S id e Ec on om ize r W at er -S id e Ec on om ize r Pu m ps /M ot or s HV AC / C RA C DC P ow er
Arizona Public Service Company (APS) C C C C/P C P P C P P
Austin Energy C C C C C P P C/P
AVISTA Utilities C P P C/P
British Colombia Hydro (BC Hydro) C C C C C C C C C C C C
Commonwealth Edison C C C C C C C C P C
Duke Energy (NC, SC, OH) C C C/P C C C C/P C C P P C
Efficiency Vermont C C C P C C P P
Energy Trust of Oregon P C C C C C C/P
Focus on Energy (WI) C/P C C P C C C P C C P C
Idaho Power P P P
Nevada Power P P
New York State Energy Research and Development Authority
(NYSERDA) C C C C C C/P C C C/P C/P C
Pacific Gas & Electric Company (PG&E) C C C C C C P C C P P C
Puget Sound Energy (PSE) C C C C C
Sacrament Municipal Utility District (SMUD) C C/P C C/P C C P C/P
Salt River Project P P P
ENERGY STAR rating for data
centers
• Rewards data centers in the top 25 % of their peers in
energy efficiency
• Uses Power Usage Effectiveness (PUE)
• Allows you to compare your data center to others across
the U.S.
• Limited to stand-alone data centers or buildings that
house large data centers
NetApp Data Center in Research Triangle Park, NC
Suggested next steps
1. Schedule a walk-thru to look for potential savings
opportunities
2. Counter technical concerns/questions with…
– “You might be right: why don’t we ask an expert?”
– Schedule a (free) conference call with a vendor-neutral ENERGY STAR technical advisor
3. Estimate project ROI
– Emphasize increased reliability and redundancy as direct benefits
Contact information
• Additional information at:
www.energystar.gov/lowcarbonit
• Contacts:
– Mike Walker, AlterAction Inc. (EPA Technical Support
Contractor): 617-921-8445, [email protected] – Steve Ryan, US EPA ENERGY STAR Program Manager: