You are on page 1of 27

Addressing multiple cooling challenges

with rack and row cooling architecture


Presented by: Kevin Dunlap
Director, Business Strategy - Cooling
The problem
ƒ Rack power densities of up to 30kW or more per rack thermally
challenge traditional data centers that were designed for an
average of 3kW per rack
ƒ Data center lifetime will span refresh cycles involving unknown
load and therefore heat profiles
ƒ Newer IT equipment exhibits dynamic power variation where
power and heat output vary more than 3:1 over time
ƒ Pushing traditional data centers to achieve high density
reduces the efficiency of air conditioners, unnecessarily
driving up electricity use
ƒ Users cannot predict if the designed-in cooling redundancy of
their system will actually work

Result: an impossible planning challenge

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Cooling Challenges
ƒ Increasing Densities
ƒ Rack loads may vary from 2-30 kW in the same environment
ƒ A scalable cooling solution to handle future densities
ƒ Efficiency Strain
ƒ Not addressing increased heat load can result in reduction of
server efficiency
- Pull back on processing power
- Increase in server fan speed

Fewer Instructions per Watt !!!


2006 Average
= 6-8 kW rack

Source: IDC

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Drivers for Energy Efficient Cooling

ƒ Real estate
ƒ Energy efficient infrastructure allows more space for IT
ƒ Compaction of IT equipment
ƒ Increasing energy costs
ƒ Commercial costs as high as $.13 kW/hour
ƒ Maximizing the investment in IT equipment
ƒ Lowering the kW entering the data center for every 1 kW
consumed by IT
ƒ Maximizing the computing per watt (Mips/kW)
ƒ Power Availability
ƒ Limits on available power for new and existing data centers
ƒ 40% of end users claiming that demand is greater than supply
ƒ New power generation is only 1.3% increase per year

Source: U.S. Department of Energy, IDC

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Inefficient Response to Drivers

ƒ Supply colder air to the room


ƒ This lowers the return air and reduces the actual cooling
capacity
ƒ Increases moisture removal which must be added back to the
room
ƒ Adding Units to Increase Capacity
ƒ May slightly address some heat issues at an electrical cost

These Cost Money and Don’t


Solve the Problem: Air
Distribution
© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Cooling Challenges Not Limited To Data
Center
ƒ IT/Wiring Closets
ƒ VOIP and POE driving up densities
ƒ Space not designed for high heat loads
ƒ 5-7 watts/ft2 as office space
ƒ 50-100 watts/ft2 as wiring closet or small data center

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Solutions for Wiring Closets and Small
Computer Rooms
ƒ InRow SC
ƒ Self Contained 5 kW
ƒ Heat rejected to plenum

ƒ Ventilation Unit
ƒ Airflow enhancer
ƒ Promotes circulation

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Same racks, same room, slightly different
cooling design

Totally different cooling airflow results!


Current approaches provide unpredictable performance
© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
High density cooling systems of the future

ƒ Rack-mount IT equipment will continue to be air


cooled for the foreseeable future
ƒ Row or cabinet based distributed cooling systems
will be used to scavenge hot air closer to the IT
equipment
ƒ The cooling technology at the row and cabinet
level will be water or refrigerant based
ƒ This equipment will be modular and will not
fundamentally require a raised floor

The legacy raised floor cooling architecture will be


superseded for high density applications by more
predictable and efficient approaches
© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Alternative cooling architectures
Method Application Density
Traditional room- Low density 1-5kW per rack
oriented raised Very flexible
floor cooling
In-row Medium density 3-15kW per rack
General use

In-row with hot Very high density 10-25kW per rack


aisle containment Targeted zones
Assured redundancy

Rack-coupled Very high density specific 20-45kW per rack


racks
Mix of very high and low
density

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Close Coupling: In-row approach (InRow RC)
ƒ ½ Rack form factor
ƒ 20kW rating
ƒ N+1 hot-swap variable speed
fans
ƒ Captures hot air exhaust from
nearby IT racks
ƒ Overhead or under-floor piping
ƒ Works with any brand of IT
cabinet
ƒ Add units for redundancy or
density
InfraStruXure Cooling Distribution Unit
© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
InRow RP

ƒ Full Rack In-Row


ƒ Chilled water or
refrigerant
ƒ Variable speed fans
ƒ Variable capacity
compressor
ƒ 40-60 kW
ƒ Precision AC –
Dehumidify/Reheat/Hum
idifier
ƒ Global Product
ƒ Integrated Management

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Basic in-row design
Hot-aisle air enters
from rear preventing Cold air is supplied to
mixing the cold aisle

Heat captured and


rejected to chilled
water

InRow RC
Can operate on hard
floor or raised floor

InfraStruXure® InRow RC
© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
CFD model of in-row system:
Modeling failure of one CRAC
In-row rack-coupled CRAC
ƒ Bayed to adjacent IT racks
ƒ Up to 40kW rating
ƒ N+1 hot-swap fans
ƒ Directly ducts hot air
exhaust from connected
IT rack
ƒ Front may be open or
ducted
ƒ Mix into existing legacy
data center
ƒ Add second unit for
redundancy or capacity
InfraStruXure Cooling Distribution Unit
© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Rack Air Containment System

ƒ Rack Air Containment


System
ƒ Plan View

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Hot Aisle Containment

ƒ Shared
Capacity
ƒ Ease of
Redundancy
ƒ Zoned
approach
ƒ Room
independence

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Room-oriented cooling airflow patterns
Row-oriented cooling airflow patterns
Dynamic power of loads amplifies the
problems
ƒ Power consumption of new servers varies by 2:1 or more
depending on computational load
ƒ The variation in server power means thermal output also varies
by 3:1 or more
ƒ This means current data center temperatures tell you little
about what the temperature will be minutes or hours from now
ƒ CFD analysis or ASHRAE TC 9.9 testing will be useless in
determining the condition of your cooling system
ƒ Users cannot predict if the designed-in cooling redundancy of
their system will actually work even if it works right now

Measurement is futile: A cooling system with


assured predictable performance is required

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
A Hybrid Approach to Cooling
ƒ Most Data Centers will have a mix of heat densities
and therefore cooling solutions
ƒ IT Refreshes happen every 2-4 years resulting in a mix
of distributed IT assets
ƒ IT management of blades and storage deployments is
often in clusters
- Concentrated high density loads
ƒ Older server assets may be well served by room cooling
units

Row-oriented
Rack-oriented
d

Room-oriented
© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
What about installation and piping?

ƒ Water in the data center?


ƒ What about leaks and condensation?
ƒ Complicated installation?
ƒ Retrofittable to existing data center?

InfraStruXure® InRow RC
© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
PEX/Aluminum laminated seamless piping

Flexible:
Earthquake and
impact resistant

Joint-less bends
Eliminate leaks

Under-floor or overhead water distribution

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Coolant Distribution Unit (CDU)
Main supply and return headers
Supplies and returns coolant to and from the
Chiller

Isolation and balancing


valve
Allows isolation for servicing and
provides coolant flow adjustment Top or bottom piping
connections

Individual supply and return Allows the CDU to be top or bottom


piped
lines
Supplies and returns coolant to and from Casters
CRAC units
Allows the CDU to be installed
Isolation valve easily
Condensate pan
Allows isolation for servicing
with drain connection

InfraStruXure® Cooling Distribution Unit


© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Typical piping layout

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
Cooling becomes more like power!

Power Cooling
Power Coolant
Distribution Unit Distribution Unit

Power Whips Cooling “Whips”

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.
More Information

For further information on these topics


consult APC white papers on
www.apc.com

ƒ #130 The Advantage of Row and Rack-Oriented


Cooling Architectures for Data Centers
ƒ #131 Improved Chilled Water Piping
Distribution Methodology for Data Centers
ƒ #125 Strategies for Deploying Blade Servers in
Existing Data Centers
ƒ #43 Dynamic Power Variations in Data Centers and
Network Rooms

© 2006 American Power Conversion Corporation. All rights reserved. All trademarks provided are the property of their respective owners.

You might also like