Rack Centric - High Voltage Distribution · Data Center Application Rack Centric - High Voltage...

Data Center Application

Rack Centric - High Voltage Distribution

Randy Malik

Senior Technical Staff Member

Research Triangle Park Raleigh, North Carolina

Email: [email protected]

High Voltage Distribution Bus

© 2004 IBM Corporation2 10/18/2007

Typical Data Center Energy End Use

33 UnitsDelivered

100 Units

35 Units

UPS

PDU

IT Racks

Chiller

CRAC

http://images.google.com/imgres?imgurl=http://www.aggreko.fi/images/page_headers/Cooling%2520Towers-Chillers.jpg&imgrefurl=http://www.aggreko.fi/images/page_headers/&h=953&w=1098&sz=184&hl=en&start=22&um=1&tbnid=8ek6yTAjlTttOM:&tbnh=130&tbnw=150&prev=/images%3Fq%3Dchillers%26start%3D20%26ndsp%3D20%26svnum%3D10%26um%3D1%26hl%3Den%26sa%3DN



Consumption: 10 to 100 times more energy per square foot than a typical office building

Electricity Used: 45 billion kWh in 2005 – about 1.2% of all retail U.S. Electricity Consumption

Power Demand : Expected to double in 10 years

Average Utilization : 20 – 25% of the capacity

Overall Efficiency = IT Power / Power Input = 30%

Carbon Footprint:Coal Fired Plants = 2 Lbs/KWh

Natural Gas = 1 Lb/KWh

Diesel = 2.19 Lbs/KWh

Some Facts about a Typical Data Center

Source: Emerson Corporation



10.2

1.1 1.5

0.15

2.31.6

0

2

4

6

8

10

12

Servers Routers Storage WANSwitches

LANSwitches

HUBs

Electricity Use TWh/year

Source: Roth K. Goldstein, F. Kleinman J(2002) Energy Consumption by Office and Telecommunication Equipment

in Commercial Buildings

Energy Consumption by Office and Telecom Equipment in Commercial Buildings



Power to Data Center

UPS

PDU

Cabling

Switches

Cooling

Lights

Generator

Switchgear

Power Path

to IT

Power To

Secondary Support

Data Center

NCPI

IT Equipment

Power to IT

Useful Output

Data Center Efficiency =Power to IT

Data Center Power IN

Data Center Efficiency considering NCPI Losses



UPS, 9%

PDU, 3%

Lighting, 1%

Wiring, 1%

CRAC, 9%

Humidifier, 1%

Chiller, 28%Power Supplies, 23%

IT, 25%

UPS PDU Lighting Wiring CRAC Humidifier Chiller Power Supplies IT

Power Consumption in a Data Center



Create a strategy for enhancing Tech utilization1.Server consolidation and virtualization

2.Grid Computing

3.High Efficiency Processors

4.High Efficiency Server Power Supplies

Size the Power System for Optimum Efficiency1. Modular Approach

Consider alternate distribution methods1. 600V AC to 208V AC to the racks

2. 480V AC direct to the racks

3. 415V AC to 240V AC to the racks

4. 480V AC to 380VDC within the racks

Power Pathway to Data Center Efficiency



0

5

10

15

20

25

30

35

40

45

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Fraction of the Power Capacity Used

Effi

cien

cy

Efficiency

Efficiency of A typical Data Center



60

65

70

75

80

85

90

95

5% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

% Load of Full Power Rating

Effic

ienc

y

UPS Power System

Efficiency of UPS & Power System as a function of Load

UPS Source : Eaton Corporation



0

50

100

150

Processor Activity

Power Consumption

Wat

ts

Note: Lower Activity by the processor does not mean lower power consumption

Power Consumption by a Processor during Active and Idle Mode

Modified Power Consumption



Time of Day Work load

0

5

10

15

20

25

30

35

40

45

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24

% T

raffi

c

Source: 2006/2007 Discussions with several NYC Financial Services firms

A typical Work Load for a Data Center for a 24 hour period



Annual Electrical Cost of a 1 MW data center ( $0.10/kWh)

00.20.40.60.8

11.21.41.61.8

2

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

Fraction of Power Capacity Used

Ann

ual E

lect

rical

Cos

t (M

$)

Annual IT Electrical Cost Annual NCPI Electrical Cost

IT Load

NCPI Load

Electrical Energy Cost of Powering a Data Center

Source: APC



Drivers for Rack Centric - High Voltage Distribution

No UPS

No PDU

Modularity

Cooling

Cost

Efficiency

High Voltage

Drivers



IT 480V AC

UPS

PDU

PDU

IT Racks9% 3%

208 /120V

208 /120V

Power Path for IT Racks in a Typical Data Center

http://images.google.com/imgres?imgurl=http://www.crucialpower.com/img/products/PDU1.jpg&imgrefurl=http://www.crucialpower.com/PDU2.html&h=387&w=360&sz=38&hl=en&start=13&um=1&tbnid=HjXm_4d-KQ5VuM:&tbnh=123&tbnw=114&prev=/images%3Fq%3Dpdu%26svnum%3D10%26um%3D1%26hl%3Den%26sa%3DG

http://images.google.com/imgres?imgurl=http://www.crucialpower.com/img/products/PDU1.jpg&imgrefurl=http://www.crucialpower.com/PDU2.html&h=387&w=360&sz=38&hl=en&start=13&um=1&tbnid=HjXm_4d-KQ5VuM:&tbnh=123&tbnw=114&prev=/images%3Fq%3Dpdu%26svnum%3D10%26um%3D1%26hl%3Den%26sa%3DG



PDU - 1

PSU 3

PSU 1

PSU 3

PSU1

208V AC

PDU - 2

PSU 4

PSU 2

PSU 4

PSU 2

+12V-A

+12V-B

+12V-A

+12V-B

Server Blade ChassisSystem Rack

AC - DC

AC Distribution

Box

Typical Power Distribution for Blade Server Racks

208V AC

http://www.v3.zdnet.co.uk/i/z5/rv/2007/06/ibm_bladecenter_440x330.jpg



High Voltage DC Distribution in a Data Center

Rectifier

Rectifier

Rectifier

Rectifier

480V AC

Battery Plant

IT Racks

380V DC

Source: Lawrence Berkley National Laboratory



High Voltage DC Distribution in the Rack

AC – DC

Rectifier

AC – DC

Rectifier

3 Phase 480V AC

3 Phase 480V AC

380V DC

Server Blade Chassis




Data Flow

380V – 12V Plug in Module

UPS = 9% PDU = 3% IT Rack480 AC 208/120 AC1%1%

IT Rack Arrangement

3 Phase 480V AC



Three Phase Single Stage Series Resonant Cyclo Converter

Source: Tomasz Kotula Eaton Development Centre



Source: Vicor Corporation, Andover, USA Power Density = 1000W/in3

380V - 12V Regulator

EMC Filter + Boost + Bulk Cap Chopper

380V – 12V DC = 100W/in3

Source: Astec/Artesyn380V – 12V

VRD

uP

uP

HDD

Memory

Server Blade

Plug in Module



380V DC Bus A

AC – DC Rectifiers



3 Phase – 480V AC1

System Rack

3 Phase – 480V AC2


Battery Back Up 380V DC Bus B



Rack Centric High Voltage Distribution Bus Proposal

Blade Server



Lower Overall Cost

Higher Overall Efficiency

UPS, 9%

PDU, 3%

Lighting, 1%

Wiring, 1%

CRAC, 9%

Humidifier, 1%

Chiller, 28%Pow er Supplies, 23%

IT, 25%

UPS PDU Lighting Wiring CRAC Humidifier Chiller Power Supplies IT

Lighting, 1%Wiring, 1% CRAC, 9%Humidifier, 1%

Chiller, 28%

er Supplies, 23%Pow

IT, 38%

Lighting Wiring CRAC Humidifier Chiller Power Supplies IT

Rack Centric - High Voltage Distribution · Data Center Application Rack Centric - High Voltage...

Documents

Transcript of Rack Centric - High Voltage Distribution · Data Center Application Rack Centric - High Voltage...