Data Center Technology

Data Center Technology:Physical InfrastructureIT Trends Affecting New Technologies and Energy Efficiency Imperatives in the Data Center

Hisham ElzahharRegional Enterprise & System Manager, Schneider Electric IT business EMEA, Dubai

Schneider Electric 2- Division - Name – Date

Electricity IN

Heat OUT

Keystrokes � Kilowatts


US Electrical Energy Sources 2006

CoalCoal50%

Petroleum2%

Natural Gas20%

Nuclear19%

Hydro-Electric7%

Other Renew ables2%

Coal

Petroleum

Natural Gas

Nuclear

Hydro-Electric

Other Renewables

Source US EIA


Prime Electrical Source


WHICH infrastructure?

BUILDING BUILDING BUILDING BUILDING BUILDING BUILDING BUILDING BUILDING infrastructureinfrastructureinfrastructureinfrastructure

““““Building systemsBuilding systemsBuilding systemsBuilding systems””””

HVACHVACElectrical systemElectrical systemFire suppressionFire suppression

LightingLightingSecuritySecurity

BMSBMS Servers, storageServers, storagehypervisorshypervisors , NMS, NMS

IT IT IT IT IT IT IT IT infrastructureinfrastructureinfrastructureinfrastructure

““““IT assetsIT assetsIT assetsIT assets””””Racks Racks

Management Management LightingLighting

Fire suppressionFire suppressionPhysical securityPhysical security

PowerPowerCoolingCooling

DATA CENTER DATA CENTER DATA CENTER DATA CENTER DATA CENTER DATA CENTER DATA CENTER DATA CENTER infrastructureinfrastructureinfrastructureinfrastructure

NETWORK NETWORK NETWORK NETWORK NETWORK NETWORK NETWORK NETWORK infrastructureinfrastructureinfrastructureinfrastructure

Switches, cabling, Switches, cabling, routersrouters


IT IT IT IT IT IT IT IT infrastructureinfrastructureinfrastructureinfrastructure

Servers, storageServers, storagehypervisorshypervisors , NMS, NMS

BUILDING BUILDING BUILDING BUILDING BUILDING BUILDING BUILDING BUILDING infrastructureinfrastructureinfrastructureinfrastructure

““““Building systemsBuilding systemsBuilding systemsBuilding systems””””

HVACHVACElectrical systemElectrical systemFire suppressionFire suppression

LightingLightingSecuritySecurity

BMSBMS

““““IT assetsIT assetsIT assetsIT assets””””

WHICH infrastructure?

NETWORK NETWORK NETWORK NETWORK NETWORK NETWORK NETWORK NETWORK infrastructureinfrastructureinfrastructureinfrastructure

Switches, cabling, Switches, cabling, routersrouters

Racks Racks Management Management

LightingLightingFire suppressionFire suppressionPhysical securityPhysical security

PowerPowerCoolingCooling

DATA CENTER DATA CENTER DATA CENTER DATA CENTER DATA CENTER DATA CENTER DATA CENTER DATA CENTER infrastructureinfrastructureinfrastructureinfrastructure

Focus of this Focus of this Focus of this Focus of this Focus of this Focus of this Focus of this Focus of this discussiondiscussiondiscussiondiscussiondiscussiondiscussiondiscussiondiscussion


Data center planning and operation is under increasing pressures

Energy and service Energy and service cost control pressurecost control pressure

Increasing availability Increasing availability expectationsexpectations

Regulatory Regulatory requirementsrequirements

Server Server consolidationconsolidation

Rapid changes in Rapid changes in IT technologyIT technology

High density High density blade server blade server power/heatpower/heat

Dynamic power Dynamic power variationvariation

UncertainUncertainlonglong --term plans for term plans for capacity or densitycapacity or density

In response, will need to change the way the In response, will need to change the way the world designs, installs, operates, manages, and world designs, installs, operates, manages, and

maintains data centersmaintains data centers


Power density of IT devicesis leveling off…

20092000

The increasing power density of data centers

Management challenge:HIGH DENSITY

KW per rackKW per rack continues to increase, raising the need continues to increase, raising the need for management to keep things under controlfor management to keep things under control

… but power density of data centersdata centers

continues to increase due to “packing” of high-density devices into smaller floor footprint


● High density increases the risk of unpredictable cooling● Capacity is “tight” in some places, unused and unusable

(“stranded”) in others ● High density requires informed and efficient allocation of

your expensive power/cooling resources● High density increases the need to know where new devices

can be “squeezed in” to available capacities

IT is getting boxed-in by limitations of

power and cooling infrastructure

High density is stressing power and cooling systems

Management challenge:HIGH DENSITY


The Newest Challenge: EFFICIENCY

Provide power and cooling in the amount needed, when needed, and

wherewherewherewhere needed – but no more than what is required for redundancy

and safety margins

But we canBut we canBut we canBut we can’’’’t manage what we cant manage what we cant manage what we cant manage what we can’’’’t measuret measuret measuret measure

Efficiency goal:


Data center

Power to

data center

Power to IT

Physical infrastructure ****

IT equipment

( )

Cabling Physical securitySwitches GeneratorLights Switchgear

****To simplify the analysis, subsystems consuming a small amount of power are not included in this discussion:

POWER

system

COOLING

system

Power toSecondarySupport

Power path

to IT

Power to IT

Power todata center

DataCenter infrastructure Efficiency

=

Datacenter Efficiency - DCiE

113

White paper

%


POWER

system

POWER

system

COOLING

system

COOLING

system

Datacenter EfficiencyData Center

Physical Infrastructure

IT


Power Chain Losses

DCiE @ 47%

4,930 barrels47 tons SO216 tons N2O

6,539 tons CO2

Per mW/yr

45 racks @ 10kW

1mW


Inefficiencies Create Consumption

● Computing inefficiencies > More servers● Server inefficiencies > More power and cooling● Power and cooling inefficiencies > More power consumption

Inefficiencies drive both power consumption Inefficiencies drive both power consumption and material consumptionand material consumption


Primary drivers of inefficiency

● Oversizing of power and cooling equipment

● Pushing cooling systems to cool densities higher than they were designed for

● Ineffective room layout● Ineffective airflow patterns● Redundancy (for availability)

● Inefficient power and cooling equipment

● Inefficient operating settings of cooling equipment

● Clogged air or water filters

● Disabled or malfunctioning cooling economizer modes

● Raised floor clogged with wires


Efficiency: key reference points

● More than 50% of the power going into a typical data center goes to the power and cooling systems – NOT to the IT loads

● The typical 1MW (IT load) data center is continuously wasting about 400kW or 2,000 tons of coal per year due to poor design (DCiE = 50%, instead of best-practice 70%)

● Every kW saved in a data center saves about $1,000 per year● Every kW saved in a data center reduces carbon dioxide

emissions by 5 tons per year● Every kW saved in a data center has a carbon reduction

equivalent to eliminating about 1 car from the road.● A 1% improvement in data center infrastructure efficiency (DCiE)

corresponds to approximately 2% reduction in electrical bills

References: APC White Paper 66


Power tools for The Efficient EnterprisePower tools for The Efficient EnterprisePower tools for The Efficient EnterprisePower tools for The Efficient Enterprise™™™™


Power tools – The “Four Cs”

omponentsomponentsomponentsomponentsMODULAR and SCALABLE, with best-in-class EFFICIENCY

loseloseloselose----coupled coolingcoupled coolingcoupled coolingcoupled cooling™

Placement of cooling units near the heat source

ontainmentontainmentontainmentontainmentThermal containment of airflow in high-density zone s

apacityapacityapacityapacity managementmanagementmanagementmanagementInstrumented intelligence to optimize use of power and cooling capacity

1111

2222

3333

4444


omponents with the “right stuff”1111

Best-in-class component EFFICIENCYEFFICIENCYEFFICIENCYEFFICIENCYEFFICIENCYEFFICIENCYEFFICIENCYEFFICIENCY

MODULAR SCALABLE MODULAR SCALABLE MODULAR SCALABLE MODULAR SCALABLE MODULAR SCALABLE MODULAR SCALABLE MODULAR SCALABLE MODULAR SCALABLE component design

External modularity Internal modularity

� Efficient

� Agile

� Scalable


Problem: Underloading

In a traditional data center, over half the power c onsumption of the power/cooling infrastructure is fixedfixed and does not go down when IT load goes down

Low loading = low efficiencyLow loading = low efficiencyLow loading = low efficiencyLow loading = low efficiencyLow loading = low efficiencyLow loading = low efficiencyLow loading = low efficiencyLow loading = low efficiency

Efficiency degrades as IT load declines

0%

10%

20%

30%

40%

50%60%

70%

80%

90%

100%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

% IT Load

Effi

cien

cy

Data centerEfficiency

IT load

Typical load range

Underloading is a primary contributor to inefficienc y

Efficiency degrades at low loads


0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

% IT Load

Effi

cien

cy

Power and cooling installation method

IT load

Efficiency gain through modular scalable Efficiency gain through modular scalable buildoutbuildout –– avoids avoids oversizingoversizing / / underloadingunderloading

Solution: Right-sizing

Data centerEfficiency


Modular scalable design

● Avoid underloading �� run more efficiently

● Pay only for what you need, when you need it

Reduce power consumption up to 30% by Reduce power consumption up to 30% by Reduce power consumption up to 30% by Reduce power consumption up to 30% by Reduce power consumption up to 30% by Reduce power consumption up to 30% by Reduce power consumption up to 30% by Reduce power consumption up to 30% by ““““““““rightrightrightrightrightrightrightright--------sizingsizingsizingsizingsizingsizingsizingsizing””””””””

power and cooling infrastructurepower and cooling infrastructurepower and cooling infrastructurepower and cooling infrastructurepower and cooling infrastructurepower and cooling infrastructurepower and cooling infrastructurepower and cooling infrastructure

PPPP = Power CCCC = Cooling RRRR = Racks


25kW50kW75kW100kW125kW150kW175kW200kW225kW250kW275kW300kW325kW350kW375kW400kW425kW450kW

500kW of scalable, high-efficiency power protection

475kW500kW


lose-coupled cooling™

● Closely couples cooling with heat load, preventing exhaust air recirculation

● Less fan power than traditional raised-floor system

● Varying equipment temperatures are constantly held to set point conditions

● Lowers operating cost by monitoring inlet temperatu res to modulate cooling capacity based on the cooling demand

Fan speed adjusts to follow changing IT heat load

Reduce power consumption up to 20% with Reduce power consumption up to 20% with Reduce power consumption up to 20% with Reduce power consumption up to 20% with Reduce power consumption up to 20% with Reduce power consumption up to 20% with Reduce power consumption up to 20% with Reduce power consumption up to 20% with InRowInRowInRowInRowInRowInRowInRowInRow®®®®®®®®

architecturearchitecturearchitecturearchitecturearchitecturearchitecturearchitecturearchitecture


Close-coupled cooling™

Cold air is supplied to the cold aisle

Cold aisleCold aisleCold aisleCold aisle

Hot aisleHot aisleHot aisleHot aisle

InRow ® air conditioner

Heat captured and rejected to chilled water

Hot-aisle air enters from rear, preventing mixing

Can operate on hard floor or raised floor


Efficiency comparison

Cooling efficiency = useful cooling power / (power consumed + useful cooling power )

40%

50%

60%

70%

80%

90%

100%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

% IT Load

Coo

ling

Effi

cien

cy

IT loadIT loadIT loadIT load

Cooling Cooling Cooling Cooling

efficiencyefficiencyefficiencyefficiency


ontainment

Hot Aisle ContainmentHot Aisle ContainmentHot Aisle ContainmentHot Aisle Containment (HAC)

Rack Air ContainmentRack Air ContainmentRack Air ContainmentRack Air Containment (RAC)

Eliminate expensive temperature crossEliminate expensive temperature crossEliminate expensive temperature crossEliminate expensive temperature crossEliminate expensive temperature crossEliminate expensive temperature crossEliminate expensive temperature crossEliminate expensive temperature cross--------contamination contamination contamination contamination contamination contamination contamination contamination

with thermal containment optionswith thermal containment optionswith thermal containment optionswith thermal containment optionswith thermal containment optionswith thermal containment optionswith thermal containment optionswith thermal containment options

● Simplifies analysis and understanding of the thermal environment

● Increases predictability of the cooling system

● Increases cooling EFFICIENCY and cooling CAPACITY by returning warmest possible air to cooling units

● Ensures proper air distribution by separating supply and return air paths


Rack Air Containment

● Rear containment prevents hot exhaust air from escaping

● All exhaust air is returned to InRow ® cooling unit

● Optional front containmentdirects cool air to front of servers

● Allows up to 60 kW per rack (30 kW with N+1 redundancy)

Top Down ViewFrontFrontFrontFront

RearRearRearRear

InRowInRowInRowInRow

coolingunit

InRowInRowInRowInRow

cooling unit

Rear Containment

Front Containment

NetShelterNetShelterNetShelterNetShelter SX SX SX SX

rack


Hot aisle containment vs traditional room cooling●Inherently higher power density capability than room designs

●Fan power is reduced by 50%

●Needless dehumidification / re-humidification is eliminated

●Need for high-bay areas and raised floors is reduced or eliminated (particularly for small installations)

●Cooling capacity can “follow”IT loads that move due to virtualization and server power management

40%

50%

60%

70%

80%

90%

100%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%

% IT Load

Coo

ling

Effi

cien

cy

Cooling efficiency = useful cooling power / (power consumed + useful cooling power )


Hot Aisle Containment areas can be added as needed


apacity Management™Increase IT staff efficiency with predictable Increase IT staff efficiency with predictable Increase IT staff efficiency with predictable Increase IT staff efficiency with predictable Increase IT staff efficiency with predictable Increase IT staff efficiency with predictable Increase IT staff efficiency with predictable Increase IT staff efficiency with predictable

Capacity ManagementCapacity ManagementCapacity ManagementCapacity ManagementCapacity ManagementCapacity ManagementCapacity ManagementCapacity Management

● Identify over- and under-utilized areas of your data center

● Minimize waste and human error via predictable software monitoring, sensing, and environmental control

● Quickly adapt to change with real-time data on what to power and where to cool


Capacity Manager™

Airflow analysisAirflow analysisAirflow analysisAirflow analysis

Locate new devices without

overheating new or existing

equipment by simulating

changes in; supply

temperature, airflow and

number of cooling units

Physical equipment Physical equipment Physical equipment Physical equipment

provisioningprovisioningprovisioningprovisioning

Quickly locate the optimum spot

for that next server based on

space, cooling, and power needs

Design analysisDesign analysisDesign analysisDesign analysis

Model the effects of and

compare alternative layouts

through detailed design

analysis

Capacity groupingCapacity groupingCapacity groupingCapacity grouping

Specify architecture

capabilities to; match IT

equipment with availability

needs ad avoid stranded

space, power and cooling

capacity

Rack elevationsRack elevationsRack elevationsRack elevations

Easy-to-use front view for

accurate and detailed

representation of equipment

layout

Available capacityAvailable capacityAvailable capacityAvailable capacity

Understand available capacity by

calculating actual space, power

and cooling consumption against

data center architecture

constraints


Capacity and energy management●Poor utilization of capacity is a primary cause of inefficiency

●Software can identify available capacity (even by rack) and help prevent creation of stranded capacity

●Side effect is you can fit more IT equipment in the power and cooling “envelope” of the data center

●Energy management can identify efficiency improvement opportunities

Infrastructure Central SoftwareWith Capacity Manager


0.0% 20.0% 40.0% 60.0% 80.0% 100.0% 120.0%

UPS

PDU

Generator

Switchgear

Distribution Wiring

CRAC

Heat Rejection

Pumps

Chiller

Humidifier

Lights

Aux Devices

IT Load

Power consumption as % of the IT load

0% 20% 40% 60% 80% 100% 120%

Power consumptions compared to the IT load

Improving efficiency

means working to

reduce power

consumption (increase

efficiency) for each of

these device categories

Power Consumption as % of IT Load

Reference: APC White Paper 114 Data for a typical tier 4 data center operating at 30% of rated load


Drivers of infrastructure efficiency gains

IMPROVEMENT Device Gain DCiE Gain$$ saved over 15

years in a 1MW data center**

Move from room cooling to

dynamic row/rack cooling70% 8% $5,900,000

Cooling economizers 38% 4% $2,500,000

Right-sizing through modular

power and cooling equipment4% 4% $2,400,000

Higher UPS efficiency 8% 4% $1,900,000

415/240 V transformerless

power distribution (NAM)*4% 2.5% $1,500,000

Dynamic control of cooling

plant (VFD fans, pumps,

chillers)25% 2.5% $1,200,000

TOTAL to get industry

from 47% to 72% DCiE 25%25%25%25% $14,700,000

(Baseline: Average of existing installed base)

**$$ values based on $.15 per kwh electric cost, starting DCiE of 47%, ave density 8KW/rack*No benefit outside of NAM; Transformer based PDUs typically in NAM only


Power Chain Losses – Could Be

DCiE @ 70%

4,930 barrels6,539 tons CO2

47 tons SO216 tons N2O

Per mW/yr

1mW

400kW

1,971 barrels2,615 tons CO2

19 tons SO26 tons N2O


Tour the booth and be entered into our daily lotter yThe lucky winner to receive a brand newAmazon Kindle e-reading device right away!

Visit us

Hall 4, booth 4405(next to the BP Carbon Theater)


Questions?Questions?Questions?Questions?

Data Center Technology

Documents

Transcript of Data Center Technology