The Role of Power in Networks

TopicsTopics

• State of Energy Efficient Ethernet- Mike Bennett, LBNL

• ENERGY STAR Small Network Equipment: Program Update- Una Song, EPA

• Energy, Ethernet and Power Distribution- Bruce Nordman, LBNL

• Thoughts on EEE- Bob Felderman, Google

ForewordForeword

The views being expressed on IEEE standards and related products should NOT be considered the position, explanation, or interpretation of the Ethernet Alliance.

TEF 2012: The End Users Speak!February 16, 2012

Questions Questions –– At the end please At the end please ……

Technology Exploration Forum

The State ofThe State ofEnergy Efficient EthernetEnergy Efficient Ethernet

Michael J. BennettLawrence Berkeley National Laboratory

Technology Exploration ForumFebruary 16, 2012 2

DiscussionDiscussion• Past

• IEEE 802.3az• Present

– EEE for 100G – possibly 40G?

• Future– How to continue energy efficiency for Ethernet?

– Optical Ethernet– Energy management

Technology Exploration ForumFebruary 16, 2012 3

Past Past –– IEEE Std 802.3azIEEE Std 802.3az --20102010

Wake

Active

Sleep Wake

Active

SleepRefresh

Tw TsTr

Tw Ts

Tq

• Specify Low Power Idle (LPI) for– “BASE-T PHYs” and Backplane PHYs

• Specify a layer 2 protocol to communicate between link partners while the link is up

Low Power Idle

Technology Exploration ForumFebruary 16, 2012 4

Past Past –– IEEE Std 802.3azIEEE Std 802.3az --20102010• Based on the premise it is most efficient to

– Send the data as fast as possible (Active)– Go to low power mode as fast and as long as possible (LPI)

Source: http://www.ieee802.org/3/az/public/jan08/hays_01_0108.pdf slide 4

• Saves ~80% of PHY power– Much more using intelligent system power control– Go to low power mode as fast and as long as possible (LPI)

• Expected benefit ( Assuming 100% adoption in US )• Save 5 TW/year, which is ~$450M/year (not including cooling)

Technology Exploration ForumFebruary 16, 2012 5

Present Present –– IEEE P802.3bjIEEE P802.3bj

• Added an objective in November, 2011

To define optional Energy-Efficient Ethernet operation for 100GBackplane and Twinaxial cable PHYs specified in P802.3bj

• Consensus group working on a baseline proposal• on track for March submission

• Proposed new “continued clocking” LPI mode• Wakes up faster, but saves less energy• May be of interest in NG Optics Study Group

Technology Exploration ForumOctober 5, 2010 6

Future Future –– where else does EEE make sense?where else does EEE make sense?

• There have been some academic papers looking into EEE and how it might apply to optical Ethernet networks

– P. Reviriego, D. Larrabeiti, J. A. Maestro, J. A. H ernandez, P. Afshar, and L. G. Kazovsky, " Energy Efficiency in 10Gbps Ethernet Transceivers: Copper versus Fiber ," in National Fiber Optic Engineers Conference, OSA Technical Digest (CD) (Op tical Society of America, 2010), paper JThA51.

– Pedro Reviriego, Jose-Alberto Hernadez, David Larra beiti, Juan Antonio Maestro, " Burst Transmission for Energy-Efficient Ethernet ," IEEE Internet Computing, vol. 14, no. 4, pp. 50- 57, July/Aug. 2010, doi:10.1109/MIC.2010.52

– P. Reviriego, J.A. Hernández, D. Larrabeiti and J.A. Maestro “ Performance Evaluation of Energy Efficient Ethernet ” IEEE Communication Letters, vol 13 no 9, September 2009, pp 697-699.

• Short term, start the conversation in NG 100G Optics SG

Technology Exploration ForumFebruary 16, 2012 7

Future Future –– interest in doing moreinterest in doing more• System Savings

- Some work being done in this area- Needs more work as this is where the higher

magnitude energy savings potential is

• Energy management software– Is just enabling EEE to save energy enough?– Should there be some centralized means to control e nergy

profiles?

Technology Exploration ForumFebruary 16, 2012 8

THANKS!

mjbennett@lbl.gov

ENERGY STAR Small Network

Equipment: Program Update

Una SongU. S. Environmental Protection Agency

Ethernet Alliance

Technology Exploration ForumFebruary 16, 2012

Topics

• ENERGY STAR Small Network Equipment program development status– Overview

– Draft 1 Updates

– Products in Consideration

• Energy Efficient Ethernet

• What is next: Large Network Equipment

• Update on Standards Development

What Is ENERGY STAR?

• Voluntary climate protection partnership with the U.S. Environmental Protection Agency (EPA)

• Strategic approach to energy management, promoting energy efficient products and practices

• Tools and resources to help save money and protect the environment

• Influential brand recognized by over 80 percent of Americans

Small Network Equipment

• Large installed base

• Always on status

• Lack of scaling

• Support eco-system energy savings

ENERGY STAR Draft

Development Overview

• ENERGY STAR Electronics programs

generally have three components:

– Partner Commitments: organizational

requirements to participate in the ENERGY

STAR program

– Specification: requirements and criteria for

earning the ENERGY STAR label

– Test Method

Development Updates

• Spring-Summer 2011: EPA completed a dataset development effort focused on industry test data

• Summer 2011: Test method revision

• Fall 2011: Draft and requirement development

• February: Draft 1 scheduled for release for stakeholder comment

Test Method Development

• Multiple revisions shared with

stakeholders for review

• 4th update used for dataset development

– Key data points:

• Links tested at 1 kb/s throughput (WAN, LAN, and

WLAN)

• Half of available wired LAN ports connected

Test Method Development

• Revision 5

– Will be released with Draft 1

– Input from Department of Energy

– Focus on procedure clarifications

• Data collected with this revision consistent with

drafts

Draft 1

• Key Elements

– Average power consumption metric

– Levels for products based on available data

– Efficient technologies (requests for feedback)

– A look ahead to future versions

Products Covered in Draft 1

• Draft 1 includes the following products (products with less than eleven wired Physical Network Ports):

– Switches

– Routers

– Access Points

– Broadband Modems (ONT, Cable, DSL)

– Integrated Access Devices (IADs)

• Initial level proposal limited to products where EPA had sufficient data available

Products Covered in Draft 1

• Two overall categories: Broadband Access Equipment and Local Network Equipment– Intended to align with testing considerations, dividing products

requiring an interface with service provider head-end equipment from those functioning within a network user’s internal network

NoYes

Broadband Access Equipment

Does the device provide Modem functionality?

Local Network Equipment

Broadband Modem

(e.g., Cable, DSL, ONT)

IAD Access Point Router Switch

Products Covered in Draft 1

• EPA recognizes likelihood of feature integration and the gray lines among product categories– Test method designed to accommodate this by testing

functions if present rather than specifying tests specific to a product type

• Limited data was received in two proposed categories: the standalone Broadband Modem category (with the exception of ONTs) and Access Points

• EPA welcomes feedback on sources of data that could be drawn upon to support creation of efficiency criteria in these areas

Energy Efficient Ethernet

• Ethernet connectivity is present in a number of existing ENERGY STAR Programs (e.g., Computers, Servers, Imaging Equipment, Televisions, Displays)

• Energy Efficient Ethernet (IEEE 802.3az) has been on EPA’s radar for some time

– Raised during Computer specification revisions as the effort was beginning

Energy Efficient Ethernet

• EPA is supportive of EEE adoption

• SNE offers ENERGY STAR an interesting savings opportunity– Savings in the network product and enabled savings

in connected EEE-compliant products

• Stakeholders encouraged to respond to Draft 1 request for feedback on savings potential and ways to provide an appropriate incentive through the ENERGY STAR program to implement EEE-compliant hardware

• Interested in also getting feedback on network connectivity proxying (ECMA-393)

Future Effort: Large Network

Equipment

• Currently scoping

• Expect to launch specification

development in 2012

• Looking at ATIS test procedures

Energy Standards Activity

• EU Code of Conduct:– Studying program impacts

– Setting up technical working groups

– EPA works to harmonize definitions and test procedures

• US Department of Energy:– Current focus set top box and network equipment

– Issued rulemaking overview and market assessment in December 2011

– Held public meeting January 2012

– http://www1.eere.energy.gov/buildings/appliance_standards/residential/set_top_boxes.html

In Closing

• Draft development is set to accelerate

• EPA always welcomes feedback and data

and encourages stakeholders interested in

participating to request updates

(networking@energystar.gov)

Questions?

• References:– ENERGY STAR Small Network Equipment (SNE)

specification revision:• www.energystar.gov/NewSpecs

• Select “Small Network Equipment”

– Requests to join the contact list, questions:• networking@energystar.gov

Thank you!

Una SongEPA, ENERGY STAR

(202) 343-9024

Song.Una@epa.gov

Evan HainesICF International

(202) 572-9456

Ehaines@icfi.com

Bizhan ZhumagaliICF International

(202) 572-9448

Bzhumagali@icfi.com

Ethernet Alliance - Technology Exploration Forum

Energy, Ethernet, andP Di t ib tiPower Distribution

Bruce NordmanLawrence Berkeley National Laboratory

February 16, 2012

BNordman@LBL.gov — eetd.LBL.gov/ea/nordman

Slide 1 of 18

Overview

• “How much energy is used?”– NationallyNationally– Locally

• Outstanding questions– EEE savings– Ethernet in consumer audio/video devices

P di t ib ti (“ id ”)• Power distribution (“nanogrids”)

Slide 2 of 18

“How much electricity” - national

Buildings Electricity: ~2,700 TWh To scale

CommercialResidential

Electronics

Networked~170 TWh ?

Net. Eqt.q~ 20 TWh

One central

~290 TWhTel.

• U S only

One central baseload power plant (about 7 TWh/year)

Slide 3 of 183

U.S. only• Annual figurescirca 2008

• All approximate

“How much” - Network equipment energy (U.S. 2008)

Small Devices (mostly

Switching Products:7.2 TWh

Slide 4 of 18

( yresidential):

5.8 TWh18 TWh Total

Expected growth: 6%/year

“How much electricity” – in my building?

• Today – difficult to determine by device– Expensive to measure; aggregatep gg g– Can estimate power – usage uncertain

• Ideald i t / i f ti– every device reports own power/energy information

– all with same protocol over IP network

IETF – Energy Management• See: http://datatracker.ietf.org/wg/eman/

( l “i tf ”)(or google “ietf eman”)• Covers protocol (SNMP) and data model for reporting

energy and power data over IP network

Slide 5 of 18

– Enables a variety of power supply topologies; proxyingto non-IP networks

Audio / video devices

• Many types of A/V devices now incorporate Ethernet– TVs, Cable STBs, Satellite STBs, IP STBs, Receivers,TVs, Cable STBs, Satellite STBs, IP STBs, Receivers,

DVD players, Game consoles, (PCs), …

• What fraction of new sales have this?• What fraction of new sales have this?• How often are Ethernet ports connected?• How frequently are they used?How frequently are they used?

• Could Ethernet save energy in A/V systems?• Is there a role for PoE in A/V systems?

Slide 6 of 18

• Is AVB being deployed?• Any other standards development needed?

EEE Status

Slide 7 of 18

EEE Status

• How widely sold is EEE today?y y• What is trajectory for incorporation into

products?

• What can we expect from EEE savings?Phasing into market– Phasing into market

– Turnover of legacy products

We should document EEE success

Slide 8 of 18

Power distribution

“Technology / infrastructure thatmoves electrons from devicesmoves electrons from devices

where they are availableto devices where they are wanted”to devices where they are wanted

• Important similarities between moving bits and• Important similarities between moving bits and moving electrons

• Important differences between moving bits and• Important differences between moving bits and moving electrons

Slide 9 of 18

Traditional power distribution

• Grid is a single undifferentiated “pool” of power

• Enormous complexity suggests difficult to manage

Slide 10 of 18

• Enormous complexity suggests difficult to manage– Only works because it is NOT managed

“Distributed” power distribution

• Network of “grids” of various sizes

• Generation and storagecan be placed anywhere

• Grids are managed locally• Interfaces between grids• Interfaces between grids

enable sharing / isolation– exchanging power g g p

whenever mutually beneficial

Slide 11 of 18

“Distributed” power distribution

• Distributed power looks a lot like the Internet

– A network of grids(“intergrid”)

P i h• Peering exchanges can be multiple, dynamic

• With reliability at edgeWith reliability at edge, core can be less reliable

• Power distribution is NOT about functionality

Slide 12 of 18

• Smallest piece is “nanogrid”

What is a Nanogrid?

“A (very) small electricity domain”( y) y

• Like a microgrid, only (much) smaller

H i l h i l l ( l ll DC)• Has a single physical layer (voltage; usually DC)

• Is a single administrative, reliability, and price domain

• Can interoperate with other (nano, micro) grids through gatewaysthrough gateways– May be multiple

• With storage can operate

Slide 13 of 18

g pindependently

Existing nanogrid examples

No communications• Vehicles – 12 V, 42 V, 400 V, …, , ,• eMerge – 24 V, 380 V• Downstream of UPS – 115 VAC

With i tiWith communications• Universal Serial Bus, USB – 5 V• Power over Ethernet, PoE – 48 V,• Proprietary systems

Power adapter systems• Universal Power Adapter for Mobile Devices, UPAMD – IEEE• Wireless technologies

Slide 14 of 18

Village example

• Start with single house – car battery recharged every few days– Light, phone charger, TV, ??? PVg p g– Add local generation – PV, wind, …

• Neighbors do sameB

– Interconnect two houses

• School gets PVMore variable demand

BPV

PV

PVB

– More variable demand

• Eventually all houses, businesses connected in a mesh– Can consider when topology should be changedCan consider when topology should be changed

• Existence of generation, storage, households, connections all dynamic

Slide 15 of 18

• Can later add grid connection

Nanogrids and Ethernet

• Define a “meta-architecture”– Operation within grid, gateway semantics, role of pricesOperation within grid, gateway semantics, role of prices– Add features to PoE/LLDP to support this

• Define specific gateways (voltage, communication)p g y ( g , )

• Treat other physical layers (DC technologies) as allies– Not zero-sum gameg

• Create demonstrations integrating storage, and connecting to local generation

– In industrialized and developing world

Slide 16 of 18

Why embrace distributed power?

• It is useful, can save money in variety of ways

• Has many energy advantages• Has many energy advantages– Better efficiency for native DC loads– Easier (cheaper) renewables integration( p ) g– Benefits are immediate– Change can be accomplished quickly (locally)– Are bottom-up and de-centralized– Leverage other advantages for cost, motivation

• Can interoperate with a smart(er) grid

• Better integration with mobile devices, mobile buildings

Slide 17 of 18

• Can help bring good electricity services to developing countries

Thank you

Slide 18 of 18

Thoughts on EEE

Bob FeldermanGoogle Platforms GroupTechnology Exploration ForumFebruary 16, 2012

Power and Efficiency

Efficient power utilization is HUGELY important to datacenter operators. Google's 2010 electricity consumption was

2,259,998 MWh. At a hypothetical $0.10 per KWh(easy to do the math, not a real number)that's $226M / yearhttp://www.google.com/green/the-big-picture.html

Proportionality is a Key Desire

The heart of the datacenter is servers+network. Today the servers are the dominant cost and dominant energy cost. They have not been energy-proportional in the past, but are getting better.

Server Power vs Utilization

yesterday near future?90% busy - use 90% of the rated power10% busy - use 20% of the rated power

90% busy - use 90% of the rated power10% busy - use 55% of the rated power “The Case for Energy-Proportional Computing”, Luiz André Barroso, Urs Hölzle, IEEE Computer, vol. 40 (2007).

As Servers Get Better -Networks looks Worse

Need wide dynamic power rangeCPUs can operate over a wide range (70%)DRAM is more like 50%Disk Drives 25%Network switches 15%

Need active low power modes

CPUs can still get work done at low powerDRAM, Disks and Network, not so much

Energy Proportional Networks“Energy Proportional Datacenter Networks”, Dennis Abts, Mike Marty, Philip Wells, Peter Klausler, Hong Liu, Proceedings of the International Symposium on Computer Architecture, 2010, pp. 338-347.

Infiniband16x range of speedand60% dynamic power Ethernet40G sometimes is 4x10, could we get 1,2,3,4x10 support with energy savings?

Same for 100G (10x10) or (4x25).

Optical Links are Important

Data centers are not small and they are engineered spaces, not random collections of machines/locations like an office. "Cheap" copper links to a few meters may be sufficient, but then optics are used beyond that range. Likely a lot of value in figuring out EEE for optical links.

The System Matters

Typical routers/switches don't yet have their dominant power in links. We need a way to reduce power IN the equipment in addition to the links.ElasticTree: Saving Energy in Data Center NetworksB. Heller, S. Seetharaman, P. Mahadevan, Y. Yiakoumis, P. Sharma, S. Banerjee, N. McKeown, USENIX NSDI, April, 2010

In all cases, turning the switch on consumes most of the power; going from zero to full traffic increases power by less than 8%. Turning off a switch yields the most power benefits, while turning off an unused port saves only 1-2 WattsP. Mahadevan, P. Sharma, S. Banerjee, and P. Ranganathan. A Power Benchmarking Framework forNetwork Devices. In Proceedings of IFIP Networking, May 2009.

OpenFlow and Software Defined Networking combined with EEE techniques could lead to best-in-class energy utilization for networking?