March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85,...

30
inst.eecs.berkeley.edu/~ee241b Borivoje Nikolić EE241B : Advanced Digital Circuits Lecture 17 – Power-Performance Tradeoffs 1 EECS241B L17 POWER-PERFORMANCE TRADEOFFS March 16, hpcwire.com: Folding@home Turns Its Massive Crowdsourced Computer Network Against COVID-19

Transcript of March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85,...

Page 1: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

inst.eecs.berkeley.edu/~ee241b

Borivoje Nikolić

EE241B : Advanced Digital Circuits

Lecture 17 – Power-Performance Tradeoffs

1EECS241B L17 POWER-PERFORMANCE TRADEOFFS

March 16, hpcwire.com: Folding@home Turns

Its Massive Crowdsourced Computer Network

Against COVID-19

Page 2: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Announcements

• Project midterm reports postponed until Tuesday, March 31

• Assignment 3 postponed until Thursday, April 2.

• Reading – req’d• Markovic et al, Methods for true energy-performance optimization, IEEE Journal

of Solid-State Circuits, vol. 39, no.8, pp. 1281-1293, August 2004.

• Chandrakasan and Brodersen, Low power CMOS digital design, IEEE Journal of Solid-State Circuits, vol. 27, no. 4, pp. 473-484, Apr. 1995.

• Recommended• Zyuban et al, Integrated Analysis of Power and Performance for Pipelined

Microprocessors, IEEE Trans. on Computers, vol.53, no. 8, August 2004.

2EECS241B L17 POWER-PERFORMANCE TRADEOFFS

Page 3: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Outline

• Module 4• SRAM alternatives

• Module 5• Low-power design

• Power-performance tradeoffs

3EECS241B L17 POWER-PERFORMANCE TRADEOFFS

Page 4: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

4.J SRAM Alternatives

4EECS241B L17 POWER-PERFORMANCE TRADEOFFS

Page 5: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

eDRAM

• Process cost: Added trench capacitor

Barth, ISSCC’07, Wang, IEDM’06EECS241B L17 POWER-PERFORMANCE TRADEOFFS 5

Page 6: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Crosspoint Memories• Barrett, IRE Trans. Comp. 1961.

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 6

Page 7: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Crosspoint Memories

• Neale, Nelson, Moore, Electronics’70• 16 x 16 array (256b) of ‘read-mostly memory’

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 7

Page 8: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Crosspoint Memory

• Four modes• Form

• Set

• Reset

• Read

Endurance

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 8

Page 9: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

3D Crosspoint Arrays

• Yeh, JSSC’15

Ou, JSSC’11

Kau, IEDM’09

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 9

Page 10: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Crosspoint Arrays

• Read and sneak currents

Bae, TED 4/17

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 10

Page 11: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

In the News…

• Intel Optane = 3D XPoint

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 11

Page 12: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Optane DDR

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 12

Page 13: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

5. Low-Power Design

13EECS241B L17 POWER-PERFORMANCE TRADEOFFS

Page 14: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Importance of Power Awareness• Energy: Crucial for Portable Applications

• Determines battery lifetime

• Amount of computation that can be performed

• Performance is what sells products

• Power: Crucial for High-Performance Applications• Determines cooling and energy costs

• Most designs today are power limited

• Still need maximum performance

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 14

Page 15: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

The Old Design Philosophy

• Maximum performance is primary goal• Minimum delay at circuit level

• Architecture implements the required function with target throughput, latency

• At circuit level, supplies, thresholds set to achieve maximum performance, subject to reliability constraints

• Performance achieved through optimum sizing, logic mapping, architectural transformations

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 15

Page 16: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Constant Field Scaling Model

Traditional scaling model

CVDDf2 3.1)7.0

1()7.0()14.17.0

1(Power 22

1),

7.0(Freqand,7.0VDDIf

CVDDf2 3.1)7.0

1()7.0()14.17.0

1(Power 22

1),

7.0(Freqand,7.0VDDIf

CVDD 8.1)2()7.0()14.17.0

1(fPower,2Freqand,7.0VDDIf

222

CVDD 8.1)2()7.0()14.17.0

1(fPower,2Freqand,7.0VDDIf

222

CVDD 7.2)2()85.0()14.17.0

1(fPower,2Freqand,85.0VDDIf

222

CVDD 7.2)2()85.0()14.17.0

1(fPower,2Freqand,85.0VDDIf

222

Maintaining the frequency scaling model of 1990s

While slowing down voltage scaling

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 16

Page 17: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

2001 Picture: Power As a Problem

5KW 18KW

1.5KW 500W

4004800880808085

8086286

386486

Pentium® proc

0.1

1

10

100

1000

10000

100000

1971 1974 1978 1985 1992 2000 2004 2008Year

Pow

er (W

atts

)

Power delivery and dissipation will be prohibitive

S. Borkar

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 17

Page 18: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

The New Design Philosophy

• Maximum performance is too power-hungry, and/or not even practically achievable

• Extract maximum performance under a power/energy envelope

• Excess performance (as offered by technology) to be used for energy/power reduction

Trading off speed for powerEECS241B L17 POWER-PERFORMANCE TRADEOFFS 18

Page 19: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

5.A Power and Energy Basics

19EECS241B L17 POWER-PERFORMANCE TRADEOFFS

Page 20: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Portability: Battery Limits

• Little change in basic technology• store energy using a chemical reaction

• Battery capacity doubles every 10 years• Has slowed down

• Energy density/size, safe handling are limiting factor

Energy densityof material

KWH/kg

Gasoline 14

Lead-Acid 0.04

Li polymer 0.15EECS241B L17 POWER-PERFORMANCE TRADEOFFS 20

Page 21: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Battery Progress

0

50

100

150

200

1940 1960 1980 2000 2020

First Commercial Use

Energy Density(Wh/kg) Trend Line

NiCd SLA NiMH Li-Ion ReusableAlkaline

Li-Polymer

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 21

Page 22: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 22

Page 23: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Battery Technology Saturating

Battery capacity naturally plateaus as systems develop

[Courtesy: M. Doyle, Dupont]

0

100

200

300

400

500

600

1995 1997 1999 2001 2003 2005 2007 2009

Ener

gy D

ensi

ty (W

h/L)

Year

18650 Li-ion Cell Energy Density

Energy

0

100

200

300

400

500

600

1995 1997 1999 2001 2003 2005 2007 2009

Ener

gy D

ensi

ty (W

h/L)

Year

18650 Li-ion Cell Energy Density

Energy

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 23

Page 24: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

5.B Power-Performance Tradeoffs

24EECS241B L17 POWER-PERFORMANCE TRADEOFFS

Page 25: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Know Your Enemy

• Where does power go in CMOS?

• Switching (dynamic) power• Charging capacitors

• Leakage power• Transistors are imperfect switches

• Short-circuit power• Both pull-up and pull-down on during transition

• Static currents• Biasing currents

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 25

Page 26: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Summary of Power Dissipation Sources

• – switching activity

• CL – load capacitance

• CCS – short-circuit “capacitance”

• Vswing – voltage swing

• f – frequency

DDLeakDCDDswingCSL VIIfVVCCP ~

IDC – static current Ileak – leakage current

powerstaticrateoperationenergyP

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 26

Page 27: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

CMOS Performance Optimization• Reminder - sizing: Optimal performance with equal fanout per stage

• Extendable to general logic cone through ‘logical effort’

• Equal effective fanouts (giCi+1/Ci) per stage

• Optimal fanout is around 4

CL

CL

predecoder

3 15

CW

word driver

addrinput

wordline

[Ref: I. Sutherland, Morgan-Kaufman‘98]EECS241B L17 POWER-PERFORMANCE TRADEOFFS 27

Page 28: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Performance Optimization

Energy

Increasing performanceincreases power!

Delay =1/PerformanceEECS241B L17 POWER-PERFORMANCE TRADEOFFS 28

Page 29: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Performance Optimization

Energy

Delay = 1/Performance

Mircoarchitecture A

Mircoarchitecture B

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 29

Page 30: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:

Next Lecture

• Spring break

• Low-power design• Power-performance tradeoffs

EECS241B L17 POWER-PERFORMANCE TRADEOFFS 30