March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85,...
Transcript of March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85,...
![Page 1: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/1.jpg)
inst.eecs.berkeley.edu/~ee241b
Borivoje Nikolić
EE241B : Advanced Digital Circuits
Lecture 17 – Power-Performance Tradeoffs
1EECS241B L17 POWER-PERFORMANCE TRADEOFFS
March 16, hpcwire.com: Folding@home Turns
Its Massive Crowdsourced Computer Network
Against COVID-19
![Page 2: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/2.jpg)
Announcements
• Project midterm reports postponed until Tuesday, March 31
• Assignment 3 postponed until Thursday, April 2.
• Reading – req’d• Markovic et al, Methods for true energy-performance optimization, IEEE Journal
of Solid-State Circuits, vol. 39, no.8, pp. 1281-1293, August 2004.
• Chandrakasan and Brodersen, Low power CMOS digital design, IEEE Journal of Solid-State Circuits, vol. 27, no. 4, pp. 473-484, Apr. 1995.
• Recommended• Zyuban et al, Integrated Analysis of Power and Performance for Pipelined
Microprocessors, IEEE Trans. on Computers, vol.53, no. 8, August 2004.
2EECS241B L17 POWER-PERFORMANCE TRADEOFFS
![Page 3: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/3.jpg)
Outline
• Module 4• SRAM alternatives
• Module 5• Low-power design
• Power-performance tradeoffs
3EECS241B L17 POWER-PERFORMANCE TRADEOFFS
![Page 4: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/4.jpg)
4.J SRAM Alternatives
4EECS241B L17 POWER-PERFORMANCE TRADEOFFS
![Page 5: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/5.jpg)
eDRAM
• Process cost: Added trench capacitor
Barth, ISSCC’07, Wang, IEDM’06EECS241B L17 POWER-PERFORMANCE TRADEOFFS 5
![Page 6: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/6.jpg)
Crosspoint Memories• Barrett, IRE Trans. Comp. 1961.
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 6
![Page 7: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/7.jpg)
Crosspoint Memories
• Neale, Nelson, Moore, Electronics’70• 16 x 16 array (256b) of ‘read-mostly memory’
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 7
![Page 8: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/8.jpg)
Crosspoint Memory
• Four modes• Form
• Set
• Reset
• Read
Endurance
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 8
![Page 9: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/9.jpg)
3D Crosspoint Arrays
• Yeh, JSSC’15
Ou, JSSC’11
Kau, IEDM’09
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 9
![Page 10: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/10.jpg)
Crosspoint Arrays
• Read and sneak currents
Bae, TED 4/17
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 10
![Page 11: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/11.jpg)
In the News…
• Intel Optane = 3D XPoint
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 11
![Page 12: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/12.jpg)
Optane DDR
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 12
![Page 13: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/13.jpg)
5. Low-Power Design
13EECS241B L17 POWER-PERFORMANCE TRADEOFFS
![Page 14: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/14.jpg)
Importance of Power Awareness• Energy: Crucial for Portable Applications
• Determines battery lifetime
• Amount of computation that can be performed
• Performance is what sells products
• Power: Crucial for High-Performance Applications• Determines cooling and energy costs
• Most designs today are power limited
• Still need maximum performance
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 14
![Page 15: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/15.jpg)
The Old Design Philosophy
• Maximum performance is primary goal• Minimum delay at circuit level
• Architecture implements the required function with target throughput, latency
• At circuit level, supplies, thresholds set to achieve maximum performance, subject to reliability constraints
• Performance achieved through optimum sizing, logic mapping, architectural transformations
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 15
![Page 16: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/16.jpg)
Constant Field Scaling Model
Traditional scaling model
CVDDf2 3.1)7.0
1()7.0()14.17.0
1(Power 22
1),
7.0(Freqand,7.0VDDIf
CVDDf2 3.1)7.0
1()7.0()14.17.0
1(Power 22
1),
7.0(Freqand,7.0VDDIf
CVDD 8.1)2()7.0()14.17.0
1(fPower,2Freqand,7.0VDDIf
222
CVDD 8.1)2()7.0()14.17.0
1(fPower,2Freqand,7.0VDDIf
222
CVDD 7.2)2()85.0()14.17.0
1(fPower,2Freqand,85.0VDDIf
222
CVDD 7.2)2()85.0()14.17.0
1(fPower,2Freqand,85.0VDDIf
222
Maintaining the frequency scaling model of 1990s
While slowing down voltage scaling
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 16
![Page 17: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/17.jpg)
2001 Picture: Power As a Problem
5KW 18KW
1.5KW 500W
4004800880808085
8086286
386486
Pentium® proc
0.1
1
10
100
1000
10000
100000
1971 1974 1978 1985 1992 2000 2004 2008Year
Pow
er (W
atts
)
Power delivery and dissipation will be prohibitive
S. Borkar
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 17
![Page 18: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/18.jpg)
The New Design Philosophy
• Maximum performance is too power-hungry, and/or not even practically achievable
• Extract maximum performance under a power/energy envelope
• Excess performance (as offered by technology) to be used for energy/power reduction
Trading off speed for powerEECS241B L17 POWER-PERFORMANCE TRADEOFFS 18
![Page 19: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/19.jpg)
5.A Power and Energy Basics
19EECS241B L17 POWER-PERFORMANCE TRADEOFFS
![Page 20: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/20.jpg)
Portability: Battery Limits
• Little change in basic technology• store energy using a chemical reaction
• Battery capacity doubles every 10 years• Has slowed down
• Energy density/size, safe handling are limiting factor
Energy densityof material
KWH/kg
Gasoline 14
Lead-Acid 0.04
Li polymer 0.15EECS241B L17 POWER-PERFORMANCE TRADEOFFS 20
![Page 21: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/21.jpg)
Battery Progress
0
50
100
150
200
1940 1960 1980 2000 2020
First Commercial Use
Energy Density(Wh/kg) Trend Line
NiCd SLA NiMH Li-Ion ReusableAlkaline
Li-Polymer
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 21
![Page 22: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/22.jpg)
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 22
![Page 23: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/23.jpg)
Battery Technology Saturating
Battery capacity naturally plateaus as systems develop
[Courtesy: M. Doyle, Dupont]
0
100
200
300
400
500
600
1995 1997 1999 2001 2003 2005 2007 2009
Ener
gy D
ensi
ty (W
h/L)
Year
18650 Li-ion Cell Energy Density
Energy
0
100
200
300
400
500
600
1995 1997 1999 2001 2003 2005 2007 2009
Ener
gy D
ensi
ty (W
h/L)
Year
18650 Li-ion Cell Energy Density
Energy
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 23
![Page 24: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/24.jpg)
5.B Power-Performance Tradeoffs
24EECS241B L17 POWER-PERFORMANCE TRADEOFFS
![Page 25: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/25.jpg)
Know Your Enemy
• Where does power go in CMOS?
• Switching (dynamic) power• Charging capacitors
• Leakage power• Transistors are imperfect switches
• Short-circuit power• Both pull-up and pull-down on during transition
• Static currents• Biasing currents
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 25
![Page 26: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/26.jpg)
Summary of Power Dissipation Sources
• – switching activity
• CL – load capacitance
• CCS – short-circuit “capacitance”
• Vswing – voltage swing
• f – frequency
DDLeakDCDDswingCSL VIIfVVCCP ~
IDC – static current Ileak – leakage current
powerstaticrateoperationenergyP
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 26
![Page 27: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/27.jpg)
CMOS Performance Optimization• Reminder - sizing: Optimal performance with equal fanout per stage
• Extendable to general logic cone through ‘logical effort’
• Equal effective fanouts (giCi+1/Ci) per stage
• Optimal fanout is around 4
CL
CL
predecoder
3 15
CW
word driver
addrinput
wordline
[Ref: I. Sutherland, Morgan-Kaufman‘98]EECS241B L17 POWER-PERFORMANCE TRADEOFFS 27
![Page 28: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/28.jpg)
Performance Optimization
Energy
Increasing performanceincreases power!
Delay =1/PerformanceEECS241B L17 POWER-PERFORMANCE TRADEOFFS 28
![Page 29: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/29.jpg)
Performance Optimization
Energy
Delay = 1/Performance
Mircoarchitecture A
Mircoarchitecture B
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 29
![Page 30: March 16, hpcwire.com: Folding@home Turns Its Massive ...ee241b/sp20/...0.7 1 Power f (If V DD 0.85, and Freq 2, ... Microsoft PowerPoint - Lecture17-Power-Performance.pptx Author:](https://reader036.fdocuments.net/reader036/viewer/2022071214/604251b061bd9f704f2a3588/html5/thumbnails/30.jpg)
Next Lecture
• Spring break
• Low-power design• Power-performance tradeoffs
EECS241B L17 POWER-PERFORMANCE TRADEOFFS 30