Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of...
Transcript of Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of...
![Page 1: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/1.jpg)
1 / 98
Processor Design
José María Arnau
![Page 2: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/2.jpg)
2 / 98
Objective
● Understand the intricacies of advanced IC design and development
![Page 3: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/3.jpg)
3 / 98
Objective
● Understand the intricacies of advanced IC design and development
module dff(input clk, input d, output q);
always @(posedge clk)q <= d;
endmodule
...
RTL code
![Page 4: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/4.jpg)
4 / 98
Objective
● Understand the intricacies of advanced IC design and development
module dff(input clk, input d, output q);
always @(posedge clk)q <= d;
endmodule
...
RTL code
IC layout
![Page 5: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/5.jpg)
5 / 98
PD Contents
1. Moore’s Law and Dennard Scaling
2. Hardware Design Cycle
3. Functional Verification
4. Circuit Design
5. Physical Design
![Page 6: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/6.jpg)
6 / 98
Evaluation
● Presentation on related research work– PechaKucha format: 20 slides, 20 seconds/slide
● List of papers posted soon in PD web site– http://jarnau.site.ac.upc.edu/PD/
● 20% of final mark
![Page 7: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/7.jpg)
7 / 98
Practical approach
● Theory sessions are useful for lab assigments– How to write effective test benches
– How to verify your design
– How to synthesize, place and route your design
– How to estimate max freq and area of your design
● EDA tools for digital synthesis– Qflow: http://opencircuitdesign.com/qflow/
![Page 8: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/8.jpg)
8 / 98
PD Contents
1. Moore’s Law and Dennard Scaling
(a) Transistor basic physics
(b) Power wall
(c) Dark silicon
2. Hardware Design Cycle
3. Functional Verification
4. Circuit Design
5. Physical Design
![Page 9: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/9.jpg)
9 / 98
1. Moore’s Law and Dennard Scaling
![Page 10: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/10.jpg)
10 / 98
1. Moore’s Law and Dennard Scaling
The number of transistors in a dense integrated circuit doubles about every two years.
Moore’s Law
![Page 11: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/11.jpg)
11 / 98
1. Moore’s Law and Dennard Scaling
The number of transistors in a dense integrated circuit doubles about every two years.
As transistors shrink, they become faster, consume less power, and are cheaper to manufacture.
Moore’s Law
Dennard Scaling
![Page 12: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/12.jpg)
12 / 98
MOS Transistors
● Metal Oxide Semiconductor
nMOS Transistor pMOS Transistor
![Page 13: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/13.jpg)
13 / 98
MOS Transistors
nMOS gate
drain
source
pMOS gate
drain
source
![Page 14: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/14.jpg)
14 / 98
MOS Transistors
nMOS gate
drain
source
pMOS gate
drain
source
gate = 0
drain
source
OFF
![Page 15: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/15.jpg)
15 / 98
MOS Transistors
nMOS gate
drain
source
pMOS gate
drain
source
gate = 0
drain
source
OFF gate = 1
drain
source
ON
![Page 16: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/16.jpg)
16 / 98
MOS Transistors
nMOS gate
drain
source
pMOS gate
drain
source
gate = 0
drain
source
OFF gate = 1
drain
source
ON
gate = 0
drain
source
ON
![Page 17: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/17.jpg)
17 / 98
MOS Transistors
nMOS gate
drain
source
pMOS gate
drain
source
gate = 0
drain
source
OFF gate = 1
drain
source
ON
gate = 0
drain
source
ON gate = 1
drain
source
OFF
![Page 18: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/18.jpg)
18 / 98
CMOS Logic
● Inverter
![Page 19: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/19.jpg)
19 / 98
CMOS Logic
● Inverter
0
![Page 20: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/20.jpg)
20 / 98
CMOS Logic
● Inverter
0
ON
![Page 21: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/21.jpg)
21 / 98
CMOS Logic
● Inverter
0
ON
OFF
![Page 22: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/22.jpg)
22 / 98
CMOS Logic
● Inverter
0
ON
OFF1
![Page 23: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/23.jpg)
23 / 98
CMOS Logic
● Inverter
0
ON
OFF1
![Page 24: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/24.jpg)
24 / 98
CMOS Logic
● Inverter
0
ON
OFF1
1
![Page 25: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/25.jpg)
25 / 98
CMOS Logic
● Inverter
0
ON
OFF1
1
OFF
![Page 26: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/26.jpg)
26 / 98
CMOS Logic
● Inverter
0
ON
OFF1
1 ON
OFF
![Page 27: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/27.jpg)
27 / 98
CMOS Logic
● Inverter
0
ON
OFF1
1 ON
OFF
0
![Page 28: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/28.jpg)
28 / 98
CMOS Logic
● NAND gate
![Page 29: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/29.jpg)
29 / 98
CMOS Logic
● NAND gate
0
1
![Page 30: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/30.jpg)
30 / 98
CMOS Logic
● NAND gate
0
1
ON
![Page 31: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/31.jpg)
31 / 98
CMOS Logic
● NAND gate
0
1
OFF
ON
![Page 32: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/32.jpg)
32 / 98
CMOS Logic
● NAND gate
0
1
OFF
OFF
ON
![Page 33: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/33.jpg)
33 / 98
CMOS Logic
● NAND gate
0
1
OFF
OFF
ON
ON
![Page 34: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/34.jpg)
34 / 98
CMOS Logic
● NAND gate
0
1
OFF
OFF
ON
ON
1
![Page 35: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/35.jpg)
35 / 98
CMOS Logic
● NAND gate
0
1
OFF
OFF
ON
ON
1
![Page 36: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/36.jpg)
36 / 98
CMOS Logic
● NAND gate
0
1
OFF
OFF
ON
ON
11
1
![Page 37: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/37.jpg)
37 / 98
CMOS Logic
● NAND gate
0
1
OFF
OFF
ON
ON
11
1
OFF OFF
![Page 38: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/38.jpg)
38 / 98
CMOS Logic
● NAND gate
0
1
OFF
OFF
ON
ON
11
1
OFF OFF
ON
ON
![Page 39: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/39.jpg)
39 / 98
CMOS Logic
● NAND gate
0
1
OFF
OFF
ON
ON
11
1
OFF OFF
ON
ON
0
![Page 40: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/40.jpg)
40 / 98
CMOS Logic
● Complementary Metal-Oxide Semicondutor– pMOS pull-up network
– nMOS pull-down network
![Page 41: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/41.jpg)
41 / 98
CMOS Logic
● Multiplexers
![Page 42: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/42.jpg)
42 / 98
CMOS Logic
● Multiplexers
0
0
![Page 43: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/43.jpg)
43 / 98
CMOS Logic
● Multiplexers
0
0
1
![Page 44: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/44.jpg)
44 / 98
CMOS Logic
● Multiplexers
0
0
1
ON
ON
![Page 45: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/45.jpg)
45 / 98
CMOS Logic
● Multiplexers
0
0
1
ON
ON
OFFOFF
![Page 46: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/46.jpg)
46 / 98
CMOS Logic
● Multiplexers
0
0
1
ON
ON
OFFOFF
D0
![Page 47: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/47.jpg)
47 / 98
CMOS Logic
● Latches and flip-flops
D latch D flip-flop
![Page 48: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/48.jpg)
48 / 98
Moore’s Law
● The number of transistors in a dense integrated circuit doubles about every two years
![Page 49: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/49.jpg)
49 / 98
Moore’s Law
● The number of transistors in a dense integrated circuit doubles about every two years
![Page 50: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/50.jpg)
50 / 98
Moore’s Law
● The number of transistors in a dense integrated circuit doubles about every two years
~2 years
![Page 51: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/51.jpg)
51 / 98
Moore’s Law
● The number of transistors in a dense integrated circuit doubles about every two years
161514131211109876543210
1959
1960
1961
1962
1963
196
419
65
1966
1967
1968
1969
1970
1971
1972
1973
1974
1975
LO
G 2 O
F T
HE
NU
MB
ER
OF
CO
MP
ON
EN
TS
PE
R I
NT
EG
RA
TE
D F
UN
CT
ION
Electronics, April 19, 1965.
![Page 52: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/52.jpg)
52 / 98
Moore’s Law
![Page 53: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/53.jpg)
53 / 98
Moore’s LawTransistors per Square Millimeter by Year, 1971–2018. Logarithmic scale. Data from Wikipedia.
![Page 54: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/54.jpg)
54 / 98
Technology
● What do “7nm” or “10nm” technology mean?
![Page 55: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/55.jpg)
55 / 98
Layout Design Rules● Define how small features can be and how closely
they can be reliably packed
● Lambda based rules
– C. Mead and L. Conway, Introduction to VLSI Systems, Reading, MA: Addison-Wesley, 1980.
![Page 56: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/56.jpg)
56 / 98
Dennard Scaling
● As transistors shrink, they become faster, consume less power, and are cheaper to manufacture.
– Miniaturization provides smaller and faster transistors
![Page 57: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/57.jpg)
57 / 98
Dennard Scaling
● As transistors shrink, they become faster, consume less power, and are cheaper to manufacture.
– Miniaturization provides smaller and faster transistors
S
S
Area = S2
![Page 58: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/58.jpg)
58 / 98
Dennard Scaling
● As transistors shrink, they become faster, consume less power, and are cheaper to manufacture.
– Miniaturization provides smaller and faster transistors
S
S
Area = S2
0.7*S
0.7*S
Area = 0.5*S2
![Page 59: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/59.jpg)
59 / 98
Dennard Scaling
● As transistors shrink, they become faster, consume less power, and are cheaper to manufacture.
– Miniaturization provides smaller and faster transistors
S
S
Area = S2
0.7*S
0.7*S
Area = 0.5*S2
● Transistor dimensions scaled by 30%
![Page 60: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/60.jpg)
60 / 98
Dennard Scaling
● As transistors shrink, they become faster, consume less power, and are cheaper to manufacture.
– Miniaturization provides smaller and faster transistors
S
S
Area = S2
0.7*S
0.7*S
Area = 0.5*S2
● Transistor dimensions scaled by 30%
● Delay reduced by 30%
![Page 61: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/61.jpg)
61 / 98
Dennard Scaling
● As transistors shrink, they become faster, consume less power, and are cheaper to manufacture.
– Miniaturization provides smaller and faster transistors
S
S
Area = S2
0.7*S
0.7*S
Area = 0.5*S2
● Transistor dimensions scaled by 30%
● Delay reduced by 30%
● Frequency increased by ~40%
![Page 62: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/62.jpg)
62 / 98
Performance Scaling
● Smaller transistors are faster– ~1.4x higher performance per generation
● More transistors allow more functionality– Better branch predictors
– Larger caches
– ILP: superscalar, out-of-order execution
– DLP: vector unit
– Better memory controller
![Page 63: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/63.jpg)
63 / 98
CPU Performance
Hennessy, J. L., & Patterson, D. A. (2011). Computer architecture: a quantitative approach. Elsevier.
![Page 64: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/64.jpg)
64 / 98
CPU Frequency
![Page 65: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/65.jpg)
65 / 98
CPU FrequencyPower wall!
![Page 66: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/66.jpg)
66 / 98
CMOS Power
● Dynamic Power– Switching power
● Static Power (Leakage)– Power dissipated even
when not switching
– Around one third of the total power in current technology
Pdyn=αCV 2 f
Psta=I leakV
Ptotal=Pdyn+Psta
![Page 67: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/67.jpg)
67 / 98
CMOS Power
● Static Power
– Gate leakage (Igate)
– Subthreshold leakage (Isub)
– Junction leakage (Ijunct)
– Depends on the temperature
![Page 68: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/68.jpg)
68 / 98
CMOS Power
Im, Y., Cho, E. S., Choi, K., & Kang, S. (2007, March). Development of Junction Temperature Decision (JTD) Map for Thermal Design of Nano-scale Devices Considering Leakage Power. In Twenty-Third Annual IEEE Semiconductor Thermal Measurement and Management Symposium (pp. 63-67). IEEE.
![Page 69: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/69.jpg)
69 / 98
Frequency vs Power
![Page 70: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/70.jpg)
70 / 98
Power Wall
![Page 71: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/71.jpg)
71 / 98
Power Wall
![Page 72: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/72.jpg)
72 / 98
Power Wall and ILP Limits
● Cannot increase performance by raising the frequency due to thermal constraints
● Diminishing returns in ILP– Computer architects optimized superscalar out-of-
order CPUs for decades
● But Moore’s law still provides more and more transistors
● What can we do with the extra transistors?
![Page 73: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/73.jpg)
73 / 98
Multi-core Processors
https://www.guru3d.com/articles-summary/amd-ryzen-5-2400g-review,2.html
![Page 74: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/74.jpg)
74 / 98
Multi-core Processors
● Use extra transistors to include multiple cores in the same chip
● Exploit TLP (Thread-Level Parallelism)● Programmer has to manually extract parallelism
– The Free Lunch Is Over. A Fundamental Turn Toward Concurrency in Software. Herb Sutter. http://www.gotw.ca/publications/concurrency-ddj.htm
![Page 75: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/75.jpg)
75 / 98
CPU Trends
![Page 76: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/76.jpg)
76 / 98
End of Dennard Scaling● According to Dennard scaling, power density remains
constant
– Smaller transistors consume less power
– If frequency is not increased, total power remains the same
● Dennard scaling did not take subthreshold leakage into account
● In current technology, more transistors result in more power
– Power density increases even at the same frequency!
P=αCV 2 f + I leakV
![Page 77: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/77.jpg)
77 / 98
Power Density
John Hennessy and David Patterson. “A New Golden Age for Computer Architecture: Domain-Specific Hardware/Software Co-Design, Enhanced Security, Open Instruction Sets, and Agile Chip Development
![Page 78: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/78.jpg)
78 / 98
Dark Silicon
● Dark Silicon and the End of Multicore Scaling. Esmaeilzadeh, H., Blem, E., Amant, R. S., Sankaralingam, K., & Burger, D. ISCA 2011.
● Part of the chip must be powered off due to thermal constraints– 22 nm: 21% of the chip powered off
– 8 nm: ~50% of the chip powered off
![Page 79: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/79.jpg)
79 / 98
Multicore Limitations
● Increasing the number of cores is no longer an effective solution to improve performance– Due to the dark silicon problem, not all the cores
can be powered at the same time
– Diminishing returns in TLP
● But Moore’s law still provides more and more transistors
● What can we do with the extra transistors?
![Page 80: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/80.jpg)
80 / 98
Hardware Accelerators● Welcome to the golden age of hardware
accelerators!
https://www.hotchips.org/hc30/1conf/1.05_AMD_APU_AMD_Raven_HotChips30_Final.pdf
![Page 81: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/81.jpg)
81 / 98
Hardware Accelerators
Qualcomm Snapdragon 835 [1] NVIDIA “Parker” SoC [2]
1. https://www.notebookcheck.net/Qualcomm-Snapdragon-835-SoC-Benchmarks-and-Specs.207842.0.html2. https://www.hotchips.org/wp-content/uploads/hc_archives/hc28/HC28.22-Monday-Epub/HC28.22.30-Low-Power-Epub/HC28.22.322-Tegra-Parker-AndiSkende-NVIDIA-v01.pdf
![Page 82: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/82.jpg)
82 / 98
ASIC
● Application Specific Integrated Circuit
https://ngcodec.com/markets-cloud-transcoding/
![Page 83: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/83.jpg)
83 / 98
Software Overheads
for (i = 0; i < 4; i++) v[i] *= 2.0f;
![Page 84: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/84.jpg)
84 / 98
Software Overheads
for (i = 0; i < 4; i++) v[i] *= 2.0f;
la $t0, v la $t1, v+16 li $t2, 0x40000000 mtc1 $t2, $f2for: lwc1 $f0, 0($t0) mul.s $f0, $f0, $f2 swc1 $f0, 0($t0) addiu $t0, $t0, 4 bne $t0, $t1, for
![Page 85: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/85.jpg)
85 / 98
Software Overheads
for (i = 0; i < 4; i++) v[i] *= 2.0f;
la $t0, v la $t1, v+16 li $t2, 0x40000000 mtc1 $t2, $f2for: lwc1 $f0, 0($t0) mul.s $f0, $f0, $f2 swc1 $f0, 0($t0) addiu $t0, $t0, 4 bne $t0, $t1, for
https://en.wikibooks.org/wiki/Microprocessor_Design/Pipelined_Processors
![Page 86: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/86.jpg)
86 / 98
Software Overheads
for (i = 0; i < 4; i++) v[i] *= 2.0f;
la $t0, v la $t1, v+16 li $t2, 0x40000000 mtc1 $t2, $f2for: lwc1 $f0, 0($t0) mul.s $f0, $f0, $f2 swc1 $f0, 0($t0) addiu $t0, $t0, 4 bne $t0, $t1, for
ReadI$
R/W D$
ReadRF
WriteRF
ADD/SUB
MUL BytesR MM
Bytes W MM
4 4 4 4 4 16
4 8 4 4
4 4 8 4 16
4 4 4 4
4 8 4
20 8 32 12 16 4 16 16TOTAL:
https://en.wikibooks.org/wiki/Microprocessor_Design/Pipelined_Processors
![Page 87: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/87.jpg)
87 / 98
Software Overheads
for (i = 0; i < 4; i++) v[i] *= 2.0f;
la $t0, v la $t1, v+16 li $t2, 0x40000000 mtc1 $t2, $f2for: lwc1 $f0, 0($t0) mul.s $f0, $f0, $f2 swc1 $f0, 0($t0) addiu $t0, $t0, 4 bne $t0, $t1, for
ReadI$
R/W D$
ReadRF
WriteRF
ADD/SUB
MUL BytesR MM
Bytes W MM
4 4 4 4 4 16
4 8 4 4
4 4 8 4 16
4 4 4 4
4 8 4
20 8 32 12 16 4 16 16TOTAL:
Accesses to TLBTLB missesROB accessesIssue queue...
https://en.wikibooks.org/wiki/Microprocessor_Design/Pipelined_Processors
![Page 88: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/88.jpg)
88 / 98
ASIC vs CPU
Main MemoryMain Memory
X
X
X
X
ReadMEM
WriteMEM
2.0f
MUL BytesR MM
Bytes W MM
4 16 16
![Page 89: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/89.jpg)
89 / 98
ASIC vs CPU
Main MemoryMain Memory
X
X
X
X
ReadMEM
WriteMEM
2.0f
MUL BytesR MM
Bytes W MM
4 16 16
ReadI$
R/W D$
ReadRF
WriteRF
ADD/SUB
MUL BytesR MM
Bytes W MM
20 8 32 12 16 4 16 16
![Page 90: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/90.jpg)
90 / 98
ASIC vs CPU
Main MemoryMain Memory
X
X
X
X
ReadMEM
WriteMEM
2.0f
MUL BytesR MM
Bytes W MM
4 16 16
ReadI$
R/W D$
ReadRF
WriteRF
ADD/SUB
MUL BytesR MM
Bytes W MM
20 8 32 12 16 4 16 16
ASIC does much less work, so it is faster and consumes less energy
![Page 91: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/91.jpg)
91 / 98
Hardware Accelerators
Shao, Yakun Sophia, et al. "The aladdin approach to accelerator design and modeling." IEEE Micro 35.3 (2015): 58-70.
![Page 92: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/92.jpg)
92 / 98
Hardware Accelerators
Shao, Yakun Sophia, et al. "The aladdin approach to accelerator design and modeling." IEEE Micro 35.3 (2015): 58-70.
![Page 93: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/93.jpg)
93 / 98
Sea of Accelerators
Y. S. Shao, B. Reagen, G. Wei and D. Brooks, "Aladdin: A pre-RTL, power-performance accelerator simulator enabling large design space exploration of customized architectures," 2014 ACM/IEEE 41st International Symposium on Computer Architecture (ISCA), 2014, pp. 97-108.
![Page 94: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/94.jpg)
94 / 98
Hardware Accelerators
● ASICs provide higher performance and energy-efficiency
● But they are less programmable and have large development costs
● Only accelerate in hardware applications that are widely popular and compute intensive
● Example: machine learning accelerators
![Page 95: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/95.jpg)
95 / 98
Google TPUJouppi, Norman P., et al. "In-datacenter performance analysis of a tensor processing unit." Computer Architecture (ISCA), 2017 ACM/IEEE 44th Annual International Symposium on. IEEE, 2017.
● 92 TOPS
● 28 MB on-chip
● 15x – 30x speedup
● 30x – 80x higher Perf/W
![Page 96: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/96.jpg)
96 / 98
Turing Lecture at ISCA 2018
https://www.acm.org/hennessy-patterson-turing-lecture
![Page 97: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/97.jpg)
97 / 98
What about the future?
● Hardware accelerators will start providing diminishing returns in the future
● Any solution?– Quantum computing
– DNA computing
– Photonic computing
– Superconducting computing
![Page 98: Processor Designjarnau.site.ac.upc.edu/PD/01_Moores_Law_and_Dennard_Scaling.pdf76 / 98 End of Dennard Scaling According to Dennard scaling, power density remains constant – Smaller](https://reader036.fdocuments.net/reader036/viewer/2022081617/60532ecb5bc6193539584b7e/html5/thumbnails/98.jpg)
98 / 98
Bibliography
● Weste, N. H., & Harris, D. “CMOS VLSI Design : A Circuits and Systems Perspective”. 4th Edition, 2010.
● Kahng AB, Lienig J, Markov IL, Hu J. “VLSI Physical Design: from Graph Partitioning to Timing Closure”. Springer Science & Business Media; 2011 Jan 27.
● Mead, C., & Conway, L. (1980). Introduction to VLSI systems (Vol. 1080). Reading, MA: Addison-Wesley.