NVIDIA A100 Ampere GPU - System Plus...Ampere A100 provides the consumer market with 40GB or 80GB of...
34
22 Bd Benoni Goullin 44200 NANTES - FRANCE +33 2 40 18 09 16 [email protected] www.systemplus.fr NVIDIA A100 Ampere GPU NVIDIA’s new generation Graphics Processing Unit (GPU) with TSMC CoWoS, 40GB Samsung HBM2, 2.5D and 3D packaging. SP20579 - Advanced Packaging report by Belinda Dube Laboratory Analysis by Véronique Le Troadec February 2021 – Sample REVERSE COSTING® – STRUCTURAL, PROCESS & COST REPORT
Transcript of NVIDIA A100 Ampere GPU - System Plus...Ampere A100 provides the consumer market with 40GB or 80GB of...
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 1
22 Bd Benoni Goullin44200 NANTES - FRANCE +33 2 40 18 09 16 [email protected] www.systemplus.fr
NVIDIA A100 Ampere GPU NVIDIA’s new generation Graphics Processing Unit (GPU) with TSMC CoWoS, 40GB Samsung HBM2, 2.5D and 3D packaging.SP20579 - Advanced Packaging report by Belinda Dube
Laboratory Analysis by Véronique Le TroadecFebruary 2021 – Sample
REVERSE COSTING® – STRUCTURAL, PROCESS & COST REPORT
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 2
Table of Contents
Overview / Introduction 4
o Executive Summary
o Reverse Costing Methodology
Company Profile 8
o 2.5D & 3D Packaging Market
o High Bandwidth Memory
o TSMC CoWoS
o TSV Technology
o NVIDIA Company Profile
o NVIDIA Ampere A100 Characteristics
o GPU Supply Chain
Physical Analysis 31
o Summary of the Physical Analysis
o Physical Analysis Methodology
o NVIDIA Ampere A100 Teardown
o Package
✓ Views & Dimensions
✓ Passives Assembly
✓ Laminate & IHS Cross-Section
o DRAM Die
✓ View, Dimensions & Marking
✓ µBumps & TSVs
✓ HBM2 Stack Cross-Section
o GPU Die
✓ View, Dimensions & Marking
✓ µBumps
✓ GPU Cross-Section
o Filler Die
✓ View, Dimensions & Marking
✓ Filler Cross-Section
o Interposer Die
✓ View, Dimensions & Marking
✓ µBumps & TSVs
✓ Interposer Cross-Section
o Comparison with AMD Fury X including SK-Hynix HBM1
Manufacturing Process Flow 160
o Global Overview
o GPU Process Description & Foundry
o Interposer Process Flow & Foundry
o HBM2 Stack Process Flow & Foundry
o CoWoS Process Flow & Foundry
Cost Analysis 191
o Summary of the Cost Analysiso Yields Explanation & Hypotheseso GPU Front-End & Die Costo HBM2 Stack
✓ TSV Manufacturing Cost
✓ Micro-Bumping Manufacturing Cost
✓ Dies Cost (DRAM + Logic)
✓ HBM2 Stack Cost
o Interposer
✓ TSV Manufacturing Cost
✓ Microbumping Cost
✓ Interposer Cost
o CoWoS Assembly Manufacturing Costo Final Component Cost
Estimated Price Analysis 213
o Manufacturer Financial Ratios
o Component Manufacturer Price
Feedback 216
System plus Consulting Services 218
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 3
O V E R V I E WMETHODOLOGY
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 4
Overview / Introductiono Executive Summaryo Reverse Costing
Methodologyo Glossary
Company Profile & Supply Chain
Physical Analysis
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
Executive Summary• The high end electronic packaging market was worth more than $880 million dollars in 2019. The biggest market for
high end performance packaging comes from telecom and infrastructure. It has more than a 50% market shareaccording to Yole Développement’s report High-End Performance Packaging: 3D/2.5D Integration 2020.
• The NVIDIA Ampere A100 targets high performance data centers, artificial intelligence applications, data analytics, andHigh-Performance Computing (HPC). It uses advanced technologies, including TSMC’s 7nm FinFET chip, 3D stackedmemory with 2.5D integration on a silicon interposer in a Chip-on-Wafer-on-Substrate (CoWoS) process.
• The new generation GPU provides significantly higher performance compared to the previous generation. The NVIDIAAmpere A100 provides the consumer market with 40GB or 80GB of Samsung’s high bandwidth memory (HBM2).Samsung’s HBM2 is engineered to sustain and support high speed data transfer. The HBM2 DRAM solution satisfies themarket need for high performance, energy efficiency, and compact integration. The NVIDIA Ampere A100 ischaracterized by GPU Memory Bandwidth of 1,555 GB/s. A 3D assembly process yields HBM2 stacks composed of eight1GB memory dies and one logic die, connected with via-middle through-silicon vias and micro-bumps.
• More than 6,000mm² of silicon area is integrated in a single 55mm x 55mm 12-layer ball grid array (BGA) package of theNVIDIA Ampere A100. Two major semiconductor leaders, Samsung and TSMC, collaborate to deliver this much silicon ina single package. TSMC is the main provider for the NVIDIA Ampere A100. Using its 2.5D CoWoS platform, itmanufactures the world’s largest processor built on 7nm process technology. This GPU die features a 7nm FinFETtransistor process and 54 billion transistors on a single chip. It also produces a large silicon interposer on which the GPUand HBM2 memory is assembled at the wafer-level.
• The report includes a complete physical analysis of the package, the GPU die, interposer die and the HBM2 DRAM. Alongwith the manufacturing process of the silicon dies, CoWoS process and final assembly, this report comes with a costanalysis and a price estimation of the NVIDIA Ampere A100. Finally, the report includes a comparison to highlight thesimilarities and differences between the NVIDIA Ampere A100 and NVIDIA’s Tesla P100 and V100.
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 5
PHYSICALANALYSIS
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 6
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis o Summaryo Graphic Card View &
Teardowno Package X-Ray Imageso Package Overviewo Package Openingo Package Cross Sectiono HBM Stack-Logic/DRAM Dieo HBM Stack Cross Sectiono GPU Dieo Cross-Section – GPU o Filler Dieo Cross-Section – Filler o Interposer Dieo Cross-Section – Interposer
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
Graphic Card Teardown
NVIDIA Ampere A100 Teardown – PCB Front Side©2021 by System Plus Consulting
NVIDIA Ampere A100 Teardown – PCB Back Side©2021 by System Plus Consulting
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 7
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis o Summaryo Graphic Card View &
Teardowno Package X-Ray Imageso Package Overviewo Package Openingo Package Cross Sectiono HBM Stack-Logic/DRAM Dieo HBM Stack Cross Sectiono GPU Dieo Cross-Section – GPU o Filler Dieo Cross-Section – Filler o Interposer Dieo Cross-Section – Interposer
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
NVIDIA Ampere A100 X-Ray Image©2021 by System Plus Consulting
NVIDIA AMPERE 100 Package - XRAY Images-
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 8
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis o Summaryo Graphic Card View &
Teardowno Package X-Ray Imageso Package Overviewo Package Openingo Package Cross Sectiono HBM Stack-Logic/DRAM Dieo HBM Stack Cross Sectiono GPU Dieo Cross-Section – GPU o Filler Dieo Cross-Section – Filler o Interposer Dieo Cross-Section – Interposer
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
Package Opening
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 9
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis o Summaryo Graphic Card View &
Teardowno Package X-Ray Imageso Package Overviewo Package Openingo Package Cross Sectiono HBM Stack-Logic/DRAM Dieo HBM Stack Cross Sectiono GPU Dieo Cross-Section – GPU o Filler Dieo Cross-Section – Filler o Interposer Dieo Cross-Section – Interposer
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
Package Cross Section
Package Cross Section©2021 by System Plus Consulting
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 10
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis o Summaryo Graphic Card View &
Teardowno Package X-Ray Imageso Package Overviewo Package Openingo Package Cross Sectiono HBM Stack-Logic/DRAM Dieo HBM Stack Cross Sectiono GPU Dieo Cross-Section – GPU o Filler Dieo Cross-Section – Filler o Interposer Dieo Cross-Section – Interposer
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
Board Cross-Section
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 11
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis o Summaryo Graphic Card View &
Teardowno Package X-Ray Imageso Package Overviewo Package Openingo Package Cross Sectiono HBM Stack-Logic/DRAM Dieo HBM Stack Cross Sectiono GPU Dieo Cross-Section – GPU o Filler Dieo Cross-Section – Filler o Interposer Dieo Cross-Section – Interposer
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
Package Cross-Section – HBM2 Stack
HBM Stack Cross-Section – SEM View©2021 by System Plus Consulting
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 12
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis o Summaryo Graphic Card View &
Teardowno Package X-Ray Imageso Package Overviewo Package Openingo Package Cross Sectiono HBM Stack-Logic/DRAM Dieo HBM Stack Cross Sectiono GPU Dieo Cross-Section – GPU o Filler Dieo Cross-Section – Filler o Interposer Dieo Cross-Section – Interposer
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
Package Cross-Section – HBM2 Stack
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 13
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis o Summaryo Graphic Card View &
Teardowno Package X-Ray Imageso Package Overviewo Package Openingo Package Cross Sectiono HBM Stack-Logic/DRAM Dieo HBM Stack Cross Sectiono GPU Dieo Cross-Section – GPU o Filler Dieo Cross-Section – Filler o Interposer Dieo Cross-Section – Interposer
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
Package Cross-Section – GPU – Interposer Bumps
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 14
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis o Summaryo Graphic Card View &
Teardowno Package X-Ray Imageso Package Overviewo Package Openingo Package Cross Sectiono HBM Stack-Logic/DRAM Dieo HBM Stack Cross Sectiono GPU Dieo Cross-Section – GPU o Filler Dieo Cross-Section – Filler o Interposer Dieo Cross-Section – Interposer
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
Die Cross-Section – GPU
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 15
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis o Summaryo Graphic Card View &
Teardowno Package X-Ray Imageso Package Overviewo Package Openingo Package Cross Sectiono HBM Stack-Logic/DRAM Dieo HBM Stack Cross Sectiono GPU Dieo Cross-Section – GPU o Filler Dieo Cross-Section – Filler o Interposer Dieo Cross-Section – Interposer
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
Package Cross-Section – Interposer (under GPU Die)
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 16
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis o Summaryo Graphic Card View &
Teardowno Package X-Ray Imageso Package Overviewo Package Openingo Package Cross Sectiono HBM Stack-Logic/DRAM Dieo HBM Stack Cross Sectiono GPU Dieo Cross-Section – GPU o Filler Dieo Cross-Section – Filler o Interposer Dieo Cross-Section – Interposer
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
Package Cross-Section – Interposer
Interposer Cross-Section – SEM View©2021 by System Plus Consulting
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 17
P H Y S I C A LCOMPARISON
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 18
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Comparison V100/ P100/ A100o Characteristicso Packageo HBM Stacko Interposero Summary
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
Comparison NVIDIA Tesla V100, P100 and Ampere A100- Package Cross Section
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 19
MANUFACTURINGPROCESS FLOW
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 20
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Comparison V100/ P100/ A100
Manufacturing Process Flowo Global Overviewo GPU Processo GPU Wafer Fab Unito HBM Processo HBM Wafer Fab Unito Interposer & CoW Processo Interposer Wafer Fab Unito Final Assembly Processo Final Assembly Unit
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
HBM Stacking Process Flow (2/4)
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 21
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Comparison V100/ P100/ A100
Manufacturing Process Flowo Global Overviewo GPU Processo GPU Wafer Fab Unito HBM Processo HBM Wafer Fab Unito Interposer & CoW Processo Interposer Wafer Fab Unito Final Assembly Processo Final Assembly Unit
Cost Analysis
Selling Price Analysis
Feedback
Related Reports
About System Plus
Interposer – CoW Process Flow (2/7)
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 22
C O S TANALYSIS
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 23
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Comparison V100/ P100/ A100
Manufacturing Process Flow
Cost Analysiso Summaryo Supply Chaino Yieldso GPU Costo HBM Stack Costo Interposer Costo CoW Assembly Costo Component Cost
Selling Price Analysis
Feedback
Related Reports
About System Plus
GPU Wafer & Die Cost
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 24
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Comparison V100/ P100/ A100
Manufacturing Process Flow
Cost Analysiso Summaryo Supply Chaino Yieldso GPU Costo HBM Stack Costo Interposer Costo CoW Assembly Costo Component Cost
Selling Price Analysis
Feedback
Related Reports
About System Plus
DRAM Microbumping Cost
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 25
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Comparison V100/ P100/ A100
Manufacturing Process Flow
Cost Analysiso Summaryo Supply Chaino Yieldso GPU Costo HBM Stack Costo Interposer Costo CoW Assembly Costo Component Cost
Selling Price Analysis
Feedback
Related Reports
About System Plus
DRAM Wafer & Die Cost
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 26
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Comparison V100/ P100/ A100
Manufacturing Process Flow
Cost Analysiso Summaryo Supply Chaino Yieldso GPU Costo HBM Stack Costo Interposer Costo CoW Assembly Costo Component Cost
Selling Price Analysis
Feedback
Related Reports
About System Plus
HBM Stack Cost
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 27
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Comparison V100/ P100/ A100
Manufacturing Process Flow
Cost Analysiso Summaryo Supply Chaino Yieldso GPU Costo HBM Stack Costo Interposer Costo CoW Assembly Costo Component Cost
Selling Price Analysis
Feedback
Related Reports
About System Plus
Chip-on-Wafer (CoW) Stack Wafer Cost
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 28
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Physical Comparison
Manufacturing Process Flow
Cost Analysis
Selling Price Analysis
Feedbacks
Related Reports
About System Plus
REVERSE COSTING ANALYSES - SYSTEM PLUS CONSULTING
Related Reports
MARKET AND TECHNOLOGY REPORTS - YOLE DÉVELOPPEMENT
ADVANCED PACKAGING• Computing for Datacenter Servers 2021• Processor Quarterly Market Monitor
REVERSE COSTING ANALYSES - SYSTEM PLUS CONSULTING
ADVANCED PACKAGING• NVIDIA Tesla P100 GPU with HBM2• Intel Foveros 3D Packaging Technology
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 29
COMPANYSERVICES
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 30
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Physical Comparison
Manufacturing Process Flow
Cost Analysis
Cost Comparison
Selling Price Analysis
Feedback
Related Analyses
About System Pluso Company serviceso Contact
A Structure, Process and Cost Analysis
Reverse Costing® consists in disassembling a device or a system, in orderto identify its technology and determine its manufacturing processes andcost, using in-house models and tools.
Our Core Activity : The Reverse Costing®
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 31
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Physical Comparison
Manufacturing Process Flow
Cost Analysis
Cost Comparison
Selling Price Analysis
Feedback
Related Analyses
About System Pluso Company serviceso Contact
Fields Of Expertise
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 32
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Physical Comparison
Manufacturing Process Flow
Cost Analysis
Cost Comparison
Selling Price Analysis
Feedback
Related Analyses
About System Pluso Company serviceso Contact
Business Model
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 33
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Physical Comparison
Manufacturing Process Flow
Cost Analysis
Cost Comparison
Selling Price Analysis
Feedback
Related Analyses
About System Pluso Company serviceso Contact
Worldwide Presence
100+ collaborators in 8 different countries
Headquarters› Nantes – System Plus Consulting› Lyon – Yole Développement
Boise
CorneliusRaleighPhoenix
Austin
Singapore
Hsinchu
TokyoShenzhen
Seoul
Frankfurt
Nantes
Lyon
©2021 System Plus Consulting | SP20579 NVIDIA A100 Ampere GPU | Sample 34
Overview / Introduction
Company Profile & Supply Chain
Physical Analysis
Physical Comparison
Manufacturing Process Flow
Cost Analysis
Cost Comparison
Selling Price Analysis
Feedback
Related Analyses
About System Pluso Company serviceso Contact
Contacts
HEADQUARTER & CUSTOM PROJECT SERVICES
22 Bd Benoni Goullin44200 Nantes, France
[email protected] - +33 2 40 18 09 16
REPORTS & MONITORS WEBSITE
www.systemplus.fr
TRACKS WEBSITE
www.reverse-costing.com
MARKETING, COMMUNICATION & PR
Camille Veyrier, Marketing & [email protected] - +33 472 83 01 01
Sandrine Leroy, Public [email protected] - +33 4 72 83 01 89
Western US & Canada
Steve Laferriere - [email protected]
+ 1 310 600 8267
Eastern US & Canada
Chris Youman - [email protected]
+1 919 607 9839
Europe and RoW
Lizzie Levenez - [email protected]
+49 15 123 544 182
Benelux, UK & Spain
Marine Wybranietz - [email protected]
+49 69 96 21 76 78
India and RoA
Takashi Onozawa - [email protected]
+81 80 4371 4887
Greater China
Mavis Wang - [email protected]
+886 979 336 809 +86 136 6156 6824
Korea
Peter Ok - [email protected]
+82 10 4089 0233
Japan
Miho Ohtake - [email protected]
+81 34 4059 204
Japan and Singapore
Itsuyo Oshiba - [email protected]
+81 80 3577 3042
Japan
Toru Hosaka – [email protected]
+81 90 1775 3866
Follow us on
REPORTS, MONITORS & TRACKS
