Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit...
Transcript of Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit...
![Page 1: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/1.jpg)
AI IoT
杭州国芯科技股份有限公司 ⼈⼯智能事业部 凌云
E-FUTURE
![Page 2: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/2.jpg)
A I AIPart 1
![Page 3: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/3.jpg)
AI -
![Page 4: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/4.jpg)
&
•
• 2 /3 /4 /6
• Beamforming
• DOA
•
![Page 5: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/5.jpg)
• > 90%
• 24 <=1
•
• 500
![Page 6: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/6.jpg)
AEC • AEC
•
•
•
•
•
![Page 7: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/7.jpg)
•
•
•
ASR
NLP
TTS
KWS
Skills
![Page 8: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/8.jpg)
A I AIPart 2
![Page 9: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/9.jpg)
1.
2.
3.A I
![Page 10: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/10.jpg)
![Page 11: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/11.jpg)
gxNPU -
•
• 64 MAC FP32 / FP16 / Int8
• DNN CNN LSTM
•
• OP
•
MAC Array Activations()
NCodeInstruction
Decoder
Data Cache
Programable ops()
DMA
Weights Cache
gxNPU: Neural Process Unit
De-Compression Engine
Polling()
ReShape()
Convolution()
![Page 12: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/12.jpg)
NPU
Training
gxNPUC
/
gxDNN
Linux / RTOS
Step-2 Step-3
ProtoBuffer NcodeCaffe
Step-1
![Page 13: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/13.jpg)
AI
NPUDSP CPU OutputInput
![Page 14: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/14.jpg)
AI SoC (System on Chip)
GX8010
Embedded DRAM
MicrophoneArray
Voice DSPHIFI4
sNPU(KeyWord Detection)
Voice
NPUgxNPU
Communication(SPI/SDIO/USB…)
CPU(ARM Cortex A7)
SecurityOTP/AES/3DES..)
Audio Decoder
Thinking
Audio DAC
CameraInterface
GraphicAccelerator
Vision
JPEGEncode & Decode
![Page 15: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/15.jpg)
A I AIPart 3
![Page 16: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/16.jpg)
AI
![Page 17: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/17.jpg)
“ ” - AI
![Page 18: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/18.jpg)
“ ” - AI
•
• 4G ->
•
• /
•
•
![Page 19: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/19.jpg)
• 2 AEC
•
•
•
• DMA AMAGX8008
![Page 20: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/20.jpg)
“ ” -
![Page 21: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/21.jpg)
• 2 4 6
• +
• +
• 50mW
• 2
![Page 22: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/22.jpg)
GX8008 USB
GX8008 IoT
NationalChip AI+IOT
GX8009
GX8010
![Page 23: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/23.jpg)
A IPart 4
![Page 24: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/24.jpg)
•
• AI PPA
• IoT
•
![Page 25: Í ª AI . Æ Á IoT q Ëfile.elecfans.com/web1/M00/9C/F5...gxNPU: Neural Process Unit De-Compression Engine Polling() ReShape() Convolution() NPU á M ~ Training gxNPUC « ² / 4](https://reader031.fdocuments.net/reader031/viewer/2022011922/603d4e14b422b843a43f3d87/html5/thumbnails/25.jpg)
用芯塑造美好⽣活!
杭州国芯科技
谢谢!