A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction...
58
A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets
Transcript of A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction...
![Page 1: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/1.jpg)
A Brief Introduction to Convolutional Networks
Yingbo Zhou
Intro to Conv Nets
![Page 2: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/2.jpg)
Neural science inspirations
(Image from Carandini 2006)
Visual receptive fields in cat brain (simple cell)
(Image from DeAngelis et al. 1999)
Intro to Conv Nets
![Page 3: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/3.jpg)
Following slides are from DR. Rob Fergus Tutorial slides in NIPS2013
Intro to Conv Nets
![Page 4: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/4.jpg)
![Page 5: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/5.jpg)
![Page 6: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/6.jpg)
![Page 7: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/7.jpg)
![Page 8: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/8.jpg)
![Page 9: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/9.jpg)
![Page 10: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/10.jpg)
![Page 11: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/11.jpg)
![Page 12: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/12.jpg)
![Page 13: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/13.jpg)
![Page 14: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/14.jpg)
![Page 15: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/15.jpg)
![Page 16: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/16.jpg)
![Page 17: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/17.jpg)
![Page 18: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/18.jpg)
![Page 19: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/19.jpg)
![Page 20: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/20.jpg)
![Page 21: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/21.jpg)
![Page 22: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/22.jpg)
![Page 23: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/23.jpg)
![Page 24: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/24.jpg)
![Page 25: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/25.jpg)
![Page 26: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/26.jpg)
![Page 27: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/27.jpg)
![Page 28: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/28.jpg)
![Page 29: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/29.jpg)
![Page 30: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/30.jpg)
![Page 31: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/31.jpg)
![Page 32: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/32.jpg)
![Page 33: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/33.jpg)
![Page 34: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/34.jpg)
![Page 35: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/35.jpg)
![Page 36: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/36.jpg)
![Page 37: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/37.jpg)
![Page 38: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/38.jpg)
![Page 39: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/39.jpg)
![Page 40: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/40.jpg)
![Page 41: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/41.jpg)
![Page 42: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/42.jpg)
![Page 43: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/43.jpg)
![Page 44: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/44.jpg)
![Page 45: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/45.jpg)
![Page 46: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/46.jpg)
![Page 47: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/47.jpg)
![Page 48: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/48.jpg)
![Page 49: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/49.jpg)
![Page 50: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/50.jpg)
![Page 51: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/51.jpg)
![Page 52: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/52.jpg)
![Page 53: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/53.jpg)
![Page 54: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/54.jpg)
![Page 55: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/55.jpg)
![Page 56: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/56.jpg)
![Page 57: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/57.jpg)
![Page 58: A Brief Introduction to Convolutional Networksinwogu/teaching/Coursepage573...A Brief Introduction to Convolutional Networks Yingbo Zhou Intro to Conv Nets Neural science inspirations](https://reader036.fdocuments.net/reader036/viewer/2022071109/5fe4bf120a0f465d78765e45/html5/thumbnails/58.jpg)