Download - Administrative - Stanford Universitycs231n.stanford.edu/slides/2016/winter1516_lecture15.pdfFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 -Lecture 15 - 16 7 Mar 2016 And

Transcript

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20161

Administrative

- Poster Session on Wednesday!- http://cs231n.stanford.edu/postersession.html- Facebook group: https://www.facebook.

com/events/1024309900974098/ - If using AWS, use EBS

- Instructions on Piazza- A3 Grades out soon

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20162

Together, we’ve defined Score Functions...

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20163

And Loss Functions...

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20164

We’ve learned how to optimize them...

Chain rule:

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20165

NEURAL NETWORKS

We learned to express more powerful Score Functions...

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20166

For an extra wiggle...

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20167

Together we tamed the learning process...

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20168

Together we explored image-specific Neural Nets...CONV

ReLUCONV

ReLUPOOLCONV

ReLUCONV

ReLUPOOL CONV

ReLUCONV

ReLUPOOL FC

(Fully-connected)

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20169

We explored how they work...

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201610

And how they don’t… (but really they still do)

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201611

And how to make art

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201612

We looked at what makes ConvNets “tick”...

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201613

We learned tips/tricks for making ConvNets work well in practice

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201614

And explored their practical bottlenecks...

Moving parts lol

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201615

And we bravely ventured beyond Image Classification...

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201616

And developed an understanding of cutting-edge research

Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning

[Szegedy et al., 2016] (Google)

We saw 2015 & 2016 citations...e.g.

Deep Residual Learning for Image Recognition[He et al., CVPR 2016] (MSR)

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201617

You are now ready.

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201618

You are now ready.

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201619

You are now ready.

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201620

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201621

END

Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201622