Administrative - Stanford Fei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 -Lecture...

download Administrative - Stanford Fei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 -Lecture 15 - 16

of 22

  • date post

    21-Jan-2020
  • Category

    Documents

  • view

    5
  • download

    0

Embed Size (px)

Transcript of Administrative - Stanford Fei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 -Lecture...

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20161

    Administrative

    - Poster Session on Wednesday! - http://cs231n.stanford.edu/postersession.html - Facebook group: https://www.facebook.

    com/events/1024309900974098/ - If using AWS, use EBS

    - Instructions on Piazza - A3 Grades out soon

    http://cs231n.stanford.edu/postersession.html http://cs231n.stanford.edu/postersession.html https://www.facebook.com/events/1024309900974098/ https://www.facebook.com/events/1024309900974098/ https://www.facebook.com/events/1024309900974098/

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20162

    Together, we’ve defined Score Functions...

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20163

    And Loss Functions...

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20164

    We’ve learned how to optimize them...

    Chain rule:

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20165

    NEURAL NETWORKS

    We learned to express more powerful Score Functions...

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20166

    For an extra wiggle...

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20167

    Together we tamed the learning process...

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20168

    Together we explored image-specific Neural Nets... CONV

    ReLU CONV

    ReLU POOLCONV

    ReLU CONV

    ReLU POOL CONV

    ReLU CONV

    ReLU POOL FC

    (Fully-connected)

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 20169

    We explored how they work...

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201610

    And how they don’t… (but really they still do)

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201611

    And how to make art

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201612

    We looked at what makes ConvNets “tick”...

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201613

    We learned tips/tricks for making ConvNets work well in practice

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201614

    And explored their practical bottlenecks...

    Moving parts lol

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201615

    And we bravely ventured beyond Image Classification...

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201616

    And developed an understanding of cutting-edge research

    Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning

    [Szegedy et al., 2016] (Google)

    We saw 2015 & 2016 citations... e.g.

    Deep Residual Learning for Image Recognition [He et al., CVPR 2016] (MSR)

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201617

    You are now ready.

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201618

    You are now ready.

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201619

    You are now ready.

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201620

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201621

    END

  • Lecture 15 - 7 Mar 2016Fei-Fei Li & Andrej Karpathy & Justin JohnsonFei-Fei Li & Andrej Karpathy & Justin Johnson Lecture 15 - 7 Mar 201622