Linear Classifiers & Classification Lecture...
Transcript of Linear Classifiers & Classification Lecture...
Lecture 15 - 15-Nov-2016
Lecture 15: Linear Classifiers & Classification
1
Lecture 15 - 15-Nov-2016
Linear Regression
2
Slide Credit: Iasonas Kokkinos
Lecture 15 - 15-Nov-2016
Linear Regression
3
Slide Credit: Iasonas Kokkinos
Lecture 15 - 15-Nov-2016
Linear Regression
4
Slide Credit: Pedro Domingoss
Lecture 15 - 15-Nov-2016
Linear Regression
5
Slide Credit: Pedro Domingoss
Lecture 15 - 15-Nov-2016
Linear Regression
6
Slide Credit: Pedro Domingoss
Lecture 15 - 15-Nov-2016
Linear Regression
7
Slide Credit: Pedro Domingoss
Lecture 15 - 15-Nov-2016
Linear Regression
8
Slide Credit: Pedro Domingoss
Lecture 15 - 15-Nov-2016
Linear Regression
Why not closed form?
9
Lecture 15 - 15-Nov-2016
Linear Regression
Example
Y = X
w = 0
1. p = 1 -> 11.1. w’ = lr*1
2. p = -1 -> -12.1. w’ = lr*1
3. p = 2 -> 23.1. w’ = lr*4
10
Lecture 15 - 15-Nov-2016
Linear Regression
11
Slide Credit: Pedro Domingoss
Lecture 15 - 15-Nov-2016
Linear Regression
What can we learn?
12
Lecture 15 - 15-Nov-2016
Linear Regression
● XOR Example○ Picture○ Logic “features”○ Layers
● Why “layers”?
13
Lecture 15 - 15-Nov-2016
Linear Regression
14
Slide Credit: Pedro Domingoss
Lecture 15 - 15-Nov-2016
Linear Regression
15
Slide Credit: Pedro Domingoss
Lecture 15 - 15-Nov-2016
Linear Regression
16
Slide Credit: Pedro Domingoss
Lecture 15 - 15-Nov-2016
Linear Regression
17
Slide Credit: Pedro Domingoss
Lecture 15 - 15-Nov-2016
Model Complexity
18
Slide Credit: Iasonas Kokkinos
Lecture 15 - 15-Nov-2016
Linear Regression
19
Slide Credit: Pedro Domingoss
Lecture 15 - 15-Nov-2016
Images?
20
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Images?
21
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Images?
22
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Images?
23
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Images?
24
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Images?
25
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Images?
26
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Images?
27
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Images?
28
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Images?
29
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Images?
30
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Images?
31
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Images?
32
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Images?
33
Slide Credit: CS231N
Lecture 15 - 15-Nov-2016
Decision Trees
34
Lecture 15 - 15-Nov-2016
Decision Trees
35
Slide Credit: Pedro Domingoss
XOR Example