Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... ·...

50
Lecture 12 - 3-Nov-2016 Fei-Fei Li

Transcript of Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... ·...

Page 1: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Page 2: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

•••

Page 3: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Salvador Dalí “Man/couple with sleeping dog" (1948)

Page 4: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Slide credit: Steve Seitz, Kristen Grauman

Page 5: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Slide credit: Svetlana Lazebnik

Page 6: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Berkeley Segmentation Dataset [Martin et al., ICCV 2001]

Page 7: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

••

“superpixels”

Slid

e cr

edit

: Sv

etla

na L

azeb

nik

Page 8: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

50x50 Patch50x50 Patch

Page 9: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

[Felzenszwalb and Huttenlocher 2004]

[Mori et al. 2005]

Page 10: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

“GrabCut” [Rother et al. 2004]

Page 11: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Oversegmentation Undersegmentation

Multiple Segmentations

Page 12: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Page 13: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

•––

•–

•–

•–

Page 14: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

•–

•–

•–

•–

Page 15: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

•–

•–

•–

…→

Page 16: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Slide credit: Kristen Grauman

What things should be grouped?

What cues indicate groups?

Page 17: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

•••

Page 18: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Slide credit: Kristen Grauman

Page 19: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Slide credit: Kristen Grauman

[ ][ ][ ]

Page 20: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Slide credit: Kristen Grauman

Page 21: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Slide credit: Kristen Grauman

Page 22: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Page 24: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

[Gregory 1968]

Page 25: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

[Gregory 1968]

Page 26: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

••

Slid

e cr

edit

: Sv

etla

na L

azeb

nik

Page 27: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

•––

Untersuchungen zur Lehre von der Gestalt,Psychologische Forschung, Vol. 4, pp. 301-350, 1923

“I stand at the window and see a house, trees, sky. Theoretically I might say there were 327 brightnesses and nuances of colour. Do I have "327"? No. I have sky, house, and trees.”

Max Wertheimer(1880-1943)

Page 28: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Imag

e so

urce

: Fo

rsyt

h &

Pon

ce

Page 29: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Imag

e so

urce

: Fo

rsyt

h &

Pon

ce

Page 30: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Imag

e so

urce

: Fo

rsyt

h &

Pon

ce

Page 31: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Imag

e so

urce

: Fo

rsyt

h &

Pon

ce

Page 32: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Imag

e so

urce

: Fo

rsyt

h &

Pon

ce

Page 34: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

https://en.wikipedia.org/wiki/Rubin_vase

Multistability

Page 35: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Man and crane, Mimbres culturepot, c. 1000 -1150 AD

second century B.C. Greek mosaic from the Acropolis

Page 36: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Page 37: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

•••

Page 38: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Page 39: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

(or bottom-up hierarchical clustering)

Simple algorithm

● Initialization: ○ Every point is its own cluster

● Repeat:○ Find “most similar” pair of clusters○ Merge into a parent cluster

● Until:○ The desired number of clusters has been reached○ There is only one cluster

Page 40: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

● Initialization: ○ Every point is its own cluster

Page 41: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

● Initialization: ○ Every point is its own cluster

● Repeat:○ Find “most similar” pair of

clusters

Page 42: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

● Initialization: ○ Every point is its own cluster

● Repeat:○ Find “most similar” pair of

clusters○ Merge into a parent cluster

Page 43: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

● Initialization: ○ Every point is its own cluster

● Repeat:○ Find “most similar” pair of

clusters○ Merge into a parent cluster

Page 44: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

● Initialization: ○ Every point is its own cluster

● Repeat:○ Find “most similar” pair of

clusters○ Merge into a parent cluster

Page 45: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

----

---

dist

ance

Page 46: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

●○

http://scikit-learn.org/stable/auto_examples/cluster/plot_agglomerative_clustering.html

Page 47: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

Page 48: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

••••

••••

Page 49: Fei-Fei Li Lecture 12 - 3-Nov-2016vision.stanford.edu/teaching/cs131_fall1617/lectures/... · 2016-11-03 · Fei-Fei Li Lecture 12 - 3-Nov-2016 Untersuchungen zur Lehre von der Gestalt,

Lecture 12 - 3-Nov-2016Fei-Fei Li

•••