Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera...

42
Camera, Geometry and Photometry Computer Vision Some Slides are from Derek Hoiem, Alexei Efros, Steve Seitz, David Forsyth, James Hays, Bob Collins

Transcript of Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera...

Page 1: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Camera, Geometry and

Photometry

Computer Vision

Some Slides are from Derek

Hoiem, Alexei Efros, Steve

Seitz, David Forsyth, James

Hays, Bob Collins

Page 2: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Cameras ?

Page 3: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Camera Array

Mesh Model

Page 4: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Lens Array (Integral Imaging)

Raytrix Plenoptic Camera, Adobe

Lytro ,,,,,, tzyxPI

),( 11

),( 22

1

2

t

),,( zyx

Page 5: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Digital Holography (CGH)

Page 6: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Normal Sensor (Photon-X)

< Photon-X>

Page 7: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Structured Light

Page 8: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Kinect V1

IR Speckle

Pattern

Page 9: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Time of Flight

MESA SR4000 Intel PMD Nano

Time-of-flight of Light Distance

Page 10: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Laser Scanning

Structured Laser Light

Time-of-Flight - LIDAR

Page 11: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Color Camera

Page 12: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Digital Image

Slide source: Bob Collins

Page 13: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Camera and World Geometry

How tall is this woman?

Which ball is closer?

How high is the camera?

What is the camera

rotation?

What is the focal length of

the camera?

Page 14: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image formation

Let’s design a camera – Idea 1: put a piece of film in front of an object – Do we get a reasonable image?

Slide source: Seitz

Page 15: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Pinhole camera

Idea 2: add a barrier to block off most of the rays

– This reduces blurring

– The opening known as the aperture

Slide source: Seitz

Page 16: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Pinhole camera

Figure from Forsyth

f

f = focal length

c = center of the camera

c

Page 17: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Camera obscura: the pre-camera

• Known during classical period in China and Greece (e.g. Mo-Ti, China, 470BC to 390BC)

Illustration of Camera Obscura Freestanding camera obscura at UNC Chapel Hill

Photo by Seth Ilys

Page 18: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Camera Obscura used for Tracing

Lens Based Camera Obscura, 1568

Page 19: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Point of observation

Figures © Stephen E. Palmer, 2002

Dimensionality Reduction Machine (3D to 2D)

3D world 2D image

Page 20: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Projection can be tricky… Slide source: Seitz

Page 21: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Projection can be tricky… Slide source: Seitz

Page 22: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Projective Geometry

What is lost?

• Length

Which is closer?

Who is taller?

Page 23: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Length is not preserved

Figure by David Forsyth

B’

C’

A’

Page 24: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Projective Geometry

What is lost?

• Length

• Angles

Perpendicular?

Parallel?

Page 25: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Projective Geometry

What is preserved?

• Straight lines are still straight

Page 26: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Vanishing points and lines

Parallel lines in the world intersect in the image at a “vanishing point”

Page 27: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Vanishing points and lines

o Vanishing Point o

Vanishing Point

Vanishing Line

Page 28: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Vanishing points and lines

Vanishing point

Vanishing line

Vanishing point

Vertical vanishing point

(at infinity)

Slide from Efros, Photo from Criminisi

Page 29: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Geometry

Slide source: Bob Collins

Page 30: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Geometry

Slide source: Bob Collins

Page 31: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Geometry

Slide source: Bob Collins

Page 32: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Geometry

Slide source: Bob Collins

Page 33: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Geometry

Slide source: Bob Collins

Page 34: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Photometry

Slide source: Bob Collins

Page 35: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Photometry

Slide source: Bob Collins

Page 36: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Photometry

Slide source: Bob Collins

Page 37: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Photometry

Slide source: Bob Collins

Page 38: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Photometry

Slide source: Bob Collins

Page 39: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Photometry

Slide source: Bob Collins

Page 40: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Photometry

Slide source: Bob Collins

Page 41: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Photometry

Slide source: Bob Collins

Page 42: Camera, Geometry and Photometry - khu.ac.krcvlab.khu.ac.kr/CVLecture2.pdf · 2014. 9. 3. · Camera obscura: the pre-camera •Known during classical period in China and Greece (e.g.

Image Photometry

Slide source: Bob Collins