Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image...

19
Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016 Acknowledgements: Slides used/modified from Prof. Trevor Darrell ([email protected] ) (http://www.eecs.berkeley.edu/~trevor/CS280.html)

Transcript of Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image...

Page 1: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

Image Formation IIChapter 1 (Forsyth&Ponce)

Guido GerigCS-GY 6643, Spring 2016

Acknowledgements: • Slides used/modified from Prof. Trevor Darrell

([email protected]) (http://www.eecs.berkeley.edu/~trevor/CS280.html)

Page 2: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

Recall, perspective effects…

• Far away objects appear smaller

Forsyth and Ponce

Page 3: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

Perspective effects

Page 4: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

Perspective effects

Page 5: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

Perspective effects

• Parallel lines in the scene intersect in the image

• Converge in image on horizon lineImage plane(virtual)

Scene

pinhole

Page 6: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

Projection properties

• Many-to-one: any points along same ray map to same point in image

• Points ? – points

• Lines ?– lines (collinearity preserved)

• Distances and angles are / are not ?preserved– are not

• Degenerate cases:– Line through focal point projects to a point.– Plane through focal point projects to line– Plane perpendicular to image plane projects to

part of the image.

Page 7: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

Weak perspective

• Approximation: treat magnification as constant

• Assumes scene depth << average distance to camera

World points:

Image plane

Page 8: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

Orthographic projection

• Given camera at constant distance from scene

• World points projected along rays parallel to optical access

Page 9: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:
Page 10: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:
Page 11: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

2D

Page 12: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

3D

Page 13: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

Other types of projection

• Lots of intriguing variants…• (I’ll just mention a few fun ones)

S. Seitz

Page 14: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

360 degree field of view…

• Basic approach– Take a photo of a parabolic mirror with an orthographic lens

(Nayar)– Or buy one a lens from a variety of omnicam manufacturers…

• See http://www.cis.upenn.edu/~kostas/omni.html

S. Seitz

Page 15: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

Tilt-shift

Titlt-shift images from Olivo Barbieriand Photoshop imitations

http://www.northlight-images.co.uk/article_pages/tilt_and_shift_ts-e.html

S. Seitz

Page 16: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

tilt, shift

http://en.wikipedia.org/wiki/Tilt-shift_photography

wikipedia http://www.luminous-landscape.com/tutorials/focusing-ts.shtml

Page 17: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

Tilt-shift perspective correction

http://en.wikipedia.org/wiki/Tilt-shift_photography

Page 18: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

normal lens tilt-shift lens

http://www.northlight-images.co.uk/article_pages/tilt_and_shift_ts-e.html

Page 19: Image Formation II Chapter 1 (Forsyth&Ponce)engineering.nyu.edu/~gerig/CS-GY-6643-S2016... · Image Formation II Chapter 1 (Forsyth&Ponce) Guido Gerig CS-GY 6643, Spring 2016. Acknowledgements:

Rollout Photographs © Justin Kerr http://research.famsi.org/kerrmaya.html

Rotating sensor (or object)

Also known as “cyclographs”, “peripheral images”S. Seitz