Looking Around Corners using Femto-Photography and Transient Imaging

17
Raskar, Camera Culture, MIT Media Lab Camera Culture Ramesh Raskar Camera Culture MIT Media Lab Ramesh Raskar

description

Presentation during MIT Media Lab 25th Year Anniversary Celebrations http://web.media.mit.edu/~raskar//femto/ Our goal is to exploit the finite speed of light to improve image capture and scene understanding. New theoretical analysis coupled with emerging ultra-high-speed imaging techniques can lead to a new source of computational visual perception. We are developing the theoretical foundation for sensing and reasoning using transient light transport, and experimenting with scenarios in which transient reasoning exposes scene properties that are beyond the reach of traditional machine vision.

Transcript of Looking Around Corners using Femto-Photography and Transient Imaging

Page 1: Looking Around Corners using Femto-Photography and Transient Imaging

Raskar, Camera Culture, MIT Media Lab

Camera Culture

Ramesh Raskar

Camera CultureMIT Media Lab

Ramesh Raskar

Page 2: Looking Around Corners using Femto-Photography and Transient Imaging

Can you look around the corner ?

Page 3: Looking Around Corners using Femto-Photography and Transient Imaging

Can you look around the corner ?

Without any gadget in the line of sight

Page 4: Looking Around Corners using Femto-Photography and Transient Imaging

Can you look around the corner ?

Page 5: Looking Around Corners using Femto-Photography and Transient Imaging

2nd Bounce

Multi-path Analysis

1st Bounce

3rd Bounce

Page 6: Looking Around Corners using Femto-Photography and Transient Imaging

…, rescue operations, …

Page 7: Looking Around Corners using Femto-Photography and Transient Imaging

Collision avoidance, robot navigation, …

Page 8: Looking Around Corners using Femto-Photography and Transient Imaging

…, bronchoscopies, …

Page 9: Looking Around Corners using Femto-Photography and Transient Imaging

…, colonoscopies, …

Page 10: Looking Around Corners using Femto-Photography and Transient Imaging

…, cardioscopies, …

Page 11: Looking Around Corners using Femto-Photography and Transient Imaging

Femto-Photography: Higher Dimensional LF

FemtoFlash

UltraFast Detector

Computational Optics

Serious Sync

Kirmani, Hutchison, Davis, RaskarICCV 2009, Marr Prize #2

Page 12: Looking Around Corners using Femto-Photography and Transient Imaging

+

Femtosecond Laser Picosecond Camera

Transient Impulse Imaging

Page 13: Looking Around Corners using Femto-Photography and Transient Imaging

Space

Tim

eRaw Camera Images (before Shape Recovery)

Page 14: Looking Around Corners using Femto-Photography and Transient Imaging

Raw Camera Images (before Shape Recovery)

Page 15: Looking Around Corners using Femto-Photography and Transient Imaging

Raw Camera Images (before Shape Recovery)

Page 16: Looking Around Corners using Femto-Photography and Transient Imaging

Bits

Photon

s

Computer Vision

Optics

Sensors

Computational Photography & Imaging

Signal Processing

Displays

Machine Learning

Page 17: Looking Around Corners using Femto-Photography and Transient Imaging

Raskar, Camera Culture, MIT Media Lab

Camera Culture

Ramesh Raskar

Camera CultureMIT Media Lab

Ramesh Raskar http://[email protected]

Team

Moungi G. Bawendi, Professor, Dept of Chemistry, MITJames Davis, UC Santa CruzAndreas Velten, Postdoctoral Associate, MIT Media LabAhmed Kirmani, RA, MIT Media LabTyler Hutchison, RA, MIT Media LabRohit Pandharkar, RA, MIT Media LabAndrew Matthew Bardagjy, RA, MIT Media LabEverett Lawson, MIT Media Lab