Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors...
-
date post
21-Dec-2015 -
Category
Documents
-
view
229 -
download
1
Transcript of Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors...
![Page 1: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/1.jpg)
Marc Levoy
Synthetic aperturephotography and illumination
using arrays of cameras and projectors
Marc Levoy
Computer Science DepartmentStanford University
![Page 2: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/2.jpg)
Marc Levoy
Outline
technologies– large camera arrays
– large projector arrays
– camera–projector arrays
optical effectssynthetic aperture photography
synthetic aperture illumination
synthetic confocal imaging
applications– partially occluding environments
– weakly scattering media
examplesfoliage
murky water
![Page 3: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/3.jpg)
Marc Levoy
Multi-camera systems
• multi-camera vision systems
• omni-directional vision
• 1D camera arrays
• 2D camera arrays
Immersive Media’sdodeca camera
Nayar’sOmnicam
Kang’s multi-baseline stereo
Manex’s bullet time array
Kanade’s 3D room
![Page 4: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/4.jpg)
Marc Levoy
Stanford multi-camera array
• 640 × 480 pixels ×30 fps × 128 cameras ÷ 18:1 MPEG = 512 Mbs
• snapshot or video
• synchronized timing
• continuous streaming
• cheap sensors & optics
• flexible arrangement
![Page 5: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/5.jpg)
Marc Levoy
Applications for the array
• How are the cameras arranged?– tightly packed high-performance imaging
– widely spaced light fields
– intermediate spacing synthetic aperture photography
![Page 6: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/6.jpg)
Marc Levoy
Cameras tightly packed:high-performance imaging
• high-resolution– by abutting the cameras’ fields of view
• high speed– by staggering their triggering times
• high dynamic range– mosaic of shutter speeds, apertures, density filters
• high precision– averaging multiple images improves contrast
• high depth of field– mosaic of differently focused lenses
![Page 7: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/7.jpg)
Marc Levoy
Abutting fields of view
Q. Can we align images this well?
A. Yes.
![Page 8: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/8.jpg)
Marc Levoy
Cameras tightly packed:high-performance imaging
• high-resolution– by abutting the cameras’ fields of view
• high speed– by staggering their triggering times
• high dynamic range– mosaic of shutter speeds, apertures, density filters
• high precision– averaging multiple images improves contrast
• high depth of field– mosaic of differently focused lenses
![Page 9: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/9.jpg)
Marc Levoy
High-speed photography
Harold Edgerton, Stopping Time, 1964
![Page 10: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/10.jpg)
Marc Levoy
A virtual high-speed video camera[Wilburn, 2004 (submitted) ]
• 52 cameras, each 30 fps
• packed as closely as possible
• staggered firing, short exposure
• result is 1560 fps camera
• continuous streaming
• no triggering needed
![Page 11: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/11.jpg)
Marc Levoy
Example
![Page 12: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/12.jpg)
Marc Levoy
A virtual high-speed video camera[Wilburn, 2004 (submitted) ]
• 52 cameras, 30 fps, 640 × 480
• packed as closely as possible
• short exposure, staggered firing
• result is 1536 fps camera
• continuous streaming
• no triggering needed
• scalable to more cameras
• limited by available photons
• overlap exposure times?
100 cameras3072 fps
![Page 13: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/13.jpg)
Marc Levoy
Cameras tightly packed:high-X imaging
• high-resolution– by abutting the cameras’ fields of view
• high speed– by staggering their triggering times
• high dynamic range– mosaic of shutter speeds, apertures, density filters
• high precision– averaging multiple images improves contrast
• high depth of field– mosaic of differently focused lenses
![Page 14: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/14.jpg)
Marc Levoy
High dynamic range (HDR)
• overcomes one of photography’s key limitations– negative film = 250:1 (8 stops)
– paper prints = 50:1
– [Debevec97] = 250,000:1 (18 stops)
– hot topic at recent SIGGRAPHs
![Page 15: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/15.jpg)
Marc Levoy
Cameras tightly packed:high-X imaging
• high-resolution– by abutting the cameras’ fields of view
• high speed– by staggering their triggering times
• high dynamic range– mosaic of shutter speeds, apertures, density filters
• high precision– averaging multiple images improves contrast
• high depth of field– mosaic of differently focused lenses
![Page 16: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/16.jpg)
Marc Levoy
Seeing through murky water
• scattering decreases contrast
• noise limits perception in low contrast images
• averaging multiple images decreases noise
![Page 17: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/17.jpg)
Marc Levoy
Seeing through murky water
• scattering decreases contrast, but does not blur
• noise limits perception in low contrast images
• averaging multiple images decreases noise
![Page 18: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/18.jpg)
Marc Levoy
Seeing through murky water
16 images 1 image
![Page 19: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/19.jpg)
Marc Levoy
Cameras tightly packed:high-X imaging
• high-resolution– by abutting the cameras’ fields of view
• high speed– by staggering their triggering times
• high dynamic range– mosaic of shutter speeds, apertures, density filters
• high precision– averaging multiple images improves contrast
• high depth of field– mosaic of differently focused lenses
![Page 20: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/20.jpg)
Marc Levoy
High depth-of-field
• adjacent views use different focus settings
• for each pixel, select sharpest view
close focus distant focus composite
[Haeberli90]
![Page 21: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/21.jpg)
Marc Levoy
Synthetic aperture photography
![Page 22: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/22.jpg)
Marc Levoy
Synthetic aperture photography
![Page 23: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/23.jpg)
Marc Levoy
Synthetic aperture photography
![Page 24: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/24.jpg)
Marc Levoy
Synthetic aperture photography
![Page 25: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/25.jpg)
Marc Levoy
Synthetic aperture photography
![Page 26: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/26.jpg)
Marc Levoy
Synthetic aperture photography
![Page 27: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/27.jpg)
Marc Levoy
Long-rangesynthetic aperture photography
![Page 28: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/28.jpg)
Marc Levoy
Synthetic pull-focus
![Page 29: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/29.jpg)
Marc Levoy
Crowd scene
![Page 30: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/30.jpg)
Marc Levoy
Crowd scene
![Page 31: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/31.jpg)
Marc Levoy
Synthetic aperture photographyusing an array of mirrors
• 11-megapixel camera
• 22 planar mirrors
?
![Page 32: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/32.jpg)
Marc Levoy
![Page 33: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/33.jpg)
Marc Levoy
![Page 34: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/34.jpg)
Marc Levoy
Synthetic aperture illumation
![Page 35: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/35.jpg)
Marc Levoy
Synthetic aperture illumation
• technologies– array of projectors
– array of microprojectors
– single projector + array of mirrors
• applications– bright display
– autostereoscopic display [Matusik 2004]
– confocal imaging [this paper]
![Page 36: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/36.jpg)
Marc Levoy
Confocal scanning microscopy
pinhole
light source
![Page 37: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/37.jpg)
Marc Levoy
Confocal scanning microscopy
pinhole
light source
photocell
pinhole
r
![Page 38: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/38.jpg)
Marc Levoy
Confocal scanning microscopy
pinhole
light source
photocell
pinhole
![Page 39: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/39.jpg)
Marc Levoy
Confocal scanning microscopy
pinhole
light source
photocell
pinhole
![Page 40: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/40.jpg)
[UMIC SUNY/Stonybrook]
![Page 41: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/41.jpg)
Marc Levoy
Synthetic confocal scanning
light source
→ 5 beams→ 0 or 1 beam
![Page 42: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/42.jpg)
Marc Levoy
Synthetic confocal scanning
light source
→ 5 beams→ 0 or 1 beam
![Page 43: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/43.jpg)
Marc Levoy
Synthetic confocal scanning
→ 5 beams→ 0 or 1 beam
• works with any number of projectors ≥ 2
• discrimination degrades if point to left of
• no discrimination for points to left of
• slow!
• poor light efficiency
d.o.f.
![Page 44: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/44.jpg)
Marc Levoy
Synthetic coded-apertureconfocal imaging
• different from coded aperture imaging in astronomy• [Wilson, Confocal Microscopy by Aperture Correlation, 1996]
![Page 45: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/45.jpg)
Marc Levoy
Synthetic coded-apertureconfocal imaging
![Page 46: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/46.jpg)
Marc Levoy
Synthetic coded-apertureconfocal imaging
![Page 47: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/47.jpg)
Marc Levoy
Synthetic coded-apertureconfocal imaging
![Page 48: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/48.jpg)
Marc Levoy
Example pattern
![Page 49: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/49.jpg)
Marc Levoy
Patterns with less aliasing
![Page 50: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/50.jpg)
Marc Levoy
Implementation using an array of mirrors
![Page 51: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/51.jpg)
(video available at http://graphics.stanford.edu/papers/confocal/)
![Page 52: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/52.jpg)
Synthetic aperture confocal imaging
synthetic aperture image
confocal image
single viewpoint
combined
![Page 53: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/53.jpg)
Marc Levoy
Selective illumination using object-aligned mattes
![Page 54: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/54.jpg)
Marc Levoy
Confocal imaging in scattering media
• small tank– too short for attenuation
– lit by internal reflections
![Page 55: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/55.jpg)
Marc Levoy
Experiments in a large water tank
50-foot flume at Wood’s Hole Oceanographic Institution (WHOI)
![Page 56: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/56.jpg)
Marc Levoy
Experiments in a large water tank
• 4-foot viewing distance to target
• surfaces blackened to kill reflections
• titanium dioxide in filtered water
• transmissometer to measure turbidity
![Page 57: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/57.jpg)
Marc Levoy
Experiments in a large water tank
• stray light limits performance
• one projector suffices if no occluders
![Page 58: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/58.jpg)
Marc Levoy
Seeing through turbid water
floodlit scanned tile
![Page 59: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/59.jpg)
Marc Levoy
Other patterns
sparse grid
staggered grid
swept stripe
![Page 60: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/60.jpg)
Marc Levoy
Other patterns
swept stripefloodlit scanned tile
![Page 61: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/61.jpg)
Marc Levoy
Stripe-based illumination
• if vehicle is moving, no sweeping is needed!
• can triangulate from leading (or trailing) edge of stripe, getting range (depth) for free
[Jaffe90]
![Page 62: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/62.jpg)
swept linefloodlit scanned tile
sum of floodlit
![Page 63: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/63.jpg)
Marc Levoy
Strawman conclusions onimaging through a scattering medium
• shaping the illumination lets you see 2-3x further, but requires scanning or sweeping
• use a pattern that avoids illuminating the media along the line of sight
• contrast degrades with increasing total illumination, regardless of pattern
![Page 64: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/64.jpg)
Marc Levoy
Application tounderwater exploration
[Ballard/IFE 2004]
[Ballard/IFE 2004]
![Page 65: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/65.jpg)
Marc Levoy
The team
• staff– Mark Horowitz
– Marc Levoy
– Bennett Wilburn
• students– Billy Chen
– Vaibhav Vaish
– Katherine Chou
– Monica Goyal
– Neel Joshi
– Hsiao-Heng Kelin Lee
– Georg Petschnigg
– Guillaume Poncin
– Michael Smulski
– Augusto Roman
• collaborators– Mark Bolas
– Ian McDowall
– Guillermo Sapiro
• funding– Intel
– Sony
– Interval Research
– NSF
– DARPA
![Page 66: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/66.jpg)
Relevant publications(in reverse chronological order)
– Spatiotemporal Sampling and Interpolation for Dense Camera ArraysBennett Wilburn, Neel Joshi, Katherine Chou, Marc Levoy, Mark Horowitz
ACM Transactions on Graphics (conditionally accepted)
– Interactive Design of Multi-Perspective Images for Visualizing Urban LandscapesAugusto Román, Gaurav Garg, Marc Levoy
Proc. IEEE Visualization 2004
– Synthetic aperture confocal imaging Marc Levoy, Billy Chen, Vaibhav Vaish, Mark Horowitz, Ian McDowall, Mark Bolas
Proc. SIGGRAPH 2004
– High Speed Video Using a Dense Camera Array Bennett Wilburn, Neel Joshi, Vaibhav Vaish, Marc Levoy, Mark Horowitz
Proc. CVPR 2004
– High Speed Video Using a Dense Camera Array Bennett Wilburn, Neel Joshi, Vaibhav Vaish, Marc Levoy, Mark Horowitz
Proc. CVPR 2004
– The Light Field Video Camera Bennett Wilburn, Michael Smulski, Hsiao-Heng Kelin Lee, and Mark Horowitz
Proc. Media Processors 2002, SPIE Electronic Imaging 2002
![Page 67: Marc Levoy Synthetic aperture photography and illumination using arrays of cameras and projectors Marc Levoy Computer Science Department Stanford.](https://reader038.fdocuments.net/reader038/viewer/2022103005/56649d585503460f94a38532/html5/thumbnails/67.jpg)
Marc Levoyhttp://graphics.stanford.edu/projects/array