Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature...
Transcript of Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature...
![Page 1: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/1.jpg)
MIT 2.71/2.71009/26/05 wk4-a-1
Imaging systems in nature
• “Physical” architecture matches survival requirements and processing capabilities
• Human eye: evolved for– adaptivity (e.g. brightness adjustment)– transmission efficiency (e.g. mexican hat response)– bypass structural defects (e.g. blind spot)– other functional requirements (e.g. stereo vision)
• Insect eye: similar, but much simpler processor (human brain = ~1011 neurons; insect brain = ~104 neurons)
![Page 2: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/2.jpg)
MIT 2.71/2.71009/26/05 wk4-a-2
Anatomy of the human eye
W. J. Smith, “Modern Optical Engineering,” McGraw-Hill
![Page 3: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/3.jpg)
MIT 2.71/2.71009/26/05 wk4-a-3
Eye schematic with typical dimensions
Photographic camera
FFP1.5cm BFP
![Page 4: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/4.jpg)
MIT 2.71/2.71009/26/05 wk4-a-4
Remote object (unaccommodated eye)
Proximal object (accommodated eye)
Comfortable viewing up to 2.5cm away from the cornea
Accommodation (focusing)
![Page 5: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/5.jpg)
MIT 2.71/2.71009/26/05 wk4-a-5
Eye defects and their correction
from Fundamentals of Opticsby F. Jenkins & H. White
![Page 6: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/6.jpg)
MIT 2.71/2.71009/26/05 wk4-a-6
The eye’s “digital camera”: retina
http://www.mdsupport.org
![Page 7: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/7.jpg)
MIT 2.71/2.71009/26/05 wk4-a-7
The eye’s “digital camera”: retina
http://www.phys.ufl.edu/~avery/
rods: intensity (grayscale) cones: color (R/G/B)
![Page 8: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/8.jpg)
MIT 2.71/2.71009/26/05 wk4-a-8
Retina vs your digital camera
(grossly exaggerated; in actual retinatransition from dense to sparse sampling
is much smoother)
Retina:variant sampling rate
Digital camera:fixed sampling rate
![Page 9: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/9.jpg)
MIT 2.71/2.71009/26/05 wk4-a-9
Retina vs your digital cameraRetina:
blind spot not noticeableDigital camera:
bad pixels destructive
![Page 10: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/10.jpg)
MIT 2.71/2.71009/26/05 wk4-a-10
Retina vs your digital camera
CCD imageRetinal image
http://www.klab.caltech.edu/~itti/
![Page 11: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/11.jpg)
MIT 2.71/2.71009/26/05 wk4-a-11
Spatial response of the retina –lateral connections
http://webvision.med.utah.edu/
![Page 12: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/12.jpg)
MIT 2.71/2.71009/26/05 wk4-a-12
Spatial response of the retina –lateral connections
http://www.phys.ufl.edu/~avery/
![Page 13: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/13.jpg)
MIT 2.71/2.71009/26/05 wk4-a-13
Spatial response of the retina –lateral connections
http://faculty.washington.edu/wcalvin
Explanation of the “flipping dot” illusion: the Mexican hat response
![Page 14: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/14.jpg)
MIT 2.71/2.71009/26/05 wk4-a-14
Temporal response: after-images
http://dragon.uml.edu/psych/
![Page 15: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/15.jpg)
MIT 2.71/2.71009/26/05 wk4-a-15
Seeing 3D
http://www.ccom.unh.edu/vislab/VisCourse
![Page 16: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/16.jpg)
MIT 2.71/2.71009/26/05 wk4-a-16
http://research.microsoft.com/users/antcrim/talks/UWTalk_files/slide0074.htm
![Page 17: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/17.jpg)
MIT 2.71/2.71009/26/05 wk4-a-17
![Page 18: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/18.jpg)
MIT 2.71/2.71009/26/05 wk4-a-18
The compound eye
![Page 19: Imaging systems in nature - MITweb.mit.edu/2.710/Fall06/2.710-wk4-a-sl.pdfImaging systems in nature • “Physical” architecture matches survival requirements and processing capabilities](https://reader034.fdocuments.net/reader034/viewer/2022042310/5ed846e40fa3e705ec0e2cb9/html5/thumbnails/19.jpg)
MIT 2.71/2.71009/26/05 wk4-a-19
Elements of the compound eye:ommatidia (=little eyes)
“image” formation:blurry, but
computationally efficientfor moving-edge detection