Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow &...
Transcript of Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow &...
![Page 1: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/1.jpg)
GV12/3072
Image Processing.
1
Image Processing
Gabriel Brostow & Simon Prince
![Page 2: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/2.jpg)
GV12/3072
Image Processing.
2
![Page 3: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/3.jpg)
GV12/3072
Image Processing.
3
Motivation and Goals
• Grounding in image processing techniques
• Concentrate on algorithms used in machine
vision, graphics, medical imaging
• Best sensors ever!
![Page 4: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/4.jpg)
GV12/3072
Image Processing.
4
Motivation and Goals
• Grounding in image processing techniques
• Concentrate on algorithms used in machine
vision, graphics, medical imaging
• Best sensors ever! With a few problems…
![Page 5: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/5.jpg)
Transmission interference
5
![Page 6: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/6.jpg)
Compression artefacts
6
![Page 7: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/7.jpg)
Spilling
7
![Page 8: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/8.jpg)
Scratches, Sensor noise
8
![Page 9: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/9.jpg)
Bad contrast
9
![Page 10: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/10.jpg)
Resolution Super resolution?
10
![Page 12: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/12.jpg)
Removing motion blur
Original image
Cropped subwindow
After motion blur removal
[Images from Amit Agrawal]12
![Page 13: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/13.jpg)
Removing motion blur
13
![Page 14: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/14.jpg)
14
![Page 15: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/15.jpg)
Removing motion blur
15
![Page 16: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/16.jpg)
GV12/3072
Image Processing.
16
Syllabus
1. The digital image
2. Image segmentation*
3. Image transformations
4. Morphological operations*
5. Feature characterization
*= Homework will be assigned
![Page 17: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/17.jpg)
GV12/3072
Image Processing.
17
Features and Object Recognition
![Page 18: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/18.jpg)
GV12/3072
Image Processing.
18
Syllabus (GV12/3072)
6. Image Filtering
7. Edge detection*
8. Corner detection
9. Color images*
10.Template matching
*= Homework will be assigned
![Page 19: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/19.jpg)
GV12/3072
Image Processing.
19
Why Now?
• Why are these sectors paying more attention?
•Medicine• Automatic or assisted diagnosis
• Image-guided surgery
•Agriculture
•Film and television
•Surveillance and police work
•Military
•http://www.cs.ubc.ca/spider/lowe/vision.html
![Page 20: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/20.jpg)
GV12/3072
Image Processing.
20
Course content
• Lots of material!
• Some mathematics• Calculus (light)
• Geometry and matrix algebra
• Probability and statistics (light)
• Some programming – Matlab
![Page 21: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/21.jpg)
21
Lectures and notes
• http://www.cs.ucl.ac.uk/staff/G.Brostow/classes/IP2009/
• Mon 16:00-17:00 (Drayton Ricardo LT)
• Wed 09:00-11:00 (Roberts G08, Sir David Davies LT)
• Lab sessions
– Monday 11-12 (Malet Place Eng 4.06)
Monday 12-13 (Malet Place Eng 4.06)
Monday 17-18 (Malet Place Eng 4.06)
• subject: “join” to [email protected]
![Page 22: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/22.jpg)
22
![Page 23: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/23.jpg)
GV12/3072
Image Processing.
24
Assessment
• Exam 80%
• Four Courseworks 20%.• Implement and test algorithms in Matlab
• Honor System
![Page 24: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/24.jpg)
GV12/3072
Image Processing.
27
Unassessed CW Assignment
• Matlab introduction
• Start matlab:
% matlab or
% /opt/matlab7/bin/matlab
• Download any simple image
• Load it into matlab:
>> I = imread(‘foo.jpg’);
![Page 25: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/25.jpg)
28
Unassessed CW Assignment
• Display the image in Matlab:
>> imshow(I);
• Print the image data array:
>> I
(Ha! It’s a trap! – use Ctrl-C to make it stop)
• Print the size of the image array and create a subimage:
>> size( I )
>> Isubwindow = I(72:92, 62:82);
>> imshow(Isubwindow);
![Page 26: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/26.jpg)
GV12/3072
Image Processing.
29
Unassessed CW Assignment
• Start the Matlab help tool (Help menu).
• In the “Contents” pane to the left of the
window. Click on MATLAB.
• Go through the “Getting Started” section.
• Continue to the “Using MATLAB” section
when you have time.
![Page 27: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/27.jpg)
IP is Only Part of the Picture
• See Machine Vision
(GI04) in MPEB 1.03
Tuesday at 10am
• Why?
– To work on fun projects!
30
MRI of GJB A Computational Investigation into
the Human Representation and
Processing of Visual Information
![Page 28: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/28.jpg)
• 3D Gesture Interfaces
(Xbox 360)
• Build Your Own 3D Scanner: Optical Triangulation for
Beginners (Lanman + Taubin)
GV12/3072
Image Processing.
31
![Page 29: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/29.jpg)
GV12/3072
Image Processing.
32
Developing Drosophila eye (30 hours)With Franck PichaudEpithelial Morphogenesis & Cell PolarityLMCB, Cell Biology Unit, MRC, UCLNeeded Innovations:
- Locate & track branching structures
- Propagate confidence to neighbors
![Page 30: Image Processing - UCL Computer Science · Image Processing. 1 Image Processing Gabriel Brostow & Simon Prince. GV12/3072 Image Processing. 2. ... •Some mathematics •Calculus](https://reader030.fdocuments.net/reader030/viewer/2022033123/5edd24ffad6a402d66682030/html5/thumbnails/30.jpg)
Next Time: The Digital Image
GV12/3072
Image Processing.
33