Python in Computer Vision - Sajjad

Motivation and BackgroundPython in Computer Vision

More InformationSummary

Python in Computer Vision

Sajjad KMS7 CSE B, MESCE

Guide: Chithra V.S

October 20, 2010

Sajjad KM Python in Computer Vision

Outline

1 Motivation and Background

What is Python?

What is Computer Vision?

Uses and Examples

2 Python in Computer Vision

Image Acquisition

3 More Information

Different Platforms

Additional Tools

4 Summary

Outline

What is Python?

Uses and Examples

Image Acquisition

3 More Information

Different Platforms

Additional Tools

4 Summary

Outline

What is Python?

Uses and Examples

Image Acquisition

3 More Information

Different Platforms

Additional Tools

4 Summary

Outline

What is Python?

Uses and Examples

Image Acquisition

3 More Information

Different Platforms

Additional Tools

4 Summary

Outline

What is Python?

Uses and Examples

Image Acquisition

3 More Information

Different Platforms

Additional Tools

4 Summary

What is Python?What is Computer Vision?Uses and Examples

A word about Python

Designed by Guido van Rossum in 1991.

General-purpose high-level programming language.

Emphasizes code readability.

Large and comprehensive library.

Supports OOP, Imperative and Functional programmingstyles.

Dynamic and Interpreted.

A word about Python

Vision

25% of the whole brain is for vision. Around 50% of cerebralcortex is for vision, 80% of the brain is associated with visionis some manner.

Definition

Computer Vision is the science and technology of machinesthat see.

The goal of Computer Vision is to recognize objects andtheir motion.

Definition

Computer Vision is the science and technology of machinesthat see.

The goal of Computer Vision is to recognize objects andtheir motion.

What is it used for?

Scene reconstruction

Event detection

Video tracking

Object recognition

Learning

Motion estimation

Image resotration

Computer Vision crosses over with many domains

What makes it hard?

Figure: What we see? and What the computer see?

Endless

There are endless possibilities for Computer Vision and theseare few of them:

Scene reconstruction

Event detection

Video tracking

Object recognition

Object Recognition and Segmentation.. 1

Traffic Monitoring.. 1

Traffic Monitoring.. 2

Augmented Reality - Sixth Sense

A wearable gestural interface that augments the physicalworld with digital information and lets us use natural hand

gestures to interact with that information.

http://www.pranavmistry.com/projects/sixthsenseSajjad KM Python in Computer Vision

Outline

What is Python?

Uses and Examples

Image Acquisition

3 More Information

Different Platforms

Additional Tools

4 Summary

ToolsImage Acquisition

OpenCV

Well tested, optimized and open source code for imageprocessing and computer vision

Written in C, ensuring both fast and portable.

Has been compiled for many embedded platforms

Has multiple language wrappers including 3 for Python

Tools have been made to use graphics hardware toaccelerate CV performance on the GPU

OpenCV

Project home page and documentation is at:http://opencv.willowgarage.com

NumPy and SciPy

Open source library of algorithms and mathematicaltools for Python.

Gives strongly typed N-dimensional arrays to Python

Includes lots of handy tools such as optimisation andsignal processing used often in computer vision.

NumPy and SciPy

Plotting

Optimization.

Advanced Data Analysis.

Database.

SciPy can be downloaded from: http://www.scipy.orgNumPy is available at: http://numpy.scipy.org

NumPy and SciPy

Plotting

Optimization.

Database.

NumPy and SciPy

Plotting

Optimization.

Database.

NumPy and SciPy

Plotting

Optimization.

Database.

NumPy and SciPy

Python Imaging Library PIL

External library for the Python

Adds support for opening, manipulating, and savingmany different image file formats.

Image library is designed for fast access to data stored.

Provide a solid foundation for a general imageprocessing tool.

Quick demo of PILColor TransformationsCropping

Pygame

Set of Python modules designed for writing video games.

Now has basic Computer Vision support

Can be used with other Python tools -integrates wellwith numpy/scipy

Pygame can be downloaded from: http://www.pygame.org

Pygame

Capturing and Displaying Image

Live image acquisition is crucial and used in majority CVapplications.

A quick example to egg you on! :)

Let’s use OpenCV

Capturing and Displaying Image

Live image acquisition is crucial and used in majority CVapplications.

A quick example to egg you on! :)

Let’s use OpenCV

Outline

What is Python?

Uses and Examples

Image Acquisition

3 More Information

Different Platforms

Additional Tools

4 Summary

Different PlatformsAdditional Tools

Running on an OLPC

One Laptop per Child Association, Inc.Includes Python and a webcam - thats all you need forcomputer vision!Lots of Computer Vision work on the XO has been doneusing pygame by Nirav Patel (http://eclecti.cc/olpc)

Running on an OLPC

Documentation and Support

The documentation in both SciPy and OpenCV was found tobe pretty good though not entirely complete. The OpenCVbook is really good.

Python is Free

Documentation is not going to be as extensive as for aprofessional package like Matlab... but you can help!

There is a wonderful community around all these librariesand tools. You can get instant support from the mailing listsand IRC channels.

Outline

What is Python?

Uses and Examples

Image Acquisition

3 More Information

Different Platforms

Additional Tools

4 Summary

Summary

For the researchers and scholars of computer vision,using Python can help in trying out new algorithms veryquickly. The breadth of the additional libraries availableand the ease of integrating, enables them to make newand novel solutions quickly.

For someone just wanting to play around with some coolstuff, get along and dive in!

Limitations would be on the performance, but you cantune it to the maximum.

Summary

Thank you!

A bunch of thanks to

Ms. Chithra V.S - Guide.

Few slides from Brian Thorne, University of Canterbury,Christchurch, New Zealand

and You! - for all the patience.

References and Further Reading

1 Brian Thorne, University of Canterbury, Python inComputer Vision, Kiwi PyCon, Christchurch, 2009

2 Learning OpenCV - G. Bradski, A. KaehlerO’Reilly Media, September 2008.

3 Guide to NumPy - T. OliphantUT, Trelgol Publishing, 2006.

4 Python Imaging Library Handbook, PIL 1.1.3,Fredrik Lundh, Matthew Ellis, March 12, 2002

5 Pygame - http://pygame.org

6 OpenCV - http://opencv.willowgarage.com

7 NumPy/SciPy - http://scipy.org

Python in Computer Vision - Sajjad

Documents

Transcript of Python in Computer Vision - Sajjad