Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building –...
Transcript of Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building –...
![Page 1: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/1.jpg)
Introduction
Dr. Shuang LIANG
School of Software EngineeringTongJi University
Fall, 2012
![Page 2: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/2.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Course Information• Schedule
– 18:30-21:05, Thursday– 17 weeks
• Location– Room 334, JiShi Building, Jiading Campus
• Office Hours– 16:00-17:00, Friday
![Page 3: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/3.jpg)
Lecturer• Dr. Shuang LIANG
– Assisstant professor, SSE, Tongji• Education
– B.Sc in Computer Science, Zhejiang University, 1999-2003– PhD in Computer Science, Nanjing Univerisity, 2003-2008– Visit in Utrecht University, The Netherlands, 2007, 2008
• Research Fellowship– The Chinese University of Hong Kong, 2009– The Hong Kong Polytechnic University, 2010-2011– The City University of Hong Kong, 2012
– Contact• Office: Room 442, Jishi Building, Jiading Campus (Temporary)• Email: [email protected]
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
![Page 4: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/4.jpg)
Teaching Assistant (TA)• Chen ZHANG
– Office: Room 316, Jishi Building– Tel: 137-9549-7153– QQ: 695129095– Email: [email protected]
• Please resort to TA for all programming issues.
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
![Page 5: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/5.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Materials• The course slides• Reference papers• Texts
R. O. Duda, P. E. Hart, D. G. Stork, Pattern Classification, 2nd edition, John Wiley & Sons, Inc., 2000.
S. Theodoridis, K. Koutroumbas, Pattern Recognition, 3rd edition, Academic Press, 2006.
![Page 6: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/6.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Prerequisites• Probability theory• Statistics• Linear algebra• Geometry
![Page 7: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/7.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Grading Policy• Class participation 5%
– Please do NOT be absent for more than 5 times, otherwise you will fail.
• Assignment x 3 45%– Individual homework
• Project 50%– Teamwork by 2 or 3 people
• Bonus 10%– For being active in class
• Plagiarism is not allowed!
![Page 8: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/8.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Today’s Topics• What is pattern recognition?
![Page 9: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/9.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Human Perception• Humans have developed highly sophisticated skills
for sensing their environment and taking actions according to what they observe, e.g.– Recognizing a face,– Understanding spoken words,– Reading handwriting,– Distinguishing fresh food from its smell,– ……
• We could like to give similar capabilities to machines.
![Page 10: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/10.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
What is Pattern Recognition?• Pattern recognition is the study of how machines can
– Observe the environment,– Learn to distinguish patterns of interest from their
background,– Make sound and reasonable decisions about the
categories of the patterns.
![Page 11: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/11.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
What is a Pattern?• A pattern is defined as
– “the opposite of a chaos; it is an entity, vaguely defined, that could be given a name”
• Fingerprint image• Handwritten word• Human face• Speech signal• DNA sequence• ……
![Page 12: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/12.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Other Patterns• Insurance, credit card applications
– Applicants are characterized by• No. of accidents, make of car, year of model• Income, No. of dependents, credit worthiness, mortgage amount
• Dating services– Age, hobbies, income, etc. establish your “desirability”
• E.g., 百合网
• Web documents– Key words based descriptions
• E.g., documents containing “rain”, ”hurricane”, are different from those containing ”basketball”, ”NBA”.
• Google, 百度
• Housing market– Location, size, year, school district, etc
![Page 13: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/13.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Pattern Class• A collection of “similar” (not necessarily identical)
objects– Inter-class variability
• The letter “T” in different typefaces
– Intra-class variability• Characters that look similar
![Page 14: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/14.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Pattern Recognition Applications
![Page 15: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/15.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Pattern Recognition Applications• English handwriting recognition
![Page 16: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/16.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Pattern Recognition Applications• Chinese handwriting recognition
![Page 17: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/17.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Pattern Recognition Applications• Fingerprint recognition
![Page 18: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/18.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Pattern Recognition Applications• Biometric recognition
![Page 19: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/19.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Pattern Recognition Applications• Autonomous navigation
![Page 20: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/20.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Pattern Recognition Applications• Cancer detection and grading using microscopic
tissue data
![Page 21: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/21.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Pattern Recognition Applications• Land cover classification using satellite data
![Page 22: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/22.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Pattern Recognition Applications• Building and building group recognition using
satellite data
![Page 23: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/23.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Pattern Recognition Applications• License plate recognition
– US license plates
![Page 24: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/24.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Pattern Recognition Applications• Clustering of microarray data
![Page 25: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/25.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Related Courses• Information Theory• Introductory Applied Machine Learning• Data Mining and Exploration• Probabilistic Modeling and Reasoning• Neural Information Processing• Reinforcement Learning• ……
![Page 26: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/26.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Related Areas• Brain science• Image analysis and computer vision• Language modeling• Speech modeling• Handwriting recognition• Risk management• Medical imaging• Web analytics• Recommender engines• Computer games engines• Financial modeling• Geoinformational systems• Intelligent management• ……
![Page 27: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/27.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Why Welcome?• Exciting area
– Interesting problems• Some unsolved
– Now ubiquitous– In great demand– Related to many domains
![Page 28: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/28.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
12 IT Skills Employers Can’t Get Enough Of
• So what is number one?
![Page 29: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/29.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
12 IT Skills Empolyers Can’t Get Enough Of
• Machine Learning• But that was 2007. What about more recently……
![Page 30: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/30.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Top 3 Hottest Majors for a Career in Technology
• The top 3 hottest majors for a career in technology are…
![Page 31: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/31.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Top 3 Hottest Majors for a Career in Technology
• Pattern recognition skills are in high demand
![Page 32: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/32.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
What is the Point of Studying this Course?
• What should you be able to do after this course?– Understand why and how it is possible to do pattern
recognition– Understand how the wide set of pattern recognition
methods fit into an overall framework– Know how to use and justify these methods– Be able to create to create your own pattern recognition
methods– Learn to think in terms of probabilistic models
![Page 33: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/33.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
What Capabilities can be Improved in this Course?
• Theoretical analysis• Reasoning ability• Summarizing ability
• Team working• Communication• Presentation• Expression
![Page 34: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/34.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Course Outline• Pattern recognition systems• Classification• Feature selection• Clustering• Matching• Other topics if possible
![Page 35: Dr. Shuang LIANG - sse.tongji.edu.cn · • Chen ZHANG – Office: Room 316, Jishi Building – Tel: 137-9549-7153 – QQ: 695129095 – Email: isaackinger@gmail.com • Please resort](https://reader034.fdocuments.net/reader034/viewer/2022051408/5ff44490207b1e72a22a6147/html5/thumbnails/35.jpg)
Introduction Pattern Recognition, Fall 2012 Dr. Shuang LIANG, SSE, TongJi
Let’s start!
Let’s begin to explore the PR world!