ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.
-
Upload
dorthy-gilmore -
Category
Documents
-
view
219 -
download
0
Transcript of ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.
![Page 1: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/1.jpg)
ITCS 6157/8157
Visual Database
Fall 2015
http://www.cs.uncc.edu/~jfan/itcs6157.html
![Page 2: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/2.jpg)
Overview
Class hour 9:30AM - 12:15PM, Thursday Office hour Thursday 1:30 - 5:00PM Classroom Woodward Hall 130 Instructor - Dr. Jianping Fan
email - [email protected] Office – Woodward 205D Webpage http://www.cs.uncc.edu/~jfan
Textbook: we will use the slices and papers on the course web page
![Page 3: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/3.jpg)
Why we should have this course?
Internet is changing the world Multimedia (especially visual data) is
dominating the content of Internet Easy access of multimedia content
through Internet could be the future of IT
This class will provide training on multimedia content analysis and search!
![Page 4: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/4.jpg)
Why we should have this course?
Good job market: Google, Yahoo!....
Have fun: solving real problem
Not so “hard” to learn (??)
Next generation search engines
![Page 5: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/5.jpg)
How can I access multimedia in database over networks?
Networks
Course objectives
Multimedia ServerUser
Google, Yahoo! & MSN IE
![Page 6: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/6.jpg)
1. How to format multimedia queries? 2. How to represent multimedia content?3. How to index large-scale multimedia?
4. How to search multimedia in database ? 5. How to transmit query results over IP ?6. How to control user’s access ?
To answer above question, we need to address:
Course objectives
Everyone has smartphone now
![Page 7: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/7.jpg)
How to build multimedia search engines?
How to build text indexing?Text document
Natural language processing
Inverse File indexing
Text database
Multimedia data
multimedia analysis
Hash Indexing or othersMultimedia database & query
Yahoo, Google
Can we do multimedia retrieval like Google for text search?
Keywords
Multimedia ``keywords”
Simple extension
![Page 8: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/8.jpg)
Required Techniques How to build multimedia search engines?
Computer Vision Technologies for Multimedia Content Analysis
Machine Learning Tools for Understanding Multimedia Semantics
Database Techniques for Large-Scale Multimedia Indexing
Human-Computer Interaction for query formulation, display & exploration
![Page 9: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/9.jpg)
Components from Database System
a. Data Representation Schema
b. Database Indexing
c. Database Storage
d. Query Management
e. Big Data Analytics
![Page 10: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/10.jpg)
Components from Computer Vision
a. Image & Video Analysis & Feature Extraction
b. Object Detection & Scene Understanding
c. Classifier Training for object and concept detection
d. Scene Configuration and Structure
![Page 11: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/11.jpg)
Components from Machine Learning
a. GMM & Bayesian Network
b. Support Vector Machine (SVM)
c. Graphical Models & Structure Learning
d. Statistical Inference
e. Deep Learning & Big Data Analytics
![Page 12: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/12.jpg)
Database Management System: ITCS6160 or ITCS3160
Computer Vision Machine Learning Programming Skills
Willing to work hard
If you do not have these background, you should
![Page 13: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/13.jpg)
Course Topics
Data Clustering Tools Machine Learning Techniques Multimedia Analysis Technologies Database Indexing Structures Deep Learning & Big Data Analytics Human-Computer Interaction Tools Taking-Home Self-Study Materials Open Discussion & Student Presentation
![Page 14: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/14.jpg)
Grading
Composition Project 25% Midterm 35% Final 40%
Scale >93% = A 75-93% = B 55-74% = C <55% or cheating = F
If you miss 3 classes (three weeks) or more, you are not allowed to take tests (mid-term and final)!
![Page 15: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/15.jpg)
Class Policy You have to attend the class & come to
classroom on time (no later than 9:35am)
You should be ready to learn from the class: project implementation could be critical
You should respect your classmates: come to learn from their presentation!
![Page 16: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/16.jpg)
Classroom Policy
No food!!! Drink could be allowed & Cell Phone should be turned off.
Small talk is not allowed, but you are welcome to ask questions!
Walking inside classroom is not allowed within presentation time!
![Page 17: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/17.jpg)
Course Projects
Project implementation project: you need to set up a team or individual to implement one small system for multimedia content analysis or understanding.
Paper presentation project: you need to pick one topic to present in the class. MS students are not encouraged to take this kind of project!
More information http://www.cs.uncc.edu/~jfan
We will offer two kinds of projects:
![Page 18: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/18.jpg)
Implementation Project
Develop image/video analysis system using Visual C++ and Java. Each group consists 3-4 students 3-4 hours workload each week is expected Java or C++ assumed
Talk to your professor to decide which algorithm you may implement for your project, discuss progress with your professor if necessary
Demonstrate your implementation to your professor & get feedback
![Page 19: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/19.jpg)
Paper Presentation Project Present one research topic: you need to
talk to your professor to get relevant research papers, prepare presentation slides & present in the class. Well-understanding of the topic Good presentation in the class Be able to answer questions from classmates
& professor Topic selection: depending on available
topics and professor assignment.
If you are PhD student
![Page 20: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/20.jpg)
Course Projects
Good grade even you may perform well in final and mid-term tests Practical implementation means more than
paper work
Good recommendation letter for job hunting: professor can only memorize students with good performance!
Research position opportunities
If you do wonderful job on course project, you may expect:
![Page 21: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/21.jpg)
Midterm & Final
closed books and notes One page notes is permitted
Cumulative No makeup Bonus is expected Key components for your final
gradeIf you miss 3 classes or more, you are not allowed to take tests (mid-term and final)!
![Page 22: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/22.jpg)
Suggestions from Instructor
Do your best in the class Show your problems to the
instructor when you cannot make it Show the evidence to us if you
think you are right. Open discussion is welcome, but no
small talk
![Page 23: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/23.jpg)
10-hours Golden Rules 3 hours before class: go through the topics,
presentation slides and seek some relevant online documents, …; ready to ask questions in class
3 hours in class: listen to domain experts and try to ask questions
4 hours after class: review what you have learnt from the class, do your project and assignments…
![Page 24: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/24.jpg)
Who cares?
![Page 25: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/25.jpg)
Who cares?
Google Search Engine
Google Search Engine
![Page 26: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/26.jpg)
Who cares?
![Page 27: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/27.jpg)
The way to join them
Good grade from class
More training on programming skills, especially for multimedia analysis, indexing and retrieval
Get recommendation from professor
![Page 28: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/28.jpg)
Recommendation
Good grade is very important, but it is not everything!
Learning something and solving one problem you like may be more important!
Learning from someone who may make you better! Especially your classmates
![Page 29: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/29.jpg)
What areas we will touch?
Computer Vision Database Information Retrieval Machine Learning & AI Visualization Networks Statistics & Security
![Page 30: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/30.jpg)
What you may expect
Start-up Companies
Many wonderful companies & start-ups come from course projects!
You could be the next one!
![Page 31: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/31.jpg)
What you may expect
Start-up Companies
Product search engine for amezon.com, taobao.com
Using your smartphones to take pictures, then we will find the cheapest ones for you!
![Page 32: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/32.jpg)
What you may expect
Start-up Companies
Image Search Engine
![Page 33: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/33.jpg)
What you may expect
Start-up Companies
Google Glass App: Google glass may change world like i-phone
![Page 34: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/34.jpg)
What you may expect
Start-up Companies
Digital Camera App: Sony may sale digital cameras with your media organization & searchsoftware.
![Page 35: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/35.jpg)
What you may expect
Start-up Companies
Personal Computer App: IBM Dell may sale PCs with your media organization & search software.
![Page 36: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/36.jpg)
What you may expect
Start-up Companies
Automatic-Driving Car App: BMW Tesla may sale cars with your object recognition & navigation systems.
![Page 37: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/37.jpg)
What you may expect
Start-up Companies
Plant Species Identification: Your Kids will be proud of you because you Know every plant species on the world
![Page 38: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/38.jpg)
What you may expect
Start-up Companies
Plant Species Identification: Your Kids will be proud of you because you Know every plant species on the world
![Page 39: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/39.jpg)
What you may expect
Start-up Companies
Construction Safety Alarm: educators, government & insurance companies may care
![Page 40: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/40.jpg)
What you may expect
Start-up Companies
Multimedia Search Engine:Google will definitely care!
![Page 41: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/41.jpg)
What I or UNCC may expect
Do not forget to come back UNCC & support our research!
![Page 42: ITCS 6157/8157 Visual Database Fall 2015 jfan/itcs6157.html.](https://reader036.fdocuments.net/reader036/viewer/2022062517/56649e8f5503460f94b929ed/html5/thumbnails/42.jpg)
Do your best & have fun!
Good students should be able to push your professor to think and work harder not easier!