Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP
description
Transcript of Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP
![Page 1: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/1.jpg)
1
Applications of video-content analysis and retrieval
IEEE Multimedia Magazine 2002 JUL-SEP
Reporter: 林浩棟
![Page 2: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/2.jpg)
2
Outline Introduction Content-based Video Retrieval Applications
Professional and educational applications Consumer domain application
Conclusion
![Page 3: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/3.jpg)
3
Introduction
This is a survey of technologies and applications for video-content analysis and retrieval.
![Page 4: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/4.jpg)
4
Content-based video retrieval (1/2)
Video indexing should be analogous to text document indexing
To facilitate fast and accurate content access to video data, we should segment a video document into shots and scenes
We should extract keyframes or key sequences as index entries for scenes or stories.
![Page 5: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/5.jpg)
5
Content-based video retrieval (2/2)
The core research in content-based video retrieval is developing technologies to automatically parse video, audio, and text to identify meaningful composition structure and to extract and represent content attributes of any video sources.
![Page 6: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/6.jpg)
6
Four processes involved by video-content analysis and indexing Feature extraction Structure analysis Abstraction Indexing
![Page 7: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/7.jpg)
7
Four processes involved by video-content analysis and indexing
![Page 8: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/8.jpg)
8
Four processes involved by video-content analysis and indexing Feature Extraction
The effectiveness of an indexing scheme depends on the effectiveness of attributes in content presentation
An effective strategy in video-content analysis is to use attributes extractable from multimedia sources.
Much valuable information is also carried in other media components, such as text, audio, and speech that accompany the pictorial component.
![Page 9: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/9.jpg)
9
Four processes involved by video-content analysis and indexing
![Page 10: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/10.jpg)
10
Four processes involved by video-content analysis and indexing Structure analysis
The process of extracting temporal structural information of video sequences or programs
Organizes video data according to their temporal structures and relations and thus build table of content
Stories -> scenes -> shots -> frames
![Page 11: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/11.jpg)
11
Four processes involved by video-content analysis and indexing
Shots are a good choice as the basic unit for video-content indexing, and they provide the basis for constructing a video table of content.
![Page 12: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/12.jpg)
12
Four processes involved by video-content analysis and indexing
![Page 13: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/13.jpg)
13
Four processes involved by video-content analysis and indexing Video abstraction
Video abstraction is the process of creating a presentation of visual information about a landscape or the structure of video, which should be much shorter than the original video.
Example: baseball game Use an MPEG-7-compliant XML description
format for the event segment
![Page 14: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/14.jpg)
14
MPEG-7 Providing a standardized description of
various multimedia descriptions of user preferences and usage
history pertaining to multimedia information.
![Page 15: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/15.jpg)
15
Applications We can broadly classify users into two
extremes: Nontechnical consumer Trained, technical, professional corporate
users who regularly use the products Professional and educational applications Consumer domain application
![Page 16: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/16.jpg)
16
Professional and educational applications Automated authoring of Web content Searching and browsing large video
archives Easy access to educational material Indexing and archiving multimedia
presentation
![Page 17: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/17.jpg)
17
Professional and educational applications Automated authoring of Web content
Pictorial Transcripts AT&T DVL system
![Page 18: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/18.jpg)
18
Professional and educational applications Searching and browsing large video
archives Major news agencies and TV broadcasters
own large archives of video that have been accumulated over many years.
Intelligent video segmentation and sampling techniques can reduce the visual contents of the video program to a small number of static images.
![Page 19: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/19.jpg)
19
Professional and educational applications Easy access to educational material
The availability of large multimedia libraries that we can efficiently search has a strong impact on education.
![Page 20: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/20.jpg)
20
Professional and educational applications Indexing and archiving multimedia
presentation example
![Page 21: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/21.jpg)
21
Consumer domain application The widest audience for video-content
analysis is consumers Differences between large archives and
consumer domain Video overview and access Video content filtering
![Page 22: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/22.jpg)
22
Consumer domain application Video overview and access
example
![Page 23: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/23.jpg)
23
Consumer domain application Video content filtering
example
![Page 24: Applications of video-content analysis and retrieval IEEE Multimedia Magazine 2002 JUL-SEP](https://reader035.fdocuments.net/reader035/viewer/2022081603/56813a08550346895da1d6d2/html5/thumbnails/24.jpg)
24
Conclusion It’s important to distinguish between research
activities, experiments, and real application that have made, or likely to make, the transition from research labs into the real world
The targeted users are the ultimate judges of the technology’s usefulness in meeting their need.
Users might have a tendency to resist new tools and methods.