•1

MPEG-7STANDARDS[MULTIMEDIA CONTENT

DISCRIPTION INTERFACE]

PRESENTED BY:NILESH R. JAISWAR

INDEX

•2

MPEG-7 OVERVIEW

MAJOR FUNCTIONALITIES

DETAILED TECHNICAL DISCRIPTION

PROFILING

BEYOND VERSION -1

CONCLUSION

•3

MPEG-7:

•An international standard for descriptions and description systems

•Goal: To search, identify, filter and browse audiovisual content

•Image/Video Retrieval •Text-based Retrieval

•Content-based Retrieval

INTRODUCTION

•4

Why do we need MPEG-7 ?

N e e d

• Content Management

• Fast & Accurate Access

• Personalized Content Production and Consumption

• Automation

+

Support for Advanced Query

•Visual•Audio•Sketch

MPEG: A Brief History

•5

MPEG: Moving Picture Experts Group

ISO / IEC/JTC1/SC29/WG11

A Working Group of ISO/IEC in charge of the Development of Standards for

Coded Representation of Digital Audio and Video

Established in 1988

MPEG: A Brief History

•6

MPEG-1: Interactive CD and MP3 11 / 1992

MPEG-2: DTV, STB, DVD 11 / 1994

MPEG-4: Web and Mobility ver1: 09 /1998

ver2: 11 /1999

MPEG-7: ??? 09 / 2001

MPEG-21: Multimedia Framework 11 / 2001

MPEG-7: What Is It ?

•7

THE MPEG 7 THE MPEG 7 STANDARDSTANDARD THE MPEG 7 THE MPEG 7 STANDARDSTANDARD

Content Description of Various Audio Visual

Information

IS NOT a COMPRESSION Standardsimilar to MPEG-1/2/4 or their

Extension

IS NOT a STANDARD forFEATURE

EXTRACTION/MATCHING

Types of Audio Visual Information• Audio, Speech• Moving video, still pictures, graphics• Information on how objects are combined in scenes

Types of Audio Visual Information• Audio, Speech• Moving video, still pictures, graphics• Information on how objects are combined in scenes

MPEG-7: Application Areas

Storage and retrieval of audiovisual databases (image, film,

radio archives)

Broadcast media selection (radio, TV programs)E-commerce and Tele-shopping (searching for clothes / patterns)

Remote sensing (cartography, ecology, natural resources management)

Entertainment (searching for a game, for a karaoke)

Cultural services (museums, art galleries)

Journalism (searching for events, persons)

Intelligent multimedia presentationsEducational applications Bio-medical applications

MPEG-7: Main Elements

•9

Descriptors (D)

syntax and semantics of each feature representation

Description Schemes (DS)

structure and semantics of the relationships between

components

Description Definition Language (DDL)

creation of new DS’s

modification/extension of existing DS’s

MPEG-7: Major Functionalities

•10

Systems (ISO / IEC 15938 )

Description Definition Language (ISO / IEC 15938)

Visual (ISO / IEC 15938)

Audio (ISO / IEC 15938)

Multimedia Description Schemes (ISO / IEC 15938)

MPEG-7: Systems

•11

It defines tools to:

manage and protect intellectual property

Includes currently the binary format for encoding

synchronize between content and description

provide for efficient storage and transport

MPEG-7: DDL and its Components

•12

A language that allows the creation of new Description Schemes and, possibly, Descriptors.”

“It also allows the extension and modification of existing Description Schemes.”

Description Definition Language:It is based on XML Schema LanguageConsists of

XML Schema Structural ComponentsXML Schema Data TypesMPEG-7 Specific Extensions

MPEG-7: Audio

•13

Sound Effects• High-Level Audio Description Tools (Ds & DSs)

•Instrumental timbre description tools

•Sound recognition tools

•Spoken content description tools

•Melody description tools (facilitate query-by- humming)

MPEG-7: Visual

•14

Consist of basic structures and description

Color

quantization, dominant, scalable, color-structure, layout,

GoF/GoP

Texture

Shape

region-based, contour-based, 3D

Motion

camera motion, motion trajectory, parametric motion,

motion activity

DETAILED TECHNICAL DISCRIPTION

Visual Descriptors

It describe tools included in the std consist of basic structure & descriptor that covers the feature like-

Color DescriptorsTexture DescriptorsShape DescriptorsMotion Descriptors for Video

Basic Visual Structures

•16

Grid Layout

2D-3D Multiple View

Time Series

Spatial 2D Coordinates

Temporal Interpolation

Color Descriptors

Color SpacesIn this description following color space are supported-RGB, YCrCb, HSV, MONOCHROME etc.

Color LAYOUTIt effectively represent the spatial description of color of visual signals in a very compact form. It Clusters the image into 64 (8x8) blocks

Color structureIt is a color feature descriptor that captures both color content & information about the structure of this content.

Texture DescriptorsHomogenous Texture DescriptorNon-Homogenous Texture Descriptor (Edge Histogram &

Texture)

Homogenous texture

It has emerged as an important visual primitive for searching & browsing through large collection of similar looking pattern.

The computation of this descriptor is based on filtering using scale and orientation selective kernels.

Non-Homogenous Texture

It is useful for representing homogenous texture for browsing type application & requires only 12 bit (max).

It provide perceptual characteristic of texture similar to human characterization in terms of regularity, coarseness & directionality.

Represents the spatial distribution of five types of edges.

Dividing the image into 16 (4x4) blocks.Generating a 5-bin histogram for each block.It is scale invariant.

Shape DescriptorsRegion-based Descriptor

Contour-based Shape Descriptor

2D/3D Shape Descriptor

Region-based DescriptorThe shape of an object may consist of either a single

region or a set of region as well as some holes in the object.

Advantages:Describes complex shapes with disconnected

regions.Robust to segmentation noise.Small size , Fast extraction and matching.

Contour-Based Descriptor

The contour shape descriptor captures characteristic shape feature of an object or region based on its contour.

It uses so called curvature scale-space representation, which captures perceptually meaningful features of the shape.

•24

AUDIO

MPEG-7 audio provide stuctures bulding upon some basic structures from the MDS for discribing audio content.

1.AUDIO FRAMEWORK• It contains low level tools designed to provide a basis for the construction of higher level audio application.• By providing a common platform for the structure of description & the basic semantics for commonly regarded audio feature.

•25

PROFILING

•Similar to all MPEG Standards profiling of the tools specified in the standard will play an important role to allow deployment of MPEG-7 technology with reasonable costs & complexity.

•A profile is a set of functionality for one or more classes of application.

•The keyword to define profile is functionality.

•26

Mpeg-7 terminal•MPEG-7 system provide the means to represent coded multimedia content description .•The entity that makes use of such coded representation of the multimedia content description is generally referred as the ISO/IEC 15938 terminal or ‘MPEG-7 terminal’.

conformance testing•It includes the guideline & procedures for testing conformance of MPEG-7 implementation both for description & terminals.

•27

CONCLUSION MPEG-7 is advance version. It is better than below versions of MPEG. Because, It includes new audio , video tools. It is not aimed at any one application in particular rather the elements that standardizes support as broad a range of applications as possible.

•GROUP MEMBERS:

1.SAGAR NIKAM 2. NILESH JAISWAR

•GUIDE:M/S PRADNYA VARTAK