Multimedia Research Viewpoint and vision

Multimedia Research Viewpoint and vision

Sid AhujaVP Converged Networks and Services Research

2Lucent Technologies Proprietary

What is Multimedia?

• Not just another medium (media type)?– Audio, video, data, ..– Aggregation of two or more different medium?

• Integration of multiple medium in common applications– Multimedia mail (includes voice, data and images)

• Real time experience in multiple media around a common event (people centric.. Not machine centric)


Real Time Multimedia Experience

• Daughter’s Birthday Party– Screaming kids everywhere (rich interactive multipoint audio)– Colorful and messed up clothes (rich multipoint video)– Kisses and hugs (rich tactile feedback)– Getting hit by an errant pie (VERY rich tactile feedback)

• Going on a Space Mountain ride at Disney– The world rushing by (high speed audio, video)– Hanging on to dear life on a huge drop (g-forces)– Losing your hat on the third turn (air whizzing by )

• These are IMMERSIVE experiences – Being hit at the same time in many different ‘senses’– Produces a feeling of ‘being there’


Multimedia in Entertainment

• Multimedia Presentations (multimedia content)– DVD Movies .. Limited to big production houses– Business presentations (data + A/V clips)

• Multimedia mail – Audio and Video attachments to email– MMS .. Multimedia messaging in wireless– Video clips on the Internet

• Asynchrounous use of Multimedia content


Networked Multimedia

• Real time multimedia collaboration (why are we not using it?)– Systems being built since late 80’s .. No common standards– Confusion about the experience (document sharing, Video

conferencing)– Lack of common signaling and bandwidth

• Multimedia Books /classrooms– No standard today – Mostly one-to-many videocast of a lecture– Can be truly interactive (from each user’s point of view)

• Interactive Video Games– Shared mulitmedia experience– Virtual video, audio and other media (tactile feedback)– Networked video games .. No shared audio, local video– No tools for the consumer


Challenges .. Vision

• Billions of sources (every person a consumer and producer)– Cheap devices for capture and interface– Tools for representation, storage and movement– Network for movement– Already happened to the Text world

• Trillions of experiences– Representation and indexing

» Not just one kind of video … any set of pixels ..any rate» New media types .. Tactile, temperature, etc.

– Content identification and ownership» Encryption» Watermarking

– Easy sharing with multiple people» Multicasting » Group communication support


Push-to-view (Always-On)New Applications


User’s rich video world

User has a ‘personalized’ selection of low-bitrate, Always–On, interactive video channels

The Always-On video channels can be sourced from:• Entertainment broadcast stations• Roving reporters .. e.g. an embedded reporter in Iraq• Monitoring sources: traffic intersection, kid’s room, factory floor,etc.• Instantaneous person to person video connection (like Push-to-talk to

limited set) • Personal Video mailbox

Video channels are MPEG4 .. based• Quick set-up is required for providing Video channels from millions of

sources• Network infrastructure required to manage totality of Video sources • Bandwidth per user can be from 64 Kbits/sec to 1 Mbits/sec based on

quality and number of Always-On channels.

New Applications


VideoPhone Architecture Overview

• Current Cell Performance – For Voice only cells:

» ~180 Simultaneous users at 13.3 kbps, ~2.4 Mbps per cell

» Occupancy: to be 90 seconds per call (1.2 Mbits / call)– For Data only cells:

» ~30 Simultaneous users at 100Kbps, ~ 9 Mbps per cell

» Occupancy: unknown at this time

Video Portal

MSC

RTP/UDP/IPISUP (H.324)

3G-324mVideophone

RNC

Node B

Video Content server

Live Contents

Satellite dish

MSC

RTP/UDP/IPISUP (H.324)

3G-324mVideophone

RNC

Node B

Video Content server

Live Contents

Satellite dish


Service ProviderIP Network

XMLPortals,

Messaging,Other App Server

EnterpriseLAN

SIPH.323

SS7

UniversalGateway

PSTN

Softswitch

VoDSLIAD

DSLAM

IPDC/H.248

SIPH.323MGCP

Parlay, SIP

LMRS

IP PBX

SIPH.323

Circuit PBX

PRI

IMT/PRI

Wireless

FTTPONT

Splitter

RNC

XM/C

Access Independent Subscriber Services


Anytime Anywhere Group Communication across the Network of Networks: Connection Example

2.5G / 3G Wireless Network

MMSC

2G Wireless Network

SMSC

2G User

2.5/3 G User

PSTNPSTN PSTN user accessible

through Voice

Data NetworksData Networks

Internet, Corporate, Home etc.Internet, Corporate, Home etc.

Offline / Busy user,

accessible through email

Network Assistant Network Enabled

User reachability to an ad-hoc

groupAd-hoc group

Time, Place, Notes

Enable group

member communicat

ion

SMS

MMS, Voice, Video

Voice CallE-mail

Multi-modal communicatio

n

Online User accessible

through Voice / Video /

Messaging

New Applications


New Research Directions

• Rich definition and representation of mulitmedia content• Identification and copying• Tools for masses for creating and sharing content• Next generation network infrastructure

– New signaling infrastructure (SIP+)– Enough capacity for end points– New group support– QOS for real time– Persistence .. How to save for posterity


SIGMM .. Take the Lead

• Wireless world …3GPP / 3GPP2• Wireline world .. W3C , IETF, TV Industry• Multimedia Books …standardize content• Tools for the masses• Facilitate multimedia forums• Hold next retreat as a virtual retreat

Multimedia Research Viewpoint and vision

Documents

Transcript of Multimedia Research Viewpoint and vision