T.Sharon-A.Frank1

Multimedia

Definition and Aspects

T.Sharon-A.Frank

2

What is Multimedia?

T.Sharon-A.Frank

3

Modern Multimedia (1)

• The same story, information, etc, can be represented in different media:

– text, images, sound, animation, video …

• All media can be represented digitally as a structured collection of bits:

– manipulated by programs, stored, transmitted over networks …

• Digital media can be combined and integrated into multimedia.

T.Sharon-A.Frank

4

• Combination of media is actually commonplace (e.g., TV news) and natural – we perceive the world through all our senses at once.

• Novelty of digital multimedia is that all media can be treated as data.

• Programs can manipulate data in response to user input, so digital multimedia can be interactive.

Modern Multimedia (2)

T.Sharon-A.Frank

5

Characteristics of Modern Multimedia

Four necessary characteristics:

1. Digital Media

2. Multiple Media

3. Integrated Media

4. Interactive with Human Control

T.Sharon-A.Frank

6

Multiple Media Conversion

maps

audio

video

pictures

text

graphics

ABC

T.Sharon-A.Frank

7

Device Proliferation

T.Sharon-A.Frank

8

Multimedia Workstation

CD-ROM

VoiceRecognition

Unit

SpeechSynthesis

Unit

Video

Graphics

FrameGrabber

Audio

x

Communication

Fax

Multimedia Overall Configuration

Videodisc player

CD-ROM

AUTHORING PLAYBACK

Video display card

Sound digitizer

Touch screen

Videodisc player

Speakers

Scanner

Removable media

T.Sharon-A.Frank

10

Desktop Multimedia Publishing

Camcorder, cameraor videodisc player

High qualityvideo card

Video or TV Monitor

Audio mixer CD-ROM

Sound digitizer

Videotape recorder

Speakers

T.Sharon-A.Frank

11

Multimedia Application Types

• Local MM– Stand-alone

• Networked and Distributed MM– Network based

– Group communication oriented

– Need QoS (Quality of Service)

T.Sharon-A.Frank

12

Online/Offline MM Delivery

• Online Delivery:– Uses a network (usually the Internet) to send

information from one computer to another.– Web is commonest form of online delivery of

multimedia.

• Offline Delivery:– Removable storage medium is used to carry the

data: CD-ROM, DVD.

T.Sharon-A.Frank

13

Linearity vs. Non-Linearity

Linear Text

Hypertext/Hypermedia

T.Sharon-A.Frank

14

• Film: fixed order of frames defines a single playback sequence.

• Book: physical arrangement of text and pages implies a linear reading order.

Linearity

T.Sharon-A.Frank

15

• Hypermedia: links between pages permit multiple arbitrary reading orders.

• Flash: jumps between frames, controlled by interactivity, permits branching and loops.

Non-Linearity

T.Sharon-A.Frank

16

Hypertext

Hypertext is non lineartext. It reflects the way we think and write

---- definitions ---------------------------------------------models---------

Thinking Models Writing Models

Node

Link

T.Sharon-A.Frank

17

Hypertext on the WWW – HTML

T.Sharon-A.Frank

18

Hypermedia Example

T.Sharon-A.Frank

19

Hypermedia

HypertextHypermediaMultimedia

T.Sharon-A.Frank

20

So what was the message!?

T.Sharon-A.Frank

21

Communication History

Wheel 3200-3500

B.C

Paper105 AD

Printing Press1450s

Fax 1843

Telephone1876

Automobile~1900

Radio 1901

Powered Flight1903

Television1927

Computer1945

The Internet1973

http://www.cbc4kids.ca/general/the-lab/history-of-invention/default.html

T.Sharon-A.Frank

22

Boundaries Between: Computing, Communications and Entertainment

ComputingDevices

CommunicationDevices

ConsumerEntertainment

Devices

LANs & WANsPublic Switched

NetworkCATV &

Broadcast TV

T.Sharon-A.Frank

23

Multimedia Technology Fueling Convergence of Domains

Tele-computersComputer-based

Video conferencing

Video PhonesText-display

phoneInteractive TV

PortableComputers

TelephonesCellular phones

TelevisionsVCRs

ComputingDevices

CommunicationDevices

ConsumerEntertainment

Devices

LANs & WANsPublic Switched

NetworkCATV &

Broadcast TV

802.3, 802.5, x.25 POTS, ISDN Analog Coax

FDDI, ATM, 802.6 B-ISDN FTTC/FTTH

Multimedia in Communication Terms Media OrderMedia B/W

LinearPassiveBATCHY

Non-LinearInteraction

REAL-TIME

Low(10 B/S)

Text, DocumentsPlain BookGraphsLecture, SlidesVoice

Advanced Book + Index, CrossReferences, Photos, AppendicesVisual GlossarySlide Show + NarrationComputerized Chess Games

Medium(10 KB/S)

MapsGraphicsColor DisplayPhotographsRecorded AudioSound

Slide Show + musicAudiovisual ShowPinball MachinePersonal ComputerDesktop Publishing (DTP)Hypertext

High(10 MB/S)

GB/S???

TelevisionFilms (2D, 3D)VideoAudio +Moving VisualsBatch Multimedia

TV ZappingDesktop Video (DTV)Video GameMultimedia / HypermediaHigh Definition TV (HDTV)TeleconferencingVirtual Reality

T.Sharon-A.Frank

25

So what’s behind the picture!?