T.Sharon-A.Frank1

Multimedia

Introduction and Motivation

T.Sharon-A.Frank

2

“The Dumb Computer”

Mono-media until not long ago Text only

Human is very limited!

T.Sharon-A.Frank

3

“The Dumb Computer”

Later enhanced by graphics icons windowing

Human still has to lower oneself!

T.Sharon-A.Frank

4

Are computers user-friendly!?

New hardware-device from Microsoft

T.Sharon-A.Frank

6

Human Computer System – Schematic Structure

Grasp

Remember

DataProcessing

DecisionMaking

ActivateHandsLegs

Head...

SensesVision

HearingTouching

Displays

Controls

PerformControl

Commands

AutomaticActions

Human Computer

T.Sharon-A.Frank

7

The Semantic Gap

The Gap

PeopleComputers

The shaded area represents

an area of shared understanding

T.Sharon-A.Frank

8

Minsky’s Dumbbells

Soft systems

(People etc.)

Formalisms

Interfacedesign

User Psychology

Software tools

Task Analysis

Hardware tools

Hardware

Technology pushApplications pull

T.Sharon-A.Frank

9

"All media are not created equal“

• Some media are better for conveying certain information– A musical tune is best given via sound.

• Some people can better absorb information via a particular medium – Some Students may remember color patterns

while others may remember musical patterns better.

T.Sharon-A.Frank

10

Smell Interfaces

T.Sharon-A.Frank

11

Smelling danger

T.Sharon-A.Frank

12

“The whole is greater than the sum of its parts"

• The rate at which information can be conveyed is much higher for certain media.

• Using several media together is even better!

• Using multiple media concurrently has the potential for an even higher overall transfer/absorption rate.

T.Sharon-A.Frank

13

Live Make-up and Chat

T.Sharon-A.Frank

14

Virtual Reality (VR)

T.Sharon-A.Frank

15

VR can change the reality!?

T.Sharon-A.Frank

16

Engineer the Product, not the Human

T.Sharon-A.Frank

17

No to MMI (Man-Machine Interaction)

T.Sharon-A.Frank

18

Yes to HHI (Human-Human Interaction)

• H – Human• C – Computer• M – Mind• I – Interaction/Interface• How to enable/enhance HHI? HHI = HCI CCI CHI• Are MCI/MMI possible in the future?

T.Sharon-A.Frank

19

Brain Machine Interface (Hitachi)

T.Sharon-A.Frank

20

Relationship of HCI with other Disciplines

Computer Systems

Applications

Computer Systems

Applications

SoftwareEngineering

SoftwareEngineering

HCIHCI

KnowledgeBased

Systems

KnowledgeBased

Systems

ErgonomicsErgonomics

CommunicationsCommunications

PsychologyPsychology

CognitiveScience

CognitiveScience