IES 506 – Human Computer Interaction Lecture 11: Direct Manipulation Interfaces Lecturer: Gazihan...

IES 506 – Human Computer Interaction

Lecture 11: Direct Manipulation Interfaces

Lecturer: Gazihan Alankuş

1

Please look at the end of the presentation for assignments (marked with TODO)

© 2010 Pearson Addison-Wesley. All rights reserved.

Addison Wesley is an imprint of

Designing the User Interface:Strategies for Effective Human-Computer Interaction

Fifth Edition

Ben Shneiderman & Catherine Plaisantin collaboration with

Maxine S. Cohen and Steven M. JacobsModified by Gazihan Alankuş

CHAPTER 5:Direct Manipulation and Virtual Environments

Overview

• Midterm exam review• Project reminders• Course content

– Direct Manipulation– Virtual Environments

6-3

Project Reminders

• Let’s remember slides from week 1 in the next two slides here

6-4

5

Projects (reminder with a change)• Come up with an idea

– Discuss it with me – Present it in class

• Create it – Do not start programming it!– Find ideal users for your system– Interview them and understand their frame of mind– Create paper prototypes (optionally, together with users)

• Test the paper prototypes with the users. Learn more and improve the prototypes.• At least three two iterations with the paper prototypes!

– Create a final prototype in Balsamiq mockups• At least one more iteration

– Create the software (now you can start programming!)• At least one more iteration

• This process should result in a working user interface with high usability– Verify this with at least three user tests with new users– Assign them canonical tasks and watch them perform

6

Projects (reminder)

• You need to videotape all user tests and interviews

• You need to document the whole progress. The documentation should include the prototypes

1-7


Overview

• Direct Manipulation• Virtual Environments

6-7

1-8


Some emotions related to user interfaces

6-8

1-9


Some emotions related to user interfaces

6-9

1-10


Introduction

• Positive feelings associated with good user interfaces: – Mastery of the interface – Competence in performing tasks – Ease in learning the system originally and in

assimilating advanced features – Confidence in the capacity to retain mastery over time – Enjoyment in using the system – Eagerness to show the system off to novices – Desire to explore more powerful aspects of the system

6-10

1-11


Direct-Manipulation Interfaces

6-11

1-12


Indirect Example

6-12

1-13



2-13

1-14



• Central ideas:– Visibility of the objects and actions of interest– Rapid, reversible, incremental actions – Replacement of typed commands by a

pointing action on the object of interest

6-14

1-15


A History of Text Editors (with demonstrations)

• Ed (command line)• Emacs, vi, etc (display editor)• WYSIWYG (word processor)

6-15

1-16


Examples of Direct-Manipulation Systems

Command line vs. display editors and word processors • Training times with display editors are much less than line editors • Line editors were initially more flexible and powerful • The advances of WYSIWYG word processors:

– Display a full page of text – Display of the document in the form that it will appear when the

final printing is done – Show cursor action – Control cursor motion through physically obvious and intuitively

natural means – Use of labeled icon for actions – Display of the results of an action immediately – Provide rapid response and display – Offer easily reversible actions

6-16

1-17


Examples of Direct-Manipulation Systems

6-17

Text editors / word processing software

1-18


Remember the example of curb cuts

1-18

1-19


Technologies that derive from the word processor:

• Integration of media• Desktop publication software • Slide-presentation software • Hypermedia environments • Improved macro facilities • Spell checker and thesaurus • Grammar checkers

6-19

1-20


Examples of Direct-Manipulation Systems (cont.)

The VisiCalc spreadsheet and its descendants

(Excel, etc)• VisiCalc users delighted in watching the program

propagate changes across the screen.

6-20

1-21


Examples of Direct-Manipulation Systems (cont.): spreadsheet

6-21

1-22



Spatial Data Management• In some cases, spatial representations provide a better

model of reality (e.g., Google maps)• Successful spatial data-management systems depend on

choosing appropriate: – Icons – Graphical representations – Natural and comprehensible data layouts

6-22

1-23


Examples of Direct-Manipulation Systems (cont.) spatial data management

6-23

1-24



Video games • Great example for direct manipulation• Games require pleasant and easy experiences. • Direct-manipulation interfaces can provide such experiences

6-24

1-25



Video games • Nintendo Wii, Sony PlayStation, Microsoft Xbox, etc.• Field of action is visual and compelling • Commands are physical actions whose results are immediately

shown on the screen • No syntax to remember • Most games continuously display a score• Direct manipulation in SimCity• Second Life virtual world• Spore, WoW, Sims, etc.

6-25

1-26



Video games

6-26

1-27



Guitar Hero video game

6-27

1-28



Computer-aided design

6-28

1-29



Computer-aided design • Computer-aided design (CAD) use direct manipulation• Manipulate the object of interest• Generate alternatives easily• Explain the impact• Problem solving by analogy to the real-world

6-29

1-30



Office automation• Xerox Star was a pioneer with sophisticated formatting• Apple Lisa System• Rapid and continuous graphical interaction• Microsoft Windows is a descendant

6-30

1-31


Continuing evolution of Direct-Manipulation Systems

Direct-Manipulation interfaces are being used in a wide range of applications, e.g. management dashboard for a retail store

6-31

1-32


Continuing evolution of Direct-Manipulation Systems (cont.)

6-32

1-33


Discussion of Direct Manipulation

Successful direct manipulation • Present appropriate representation or model of reality• Do not have to mimic the real world

– Can use accepted metaphors instead

• Should enrich the experience and make it intuitive• Should require minimal effort

6-33

1-34


Discussion of Direct Manipulation

Problems with direct manipulation • Spatial or visual representations can be too spread out • High-level flowcharts and database-schema can become

confusing • Designs may force valuable information off of the screen • Users must learn the graphical representations • The visual representation may be misleading • Typing commands with the keyboard may be faster

6-34

1-35


Principles of Direct Manipulation

1. Continuous representations of the objects and actions of interest with meaningful visual metaphors.

2. Actions that resemble physical actions, instead of complex syntax.

3. Rapid, incremental, reversible actions whose effects on the objects of interest are visible immediately.

6-35

1-36


Successful Use of Direct Manipulation

• Novices can learn quickly, usually through watching demonstrations

• Experts can work rapidly without limitation• Knowledgeable users can retain usage• Error messages are rarely needed• Users can immediately see if they are making progress

towards their goals and can quickly change direction if not

• Users have less anxiety because they can undo• Confidence, mastery, feelings of control, ability to predict

what will happen

6-36

1-37


Hyundai Equus Car Seat Controller

6-37

1-39


Multitouch mobile devices

6-39

1-40


Overview

• Direct Manipulation• Virtual Environments

6-40

1-41


3D Interfaces

6-41

1-42


3D Interfaces

• “Pure” 3D interfaces have strong utility in some contexts, e.g., medical, product design. In other situations, more constrained interaction may actually be preferable to simplify interactions.

• “Enhanced” interfaces, better than reality, can help reduce the limitations of the real-world, e.g., providing simultaneous views.

• Avatars in multiplayer 3D worlds and 3D games are a common usage of 3D interfaces

6-42

1-43


3D Interfaces

6-43

1-44


3D Interfaces (cont.)

Features for effective 3D – Use occlusion, shadows, perspective, and other 3D techniques

carefully.– Minimize the number of navigation steps for users to

accomplish their tasks.– Keep text readable.– Avoid unnecessary visual clutter, distraction, contrast shifts, and

reflections.– Simplify user/camera movement.– Simplify object movement– Organize groups of items in aligned structures to allow rapid

visual search.– Enable users to construct visual groups to support spatial recall.

6-44

1-45



Guidelines for inclusion of enhanced 3D features:– Provide overviews so users can see the big picture– Offer X-ray vision so users can see into or beyond

objects.– Provide history keeping– Permit rich user actions on objects– Allow teleoperation– Enable remote collaboration– Give users control over explanatory text and let users

select for details on demand.– Offer tools to select, mark, and measure.

6-45

1-46



Guidelines for inclusion of enhanced 3D features (cont.):– Implement dynamic queries to rapidly filter out

unneeded items.– Support semantic zooming and movement– Enable landmarks to show themselves even at a

distance– Allow multiple coordinated views– Develop novel 3D icons to represent concepts that are

more recognizable and memorable.

6-46

1-47


Teleoperation• Controlling devices remotely and intuitively

• Two “parents”: direct manipulation in personal computers and process control in complex environments

• Physical operation is remote, observation is local

6-47

1-48


Teleoperation

• Complicating factors in the architecture of remote environments: – Time delays

• transmission delays • operation delays

– Incomplete feedback – Feedback from multiple sources – Unanticipated interferences

6-48

1-49


Virtual and Augmented Reality

6-49

1-50


Virtual and Augmented Reality

• Virtual reality breaks the physical limitations of space and allow users to act as though they were somewhere else

• Augmented reality shows the real world with an overlay of additional information

• Situational awareness shows information about the real world that surrounds you by tracking your movements in a computer model

6-50

1-51


Virtual and Augmented Reality (cont.)

• Successful virtual environments depend on the smooth integration of: – Visual Display – Head position sensing – Hand-position sensing – Force feedback – Sound input and output – Other sensations – Cooperative and competitive virtual reality

6-51

1-52


Impact of this technology in our everyday lives

6-52

TODO Homework 5• Improve your prototypes from HW4 by yourself. Use things that we

learned in Heuristic Evaluation, as well as your own judgment. • Conduct usability tests with two users. Each test should include at least

these:– Conceptual model extraction (before and after use)– Talk-aloud usability test– Video recording and a retrospective testing interview (that is also recorded)

• Report findings and improvements to be done in the next iteration

• Submission:• E-mail to [email protected] with subject “[IES 506] HW5”

• Deadline: 14 May

6-53

mailto:[email protected]

IES 506 – Human Computer Interaction Lecture 11: Direct Manipulation Interfaces Lecturer: Gazihan...

Documents

Transcript of IES 506 – Human Computer Interaction Lecture 11: Direct Manipulation Interfaces Lecturer: Gazihan...