HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on...
Transcript of HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on...
![Page 1: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/1.jpg)
DH2323 DGI18
INTRODUCTION TO
COMPUTER GRAPHICS ANDINTERACTION
Christopher Peters
CST, KTH Royal Institute of Technology, Sweden
[email protected]://kth.academia.edu/ChristopherEdwardPeters
HCI: A brief intro
![Page 2: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/2.jpg)
User Studies for Evaluation
• Human experiments
• Process of evaluating or understanding a technique, tool or idea in terms of needs, preferences and abilities of humans
• Have people use your system or observe stimuli
• Evaluate what they do
2016 Christopher Peters DH2323 Computer Graphics and Interaction [email protected]
![Page 3: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/3.jpg)
Human Computer Interaction
• Have been considering interactive applications
– Real-time updates of the graphical environment
– Enables sense of movement through the environment
– Enables manipulation of objects in the environments
– Immediate feedback
– Important prerequisite for interaction
![Page 4: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/4.jpg)
Human Computer Interaction
• Human Computer Interaction (HCI)
– Goes well beyond this to focus on the relationship between humans and machines
– Observe how people interact with computers
– Design interfaces that allow humans to interact with computers
– Can we build machines that adapt to human abilities and sensitivities?– Instead of the human adapting to the machine
![Page 5: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/5.jpg)
Example User Interfaces
• Mouse
• Keyboard
• Pens and tablets
• Graphical user interfaces
• Voice user interfaces
![Page 6: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/6.jpg)
Sketchpad
• Ivan Sutherland, 1963
• Pioneered the way for HCI
![Page 7: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/7.jpg)
Human Computer Interaction
• Have been considering interactive applications
– Real-time updates of the graphical environment
– Prerequisite for interaction
![Page 8: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/8.jpg)
Human Computer Interaction
• Have been considering interactive applications
– Real-time updates of the graphical environment
– Prerequisite for interaction
• Human Computer Interaction (HCI)
– Goes well beyond this
– Design and use of computer technology
– Computer science, behavioural sciences, design, media, etc
![Page 9: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/9.jpg)
User Studies
• Relevant to systems that have components that interact with users
• Bring in human participants
• Get them to use the interface
• Use their feedback to elicit requirements and guide design
• Evaluate whether solution is fit for its purpose
• Put the user, rather than the system, at the center of the process
![Page 11: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/11.jpg)
When a UI Goes Wrong
• Example: Three Mile Island accident
• Poorly designed UI partially to blame
![Page 12: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/12.jpg)
User Interfaces
• Mouse
• Keyboard
• Pens and tablets
• Graphical user interfaces
• Voice user interfaces
• Others:
– The human body?
![Page 13: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/13.jpg)
User Interfaces
• Mouse
• Keyboard
• Pens and tablets
• Graphical user interfaces
• Voice user interfaces
• Others:
– The human body?
![Page 14: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/14.jpg)
Human Body
Minority Report, Twentieth Century Fox Film Corporation
![Page 15: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/15.jpg)
Affective computing
• Which affective states are of relevance for a specific application? – Design problem
• From a machine’s perspective, use this information to decide whether and how to:– Start interaction
– Continue interaction
– Improve interaction
![Page 16: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/16.jpg)
The Human Face
From Pantic & Bartlett, 2007
![Page 17: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/17.jpg)
The Human Face
![Page 18: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/18.jpg)
The Human Face
![Page 19: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/19.jpg)
The Human Body
From Sanghvi et al., 2010
![Page 20: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/20.jpg)
The Human Body
![Page 21: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/21.jpg)
Expressivity Dynamics
![Page 22: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/22.jpg)
Databases of affective expressions
• Many corpora and databases contain posed expressions
– Currently shift to collection of naturalistic data
• Examples of publicly available databases with visual modality include:
– Cohn-Kanade
(Kanade et al., 2000)
– MMI database
(Pantic et al., 2005)
– FABO database
(Gunes & Piccardi, 2006)
– Mind Reading DVD (Baron-Cohen et al,. 2004)
From Gunes & Piccardi, 2009
![Page 23: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/23.jpg)
User Interfaces
• Computer
• Mouse
• Keyboard
• Pens and tablets
• Graphical user interfaces
• Voice user interfaces
• Others:
– The human body?
– Artificial bodies?
![Page 24: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/24.jpg)
Social Machines
Greta, ParisTech
Asimo, Honda Nao, Aldebaran Robotics
Robonaut 2, NASA
Christopher Peters [email protected]
![Page 25: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/25.jpg)
Moravec’s Paradox
“…comparatively easy to make computers exhibit adult level performance on intelligence tests … difficult or impossible to give them the skills of a one-year old when it comes to perception and mobility.”
Moravec 1988
Christopher Peters [email protected]
![Page 26: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/26.jpg)
Easy (-ish) Hard (!)
• Logic
• Algebra
• Chess
• Play golf
• Spot a bear in the woods
• Run (or even walk) away without falling
Christopher Peters [email protected]
![Page 29: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/29.jpg)
Advances in mobility
Big Dog, Boston Dynamics
Functional
But scary!
Christopher Peters [email protected]
![Page 30: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/30.jpg)
Expressive Behaviour
EMYS, University of Wroclaw, Poland
INESC ID, Portugal
Christopher Peters [email protected]
![Page 32: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/32.jpg)
Social machines
• Affective and social intelligence in human-computer and human-robot interaction
• Social perception
– Analysis of social, affective behaviour
– Focus on
• Computer vision-based techniques
• Non-verbal behaviour
From http://web.media.mit.edu/~cynthiab/
![Page 35: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/35.jpg)
Virtual characters
Christopher Peters [email protected]
Computer graphics and animation
Animation → AI, ALife
Many overlaps with social and mobile robotics
– One to one interaction
– Crowd/swarm simulation
Embodiment raises many interesting issues
Virtual models: cheap
![Page 36: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/36.jpg)
KTH Social SUDOA
![Page 37: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/37.jpg)
Assessment
Write a three page report using Latex
https://www.latex-project.org/
A topic of your choice related to HCI
Example:
Participate in a user study and report on the procedure and research area
Submission deadline: Monday 28th May
Canvas is now open for your submissions
![Page 38: HCI: A brief intro€¦ · •Human Computer Interaction (HCI) –Goes well beyond this to focus on the relationship between humans and machines –Observe how people interact with](https://reader033.fdocuments.net/reader033/viewer/2022060720/60809f4e6f81c0472726f6f9/html5/thumbnails/38.jpg)
Next Lecture
21st May, 08:00-10:00, D2