PICaFACE -...

24
PICaFACE: Controlling camera features with facial expressions Anja Bürger, Aynira Wawersig Interaction Engineering - WS 17/18 Augsburg University of Applied Sciences Prof. Dr. Michael Kipp

Transcript of PICaFACE -...

PICaFACE: Controlling camera features with

facial expressions

Anja Bürger, Aynira Wawersig

Interaction Engineering - WS 17/18 Augsburg University of Applied Sciences

Prof. Dr. Michael Kipp

1. MOTIVATION

Why?

➔ simplification of one-handed interaction while taking pictures

➔ improvement of stability

➔ acceptance of usage?

2. RELATED WORK

Chen, Xiang „Anthony“/Schwarz, Julia/Harrison, Chris/Mankoff, Jennifer/Hudson, Scott E. (2014): Air+Touch: Interweaving Touch & In-air Gestures, in: Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology. New York, NY, USA: ACM, S.519–525

Air + Touch: Interweaving Touch & In-air Gestures

faceType (Alice Strunkmann-Meister and Rodrigo Blásquez)

http://michaelkipp.de/interaction/projects/?/201516w/FaceType/, zuletzt abgerufen am 01.02.2018

3. INTERACTION TECHNIQUES

Defining Zoomcenter Panning the Picture

Left mouse click Right mouse press

Control Condition: Mouse

Zoom in and out Release

Left mouse pressLeft mouse click on

button

Interaction Scenario Mouth + Eyebrows

Zoom in Zoom out Release

Small mouth Wide mouth Raise Eyebrows

Interaction Scenario Head + Mouth

Zoom in Zoom out Release

Tilt head forwards Tilt head backwards Open mouth wide

4. TECHNICAL REALIZATION/SETUP

Laptop + Webcam + Mouse Face gestures

6 test persons

Mouse onlyMouth (zoom) +

Eyebrows (release)Head (zoom) + Mouth (release)

1 task for each scenario= 3 tasks

questionnaire

5. USER TEST

Best-Case Picture

amount of false pixels

6. RESULTS

Mean: total time

Mean: total error rate zoom Mean: total error rate release

Mouse Mouth Head Mouse Eyebrow Mouth

Mean: Efficiency

percentage of correct pixels / total time in seconds

One Significant Difference

➔ Total release error rate: Mouse interaction significantly more reliable than opening mouth for release

p = 0,0483

Most intuitive input

Head tilt

Mouth wide & purse

Zoom function

Mouse Pan

Open mouth

Raise eyebrows

Release function

Mouse click

7. QUESTIONNAIRE

The most comfortable gestures

Open mouth

Raise eyebrows

Head tilt

Mouth wide & purse

Zoom function

Release function

Gesture which would be used in public

Head tilt

Mouth wide & purse

Zoom function

Open mouth

Raise eyebrows

Release function

8. LIVE DEMONSTRATION

9. FURTHER RESEARCH

➔ Clutch mechanism

➔ Technical refinements

➔ Controlling pace of zoom

Thank you!