EyePhone : Activating Mobile Phones With Your Eyes
description
Transcript of EyePhone : Activating Mobile Phones With Your Eyes
EyePhone: Activating Mobile Phones With Your Eyes
Emiliano Miluzzo, Tianyu Wang, Andrew T. Campbell
CS Department – Dartmouth College, Hanover, NH, USA
[email protected] Miluzzo
what is the future of sensing?
[email protected] Miluzzo
mobile phone sensing
[email protected] Miluzzo
mobile phone sensing
[email protected] Miluzzo
accelerometer
digital compass
microphone
WiFi/bluetooth GPS
light sensor/camera
gyroscope
air quality /pollution sensor
mobile phone sensing ….
[email protected] Miluzzo
accelerometer
digital compass
microphone
WiFi/bluetooth GPS
light sensor/camera
gyroscope
air quality /pollution sensor
mobile phone sensing ….
light sensor/camera
[email protected] Miluzzo
accelerometer
digital compass
microphone
WiFi/bluetooth GPS
light sensor/camera
gyroscope
air quality /pollution sensor
mobile phone sensing ….
light sensor/camera
camera
[email protected] Miluzzo
front facing camera
[email protected] Miluzzo
how can we use it?
[email protected] Miluzzo
emotion assessment
[email protected] Miluzzo
why HPI?
[email protected] Miluzzo
• fairly ideal conditions for sensing
• array of sophisticated sensors
• subjects mostly static
• “sensing context” fairly constant
• subjects are on the move (video frames are blurred)
• limited sensing capabilities
• not ideal sensing context (dark, bright, etc.)
• hardware limitations
HPIHCI
[email protected] Miluzzo
EyePhone
[email protected] Miluzzo
[email protected] Miluzzo
mapping the position of the eye to an application icon on the phone display
[email protected] Miluzzo
mapping the position of the eye to an application icon on the phone display
[email protected] Miluzzo
mapping the position of the eye to an application icon on the phone display
[email protected] Miluzzo
the selected application (e.g., music) is activated with a wink
[email protected] Miluzzo
the selected application (e.g., music) is activated with a wink
[email protected] Miluzzo
EyePhone design
[email protected] Miluzzo
eye template creation
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
running on pc running on the N810
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
eye tracking
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
eye tracking
on every frame
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
eye trackingbased on a correlation function operating over the
current frame and the template on every frame
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
eye trackingbased on a correlation function operating over the
current frame and the template on every frame
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
eye trackingbased on a correlation function operating over the
current frame and the template on every frame
wink detection
[email protected] Miluzzo
eye template creation
offline for different environments image differencing over a set of frames capturing ablink. The result is a binary image with the eye pair
eye trackingbased on a correlation function operating over the
current frame and the template on every frame
wink detectionbased on the correlation function values used in the
tracking phase
[email protected] Miluzzo
evaluation
[email protected] Miluzzo
experimental results
[email protected] Miluzzo
accuracy Vs distance from display
[email protected] Miluzzo
accuracy Vs distance from display
[email protected] Miluzzo
possible applications?
[email protected] Miluzzo
beyond touch screen…
[email protected] Miluzzo
let’s recap…
[email protected] Miluzzo
let’s recap…smartphone’s computation capabilities
are growing
smarter open-eye template creation policies are needed(to be robust across different
context)
[email protected] Miluzzo
let’s recap…smartphone’s computation capabilities
are growingsmarter open-eye template creation policies are
needed(to be robust across different context)
need for eye tracking techniques that are robust against context, mobility,
distance from display
[email protected] Miluzzo
let’s recap…smartphone’s computation capabilities
are growingsmarter open-eye template creation policies are
needed(to be robust across different context)
need for eye tracking techniques that are robust against context, mobility, distance
from display more efficient false eye pair and “false” winks filtering to
avoid undesired app launches
[email protected] Miluzzo
in brief…