Blue eyes
-
Upload
hemant-jakkani -
Category
Technology
-
view
2.409 -
download
6
Transcript of Blue eyes
- HEMANT JAKKANI-Badruka college HYD (BBCIT)
WHAT IS BLUE EYES TECHNOLOGY?
Aims at creating computational machines that have perceptual and sensory ability.
Use camera and microphone to identify user actions and emotions
2
The term BLUE EYES
BLUE in the term stands for Bluetooth, which enables reliable wireless communication
EYES because the eye movement enables us to obtain a lot of interesting and important information.
3
NEED OF BLUE EYES TECHNOLOGY To built a machine that can understand your
emotions
A PC that can listen, talk or scream
Verify your identity, feels your presence and interact with you.
4
TECHNOLGIES USED• Emotion Mouse
• Manual And Gaze Input Cascaded (MAGIC)
• Artificial Intelligent Speech Recognition
• Simple User Interest Tracker (SUITOR)
• The eye movement Sensor 5
EMOTION MOUSE
Simplest way
People spend approximately 1/3 of their total computer
time touching input device
Physiological data is obtained and emotional
state is determined
A user model will be built that reflects the
personality of user.
6
ARTIFICIAL INTELLIGIENT SPEECH RECOGNITION
Input words are scanned and matched against internally stored words
Identification causes some action to be taken user speaks to the computer through microphone
Filtered and fed to ADC and then stored in RAM
Pattern matching is designed to look for the best fit because of variations in loudness, pitch, frequency difference, time gap etc.
7
APPLICATION OF ARTIFICIAL INTELLIGIENT SPEECH
RECOGNITION
• To control weapons by voice commands
• Pilot give commands to computers by speaking into microphones
• Can be connected to word processors and instead of writing, simply dictate to them
8
Simple User Interest Tracker (SUITOR)
• Help by fetching more information at desktop
• Notice where the user’s eyes focus on the screen
• Fills a scrolling ticker on a computer screen with information related to user’s task
• Ex. If reading headline ,pops up the story in the browser window
9
THE EYE MOVEMENT SENSOR DESIGNING
• A personal area network for linking all the operators and the supervising system
Two major units
- DAU (Data Acquisition Unit )
- CSU (Central System Unit )
10
Data Acquisition Unit (DAU)
• The DAU consists of the following components
• ATMEL 8952 microcontroller
• BLUE TOOTH MODULE – supports synchronous voice
• data transmission
• central system sound feedback
• microcontroller (115200 bps)
• ALPHAUNUMERIC LCD display
• LED indicators
• ID CARD interface11
DAU - features
• Lightweight
• Runs on batteries - low power consumption
• Easy to use - does not disturb the operator working
• ID cards for operator authorization
• Voice transmission using hardware PCM codec
Data Acquisition Unit
Atmel 89C52microcontroller
JazzMultisensor
Bluetooth
12
Microcontroller & bluetooth module
13
CSU Components
CONNECTION MANAGER – main task to perform low-level blue tooth communication
DATA ANALYSIS MODULE – performs the analysis of the raw sensor data
DATA LOGGER MODULE – provides support for storing the monitored data.
VISULAIZATION MODULE – provides user interface for the supervisors
14
Csu featuresCentral System Unit
ConnectionManager
Data Analysis
VisualizationModuleBluetooth
ConnectionManager
DataLogger
Connection management
Data processing
Data recording
Access verification
System maintenance
15
Multisensors
16
EXPERIMENT• Measurement of heart rate, temperature, galvanic skin
response (GSR), general somatic activity
• Six basic emotions are anger, fear, sadness, disgust, joy and surprise
17
Data security
Only registered mobile devices can connect to the system
Bluetooth connection authentication
Bluetooth connection encryption
Access rights restrictions
Personal and physiological data encryption 18
applications
In retailing record and interpret customer movements
In automobile industry
In video games
To create “Face Responsive Display” and “Perceptive Environment” Generic control rooms
Power station
Flight control centres
o Operating theatres19
BLUE EYES ENABLED DEVICES
POD
Technology used in cars
PONG
A Robot
20
IBM research
BLUE EYE – EMOTIONAL MOUSE sensors in the mouse ,sense the physiological attributes which are correlated to emotions using correlation model -by simply touching the mouse ,the computer will be able to determine a person’s emotional state.
BLUE EYE enabled TELEVISION could become active when the user makes an eye contact.
21
CONCLUSION
• Provide more delicate and user friendly facilities in computing devices
• Gap between the electronic and physical world is reduced
• The computers can be run using implicit commands instead of the explicit commands
22