Remote Control of a Television Set via Thought Patterns
description
Transcript of Remote Control of a Television Set via Thought Patterns
![Page 1: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/1.jpg)
Remote Control of a Television Set via Thought Patterns
Dr. William Hunt, Project AdvisorJosh RosnerDrew PetryGary Grimm
George Melcer
Thursday, April 29, 2010
![Page 2: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/2.jpg)
Complete System Diagram
DefinitionsEEG – Electroencephalography EAS – EmoState Analysis SoftwareSPB – Synergy Prototyping Board URC – Universal Remote Control
![Page 3: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/3.jpg)
The MindLink System
• Manipulates television functions via user thought patterns
• Provides independence to handicapped and disabled persons
• Development costs were $62k• Per unit cost is approximately $460
![Page 4: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/4.jpg)
Design Objectives
Objective ResultMinimize System Cost Components Cost $430
Intuitive Interface Train with Emotiv Control Panel
Manipulate Simple Commands Set of Five Commands
Real-Time Operation No Noticeable Delay
Utilize Emotiv API Invoked by EAS
Interface with Modified OTS URC 10 Wire Custom Interface
![Page 5: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/5.jpg)
EEG Headset
![Page 6: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/6.jpg)
Illustration
![Page 7: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/7.jpg)
Input Propagation
Emotiv Headset
USB DongleHost PC Device Driver
EEG Signals From User
14 Sensors
2.4 GHz Wireless
![Page 8: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/8.jpg)
Headset Issues
• Training– Training multiple actions– Cannot determine if thought was consistent– Cannot edit profile database
• Physical Headset– Sensor corrosion/replacement
![Page 9: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/9.jpg)
Headset Acceptance Testing
0
2
4
6
8
10
12
Drop Push Left Right
Command
Tria
ls
Failures
Sucesses
Actions Tested Independently
![Page 10: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/10.jpg)
Headset Acceptance Testing
0
2
4
6
8
10
12
Drop Push Left Right
Command
Tria
ls
Failures
Sucesses
Actions Tested Together
![Page 11: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/11.jpg)
Host PC: EmoState Analysis Software
![Page 12: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/12.jpg)
C++ Control Software Process
![Page 13: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/13.jpg)
C++ Control Software Logic
![Page 14: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/14.jpg)
EAS – Design Issues• Invoking and communicating with Emotiv API
– Included EDK.h and linked with EDK.dll– Used EE_EngineConnect for communication with
headset– Used EE_EngineRemoteConnect for communication
with EmoComposer (debugging)
• Sending commands to Synergy board– Used FTDI driver to enable serial connection over USB– Created a HANDLE and used CreateFile and WriteFile API to initialize and send commands to virtual COM port
![Page 15: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/15.jpg)
EAS – Usability Issues• Ensure real-time reaction processing
– Processed EmoEvents soon after they occurred in order to keep the event queue clear
• Avoid false positives while improving usability– Only took action if an event had a high enough power
(confidence) level reported– Compared event timestamps to differentiate if repetition
of a command was intended by user
![Page 16: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/16.jpg)
EAS – Acceptance Testing with EmoComposer
![Page 17: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/17.jpg)
Synergy Prototyping Board &
Universal Remote Control
![Page 18: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/18.jpg)
Synergy Prototyping Board
![Page 19: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/19.jpg)
SPB Layout
![Page 20: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/20.jpg)
SPB Implementation
![Page 21: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/21.jpg)
Synergy Prototyping Board Firmware
![Page 22: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/22.jpg)
SPB – Problems
• Problem: MOSFETs did not interface with URC as expected
• Solution– Utilized bi-lateral switches instead of MOSFETs in
order to short two pins instead of pulling them high or low.
• Problem: Active-Low Demux• Solution
– Directly addressed the bi-lateral switches from GPIO’s.
![Page 23: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/23.jpg)
URC – Problems
• Problem: Soldering joints are weak on URC
• Solution: Isolate joints with Hot Glue and carefully manage wires with heat shrink.
![Page 24: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/24.jpg)
URC – Acceptance Testing with Short-Wire Method
![Page 25: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/25.jpg)
URC – Acceptance Testing with SPB
![Page 26: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/26.jpg)
System Integration Issues
• EAS to SPB Serial Interface– Standard Packet Format
• URC Volume Commands did not react as expected
• Flooding SPB/URC with commands caused random behavior
![Page 27: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/27.jpg)
System Acceptance Testing (Emo-Composer)
![Page 28: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/28.jpg)
Demonstration Video
![Page 29: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/29.jpg)
Budget & Cost AnalysisMindLink Venture
![Page 30: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/30.jpg)
Future Work
• Optimize System Design– Simpler SPB– Develop In-House URC– Built-in Low Power Embedded PC– Complete Embedded Solution
• Optimize Resource Acquisition– Licensing with Emotiv– Volume Pricing with Vendors
• Develop Service Contract Platform– Initial Installation / Monthly Support & Tuning
• Register MLS with Insurance Companies– Reduce Costs to handicapped customers
![Page 31: Remote Control of a Television Set via Thought Patterns](https://reader036.fdocuments.net/reader036/viewer/2022062519/56814d62550346895dbab12c/html5/thumbnails/31.jpg)
Questions?