SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.
-
Upload
brittany-edwards -
Category
Documents
-
view
219 -
download
1
Transcript of SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.
![Page 1: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/1.jpg)
SSVEP based BCI & Application
Presented by M.S. RiaziSupervisor: Dr. M.B. Shamsollahi
![Page 2: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/2.jpg)
2 /34
Outline• Introduction
• BCI
• SSVEP
• What we did at First• Application and Results
• New Application• Introduction
• Previous Works
• Block Diagram
• Results
• References
![Page 3: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/3.jpg)
/34
What is BCI ?• Abbreviation of Brain Computer Interface
• Is a direct communication pathway between the brain and an external
• Falls in 2 major categories• External• Invasive
3
![Page 4: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/4.jpg)
4 /34
Typical BCI System
What is BCI ?
![Page 5: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/5.jpg)
5 /34
What Kind of Activities does Brain Have?
• MTB Motor Imagery based BCI
• MIB Mental task based BCI
• P300 Related to unpredictability of stimulus
• VEP Response to rapid visual stimulus
• SSVEP Response to Oscillator stimulus
What is BCI ?
![Page 6: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/6.jpg)
6 /34
What is SSVEP ?• Steady State Visual Evoked Potentials• Brain response to oscillator stimulus• If the stimulus oscillate with a specific frequency, The pattern with the same frequency will appear in the Occipital Lobe
![Page 7: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/7.jpg)
7 /34
• When This oscillating pattern enters the Eyes, these photons are captured by visionary cells
What is SSVEP ?
![Page 8: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/8.jpg)
8 /34
• By Recording the brain signals specially from the occipital lope and using FFT we see the following diagram
What is SSVEP ?
![Page 9: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/9.jpg)
9 /34
What We did at First•Using Multiple frequencies dedicated to one Class
• Aim: To select our class much FASTER (less Avg. time)
•Strategies->dedicating multiple frequencies by:• Time• Defining different signal level and adding 2 sinusoids
arithmetically • Location• Using different locations for each frequency
![Page 10: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/10.jpg)
10
/34
What We did at First•Using Emotive EEG (14 channels) for acquiring Brain signals
•Using MATLAB for processing the channels
Our Work
![Page 11: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/11.jpg)
11
/34
Project Implementation Diagram
Emotive Driver
BCI 2000
Field Trip
BufferMATLAB
Visual Studio (C#)
Feedback to user
Signal Acquisiti
on
![Page 12: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/12.jpg)
12
/34
Project Implementation Flow
•BCI 2000: An application which will handle the flow of Data among different side applications.
• Field Trip Buffer: An interface application which gets Data from BCI 2000 and pass it to MATLAB
•MATLAB: Core of all Processes! Gets Signal Data form Field Trip Buffer and give the Results to Visual Studio
![Page 13: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/13.jpg)
13
/34
MATLAB• Implementation of Paper “Towards an SSVEP Based BCI
With High ITR” [4]• Main Idea is that we generate artificial channels by which
we can reduce the noise influence will get its min value
![Page 14: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/14.jpg)
14
/34
Eigen values
MATLAB
![Page 15: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/15.jpg)
15
/34
Visual StudioOur Work
•Most Important Concern: Concise Timing
Location
Time
2nd Harmoni
c
![Page 16: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/16.jpg)
16
/34
Testing Application Results• Subject looking at 6 Hz oscillating screen
Previous Data
New application ‘s Data
![Page 17: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/17.jpg)
17
/34
Results
Previous Data
• Subject looking at TIME MIXED 6 Hz and 18 Hz oscillating screen
• Result: Energy between these Frequencies are scrambled
New application ‘s Data
![Page 18: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/18.jpg)
18
/34
Results
Previous Data
New application ‘s Data
• Subject looking at TIME MIXED 6 Hz and 10 Hz oscillating screen
• Result: Energy between these Frequencies are scrambled
![Page 19: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/19.jpg)
19
/34
New Application• Aim: Person looks at phone dial keypad for
each desired digit and then the digits are complete, a phone call will take a place with that number
![Page 20: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/20.jpg)
20
/34
New Application• Aim: Person looks at phone dial keypad for
each desired digit and then the digits are complete, a phone call will take a place with that number
![Page 21: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/21.jpg)
21
/34
Previous WorksA cell-phone-based brain–computerinterface for communication in daily life
![Page 22: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/22.jpg)
22
/34
Previous Works ResultA cell-phone-based brain–computerinterface for communication in daily life
![Page 23: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/23.jpg)
23
/34
GSM Communication
Project Implementation Diagram
BCI 2000
Field Trip
BufferMATLAB
Visual Studio (C#)
Feedback to userSignal
Acquisition
Bluetooth
Android
Platform
Emotive Driver
Wireless Data Transfer
![Page 24: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/24.jpg)
24
/34
Design Specifications• Key Pad with 12 dedicated buttons (numbers: 0 to 9, Backspace, #)
• Frequencies Dedicated: • 6 8 10 11 13 15 17 19 21 23 25 29 Constraints !• Dedicated with scatter position on Pad
• Algorithm used: Minimum Energy Combination (MEC)• + High Pass Filter
• + Threshold Scalable Classification
• + Common Mode Average Filter (CMA)
• + Dynamic Window Size (DWS)
• + Special Pattern Construction
![Page 25: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/25.jpg)
25
/34
Signal Processing DiagramRaw Signal
![Page 26: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/26.jpg)
26
/34
Signal Processing DiagramAfter CMA and HP Filter
![Page 27: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/27.jpg)
27
/34
Results• Accuracy of classification • Rows: Threshold Columns: Time interval Fixed Time
Interval
• Signal: 4 Channels, 1 Minute Data Acquisition, Person looking at 12Hz (Besides buttons: @10Hz and 14 Hz)
![Page 28: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/28.jpg)
28
/34
Results• Dynamic Window Size (DWS)
• Accuracy Vs. Threshold
![Page 29: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/29.jpg)
29
/34
Results• Dynamic Window Size (DWS)
• Distribution of each window size used
![Page 30: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/30.jpg)
30
/34
References (1/3)1. “A Study on SSVEP-Based BCI”, Zheng-Hua Wu and De-Zhong Yao ,JOURNAL OF ELECTRONIC SCIENCE
AND TECHNOLOGY OF CHINA, VOL. 7, NO. 1, MARCH 2009
2. Simple communication using a SSVEP-based BCI, Guillermo Sanchez, Pablo F. Diez, Enrique Avila, Eric Laciar Leber, Journal ofPhysics:ConferenceSeries 332 (2011) 012017 doi:10.1088/1742-6596/332/1/012017
3. “SSVEP and P300 based interfaces”, Fabrizio Beverina,Giorgio Palmas,Stefano Silvoni,Francesco Piccione, PsychNology Journal, 2003, Volume 1, Number 4, 331 – 354
4. Towards an SSVEP Based BCI With High ITR, Ivan Volosyak, Diana Valbuena, Thorsten L¨uth, and Axel Gr¨aser,
5. G. Dornhege, J. del R. Millan, T. Hinterberger, D. J. McFarland, and K.-R. M¨uller, Toward Brain-Computer Interfacing. MIT Press, 2007
6. G. Schalk, “Sensor modalities for brain-computer interfacing,” in Human-Computer Interaction, Part II, HCII 2009, LNCS 5611, 2009, pp. 616–622.
7. J. R. Wolpaw, H. Ramoser, D. J. McFarland, and G. Pfurtscheller, “EEG-based communication: improved accuracy by response verification,” IEEE Trans. Rehabil. Eng., vol. 6, no. 3, pp. 326–333, Sep. 1998.
8. E. C. Lalor, S. P. Kelly, C. Finucane, R. Burke, R. Smith, R. B. Reilly, and G. McDarby, “Steady-state VEP-based brain-computer interface control in an immersive 3D gaming environment,” EURASIP J. Appl. Signal Process., vol. 19, pp. 3156–3164, 2005.
![Page 31: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/31.jpg)
31
/34
References (2/3)9. J. R. Wolpaw et al., “Brain-computer interface technology: A review of the first international
meeting,” IEEE Trans. Rehab. Eng., vol. 8, pp. 164–173, June 2000.Towards an SSVEP Based BCI With High ITR, Ivan Volosyak, Diana Valbuena, Thorsten L¨uth, and Axel Gr¨aser,
10.Design and Implementation of a Brain-Computer Interface With High Transfer Rates Ming Cheng*, Xiaorong Gao, Shangkai Gao, Senior Member, IEEE, and Dingfeng Xu
11.Visual stimulus design for high-rate SSVEP BCI Y. Wang, Y.-T. Wang and T.-P. Jung
12.A cell-phone-based brain–computer interface for communication in daily life Yu-Te Wang1, Yijun Wang1 and Tzyy-Ping Jung Swartz Center for Computational Neuroscience, Institute for Neural Computational, University of California, San Diego, La Jolla, CA, USA
13.Developing Stimulus Presentation on Mobile Devices for a Truly Portable SSVEP-based BCI Yu-Te Wang, Student Member, IEEE, Yijun Wang, Member, IEEE, Chung-Kuan Cheng, Fellow, IEEE, and Tzyy-Ping Jung*, Senior Member, IEEE
14.G. Bin, X. Gao, Z. Yan, B. Hong, and S. Gao, “An online multi-channel SSVEP-based brain-computer interface using a canonical correlation analysis method,” Journal of Neural Engineering, vol. 6, no. 4, 2009.
![Page 32: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/32.jpg)
32
/34
References (3/3)15.D. Regan, Human brain electrophysiology: evoked potentials and evoked magnetic fields in
science and medicine. New York: Elsevier Pubs; 1989.
16.M. De Tommaso, V. Sciruicchio, M. Guido, G. Sasanelli, and F. Puca, “Steady-state visual evoked potentials in headache: diagnostic value in migraine and tension-type headache patients”. Cephalalgia, vol. 19, pp. 23-26, Jan. 1999.
17.Y.-T. Wang, Y. Wang, and T.-P. Jung, “A Cell-phone based Brain Computer Interface for Communication in Daily Life ", Journal of Neural Engineering, vol.8, no.2, pp. 1-5, 2011.
18.E. Lyskov, V. Ponomarev, M. Sandstrom, K. H. Mild, and S. Medvedev, “Steady-State Visual Evoked Potentials to Computer Monitor Flicker,” International Jurnal of Psychophysology, vol. 28, pp. 285-290, 1998.
![Page 33: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/33.jpg)
33
/34
Grateful of
•Prof. M.B. Shamsollahi
•Omid Ghasemsani•Sajad Karimi•Masih Bahrani•Javad Abedi•Mohammad Javad Seyed Talebi
Who helped me very much during this project
![Page 34: SSVEP based BCI & Application Presented by M.S. Riazi Supervisor: Dr. M.B. Shamsollahi.](https://reader036.fdocuments.net/reader036/viewer/2022062516/56649d6d5503460f94a4df2e/html5/thumbnails/34.jpg)
34
/34
ThanK you iN adVanCe f0r your AtTentiOn