Navigational BCI Using Acoustic Stimulation
-
Upload
wacax -
Category
Self Improvement
-
view
210 -
download
0
Transcript of Navigational BCI Using Acoustic Stimulation
![Page 1: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/1.jpg)
1
Auditory BCI for Navigation using ERP classification
By Mario Vivero
![Page 2: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/2.jpg)
2
Outline
• Description • Methodology • Results• Summary and Conclusion• Questions
![Page 3: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/3.jpg)
Adapted from: http://www.tobi-project.org/sites/default/files/public/Publications/TOBI-159.pdf
3
AMUSE paradigm
AMUSE paradigm Stimulation Setup
Characters chosen in two rounds. 6-class selection
![Page 4: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/4.jpg)
Custom designed maze. All textures and 3D objects were downloaded from: http://www.turbosquid.com
4
Navigational EnvironmentUpper Perspective
![Page 5: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/5.jpg)
5
Auditory Navigational BCI based on the AMUSE paradigm
Navigational Setup for Acoustic Stimulation
Speaker #1
Speaker #2
Speaker #3Speaker #4
Speaker #5
1.- Forward Movement. 2.- Forward Right Movement. 3.- Turn Right. 4.- Turn Left. 5.- Forward Left Movement
![Page 6: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/6.jpg)
6
Experimental ConditionsAuditory
Stimulation (5 Full Rounds)
Signal Processing & Classification
Control Strategy
Discrete Movement
Auditory Stimulation (5 Rounds)
Signal Processing & Classification
Discrete Condition
…
![Page 7: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/7.jpg)
7
Experimental ConditionsAuditory
Stimulation (5 Full Rounds)
Signal Processing & Classification
Control Strategy
Discrete Movement
Auditory Stimulation (5 Rounds)
Signal Processing & Classification
Discrete Condition
…
Continuous Stimulation
Signal Processing & Classification
Control Strategy
Continuous Movement
Continuous Stimulation
Signal Processing & Classification
Continuous Condition
…
![Page 8: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/8.jpg)
8
Experimental ConditionsAuditory
Stimulation (5 Full Rounds)
Signal Processing & Classification
Control Strategy
Discrete Movement
Auditory Stimulation (5 Rounds)
Signal Processing & Classification
Discrete Condition
…
Continuous Stimulation
Signal Processing & Classification
Control Strategy
Continuous Movement
Continuous Stimulation
Signal Processing & Classification
Continuous Condition
…
Joystick - Benchmark ConditionInput
MovementControl Strategy
Continuous Movement
![Page 9: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/9.jpg)
9
Auditory Stimulation and Signal ProcessingEach stimulus lasted 40 ms. SOA was set to 175 ms.
The calibration phase consisted of an auditory oddball task without visual feedback.
Binary classification of target and non-target epochs was performed using a Linear Discriminant Analysis (LDA). Due to the data high dimensionality a shrinkage method was also applied.
![Page 10: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/10.jpg)
10
Control Strategy
Penalization
Continuous
No Penalization - Discrete
W =
D’ = D ⊙ W
D ∈ R C X B
W ∈ R C X B
![Page 11: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/11.jpg)
11
Control Strategy
Penalization
Sigmoid Function Transformation
Continuous
No Penalization - Discrete
W =
D’ = D ⊙ W
D ∈ R: C X B
W ∈ R: C X B
D’’ = f (D’, a, c)
![Page 12: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/12.jpg)
12
Control Strategy
Penalization
Sigmoid Function Transformation
Re-mapping
Continuous
No Penalization - Discrete
W =
D’ = D ⊙ W
D ∈ R C X B
W ∈ R C X B
D’’ = f (D’, a, c)
V =ForwardForward-RightRight TurnLeft TurnForward-Left
∑𝑗=1
𝑛
(𝐷′ ′𝑉 )Out = --
![Page 13: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/13.jpg)
13
PerformanceContinuous Condition Discrete Condition
Custom designed maze. All textures and 3D objects were downloaded from: http://www.turbosquid.com. Full Videos can be found on: http://www.youtube.com/watch?v=DUbqThGLykg
http://www.youtube.com/watch?v=dOcuLeYRzxE
![Page 14: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/14.jpg)
14
ERP ComparisonCalibration Data ERP Grand Average
Cz
Calibration Mean of Accuracy: 71% according to cross-validation
![Page 15: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/15.jpg)
15
Path Lengths and TimesFirst room
![Page 16: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/16.jpg)
16
Data Spread at 37 seconds
![Page 17: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/17.jpg)
17
Summary and Conclusions• The Discrete condition has a more
optimal trajectory.
• Time spent in rooms is the same for both conditions
• According to subject feedback the continuous condition was found more enjoyable
![Page 18: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/18.jpg)
18
A more intelligent control strategy algorithm will improve the overall performance.
![Page 19: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/19.jpg)
19
Thank you
![Page 20: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/20.jpg)
20
![Page 21: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/21.jpg)
21
• D = Data = 5*5 matrix stored in buffer• W = Window If discrete
If continuous• m = number of classes / speakers• n = desired dimensions = 2 for X and Y
• Sigmoid membership function(z, a, c) = g(z, a, c) =
V =
5 X 5 matrix of ones
∑𝐽=1
𝑛
∑𝑘=1
𝑚
(𝑔 (𝐷⊙𝑊 ,𝑎 ,𝑐 ) 𝑖𝑘∗𝑉 𝑘𝑗 )OUTPUT =
--
ForwardForward-RightRight TurnLeft TurnForward-Left
OUTPUT = ∑𝑗=1
𝑛
(𝑔 (𝐷⊙𝑊 ,𝑎 ,𝑐 )𝑉 )
![Page 22: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/22.jpg)
22
Continuous Control Strategy
X
Penalization
Penalized Buffered Data
=
ELEMENTWISE MULTIPLICATION
Iterations
Classes / Speakers
![Page 23: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/23.jpg)
23
Continuous Control Strategy (cont. 2)
Sigmoid membership function
Sigmoid Function Transformation
𝑓 (Penalized Buffered Data ,𝑎 ,𝑐 )=
ELEMENTWISE
Iter.
Class
![Page 24: Navigational BCI Using Acoustic Stimulation](https://reader035.fdocuments.net/reader035/viewer/2022062900/58f36c9d1a28abc72a8b45d3/html5/thumbnails/24.jpg)
24
Continuous Control Strategy (cont. 3)
Re-mapping
.
MATRIX MULTIPLICATION
=
ForwardForward-RightRight TurnLeft TurnForward-Left
Class
Iter.
𝑋 1 𝑌 1𝑋 2 𝑌 2𝑋 3 𝑌 3𝑋 4 𝑌 4𝑋 5 𝑌 5
=OUTPUT