L y o n N e u ro s c ie n c e -...

12
BCI Could Make Old Two-Player Games Even More Fun: A Proof of Concept with “Connect Four” Lyon Neuroscience Research Center Maby, Perrin, Bertrand, Sanchez & Mattout, Advances in Human-Comp. Inter., 2012 Brain dynamics and cognition team (DYCOG) Connect 4 Jérémie Mattout

Transcript of L y o n N e u ro s c ie n c e -...

BCI Could Make Old Two-Player Games Even More Fun: A Proof of Concept with “Connect Four”

Lyon Neuroscience

Research Center

Maby, Perrin, Bertrand, Sanchez & Mattout, Advances

in Human-Comp. Inter., 2012

Brain dynamics and cognition team (DYCOG)

Connect 4

Jérémie Mattout

Lyon Neuroscience

Research Center

Outline

Connect 4

• General principle • OpenViBE implementation • How interesting ?

Lyon Neuroscience

Research Center

General principle

• Similar to the well-known P300-speller Perrin et al., Graz BCI Int workshop 2014 (poster 102, Th) Thomas et al., Graz BCI Int workshop 2014 (poster 65, Th)

M N O P Q R

5 6 7 8 9 _

Y Z 1 2 3 4

S T U V W X

G H I J K L

A B C D E F

L

P300 Speller

0 250 500 ms

µV

Signal

processing

Non-Target

Lyon Neuroscience

Research Center

General principle

• Similar to the well-known P300-speller Perrin et al., Graz BCI Int workshop 2014 (poster 102, Th) Thomas et al., Graz BCI Int workshop 2014 (poster 65, Th)

0 250 500 ms

µV

M N O P Q R

5 6 7 8 9 _

Y Z 1 2 3 4

S T U V W X

G H I J K L

A B C D E F

L

P300 Speller

Signal

processing

~300 ms

Target

Lyon Neuroscience

Research Center

General principle

Lyon Neuroscience

Research Center

OpenViBE implementation

TCP/IP

Parallel port

VRPN

Lyon Neuroscience

Research Center

OpenViBE implementation

VRPN Software Tagging*

* Module provided by OV

Lyon Neuroscience

Research Center

OpenViBE implementation

P2 P1

Acquisition

DownSampling

Temporal Filtering

Python Box

VRPN Server

Channel selection Channel selection

Spatial Filtering Spatial Filtering

Epoch.

Stim . Col#7

Epoch.

Stim . Col#6

Epoch.

Stim . Col#5

Epoch.

Stim . Col#4

Epoch.

Stim . Col#3

Epoch.

Stim . Col#2

Epoch.

Stim . Col#1

Epoch.

Stim . Col#7

Epoch.

Stim . Col#6

Epoch.

Stim . Col#5

Epoch.

Stim . Col#4

Epoch.

Stim . Col#3

Epoch.

Stim . Col#2

Epoch.

Stim . Col#1

Likelihood

Compute

Likelihood

Compute

Fe = 100 Hz

Bandpass filter 1 – 20 Hz

Bayesian classifier

Probabilities processing

Results sent to the stimulator

XDAWN Algorithm *

* Rivet et al., IEEE TBME 2009

Lyon Neuroscience

Research Center

How interesting ?

• 2 player game

• Do not aim to replace a fast and precise motor command

• For both patients and healthy subjects • Turn the imperfection of the BCI command into a plus

• Relies on attentional effort

• Allows for extending the game play

Lyon Neuroscience

Research Center

How interesting ?

Lyon Neuroscience

Research Center

How interesting ?

Maby, Perrin, Bertrand, Sanchez & Mattout, Advances

in Human-Comp. Inter., 2012

Project Mind Your Brain (2014 – 2017): Attentional training and clinical trial in ADHD

Open 2-years postdoctoral position at CRNL

Lyon Neuroscience

Research Center

Acknowledgments

Gaëtan Sanchez Emmanuel Maby Margaux Perrin

OpenViBE & OpenViBE 2 (Lead: Anatole Lecuyer, INRIA) CoAdapt (Lead: Maureen Clerc, INRIA)

GIPSA-Lab, Grenoble Hubert Cecotti Marco Congedo Christian Jutten Bertrand Rivet

INRIA, Sophia-Antipolis Maureen Clerc Dieter Devlaminck Théo Papadopoulo Eoin Thomas

Mensia Tech. Louis Mayaud Yann Renard

LNC, CNRS, Marseille Boris Burle Laurence Casini Matthew Dyson Franck Vidal

Henesis, Parma Pouya Ahmadian Luca Ascari

CRNL – DYCOG team Olivier Bertrand Aline Bompas Romain Bouet Lesly Fornoni Françoise Lecaignard Dominique Morlet Anatole Otman

INRIA, Rennes Anatole Lecuyer