Laskaris mining information_neuroinformatics

44
N. Laskaris N. Laskaris

description

Mining Information from Multichannel Encephalographic data

Transcript of Laskaris mining information_neuroinformatics

Page 1: Laskaris mining information_neuroinformatics

N. LaskarisN. Laskaris

Page 2: Laskaris mining information_neuroinformatics

N. LaskarisN. Laskaris

Page 3: Laskaris mining information_neuroinformatics

[ IEEE SP Magazine, May 2004 ]

N. Laskaris,S. Fotopoulos,

A. Ioannides

ENTER-2001

Page 4: Laskaris mining information_neuroinformatics

new toolsnew toolsfor Mining Information from for Mining Information from

multichannel encephalographic recordingsmultichannel encephalographic recordings

& applications& applications

Page 5: Laskaris mining information_neuroinformatics

What is Data Mining ?Data Mining ?

How is it applied ?

Why is it useful ?What is the difficulty with single trials ?

How can Data MiningData Mining help ?

Which are the algorithmic steps ?

Is there a simple example ?

Is there a more elaborate example ?

What has been the gain ?

Where one can learn more ?

Page 6: Laskaris mining information_neuroinformatics

What is Data MiningData Mining&

Knowledge DiscoveryKnowledge Discovery in databases ?

Page 7: Laskaris mining information_neuroinformatics

Data MiningData Miningis “the data-driven discovery and

modeling of hidden patterns in large volumes of data.”

It is a multidisciplinary field, borrowing and enhancing ideas from diverse areas such as statistics, image understanding, mathematical optimization, computer vision, and pattern recognition.

It is the process of nontrivialnontrivial extractionextraction of implicitof implicit, previously unknown, and

potentially useful information from voluminous datafrom voluminous data.

Page 8: Laskaris mining information_neuroinformatics

How is it applied in the context of

multichannel multichannel encephalographic recordingsencephalographic recordings ?

Page 9: Laskaris mining information_neuroinformatics

Studying Brain’s self-organizationby monitoring the dynamic pattern formation

reflecting neural activity

Page 10: Laskaris mining information_neuroinformatics

Why is it a potentially valuable methodology

for analyzing EventEvent--RelatedRelated recordings ?

33

Page 11: Laskaris mining information_neuroinformatics

The analysis of EventEvent--Related DynamicsRelated Dynamics

aims at understanding the realreal--time processingtime processing of a stimulus

performed in the cortex

and demands tools able to deal with MultiMulti--Trial dataTrial data

The traditional approach is based on identifying peaks in the averaged signal

-It blends everything happened during

the recording

Page 12: Laskaris mining information_neuroinformatics

What is the difficulty in analyzing

SingleSingle--TrialTrial responses ?

44

Page 13: Laskaris mining information_neuroinformatics

At the single-trial level, we are facing ComplexComplex SpatiotemporalSpatiotemporal DynamicsDynamics

Page 14: Laskaris mining information_neuroinformatics

How can Data MiningData Mining help to circumvent this complexity

and reveal the underlying brain mechanisms ?

55

Page 15: Laskaris mining information_neuroinformatics

directed queries are formed in the Single-Trial data

which are then summarized

using a very limited vocabulary of information granules

that are easily understood, accompanied by well-defined semanticsand help express relationships existing in the data

Page 16: Laskaris mining information_neuroinformatics

The information abstractioninformation abstractionis usually accomplished

via clusteringclustering techniques

and followed by a proper visualization schemevisualization schemethat can readily spot interesting events

and trends in the experimental data.

Page 17: Laskaris mining information_neuroinformatics

- Semantic MapsSemantic Maps

The CartographyCartography of neural function results in a topographical representation

of response variation and enables the virtual navigationin the encephalographic database

Page 18: Laskaris mining information_neuroinformatics

66

Which are the intermediate

algorithmic steps ?

Page 19: Laskaris mining information_neuroinformatics

A Hybrid approach A Hybrid approach

Pattern AnalysisPattern Analysis& Graph TheoryGraph Theory

Page 20: Laskaris mining information_neuroinformatics

Step_Step_the spatiotemporal dynamics are decomposed

Design of the spatial filterspatial filter used to extract

the temporal patternstemporal patterns conveyingthe regional response dynamics

Page 21: Laskaris mining information_neuroinformatics

Step_Step_Pattern AnalysisPattern Analysisof the extracted ST-patterns

Interactive Study Interactive Study of pattern variabilityof pattern variability

Feature Feature extractionextraction

Embedding Embedding in Feature Spacein Feature Space

Clustering & Clustering & Vector QuantizationVector Quantization

Minimal Spanning TreeMinimal Spanning Treeof the codebookof the codebook

MSTMST--ordering ordering of the code vectors of the code vectors

Orderly presentation Orderly presentation of response variabilityof response variability

Page 22: Laskaris mining information_neuroinformatics
Page 23: Laskaris mining information_neuroinformatics
Page 24: Laskaris mining information_neuroinformatics

Step_Step_Within-group Analysisof regional response dynamics

-

Page 25: Laskaris mining information_neuroinformatics

Step_Step_Within-group Analysisof multichannel single-trial signals

Page 26: Laskaris mining information_neuroinformatics

Step_Step_Within-group Analysis of single-trial MFTMFT--solutionssolutions

Page 27: Laskaris mining information_neuroinformatics

Is there a simple example?

77

[ Laskaris & Ioannides, Clin. Neurophys., 2001 ]

Page 28: Laskaris mining information_neuroinformatics

Repeated stimulationRepeated stimulation120 trials, binaural-stimulation[ 1kHz tones, 0.2s, 45 dB ], ISI: 3sec, passive listening

Task : to ‘‘explain’’the averaged M100-response

Page 29: Laskaris mining information_neuroinformatics

The M100-peak emerges from the stimulus-induced phase-resetting

Page 30: Laskaris mining information_neuroinformatics

Phase reorganizationPhase reorganizationof the ongoing brain waves

Page 31: Laskaris mining information_neuroinformatics

88

Is there a more elaborate example?

[ Laskaris et al., NeuroImage, 2003 ]

Page 32: Laskaris mining information_neuroinformatics

A study of A study of global firing patternsglobal firing patterns

Page 33: Laskaris mining information_neuroinformatics

Their relation Their relation with localized sources with localized sources

Page 34: Laskaris mining information_neuroinformatics

and and ……..initiating eventsinitiating events

Page 35: Laskaris mining information_neuroinformatics

240 trials, pattern reversal, 4.5 deg , ISI: 0.7 sec, passive viewing

Single-Trial data in unorganized format

Page 36: Laskaris mining information_neuroinformatics

Single-Trial data summarized via ordered prototypes reflecting the variability of regional response dynamics

Page 37: Laskaris mining information_neuroinformatics

‘‘‘‘The ongoing activity The ongoing activity before the stimulusbefore the stimulus--onsetonsetis functionally coupled is functionally coupled with the subsequent with the subsequent regional responseregional response’’’’

Page 38: Laskaris mining information_neuroinformatics

Polymodal Parietal Areas BA5 & BA7 are the major sources of the observed variability

Page 39: Laskaris mining information_neuroinformatics

There is relationship There is relationship between

N70m between

N70m--response variability response variability

and activity in early visual areas.

and activity in early visual areas.

Regional vs Local response dynamics :

Page 40: Laskaris mining information_neuroinformatics

99

What has been the lesson, so far,

from the analysis of Event-Related Dynamics ?

Page 41: Laskaris mining information_neuroinformatics

The The ‘‘‘‘dangerousdangerous’’’’equation equation

Page 42: Laskaris mining information_neuroinformatics
Page 43: Laskaris mining information_neuroinformatics

Where one can learn more about Mining InformationMining Information

from encephalographic recordings ?

////www.hbd.brain.riken.jp www.hbd.brain.riken.jp symposium: MEG in psychiatrysymposium: MEG in psychiatry

(AUD4, Monday, 9.00 )(AUD4, Monday, 9.00 )

Page 44: Laskaris mining information_neuroinformatics

[email protected]@zeus.csd.auth.gr