Sensorimotor multivariate projects

22
Sensorimotor multivariate projects Frank Leone, Ivan Toni, Pieter Medendorp

description

Frank Leone, Ivan Toni, Pieter Medendorp. Sensorimotor multivariate projects. Sensorimotor multivariate projects. Distributed meeting, 24 November 2011. Two projects. Saccade generation 18 locations Effector specificity Three effectors Repetition suppression General approach: - PowerPoint PPT Presentation

Transcript of Sensorimotor multivariate projects

Page 1: Sensorimotor  multivariate projects

Sensorimotor multivariate projectsFrank Leone, Ivan Toni, Pieter Medendorp

Page 2: Sensorimotor  multivariate projects

Saccade generation• 18 locations

Effector specificity• Three effectors• Repetition suppression

General approach:• Have multiple blocks• Fit GLM per block• Have multiple values per voxel (e.g.,

dir, amp, loc)• Classify t-values (SVM, searchlight)

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Two projects

Page 3: Sensorimotor  multivariate projects

The domain: saccade generation

Both the Frontal Eye Fields (FEF)and Posterior Parietal Cortex (PPC)feature tuning for saccade

• Direction• Amplitude?

It is unclear why no amplitude selectivity has been found in humans

Taking advantage of the increased sensitivity of multivariate analysis, we are busy filling this gap

Primates Humans

Direction

FEF Bruce & Goldberg, 1985Schall et al, 1995

Kastner et al, 2007Hagler Jr. & Sereno,

2007

PPC Gnadt & Andersen, 1988Thier & Andersen, 1998

Sereno et al, 2001Hagler Jr. & Sereno,

2007

Amplitude

FEF Bruce & Goldberg, 1985 ?

PPC Gnadt & Andersen, 1988Thier & Andersen, 1998 ?

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Background

Page 4: Sensorimotor  multivariate projects

Standard delayed saccade setup

+

+

+

+

Distributed meeting, 24 November 2011

Sensorimotor multivariate projects

Sereno kinda way

Page 5: Sensorimotor  multivariate projects

• Presentation– Consistent delays– Around the clock– Phase-based

analysis

• Result: nice maps

Phase-based mapping a la Sereno

& PhaseFreq

Am

p

Sereno et al, 2001

Distributed meeting, 24 November 2011

Sensorimotor multivariate projects

1

2

34

5

6 1

2

34

5

6

+

500 ms.

3000 ms.

+

750 ms.

+

+

750 ms.

Page 6: Sensorimotor  multivariate projects

The domain: saccade generation

Both the Frontal Eye Fields (FEF)and Posterior Parietal Cortex (PPC)feature tuning for saccade

• Direction• Amplitude?

It is unclear why no amplitude selectivity has been found in humans

Taking advantage of the increased sensitivity of multivariate analysis, we are busy filling this gap

Primates Humans

Direction

FEF Bruce & Goldberg, 1985Schall et al, 1995

Kastner et al, 2007Hagler Jr. & Sereno,

2007

PPC Gnadt & Andersen, 1988Thier & Andersen, 1998

Sereno et al, 2001Hagler Jr. & Sereno,

2007

Amplitude

FEF Bruce & Goldberg, 1985 ?

PPC Gnadt & Andersen, 1988Thier & Andersen, 1998 ?

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Background

Page 7: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Methods: paradigm

+

500 ms.

6*500 ms.

+

750 ms.

+

+

750 ms.

Page 8: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Methods: Analysis

Page 9: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

- Stimulus spike

Page 10: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Fitted per location

The classifier actually got:

Direction

Amplitude

Location

And was trained to classify location

Page 11: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Surface based

Page 12: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Methods: SummaryDelayed saccade task

18 targets:- 6 directions- 3 amplitudes

GLM for all 18 locations to get beta’s/t statistics

Move searchlight over the brain, try to distinguish locations

Calculate back to direction and amplitude

Noting performance, significance, and tuning

+

500 ms.6*500 ms.

+

750 ms.

++

750 ms.

Page 13: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Results: Performance

Page 14: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Results: Max voxel tuning

Page 15: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Results: Regional tuning

Page 16: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

So…Found direction, amplitude, and location information

in the expected regions

Can look at this tuning in greater detail than possible before.

- Model focused on stimulus

- It is actually a regression problem

- Participants not perfect

But…

Page 17: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Effector specificity projectSfN 2011 poster

Page 18: Sensorimotor  multivariate projects
Page 19: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

So:Specificity as expected, gradients confirmed

Interesting similarities and differences between importance and confusion

Include sides

Include repetition suppression

Analyze using RSA (* 2)

To do:

Page 20: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Page 21: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

Page 22: Sensorimotor  multivariate projects

Sensorimotor multivariate projects

Distributed meeting, 24 November 2011

General conclusionMulti-valued searchlight

Using t-values per block

Makes for great performance

Confusion matrices

For behavior/EMG

Is the next step to make