SURF Seminar Presentation
-
Upload
eshan-govil -
Category
Documents
-
view
15 -
download
1
Transcript of SURF Seminar Presentation
![Page 1: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/1.jpg)
INFLUENCE OF PARIETAL CORTEX ON SALIENCY DRIVEN VISION IN NON HUMAN PRIMATESEshan GovilSURF Summer 2016Moore Labs at Stanford UniversityMentors: Xiaomo Chen, Mark Zirnsak, and Tirin Moore
![Page 2: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/2.jpg)
Overview• 1 – Experimental Paradigm
• What was the experiment design• 2 – Basic Behavior
• Shift to the right• Main Sequence
• 3 – Optimization• IKN and GBVS model
• 4 – Saliency Driven fixations• Proportion as a function of Saliency Difference• Average saliency through the fixation sequence
• 5 – Future Direction
![Page 3: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/3.jpg)
Key Terms• Saliency / Physical Salience
• The unique features of an image we subconsciously focus on when gauging dense sensory input to determine what we are looking at
• Saccade• Rapid, almost involuntary eye movements from one point to
another• Parietal Cortex
• Sensory input processing and integration• Frontal Eye Field
• Responsible for saccadic and voluntary eye movements, visual field perception, and awareness
• Ipsilateral/Contralateral• To the same side / to the other side of the body
![Page 4: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/4.jpg)
Experimental Background and Design
EXPERIMENTAL GOALObserve and quantify the effects of reversible inactivation
of the parietal cortex on the processing of visual salience in the FEF.
IN GENERAL TERMSIf we switch off a region of our Parietal Cortex, how does that affect our vision? How does the Frontal Eye Field get
involved during inactivation?
![Page 5: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/5.jpg)
Experimental Background and Design
http://www.vanderbilt.edu/exploration/text/index.php?action=view_section&id=1192&story_id=289&images=
![Page 6: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/6.jpg)
Fixation
Time
5 s
Fixation
Reward
Free viewing task
![Page 7: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/7.jpg)
Control Block (30 min)
Inactivation Block (30 min)
Fixation
Time
5 s
Fixation
Reward
![Page 8: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/8.jpg)
Left visual hemifieldRight visual hemifield
Behavioral biases induced by parietal inactivation
Bias for eye movementsaway from the inactivatedhemifield
1. Free viewing task2. Two-target free-choice task
Two behavioral tests:
e.g.,Lynch & McLaren 1989Karnath et al. 1998
Intraparietal Sulcus (IPS)Inactivation
![Page 9: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/9.jpg)
ControlNumber of Fixations
Left: 5 Right: 3Number of Fixations
Left: 1 Right: 10
Inactivation
Free viewing task: Example image
Scanpath of the eyes Scanpath of the eyes
![Page 10: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/10.jpg)
Basic Behavior• Observed: IPS Inactivation in the right hemisphere of the
brain -> eye movements biased away from contralateral field• Ipsilateral shift in horizontal fixations• Both in free viewing and two target free choice task
![Page 11: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/11.jpg)
![Page 12: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/12.jpg)
2D Density Heatmap - Control
X axis (dva)
Y a
xis
(dva
)
Den
sity
![Page 13: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/13.jpg)
X axis (dva)
Den
sity
Y a
xis
(dva
)
2D Density heatmap - Experimental
![Page 14: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/14.jpg)
X axis (dva)
Den
sity
(Inc
or D
ec)
Y a
xis
(dva
)
2D Density Heatmap – Exp v Control Difference
![Page 15: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/15.jpg)
![Page 16: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/16.jpg)
![Page 17: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/17.jpg)
![Page 18: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/18.jpg)
![Page 19: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/19.jpg)
Magnitude (degrees)
Dur
atio
n (m
s)
![Page 20: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/20.jpg)
Magnitude (degrees)
Pea
k Ve
loci
ty (d
egre
es /
sec)
![Page 21: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/21.jpg)
Optimization – GBVS toolboxIn order to compare fixation data to calculated visual saliency that, through optimization, will be accurate to how our vision typically identifies saliency
• Parameters optimized: • IKN - center and surround levels• GBVS – feature map resolution
• More parameters to choose from but did not optimize
![Page 22: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/22.jpg)
Optimization• Default
• p.levels = [2 3 4];• p.ittiCenterLevels = [2 3 4];• p.ittiDeltaLevels = [3 4];
• Optimized• p.levels = [2 3 5 6 7 8 9];• p.ittiCenterLevels = [2 5 6];• p.ittiDeltaLevels = [1 3];
• Optimized across random set of images across all experiments
![Page 23: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/23.jpg)
Pre-optimization
![Page 24: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/24.jpg)
Post-optimization
![Page 25: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/25.jpg)
Saliency Driven Vision• Previously observed: following inactivation, responses to
visual stimuli are reduced compared to control• Currently observed: responses to visual stimuli are about
the same in some cases
![Page 26: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/26.jpg)
Fixations in order
Average Saliency (Left) per Fixation in order of Fixations across all ExperimentsA
vera
ge S
alie
ncy
![Page 27: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/27.jpg)
Average Saliency (Right) per Fixation in order of Fixations across all Experiments
Fixations in order
Ave
rage
Sal
ienc
y
![Page 28: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/28.jpg)
Saliency Difference (Right field – Left field)
Pro
porti
on o
f Fix
atio
ns in
Rig
ht fi
eld
GBVS - % Fixations to the Right as a function of Saliency
![Page 29: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/29.jpg)
Future Direction• Run my code on future data sets
• Validate my results and look for greater significance• Improve and formalize the figures created and findings
from this data set• Separate images used in optimization from the data set• Run all tests for both GBVS and IKN
![Page 30: SURF Seminar Presentation](https://reader035.fdocuments.net/reader035/viewer/2022070521/58efab9b1a28ab7a478b4609/html5/thumbnails/30.jpg)
Acknowledgements• My mentor Dr. Xiaomo Chen• Dr. Tirin Moore, Dr. Marc Zirnsak, and all other members
of the Moore lab• Stanford University• the Caltech SFP program