A Model of Spatial Development from Parieto-Hippocampal ... · Yasuo Kuniyoshi∗,∗∗ ∗...

9
HAL Id: hal-00768929 https://hal.archives-ouvertes.fr/hal-00768929 Submitted on 26 Dec 2012 HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci- entific research documents, whether they are pub- lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés. A Model of Spatial Development from Parieto-Hippocampal Learning of Body-Place Associations Alexandre Pitti, H. Mori, Y. Yamada, Yasuo Kuniyoshi To cite this version: Alexandre Pitti, H. Mori, Y. Yamada, Yasuo Kuniyoshi. A Model of Spatial Development from Parieto-Hippocampal Learning of Body-Place Associations. 10th International Workshop on Epige- netic Robotics, 2010, Sweden. pp.89-96. hal-00768929

Transcript of A Model of Spatial Development from Parieto-Hippocampal ... · Yasuo Kuniyoshi∗,∗∗ ∗...

Page 1: A Model of Spatial Development from Parieto-Hippocampal ... · Yasuo Kuniyoshi∗,∗∗ ∗ ERATOAsadaproject,JST {alex,hiroki}@jeap.org ∗∗ ISILab.,Dept. ofMechano-Informatics,

HAL Id: hal-00768929https://hal.archives-ouvertes.fr/hal-00768929

Submitted on 26 Dec 2012

HAL is a multi-disciplinary open accessarchive for the deposit and dissemination of sci-entific research documents, whether they are pub-lished or not. The documents may come fromteaching and research institutions in France orabroad, or from public or private research centers.

L’archive ouverte pluridisciplinaire HAL, estdestinée au dépôt et à la diffusion de documentsscientifiques de niveau recherche, publiés ou non,émanant des établissements d’enseignement et derecherche français ou étrangers, des laboratoirespublics ou privés.

A Model of Spatial Development fromParieto-Hippocampal Learning of Body-Place

AssociationsAlexandre Pitti, H. Mori, Y. Yamada, Yasuo Kuniyoshi

To cite this version:Alexandre Pitti, H. Mori, Y. Yamada, Yasuo Kuniyoshi. A Model of Spatial Development fromParieto-Hippocampal Learning of Body-Place Associations. 10th International Workshop on Epige-netic Robotics, 2010, Sweden. pp.89-96. �hal-00768929�

Page 2: A Model of Spatial Development from Parieto-Hippocampal ... · Yasuo Kuniyoshi∗,∗∗ ∗ ERATOAsadaproject,JST {alex,hiroki}@jeap.org ∗∗ ISILab.,Dept. ofMechano-Informatics,

A Model of Spatial Development from Parieto-

Hippocampal Learning of Body-Place Associations

Alexandre Pitti∗ Hiroki Mori∗ Yasunori Yamada∗∗

Yasuo Kuniyoshi∗,∗∗

∗ ERATO Asada project, JST

{alex, hiroki}@jeap.org

∗∗ ISI Lab., Dept. of Mechano-Informatics,

Univ. of Tokyo, 113-8656 Tokyo, Japan

{yamada, kuniyosh}@isi.imi.i.u-tokyo.ac.jp

Abstract

Infants’ ability to orient their actions inspace improves dramatically after their sixthmonth when they start to plan the correctmotion of their hands for reaching objects.Recent developmental studies speculate thatthis enhancement of spatial memory corre-sponds to the activation of the hippocam-pal system that shapes the parieto-motor cor-tices for long-term spatial representation. Wesuggest that the mechanism of phase preces-sion, which plays an active role in the para-hippocampal cortices to transform the con-tinuous body signals into a precise temporalcode could contribute as a key component forlearning body-place associations. In a com-puter simulation of a nine-months old baby,we show how the hippocampal system trans-forms the input signals from the arm musclesinto a phase code, the parietal system usesit then to build a topological map of reach-ing locations cells combined with eyes visioncells. It follows that one body posture canbe retrieved back from estimating visually itslocation (e.g., for a reaching task).

keywords: phase precession, body-place association,peripersonal space, body image

1. Introduction

The way infants perceive the space around them (i.e.,infants’ spatial representation) relies on two differ-ent mechanisms that mature separately during thefirst year (Bremner et al., 2008). Accordingly, theearlier-developing mechanism achieves a spatial cor-respondence of default body parts and the later-developing one remaps dynamically the position ofthe limbs. Piaget theorized that this developmentalshift of spatial cognition during infancy correspondsto a stage-like transition from an egocentric repre-sentation to an allocentric one (Piaget, 1936). Inthis paper, we propose to model how such binding

between the body dynamics and the external spa-tial cues emerges during development and the neuralmechanisms it underlies.

Considering the earlier-developing mechanism, in-fants under six months of age learn to correlatethe dynamics of their own bodily motions whichpermit them in return to build up simple physicalrules and causal relationships for spatial tasks: e.g.,solid objects cannot pass through other solid ob-jects. During these perceptual experiences, infantsappear to be sensitive to the temporal extent of theirown sensory-motor activity by detecting the tempo-ral contingencies across the modalities. These tem-poral associations shape a primitive representationof the spatial body, although not-yet mature. Forinstance, Rochat explains how simple it is to con-fuse infant’s perception of its own body by addingjust small delays to the visual feedback during self-observation (Rochat, 1998).

This peculiar situation nevertheless improveswhen 6 months-old children start to acquirean allocentric representation of their peripersonalspace. During this period, infants become capa-ble to categorize space from visual cues, to re-orient their body with respect to its own mo-tion, to change viewpoints and to perform men-tal rotations (Newcombe and Huttenlocher, 2006).Some developmental studies attribute the spa-tial improvements of this period to the matu-ration of the hippocampal system and its sur-rounding cortex (Nelson et al., 2006). Indeed,the hippocampus is known to play an importantrole for processing the allocentric spatial informa-tion (O’Keefe and Burgess, 2005). Particular hip-pocampal neurons, known as place cells, have beenfound to respond to spatial locations where the an-imal is, whereas other types of hippocampal cellshave been found to respond to the eye gaze direc-tion (Rolls, 1999) or to the whole-body motion.

Interestingly, EEG’s activity investigations on in-fants aged 2-11 months revealed an increase oftheta synchrony – the natural rhythm of the hip-pocampus around 6Hz– in the parietal and pre-

Page 3: A Model of Spatial Development from Parieto-Hippocampal ... · Yasuo Kuniyoshi∗,∗∗ ∗ ERATOAsadaproject,JST {alex,hiroki}@jeap.org ∗∗ ISILab.,Dept. ofMechano-Informatics,

motor lobes during handling and reaching as wellas during sucking and gazing (Futagi et al., 1998,Del Giudice et al., 2009). These observations sug-gest (i) that the hippocampal system could playa central role during the first year for construct-ing the spatial representation of the body into thesensori-motor networks (i.e., the body image) and(ii) that its theta rhythm could be involved in in-fant’s preference for motion contingency and sensory-motor binding. The hippocampal processing ofone body’s action using the theta rhythm couldshape the parietal cortex for body-place associa-tions in the same way it shapes the hippocam-pal “place cells” for navigation purpose, by creat-ing parieto-motor “reaching cells” for manipulationtask (Graziano, 2006, Save and Poucet, 2009).

In contrast to more traditional memory systems,theta phase coding as done in the hippocampusis argued to facilitate the online memory storageof continuous signals (Hasselmo et al., 2009,Sato and Yamaguchi, 2009). When conven-tional memory models code spatio-temporalsequences with discrete states (e.g., nodes) andtransition rules between these states for goaldirected behavior (c.f., (Gaussier et al., 2002,Gabalda et al., 2007, Fuke et al., 2008,Nabeshima and Kuniyoshi, 2010)), theta phasecoding forms associations between continuous statesand continuous actions with the use of oscillations forencoding temporal intervals (Hasselmo et al., 2009);a neural mechanism particularly useful for up-dating the body posture in a continuous manner.Since motion coincidences between perceived ac-tions and motor programs are hypothesized tobe learnt through hebbian learning during self-observation (Del Giudice et al., 2009), we suggestthat this later mechanism provides the ground forcontingency detection and learning of one’s bodydynamics.

Based on these assumptions, we simulate the activ-ity of the infant’s hippocampal system to representmovements in continuous space and to learn the bodyimage into the cortical network. We perform our ex-periments on a computer simulation presenting thecommon characteristics of a 9 month-old infant withan accurate model of its musculo-skeleton system andof its spinobulbar system, see (Kinjo et al., 2008).We constrain nonetheless our study to the body sig-nals coming from the arms’ muscles spindles, thejoint angles from the shoulder-elbow-wrist systemand the eye’s vision cells. During sensory-motor ex-ploration, the specific phase relation produced be-tween the entorhinal cells – that is, the contingencymatching across signals– organizes the cortical mem-ory into a map of “reachable regions” cells via Heb-bian learning. The visual cells finish to merge theneighbouring cells from each others and to refine

����������AB

CDE�F��D��A��FE��

��F��E����E�FA��FE���

����A��E��D

����E��D�F�

B�����A�D��E

��E�FA��DEF��

C�A��

F���FF�DEA

��DD��E��D

Figure 1: Basic structure of the parieto-hippocampal

model. ECII retranscribes the amplitude’s variations of

the body signals into a temporal code and the cortical

layer learns the associated postural cells that it binds

recurrently with the visual signals via Hebbian learning.

their locations into the map.

The paper is organized as follows. In the firstsection, we describe the architecture of the cortico-hippocampal model formed by the ECII systemand the parietal network with their respective neu-ral architecture inspired by (Hasselmo et al., 2009,Sato and Yamaguchi, 2009, Izhikevich, 1999): ECIIgenerates a theta phase code of the body posture andthe recurrent links in the parietal network associatethe reach-like neurons from each other into a topo-logical map. We present then the characteristics ofour baby simulator and the input/output body sig-nals associated with it. At the body level, the spinalcords dynamics explore freely the sensory-motor con-figurations in a self-organized fashion, while at thebrain level, ECII transforms the bodily changes intoa temporal code that the parietal network learns af-terwards. Over time, the parietal system constructsa topological map from the postural cells and the vi-sual cells by linking the most congruent ones; e.g, likeduring hand-regard. We can estimate then the loca-tion of one reaching area and its associated posturalconfigurations from visual information only. We dis-cuss further the relevance of this framework to seizethe statistics of the body and its links to social skillsto discriminate self and others from a developmentaland neurophysiological perspective.

2. Neural Models

We present in this section the basic structure of theparieto-hippocampal system which transforms theinput signals (e.g., the body posture) into a temporalcode and stores it as a topological memory.

Page 4: A Model of Spatial Development from Parieto-Hippocampal ... · Yasuo Kuniyoshi∗,∗∗ ∗ ERATOAsadaproject,JST {alex,hiroki}@jeap.org ∗∗ ISILab.,Dept. ofMechano-Informatics,

��������A���

BCDEFBDE��

DE��

D��������

��E��

��BC��C���

Figure 3: Parieto-hippocampal interface for coding spatial memory. The parietal system receives the temporal codes

from the ECII layer (left), which trigger its associated “reach cells” above a certain threshold and every theta cycles

(right). The recurrent links between the reach cells reinforced via the asymmetric Hebbian learning create a map.

Figure 2: Phase coding in ECII. The speed signal s(t)

of the signal x(t) (in blue) modulates the dendrite phase

φD(t), the carrying signal, relative to the baseline phase

of soma, φS(t) (dashed lines). Their respective sum pro-

duces a firing pattern (in red), in advance or in retard

with respect to φS(t), used further for the read-out.

2.1 the ECII layer

The ECII layer is composed of individual cells thatgenerate the phase code. Each cell consists of twooscillatory neurons, the soma and the dendrite, thatrealize a phase modulation function of an externalsignal (Hasselmo et al., 2009). The frequency of thesoma fS is the baseline frequency of the cell (i.e.,the baseline theta rhythm) whereas the dendrite’sfrequency fD carriers in its phase the speed signals(t) of a particular signal x: s(t) = ∆x/∆t. Theamplitude variation of one signal, which means itsspeed, modulates the phase of the dendrite.

In our experiments, the soma has the frequencyfS = 6.42Hz and the dendrite’s frequency fD equals

to:

fD(t) = fS + s(t)B (1)

where the constant B modulates the influence ofthe external input on the intrinsic frequency fD.Under this scheme, the dendrite phase φD(t) variesalong with fD(t) and proportionally to s(t) and thebaseline phase of the soma φS increases constantlyat each time step:

{

∆φD = 2πfD(t)∆ t,∆φS = 2πfS∆ t

(2)

Using the temporal information from its two units,the cells can then efficiently represent the signalsvariations by embedding within their phase the phasedifference between the modulated frequency of thedendrite and the static frequency of the soma. Thecell function g(t) is defined as follows:

gECII(t) = ΘD[cos(φD) + cos(φS)] (3)

where Θ represents the Heaviside step function forany value above the threshold D set to 1.4. There,the cell g(t) fires everytime the dendrite and the somaare near in phase, which achieves the read out intoa discrete code. We plot in Fig. 2 the phase codingof a particular signal x(t) (in blue) computed fromits speed s(t) by the dendrite and the soma (dottedlines) in the EC layer, and the cell g(t) (in red). Thedendrite frequency follows the variations of the signalspeed and an interference pattern in the cell is pro-duced every time the dendritic phase goes near thesoma’s one. The advance or retard in phase relativeto φS retranscribes the signal’s amplitude.

2.2 the parietal layer

The architecture of the parietal system differs fromthe ECII layer by the recurrent connections it has

Page 5: A Model of Spatial Development from Parieto-Hippocampal ... · Yasuo Kuniyoshi∗,∗∗ ∗ ERATOAsadaproject,JST {alex,hiroki}@jeap.org ∗∗ ISILab.,Dept. ofMechano-Informatics,

a) b)

Figure 4: Overview of the infant model. (a) Body part name of the infant model with 198 muscles. In this paper, we

control only the left and right arms (the hand, the forearm, the upper arm and the shoulder) which are constituted

each by 37 muscles and 4 joint angles. (b) eye view and third person view of the infant model.

between its units. The network follows the principleof a self-organizing map that creates reach cells fromthe current body posture. Each ECII unit is con-nected to all the parietal cells with distinct plasticsynaptic connections and each parietal cell learns aspecific temporal code from a group of ECII unitsdifferent from the other cells, see Figs. 1 and 3. Re-inforcement learning relies on a Hebbian mechanismsensitive to the temporal delays ∆t between the neu-rons firings; that is, sensitive to their phase relations.The temporal window is characterized by the timedelay ∆t = tj − ti − ηi,j between the pre-synapticECII neuron spiking ti and the post-synaptic pari-etal neuron firing tj , where η represents the synapticconduction delay between the two neurons. The plas-ticity of the synaptic weight wi,j between the ECIIneurons i and the parietal cells j depends on the de-lay and the order of the firings ηi,j . A winner-take-allalgorithm connects the most significant parietal cellsj to the ECII cells i if the temporal firings ∆t ofall cells are circumbscribed within an interval below3ms. If no parietal cells satisfy the new body con-figuration, a novel cell is added to the network.

Two concurrent mechanisms regulate the synapticconductance (weight) between the parietal neurons,namely the long-term potentiation (LTP) that in-creases the synaptic strength between the neurons,and long-term depression (LTD) that decreases it.The LTP mechanism reinforces the synaptic links ofthe firing neurons (post-synaptic neurons) with thepreceding ones that fired earlier (pre-synaptic neu-rons) in an interval range ∆t > 0 whereas the LTDmechanism decreases those in the reverse order when∆t < 0. These two mechanisms produce a competi-tive and asymmetric learning. The synaptic weightsw evolve according to eqs. 4 and 5:

wi,j(t+ 1) = wi,j(t) + ∆w,

ηi,j(t+ 1) =ηi,j(t)+∆t

2

(4)

∆w =

{

−A−exp ( ∆t/τ

−) if ∆t < 0 (LTD)

A+ exp (−∆t/τ+) if ∆t ≥ 0 (LTP )(5)

with τ−and τ+ the parameters that bound the tem-

poral window of synaptic activation (here, the phaseangle), and A

−and A+ their strength. We choose

τ−

= τ+ = 5 and A−

= A+ = 1. The weights arecircumscribed in the interval [0, 10].

3. Baby simulator

We use an extensive model of the musculo-skeletonsystem and spinal cord system reproducing theaverage characteristics of a 7-9 months-old in-fant (Kinjo et al., 2008), see Fig. 4 a). It is com-posed of 198 muscle spindles and tendons which com-ply to external pressure or to the position control ofthe spinal cords’ central pattern generators (not pre-sented here). In our experiments, we freeze the wholebody motion except the arms to study only the pos-tural mapping of the reaching locations along thevisual signals. Each arm possesses 37 muscles con-trolled by the spindles length that can vary between acontraction mode and a release mode (position nor-malized between [0, 1]), and by the joint angles inthe shoulder (3 d.o.f.) and the elbow (1 d.o.f.). Thespindles and the joint angles provide thus the signalspeed s(t) to the ECII units (2 × 37 cells and 2 × 4cells). We set B = 1 for the spindles signals andB = 0.2 for the joints signals.

The infant simulation’s vision system treats theeye field visual information to watch its own handsmotion, see Fig.4 b). The visual information fromeach eye is reduced to a 11 × 11 pixels square fil-tered by optical flow to detect the location of motionwithin the image, see Fig. 5. The pixels coordinatesare transformed into one dimensional vector sent tothe parietal system (2× 121 cells). We set B = 0.3.

Page 6: A Model of Spatial Development from Parieto-Hippocampal ... · Yasuo Kuniyoshi∗,∗∗ ∗ ERATOAsadaproject,JST {alex,hiroki}@jeap.org ∗∗ ISILab.,Dept. ofMechano-Informatics,

4. Experiments

We propose to study how the natural motor prim-itives are learnt along their spatial locations withinthe visual field during self-exploration of the armsmotion, especially during hand-regard. The newlylearnt body-place associations will permit then to re-active one muscle configuration of the arm from theestimated visual location; e.g., for reaching.

4.1 Calibrating the body image, encoding

motor coordination

In our simulation, the physical embodiment of thecentral pattern generators in the spinal cords – theirmodelling is explained in (Kinjo et al., 2008)– self-organizes the motion behavior of the infant’s arms.Over time, the muscles are contracting their dynam-ics to certain configurations only and the most redun-dant coordinations constitute then the repertoire ofthe motor primitives.

During this random exploration in the sensory-motor space, the hands move freely toward differ-ent spatial locations, crossing from time to time theeye field, see Fig. 5. There, the visual system tracksthe motion and the location of the hand, while themotor system records the actual configuration of themuscles. Fig. 6 plots the activity of the visuo-motorsystem for a period of 3 seconds which correspondsto the evolution of the muscles activity of both arms(raster plot of the spindles’ signal amplitude) andof the left eye visual information (raster plot of theactivated pixels). One can observe from the graphthat there is not a strict one-to-one correspondencebetween the patterns in the vision field with thoseof the muscles which indicates it will be difficult tolearn some probabilistic rules based on the amplitudesignals only and that one efficient learning systemshould encode the precise signal values. The hip-pocampal system plays such a functional role and en-codes a precise snapshot of the body dynamics (i.e.,the exact angle of each joint) that can be used furtherto reconstruct one trajectory of the body posture.

The encoding is realized in two steps: the entorhi-nal cortex remaps first the body signals into a phasecode that the parietal cortex learns and combines af-ter with the other sensory signals. Fig. 7 presents thephase code of the right hand signals only produced atthe ECII level during self-motion; a close-up of thedynamics is given in Fig. 3. The relative advanceor retard in phase to the baseline theta rhythm fSretranscribes the correct length of the spindles; anadvance in phase corresponds to the contraction ofthe spindle whereas a retard in phase correspondsto its elongation. Besides, the phase differences be-tween the cells retranscribes their respective phaserelations and thus, the actual arm’s posture.

These temporal relations, which represent a pos-

Hand Regard - optical flowt1 = 1.4 sec. t3 = 1.6 sec. t5 = 1.8 sec.

Figure 5: Hand regard. Visual sequence when the left

hand moves in front of the eye field. The visual system

detects the optical flow of the hand motion and its loca-

tion in the eye field.

Figure 6: Raster plot of the arms muscles’ activity dur-

ing self-exploration in the sensory-motor space, when the

infant moves its arms displayed in the lower-part. The

graph in the upper-part reproduces the variations of the

optical flow when the hands cross the vision field of the

left eye. The correspondence problem between visual and

motor modalities can be solved if the temporal relation-

ships, the motion contingencies between body posture

and optical flow, are learnt.

tural code, can then be learnt by the parietal systemas a spatial code. During sensory-motor exploration,novel locations are explored by the hands and newpostural cells are added to the parietal map.

We display in Fig. 8 the raster plot of the parietalmap’s reach cells and the trajectory in space of theleft hand in which we superimposed the activity offour cells with different colors. Each cell fills out onespecific region in space that sometimes overlaps withother regions. The code produced can serve then toshape the overall structure of the parietal system intoa topological map where the neighbouring reach cellshave a higher probability to fire contingently thanthose from farthest reaches, see Fig. 9 a). The con-nections between pre- and post-synaptic reach cellsare reinforced with respect to their temporal orderand the weights retranscribe the spatial relations be-tween the cells. The graph in Fig. 9 b) reconstructedfrom the weight matrix models the cells’ spatial re-lation presented in Fig. 8; i.e., the yellow and green

Page 7: A Model of Spatial Development from Parieto-Hippocampal ... · Yasuo Kuniyoshi∗,∗∗ ∗ ERATOAsadaproject,JST {alex,hiroki}@jeap.org ∗∗ ISILab.,Dept. ofMechano-Informatics,

Figure 7: Raster plot of the muscles’ activity from the

body and grid cells firing in ECII. The advance in phase

or the retard in phase of the grid cells reproduce the

signal variations of the muscles spindles. The relative

spatio-temporal patterns correspond then to the specific

muscle configuration.

0 200

5

10

15

time [sec]

reac

h ce

lls [i

dx]

0 20−0.5

0

0.5

time [sec]

L ha

nd p

os X

YZ

[m]

−0.4 −0.2 00.2

0.25

0.3

0.35

0.4

0.45

0.5

Y [m]

Z [m

]

Figure 8: Raster plot of the reach cells relative to the

spatial trajectory of the left hand. The superimposed

colours indicate when the reach cells are firing in the

upperleft raster plot and to which spatial regions they

correspond to when the hand is moving around (right).

cells are far from the cyan and red cells.

4.2 Evaluating the body position from vi-

sion, reaching and retrieving visuo-

motor associations

The neural map learns the body-place associationsby detecting the contingencies between the proprio-ceptive signals. Its structure can be refined by re-estimating the body location in the visual field andby merging the redundant cells.

We plot in Fig. 10 the spatio-temporal patternsin the vision map and the respective raster plots ofthe left and right reach cells when the hands move

5 10 15

5

10

15

pre−synaptic reach cells

post

−sy

napt

ic r

each

cel

ls

0

2

4

6

8

10

a)

Cell 1

Cell 4

Cell 5

Cell 2

Cell 6

Cell 3

Cell 10

b)

Figure 9: Reach cells’ connection matrix w between pre-

and post-synaptic neurons in the parietal layer. In a),

The asymmetric Hebbian learning constructs a topologi-

cal map where the weights indicate the relative distance

between the cells. In b), sub-graph reconstructed from

the weight matrix.

in front of the eye field. Over time, the vision cellsreinforce their links with the contingent reach cells.The reach cells not-yet wired, which are close in theperipersonal space but distant in the postural space –i.e., when two postural configurations completely dif-ferent, from the same hand or from the other, reachthe same point– can then be binded from the visioninformation; see Fig. 11.

These associations can permit then to estimate thelocation of the arm and its limbs configuration fromthe visual stimuli only as it is the case during reach-ing when an object is entering inside a particularregion. We stop the learning stage and start the re-trieval task. In this mode, ECII does not receiveanymore the signals from the body and we controlthe body signals directly from the learnt synapticconnections. The visual inputs activate their asso-

Page 8: A Model of Spatial Development from Parieto-Hippocampal ... · Yasuo Kuniyoshi∗,∗∗ ∗ ERATOAsadaproject,JST {alex,hiroki}@jeap.org ∗∗ ISILab.,Dept. ofMechano-Informatics,

20 22 24 26 28 300

50100

V C

ells

20 22 24 26 28 300

1020

time [sec]reac

h C

ells

L

20 22 24 26 28 300

1020

reac

h C

ells

R

Figure 10: Specific spatio-temporal patterns in the pari-

etal system of the left-arm and the right-arm during mo-

tion in front of the eye field. The vision map can refine

the parietal organization by discriminating the reach cells

from each other or by combining them if they occupy the

same visual region.

a)5 10 15 20 25

20

40

60

80

100

pre−synaptic reach L cells

post

−sy

napt

ic v

isio

n ce

lls

Reach L −> Vision cells connections, W

0

2

4

6

8

10

b)5 10 15 20

20

40

60

80

100

pre−synaptic reach R cells

post

−sy

napt

ic v

isio

n ce

lls

Reach R −> Vision cells connections, W

0

2

4

6

8

10

Figure 11: Synaptic conduction matrices between reach

cells and visual cells. Reach cells of the left and right

arm that occupy the same visual regions are combined

with respect to others; respectively a) and b).

0 1 2 3 4 5 60

50

100

V C

ells

0 1 2 3 4 5 60

5

LR J

oint

Cel

ls

0 1 2 3 4 5 6−0.5

0

0.5

time [sec]L ha

nd p

os X

YZ

[m]

Figure 12: Activation of one selected reach cell from vi-

sual inputs at t = 3.0 sec and retrieval of the arms joint

angles and hand position.

ciated reach cells which trigger at their turn theirrespective postural configurations. The reactivationof a specific phase code is done with the equationsset below that synchronizes the phase of one specificreach cell j to the one of its pre-synaptic ECII neuroni (Izhikevich, 1999) relative to its synaptic conduc-tion delay ηi,j and synaptic strength wi,j , such thatif the cell i fires, then we have:

{

Hi,j = φiD(t)− 2πfS ηi,j − φj

D(t),

∆φjD = ∆φS + wi,jHi,j .

(6)

where Hi,j is the phase distance between the two

cells. Over time, φjD(t) synchronizes to a certain pe-

riod and the body signal xj from the joint angle canbe retrieved back then by demodulation using theformula:

xj(t) =φjD(t)− φS(t)

2πB(7)

It follows that the stimulation of the vision cellslocated in the left-side of the vision field triggers theassociated reach cells as specified by the connectionmatrix in Fig. 11 a). Slowly, the compound networkconverges to a specific phase code in few hundredsof milliseconds and the hand stabilizes to a specificconfiguration and spatial location, see Fig. 12.

5. Discussion

Adults perceive space as a seamlessly reliable modal-ity which permits them to be unaware of the com-plex neural machinery behind the manipulation ofobjects or the reaching to one location. It is howevera competence that newborns lack at birth. To suc-ceed in these spatial tasks, infants have to learn firsthow to combine various kinds of signals to intrustthe position of the body limbs and to transform thewhole-body activity into spatial coordinates.

Page 9: A Model of Spatial Development from Parieto-Hippocampal ... · Yasuo Kuniyoshi∗,∗∗ ∗ ERATOAsadaproject,JST {alex,hiroki}@jeap.org ∗∗ ISILab.,Dept. ofMechano-Informatics,

Some recent developmental studies specu-late that this enhancement of spatial mem-ory could correspond to the activation of thehippocampal system that maps a spatial rep-resentation of the environment in an allocen-tric fashion (Newcombe and Huttenlocher, 2006,Nelson et al., 2006). We suggest that the mechanismof phase precession in the para-hippocampal cellscould be essential for sensory-motor integration andthe construction of the spatial representation of thebody during the first year. The hippocampus couldshape then the parieto-motor cortices that includethe mirror neurons system (Del Giudice et al., 2009)and the visual receptive fields, which remap dynam-ically the frames of reference of the peripersonalspace: the reachable space around the body.

The ability to perceive the spatial boundaries ofoneself body parts will serve later on to self-otherdifferentiation, self-perception and to higher cogni-tive skills in general such as social interaction andimitation, which require the imitator to solve the cor-respondence problem by mapping visual informationinto into his own body space.

Acknowledgments

The authors would like to acknowledge the JST ER-ATO Asada Synergistic Intelligence project whichprovided the grant and the anonymous reviewers.

References

Bremner, A., Holmes, N., and Spence, C. (2008).Infants lost in (peripersonal) space? Trends inCognitive Sciences, 12(8):298–305.

Del Giudice, M., Manera, V., and Keysers, C.(2009). Programmed to learn? the ontogenyof mirror neurons. Dev. Sci., 12(2):350–363.

Fuke, S., Ogino, M., and Asada, M. (2008). Vipneuron model: Head-centered cross-modal rep-resentation of the peri-personal space aroundthe face. Proc. of the 7th IEEE ICDL, pages1–6.

Futagi, Y., Ishihara, T., Tsuda, K., Suzuki, Y.,and Goto, M. (1998). Theta rhythms associ-ated with sucking, crying, gazing and handlingin infants. Electroenc. and Clin. Neurophysio.,106:392–399.

Gabalda, B., Rigoux, L., and Sigaud, O. (2007).Learning postures through sensorimotor train-ing: a human simulation case study. EpigeneticRobotics, pages 1–8.

Gaussier, P., Revel, A., Banquet, J., and Babeau,V. (2002). From view cells and place cells to

cognitive map learning: processing stages of thehippocampal system. Bio. Cyb., 86:15–28.

Graziano, M. (2006). The organization of behav-ioral repertoire in motor cortex. Annu. Rev.Neurosci., 29:105–134.

Hasselmo, M., Brandon, M., Yoshida, M., Giocomo,L., Heys, J., Fransen, E., Newman, E., and Zilli,E. (2009). A phase code for memory could arisefrom circuit mechanisms in entorhinal cortex.Neural Networks, 22:1129–1138.

Izhikevich, E. (1999). Weakly pulse-coupled oscil-lators, fm interactions, synchronization, and os-cillatory associative memory. IEEE Transactionon Neural Networks, 10(3):508–526.

Kinjo, K., Nabeshima, C., Sangawa, S., and Ku-niyoshi, Y. (2008). A neural model for explo-ration and learning of embodied movement pat-terns. J. of Rob. and Mecha., 20(3):358–366.

Nabeshima, C. and Kuniyoshi, Y. (2010). A methodfor sustaining consistent sensory-motor coordi-nation under body property changes includingtool grasp/release. Advanced Robotics, 12(5–6):687–717.

Nelson, C., Moulson, M., and Richmond, J. (2006).How does neuroscience inform the study of cog-nitive development? Hum. Dev., 49:260–272.

Newcombe, N. and Huttenlocher, J. (2006). Devel-opment of spatial cognition. Handbook of ChildPsychology, 5(2):734–776.

O’Keefe, J. and Burgess, N. (2005). Dual phase andrate coding in hippocampal place cells: Theoret-ical significance and relationship to entorhinalgrid cells. Hippocampus, 15:853–866.

Piaget, J. (1936). La naissance de l’intelligence chezl’enfant. Delachaux et Niestle.

Rochat, P. (1998). Self-perception and action ininfancy. Exp. Brain Res., 123:102–109.

Rolls, E. (1999). Spatial view cells and the repre-sentation of place in the primate hippocampus.Hippocampus, 9:467–480.

Sato, N. and Yamaguchi, Y. (2009). Spatial-areaselective retrieval of multiple object-place asso-ciations in a hierarchical cognitive map formedby theta phase coding. Cogn. Neurodyn., 3:131–140.

Save, E. and Poucet, B. (2009). Role of the parietalcortex in long-term representation of spatial in-formation in the rat. Neurobiology of Learningand Memory, 91(2):172–178.