Theeverydaydistributionofinfantvisualecology

SwapnaaJayaraman

IndianaUniversity,Bloomington

Ifyouweretoteachsomeone

whatacupis,

howwouldyoudoit?

1

Allthecupsintheworld?

2

Broad,representativesample?

Or,afewgoodexamples?

Whatkindofdistributiondowelearnfrom?

Theeverydaydistributionofinfantvisualecology

Thedistributionofthethingsintheinfant’secologyistheinformationonwhichvisualobjectrecognitionisbuilt.

Maytellussomethingfundamental abouthowtobuildalearningsystemfromscratch

3

Howcanwedescribethisvisualecology?

4

Hibaby!

Wantmilk?

It’saduck

5

Hibaby!

Wantmilk?

It’saduck

WhatistheVISUALavailabilityofobjectsineverydaylife? 6

1.Faces

Theveryfirstobjectsbabieslearn

Conveyinformationabouttheemotionalandattentional statesofsocialpartners

7

Visualobjectsthatbabieslearnveryearly

2.Basiclevelcategories*

Babiesstarttolearnandreliablyidentifyotherobjectsastheygrow

Visualobjectsthatbabieslearnveryearly

8*Thecategoriesnamedbyearlylearnednouns

Whataretheirvisualproperties?

Howcanwemeasuretheseproperties?

9

Study1*&Study2*:FacesandhandsVideorecordingsfrominfant’sperspective

Study3:EverydayObjectsPhotographsofobjectsininfantenvironments

Samplingfromnaturalvisualenvironments

10

*Developmentalstudies

11

Structureofvisualworldforeveryone

Hugeadvancementsinstudyingadultvisualecology

Whydoweneedtostudyitdevelopmentally?

Whynot?

Pullstostand

Prone

Prone,chestup

Rollsover

Sitsup

Walksalone

Standsalone

Stands (withsupport)

012345678910111213141516

Age(inmonths)

Cruises

Crawls

AdaptedfromAdolph,Karasik,&Tamis-LeMonda,2010 12

Thedevelopmentalperspective

13

012345678910111213141516

Thereisnotoneecology;thereisachangingvisualecologywithdevelopment

Study1&2:Facesandhands

• Whatisinfrontofbaby’shead

• 75infants• 0-2years• 342hoursofvideo• 31millionframes• 150,000framescoded

14

“Doyouseeafaceorafacepartinthisimage?”Humancoderswereaskedtojudgeeachimage:

Codingandanalysis

“Doyouseeahandinthisimage?”Andseparately:

15

Study1:Facesinearlyvisualenvironments

16Jayaraman,Fausey&Smith(2015)PLOSONE

Facetime:15minutes/hour

Facetime:5minutes/hour

R2 =.42,F(1,20)=16.11.p<.001

Earlyvisualexperiencesdensewithfaceinformation

17

18

Identitiesoffaces(whoseface)

Distanceoffacefrominfant

Theviewofface(frontal,profile)

Wealsocoded

2ft

4ft

Identities: the 3 most frequent people accounted foralmost all the faces for the very young infants

R2 =.14,F(1,20)=4.516.p<.05.R2 =.16,F(1,20)=5.24.p<.05.R2 =.23,F(1,20)=7.413.p<.0519

Distance:Forveryyounginfantsmostfacesareclosetothem(within2feet)

20R2 =.37,F(1,20)=13.61,p<.05

Consistentwiththeirvisualabilities

Views:Foreverybody,mostfacespresentfrontalviews

21

22

Matterstounderstandingvisualobjectrecognitionanddevelopment

1.Theecologychanges(notdevelopmentallystationarysamplingoftheworld)

2.Prototypicalfacesdenselypopulatethevisualworldofyounginfants:Close,frontalviews,ofveryfewpeople,andlotsoffacetime

Thisistheinformationonwhichtheearliestvisualdevelopment feeds

3.Variationaroundthisprototypeexpands– incrementally– overthefirstyear

Ecologyoffacesinearlyenvironments

23

Study2:Handsinearlyvisualenvironments

Lotsoffacesearly,butit’snotjustaboutpeoplenearbyProp

.OfVisualCorpu

s

Ageinmonths Ageinmonths

Orderlyshiftfromfacestohands(fromsocialtoinstrumental?)

OfHands,OwnHand

Acrossallages,ofallhands:

76%weretouchinganobject

48%wereholdinganobject

Developmentalshiftfromfacestomanualactionsonobjects

Study3:Everydayobjects

26

Earlyfacespresentadistributioninwhichafewindividualsdominate

Doobjectspresentamoreuniformdistribution?

27

Just8categoriesNoheadcameraParenttookphotowhensomeonesaid oneofthe8words

Whereisher

cup?

12mo,n=10 28

Earlyevidencefromapilotstudy

Objectcategories

Howmanydistinctinstancesinaweek?

Cup DuckHat CarChair AirplaneDog Donkey

TheeverydaydistributionHowmanytokensofeachcategory?

Category

Med

ianFreq

uency

acrossallchildren

airplane car chair cup hat duck dog

2520

1510

50

20dogsinaweek

5cupsinaweek

Ofthesampleddistribution,whatproportionisthemostfrequenttoken?

airplane car chair cup hat duck dog

Prop

ortio

nmostfrequ

enttoken

0.8

0.6

0.4

0.2

01

Category 31

20dogsinaweekmostlyabout1dog5cupsinaweek

mostlyabout1cup

Objects:theeverydaydistribution

Notuniquetofaces!

32

Faces Objects

Commonthemeforvisualstatisticsofobjectsinnaturalenvironments:Zipfian distribution

Thesamewithnaturallanguagecorpuses,andotherdatafromphysicalandsocialsciences33

34

1. Thecontentsandpropertieschangewithdevelopment,insystematicways.Thoughnotshownyet,theyarelikelytoinfluencevisualdevelopment.

2. Facespresentprototypicaldenseviewsearlyininfancy:close,bigintheview,ofaveryfewpeople,andshowfrontalviewswithbotheyes.Thesepropertiesmaybecriticaltobuildingspecializedfaceprocessing.

3. Hands areubiquitousandincontactwithobjectsandcometodominateearlyinthesecondyear.Handsdirectvisualattentionandconveycausalinformationtobabies.Theseearlyhandsonobjectsarethedataonwhichthatknowledgeislikelybuilt.

4. FacesarenotspecialintheirZipfian distribution.Earlyobjectexperiencesalsostartwithdistributionsinwhichaveryfewindividualinstancesdominate.Earlyvisualdevelopmentisbuiltonthiseverydaydistribution.

Infantvisualecology– whathavewelearned?

35

Thereismuchmoretodo

Universalityofinfantenvironments

3636

37

Lowlevelvisualenvironments

38

Opticflow

39Gilmore,Raudies&Jayaraman,2015

40

Timesamplingstudy

Headcamerastudy

Thankyou!

CaitlinFauseyUOregon

CharWozniakIndianaU

ArielLaUWisconsin

Researchassistants BradenKing,JosephImbrock,Shruthee Rajendran,StephanieKrupa,MeganGibbons,RemySnead,EdwardRach,Minyi Zheng,ConnorCourtney,OliviaHaas,AlexisJones,andAfiah Hasnie

Fundingsources NICHHD28675,NIHNRSAHD007475- 18,NIHR21HD068475

Participants

44

Technicians

LindaSmithIndianaU

Collaborators

RickGilmorePennState

FlorianRaudiesHPLabs

Extraslides

45

46

Facetime

Freq

uentfaces

47

Displayingbotheyes

Close-up

faces

Ingavaa!

Ajay,paathu.

Illa ma…

Pandu

Meen aaruruba kilo

Earlymultimodalenvironments

Ball

Bringmetheball

48

Arrivalratesoffaces

Consideringinfantsineachagegroupasonesuper-baby

<3mo

3-6mo

7-10mo

11-14mo

2yr

Cumulativefaceexposure

49

2ft

4ft

Measuring distance of face from infant

50

Dad(oneoftop3identities)6feetawayDoesn’tdisplaybotheyes

Dad(oneoftop3identities)1.5feetawayDisplaysbotheyes

Clusterscore=1 Clusterscore=3

Three signature propertiesBelongtoafewindividualsAppearclosetotheinfantDisplaybotheyes

51

Proportion of faces with high (2 or 3) scores

R2 =.54,F(1,20)=23.28.p<.00152

Cum

ulat

ive

wak

ing

hour

s

Cumulative waking hours and face hours

53