Announcements Psych 156A/ Ling 150: Acquisition of...

Psych156A/Ling150:AcquisitionofLanguageII

Lecture16StructureI

Announcements

HW3isduebytheendofclasstoday

Reviewquestionsareavailableforstructure

Onlinecourseevaluationsareavailableforthisclass-pleasefillthemout!:)

SubjectVerbObjectJarethjugglescrystals

ComputationalProblem: Figureouttheorderofwords(syntax)

DependsongrammaticalcategorieslikeNounsandVerbs(andtheirassociatedphrases(NP)),butalsoonmoreprecisedistinctionslikeSubjectsandObjects.

NounVerbNounNPNP

SomeNounPhrasedistinctions:Subject=usuallytheagent/actoroftheaction,“doer”:JarethObject=usuallytherecipientoftheaction,“doneto”:crystals

Importantidea:Theobservablewordorderspeakersproduce(likeSubjectObjectVerb)istheresultofasystemofwordorderrulesthatspeakersunconsciouslyusewhentheyspeak.Thissystemofwordorderrulesiscalledsyntax.

OnewaytogenerateSubjectVerbObjectorder:Thelinguisticsystemspecifiesthatorderasthegeneralpatternofthelanguage.AnexampleofthiskindofsystemisEnglish.

SubjectVerbObjectEnglish

AnotherwaytogenerateSubjectVerbObjectorder:ThelinguisticsystemspecifiesSubjectObjectVerbasthegeneralpattern,buttheVerbinmainclausesmovestothesecondpositionandsomeotherphrase(liketheSubject)movestothefirstposition.AnexamplelanguagelikethisisGerman.

German SubjectObjectVerb

____ VerbSubjectObjectVerb

movementrules

German

SubjectVerbSubjectObjectVerb

movementrules

German

AthirdwaytogenerateSubjectVerbObjectorder:ThelinguisticsystemspecifiesSubjectObjectVerbasthegeneralpattern,buttheObjectmovesaftertheVerbincertaincontexts(theObjectisunexpectedinformation).Kannadaisalanguagelikethis.

Kannada SubjectObjectVerb

Kannada SubjectObjectVerbObject

movementrule

AthirdwaytogenerateSubjectVerbObjectorder:ThelinguisticsystemspecifiesSubjectObjectVerbasthegeneralpattern,buttheObjectmovesaftertheVerbincertaincontexts(theObjectisunexpectedinformation).Kannadaisalanguagelikethis.

SubjectVerbObject SubjectVerbSubjectObjectVerb

EnglishGerman

Kannada

SubjectObjectVerbObject

Thelearningproblem:Howdochildrenknowwhichsystemtheirlanguageuses?

Thisisahardquestion!

Childrenonlyseetheoutputofthesystem(theobservablewordorderofSubjectVerbObject).

SubjectVerbObject SubjectVerbSubjectObjectVerb

EnglishGerman

Kannada

SubjectObjectVerbObject

Syntax:Onereasonwhytranslationissohard

Translationisnotsoeasy: morethanjustword-by-word

http://www.nbc.com/nbc/The_Tonight_Show_with_Jay_Leno/headlines/

Hebrew

Literally:Throughdangersimmenseanddifficultiesnotnumbered,there-isto-mefightingthroughmyherecastletransitioncitygoblintakebackyouchildthere-wasto-youstolen.

translate.google.com

HaitianCreole

Literally:Throughdangercountlessanddifficultiescountless,IwasfighthowmeheretheymansionthemorefarthancitiestheGoblintheytakebackchildrenofthatyouwasthiefit.

Literally:Untoldanduncountabledifficultiesthreatsmediumthrough,Iyoustoleisthatchildrenbacktaketheghostcitybeyondpalacethehereyourmethodsfromfightfought.

Abouthumanknowledge:Language&variation

NavajoCodeTalkers

http://en.wikipedia.org/wiki/Code_talker#Use_of_Navajo

“…JohnstonsawNavajoasansweringthemilitaryrequirementforanundecipherablecode.NavajowasspokenonlyontheNavajolandsoftheAmericanSouthwest,anditssyntaxandtonalqualities,nottomentiondialects,madeitunintelligibletoanyonewithoutextensiveexposureandtraining.OneestimateindicatesthatattheoutbreakofWorldWarIIfewerthan30non-Navajoscouldunderstandthelanguage….”

https://www.youtube.com/watch?v=5rSvm3m8ZUA(~3minvideo)

CrucialcryptographicmethodusedinWorldWarII

NavajoCodeTalkerParadox(Baker2001)

EnglishmustbeverydifferentfromNavajoJapanesecoulddecodeEnglish,butcouldn’tdecodeNavajowhentheydidn’tknowitwasNavajo.

EnglishmustbesimilartoNavajoEnglishcanbetranslatedintoNavajoandbackwithnolossofmeaning.(Languagesarenotjustaproductoftheculture-pastoralArizonalifestylecouldn’thavepreparedthecodetalkersforPacificIslandhightechwarfare.Yet,translationwasstillpossible.)

Morphology(wordforms)English:invariantwordforms “thegirliscrying”,“Iamcrying”

Navajo:noinvariantforms(theremaybe100-200prefixesforverbstems)

At’éédyicha.“Girlcrying”

Yishcha.“Iamcrying”(yi+sh+cha)

Ninááhwiishdlaad.“Iamagainplowing”(ni+náá+ho+hi+sh+l+dlaad)

Typesofvariation

Wordorder(syntax)English:SubjectVerbObject(invariantwordorder) “Theboysawthegirl”

Navajo:SubjectObjectVerb,ObjectSubjectVerb(varyingwordorders,meaningdependsonlyonverb’sform)

Ashkiiat’éédyiyiiltsáboygirlsaw“Theboysawthegirl”

Ashkiiat’éédbiilstáboygirlsaw“Thegirlsawtheboy”

Typesofvariation

wals.info:TheWorldAtlasofLanguageStructures

Typesofvariation

Let’slookatsyntax…

Jacklaughs.

LaughsJack.ThistellsusthatmostlanguageshavetheSubjectcomebeforetheVerb…butnotalldo.

Typesofvariation

HowarethedifferentSubjectandVerbordersdistributedaroundtheworld?

Typesofvariation

WhatvaluedoesEnglishhave?

WhataboutFijian?

WhataboutSpanish?

Typesofvariation

Thinkingaboutsyntacticvariation

Similarities&differences:Parameters

Chomsky:Differentcombinationsofdifferentbasicelements(parameters)wouldyieldtheobservablelanguages(similartothewaydifferentcombinationsofdifferentbasicelementsinchemistryyieldmanydifferent-seemingsubstances).

BigIdea:Arelativelysmallnumberofsyntaxparametersyieldsalargenumberofdifferentlanguages’syntacticsystems.

5differentparametersofvariation

2differentparametervaluesofoneparameter

Totallanguagesthatcanberepresented=2*2*2*2*2=25=32

English

French

Japanese

Navajo

Tagalog

Learninglanguagestructure

Chomsky:Childrenarebornknowingtheparametersofvariation.ThisispartofUniversalGrammar.Inputfromthenativelinguisticenvironmentdetermineswhatvaluestheseparametersshouldhave.

English

Japanese

Navajo

Generalizationsaboutlanguagestructure

Greenberg’swordordergeneralizations

Navajo Japanese Navajo Japanese

Basicwordorder:SubjectObjectVerb

Ashkiiat’éédyiyiiltsáboygirlsaw

“Theboysawthegirl”

Jareth-gaHoggle-obuttaJarethHogglehit

“JarethhitHoggle”

Navajo Japanese

Postpositions:NounPhrasePostposition

‘éé’biihnáásdzáclothingintoI-got-back“Igotbackinto(my)clothes.”

Jareth-gaSarahtokurumadaJarethSarahwithcarby

LondonniittaLondontowent

“JarethwenttoLondonwithSarahbycar.”

Navajo Japanese

PossessorbeforePossessed

PossessorPossession

Chidíbi-jáádCarits-leg

“thecar’swheel”

PossessorbeforePossessed

PossessorPossession

Toby-noimooto-gaToby’ssister

“Toby’ssister”

Navajo Japanese

PossessorbeforePossessedPossessorPossession

Despitethedifferencesinthelanguages(andtheirculturalhistories),bothJapaneseandNavajoareverysimilarwhenviewedthroughthesethreestructuraldescriptions.

English Edo(Nigeria)

Basicwordorder:SubjectVerbObject

SarahfoundToby

ÒzómiénAdésuwá OzofoundAdesuwa

Prepositions:PrepositionNounPhrase

JarethgavethecrystaltoSarah

ÒzórhiénénéebénéAdésuwáOzogavethebooktoAdesuwa

PossessedbeforePossessor

PossessionPossessor

questofSarah

(alternative:Sarah’squest)

PossessedbeforePossessor

PossessionPossessor

OmoOzóchildOzo

“childofOzo”

PossessedbeforePossessorPossessionPossessor

Again,despitethedifferencesinthelanguages(andtheirculturalhistories),bothEnglishandEdoareverysimilarwhenviewedthroughthesethreestructuraldescriptions.

Greenbergfoundforty-five“universals”oflanguages-patternsoverwhelminglyfollowedbylanguageswithunsharedhistory(Navajo&Japanese,English&Edo)

Notallcombinationsarepossible-somepatternsrarelyappearEx:SubjectVerbObjectlanguage(English/Edo-like)+postpositions(Navajo/Japanese-like)

Moral:Languagesmaybemoresimilarthantheyfirstappear“onthesurface”,especiallyifweconsidertheirstructuralproperties.

Greenberg’swordordergeneralizations Onepotentialparameter

English Italian

SubjectVerb

“Jarethwillcome.”

SubjectVerbJarethverráJarethwill-come

“Jarethwillcome.”

grammatical grammatical

English Italian

VerbSubjectVerráJarethWill-arriveJareth

“Jarethwillarrive”

*VerbSubject

*WillarriveJareth

ungrammatical grammatical

Onepotentialparameter

English Italian

Willcome

VerbVerráHe-will-come

“Hewillcome”

ungrammatical grammatical

English Italian

SubjectVerb SubjectVerb

VerbSubjectVerb

Thesewordorderpatternsmightbefairlyeasytonotice.TheyinvolvethecombinationsofSubjectandVerbthataregrammaticalinthelanguage.Achildmightbeabletonoticetheprevalenceofsomepatternsandtheabsenceofothers.

*VerbSubject*Verb

English Italian

Expletivesubjects:wordswithoutcontent(maybemoredifficulttonotice)

Raining.

“It’sraining.”

Piove.It-rains.

“It’sraining.”

Notokaytoleaveoutexpletivesubject“it”.

Okaytoleaveoutexpletivesubject“it”.

English Italian

That-traceeffectforsubjectquestions

Whodoyouthink(*that)willcome?

Requiresno“that”inembeddedclause,despiteallowing“that”indeclarativesandobjectquestions

Ithink(that)HogglewillsaveSarah.Whodidyouthink(that)Hogglewouldsave?

CredicheJarethverrá.YouthinkthatJarethwill-come.“YouthinkthatJarethwillcome.”

Checrediche__verrá?Whothink-youthatwill-come?“Whodoyouthinkwillcome?”

Allows“that”intheembeddedclauseofasubjectquestion(anddeclarativeclauses).

Italian

OnepotentialparameterThat-traceeffectforsubjectquestions

English

English Italian

Notokaytoleaveoutexpletivesubject“it”.

Okaytoleaveoutexpletivesubject“it”.

Doesnotrequirespecialactionforembeddedsubjectquestions.

Requiresspecialactionforembeddedsubjectquestions.

SubjectVerb SubjectVerb

VerbSubject*VerbSubject

*Verb Verb

Alltheseinvolvethesubjectinsomeway-coincidence?Idea:No!There’salanguageparameterinvolvingthesubject.

Onepotentialparameter TheValueofParameters:Learningthehardstuffbynoticingtheeasypatterns

Englishvs.Italian:SubjectParameter

English ItalianSubjectVerb SubjectVerb

VerbSubject*VerbSubject

*Verb Verb

EmbeddedSubject-questionformation(easytomiss)

Whodoyouthink(*that)willcome? Checrediche__verrá?Whothink-youthatwill-come?

ExpletivesItrains

Piove.It-rains.

Hardtonotice

Easiertonotice

Englishvs.Italian:SubjectParameter

Bigidea:Ifallthesestructuralpatternsaregeneratedfromthesamelinguisticparameter(e.g.a“subject”parameter),thenchildrencanlearnthehard-to-noticepatterns(likethepatternsofembeddedsubjectquestions)bybeingexposedtotheeasy-to-noticepatterns(liketheoptionaluseofsubjectswithverbs).Thehard-to-noticepatternsaregeneratedbyonesettingoftheparameter,whichchildrencanlearnfromtheeasy-to-noticepatterns.

Children’sknowledgeoflanguagestructurevariationisbelievedbylinguisticnativiststobepartofUniversalGrammar,whichchildrenarebornwith.

TheValueofParameters:Learningthehardstuffbynoticingtheeasypatterns Anotherpossibleparameter

Syntax:theHeadDirectionalityparameter(Baker2001,Cook&Newson1996):headsofphrases(ex:NounsofNounPhrases,VerbsofVerbPhrases,PrepositionsofPrepositionPhrases)areconsistentlyineithertheleftmostorrightmostposition

Japanese/Navajo:Head-Last

VerbPhrase:ObjectVerb

NPObject

Ppostposition

Anotherpossibleparameter

Syntax:theHeadDirectionalityparameter(Baker2001,Cook&Newson1996):headsofphrases(ex:NounsofNounPhrases,VerbsofVerbPhrases,PrepositionsofPrepositionPhrases)areconsistentlyineithertheleftmostorrightmostposition

NPObject

PObjectNP

Preposition

Edo/English:Head-First

VerbPhrase:VerbObject

UniversalGrammar:Parameters

SNP VP

NPObject

Subject Verb

PObjectNP

preposition

Edo/English

SNP VP

NPObject

Subject Verb

NPObject

Ppostposition

Japanese/Navajo

Atthislevelofstructuralanalysis(parameters),languagesdiffervaryminimallyfromeachother.Thismakeslanguagestructuremucheasierforchildrentolearn.Alltheyneedtodoissettherightparametervaluesfortheirlanguage,basedonthedatathatareeasytoobserve.

Butwhatarelinguisticparametersreally?Howdotheywork?Whatexactlyaretheysupposedtodo?

Parameters

Aparameterismeanttobesomethingthatcanaccountformultipleobservationsinsomedomain.

Parameterforastatisticalmodel:determineswhatthemodelpredictswillbeobservedintheworldinavarietyofsituations

Parameterforourmental(andlinguistic)model:determineswhatwepredictwillbeobservedintheworldinavarietyofsituations

Statisticalparameters

Thenormaldistributionisastatisticalmodelthatusestwoparameters:

-µ forthemean -σ forthestandarddeviation

Ifweknowthevaluesoftheseparameters,wecanmakepredictionsaboutthelikelihoodofdatawerarelyorneversee.

Supposethisisamodelofhowmanyminuteslateyou’llbetoclass.

Let’susethemodelwithµ =0,andσ2=0.2.(blueline)

Supposethisisamodelofhowmanyminuteslateyou’llbetoclass.

Let’susethemodelwithµ =0,andσ2=0.2.(blueline)

Howlikelyareyoutobe5minuteslate,giventheseparameters?

Notverylikely!Wecantellthisjustbyknowingthevaluesofthetwostatisticalparameters.Theseparametervaluesallowustoinfertheprobabilityofsomeobservedbehavior.

StatisticalparametersObservingdifferentquantitiesof

datawithparticularvaluescantelluswhichvaluesofμandσ2aremostlikely,ifweknowwearelookingtodeterminethevaluesofμandσ2infunctionφ(X)

Observingdatapointsdistributedlikethegreencurvetellsusthatμislikelytobearound-2,forexample.

Statisticalvs.LinguisticparametersImportantsimilarity: Wedonotseetheprocessthat

generatesthedata,butonlythedatathemselves.ThismeansthatinordertoformourexpectationsaboutX,weare,ineffect,reverseengineeringtheobservabledata.

Ourknowledgeoftheunderlyingfunction/principlethatgeneratesthesedata-φ(X)-aswellastheassociatedparameters-μ,andσ2-allowsustorepresentaninfinitenumberofexpectationsaboutthebehaviorofvariableX.

Linguisticprinciplesvs.linguisticparameters

Bothprinciplesandparametersareoftenthoughtofasinnatedomain-specificabstractionsthatconnecttomanystructuralpropertiesaboutlanguage.

Linguisticprinciplescorrespondtothepropertiesthatareinvariantacrossallhumanlanguages.Comparison:theequation’sform–itisthestatistical“principle”thatexplainstheobserveddata.

Bothprinciplesandparametersareoftenthoughtofasinnatedomain-specificabstractionsthatconnecttomanystructuralpropertiesaboutlanguage.

Linguisticparameterscorrespondtothepropertiesthatvaryacrosshumanlanguages.Comparison:μandσ2determinetheexactformofthecurvethatrepresentsthelikelihoodofobservingcertaindata.Whiledifferentvaluesfortheseparameterscanproducemanydifferentcurves,thesecurvessharetheirunderlyingformduetothecommoninvariantfunction.

Linguisticprinciplesvs.linguisticparameters Theutilityofconnectingtomultipleproperties

Thefactthatparametersconnecttomultiplestructuralpropertiesthenbecomesaverygoodthingfromtheperspectiveofsomeonetryingtoacquirelanguage.Thisisbecauseachildcanlearnaboutthatparameter’svaluebyobservingmanydifferentkindsofexamplesinthelanguage.

“Thericherthedeductivestructureassociatedwithaparticularparameter,thegreatertherangeofpotential‘triggering’datawhichwillbeavailabletothechildforthe‘fixing’oftheparticularparameter”–Hyams(1987)

Theutilityofconnectingtomultipleproperties

Parameterscanbeespeciallyusefulwhenachildistryingtolearnthethingsaboutlanguagestructurethatareotherwisehardtolearn,perhapsbecausetheyareverycomplexpropertiesthemselvesorbecausetheyappearveryinfrequentlyintheavailabledata.

Whyhard-to-learnstructuresareeasier

Let’sassumeanumberofpropertiesareallconnectedtoparameterP,whichcantakeoneoftwovalues:aorb.

P1P2P3

P aorb?

HowdowelearnwhetherP4showsbehavioraorb?OnewayistoobservemanyinstancesofP4.

P1P2P3

P aorb?

aaaaaaaaaa…

ButwhatifP4occursveryrarely?WemightneverseeanyexamplesofP4.

P1P2P3

P aorb?

Fortunately,ifP4isconnectedtoP,wecanlearnthevalueforP4bylearningthevalueofP.Alsofortunately,PisconnectedtoP1,P2,P3,andP5.

P1P2P3

P aorb?

Whyhard-to-learnstructuresareeasierStep1:ObserveP1,P2,P3,orP5.Inthiscase,alltheobserved

examplesofthesestructuresarebehaviora.

P1P2P3

P aorb?

aaaaaaaaaaaaaa…

Step2:UsethisknowledgetosetthevalueofparameterPtoa.

P1P2P3

aaaaaaaaaaaaaa…

Whyhard-to-learnstructuresareeasierStep3:SinceparameterPisconnectedtoP4,wecanpredictthatP4will

alsoshowbehaviora-eventhoughwe’veneverseenanyexamplesofit!(WecanalsoinferP3andP5thesameway.)

P1P2P3

aaaaaaaaaaaaaa…

Whyacquisitioniseasier

Thishighlightsanotherbenefitofparameters-wedon’thavetolearnthebehaviorofeachstructureindividually.Instead,wecanobservesomestructures(ex:P1andP2)andinfertherightbehaviorfortheremainingstructures(P3,P4,andP5).

Thatis,insteadofhavingtomake5decisions(oneforP1,P2,P3,P4,andP5),weactuallyonlyneedtomakeonedecision-isPaorb?

P1P2P3

aaaaaaaaaaaaaa…aa

HierarchicalBayesianlearninglinks:Overhypotheses

OverhypothesesinhierarchicalBayesianlearningaregeneralizationsmadeatamoreabstractlevel,whichcovermanydifferentdatatypes.

Inthisway,theyaresimilarinspirittolinguisticparameters.

Overhypothesisexample

Supposeyouareobservingthecontentsofmarblebags.

Thefirstbagyoulookathas20blackmarbles.

Thesecondbagyoulookathas20whitemarbles.

Thethirdandfourthbagsyoulookathave20blackmarbles.

20 20 20 20

Yougetafifthbagandpulloutasinglemarble.It’swhite.Whatdoyoupredictaboutthecolordistributionoftherestofthemarblesinthebag?

20 20 20 20

Mostadultspredictthisbagwillcontain19otherwhitemarbles,foratotalof20whitemarbles.

20 20 20 20

Whatifyouthengetasixthbagandpulloutasinglepurplemarblefromit?

20 20 20 20

Mostadultswouldpredictthattheother19marblesinthatbagarepurpletoo,for20purplemarblestotal.

20 20 20 20

1 20201

Whydoesthishappen?Itseemslikeyou’relearningsomethingaboutthecolordistributioningeneral(notjustforaparticularbag):allmarblesinabaghavethesamecolor.Thisallowsyoutomakepredictionswhenyou’veonlyseenasinglemarbleofwhatevercolorfromabag.

20 20 20 20

1 20201

20 20 20 20

1 20201observed

20 20 20 20

1 20201allblack allwhite allblack allblack

allthesamecoloroverhypothesis

20 20 20 20

1 20201allblack allwhite allblack allblack

allthesamecolor makepredictionsoverhypothesis

Linguisticoverhypothesisexample

Supposeyouareobservingthewordorderofsentencesyouhear.

ThefirstsentenceyouhearhastheVerbbeforetheObject(“Seethepenguin?”)

VerbObject

ThesecondsentenceyouhearhasthePrepositionbeforetheObject(“Ilikethepenguinontheiceberg”)andalsotheVerbbeforetheObject(“Ilikethepenguinontheiceberg”).

VerbObject PrepositionObjectVerbObject

Thesedatatellyouaboutwordorderforverbsandobjectsandalsoaboutwordorderforprepositionsandtheirobjects.

VerbObject PrepositionObjectVerbObject

observed

Inaddition,theyarerelatedviatheheaddirectionalityparameter,whichfunctionsasanoverhypothesis.

VerbObject PrepositionObject

headfirst headfirst

Headdirectionality=headfirst

VerbObject

Knowingthevalueofthisparameterallowsyoutopredictotherwordorderpropertiesofthelanguage.

PossessionPossessor

makepredictions

VerbObject PrepositionObject

headfirst headfirst

Headdirectionality=headfirst

VerbObject

Learningoverhypotheses

Bayesianlearnercomputationalmodelsareabletolearnoverhypotheses,providedtheyknowwhattheparametersareandtherangeofvaluesthoseparameterscantake(ex:Kemp,Perfors,&Tenenbaum2006).

Whataboutreallearners?

Learningoverhypotheses:Dewar&Xu(2010)

9-month-olds

Question: Whenprovidedwithpartialevidenceaboutafew

objectsinafewcategories,caninfantsformamoreabstractgeneralization(anoverhypothesis)thatthenappliestoanewcategory?

9-month-olds

Trainingtrials: Observefourdifferentobjects

pulledoutbyexperimenterwhohadhereyesclosed-theobjectsaredifferentcolorsbutalwayshavethesameshape.

9-month-olds

Experimentaltrials: Expectedoutcome(assuming

infantshadtheoverhypothesisthatalltheobjectsfromasingleboxshouldbethesameshape)=

Experimenterpullsouttwoobjectswiththesamenewshape.

Infantsshouldnotbesurprised.

9-month-olds

Experimentaltrials: Unexpectedoutcome(assuming

Experimenterpullsouttwoobjectswithdifferentshapes,onewhichisnewandonewhichisold.

Infantsshouldbesurprised.

9-month-olds

Controltrials: Expectedoutcome(assuming

Experimenterpullsouttwoobjectswiththesamenewshape.

Infantsshouldnotbesurprised.

9-month-olds

Controltrials: Unexpectedoutcomecontrol= Experimenterpullsouttwo

objects,onewithanewshapethatcamefromthenewboxandonewithanoldshapethatcamefromanoldboxthatcontainedthatshape.

Infantsshouldnotbesurprisedthisoutcomeiscompatiblewiththeoverhypothesis.(Theoverhypothesisisactuallyirrelevanthere.)

9-month-olds

Results: Infantsintheexperimental

conditionlookedlongerattheunexpectedoutcome(~14.28s)whencomparedtotheexpectedoutcome(~11.32s).

Theyweresurprisedattheevidencethatdidn’tsupporttheoverhypothesis!

9-month-olds

Results: Infantsinthecontrolcondition

didnotlooklongerattheexpectedoutcomeascomparedtotheunexpectedoutcomecontrolthathadthesameobjectspresent(~10.3-11.0s).

Theywerenotsurprisedattheevidencethatwascompatiblewiththeoverhypothesis,eveniftheevidenceinvolvedtwodifferentlyshapedobjects.

9-month-olds

Overallresult:

9-month-oldsappearabletoformoverhypothesesfromverylimiteddatasets.

Hopefully,thismeanstheycanalsouselinguisticparameterstolearn,sinceparametersaresimilartooverhypothesesaboutlanguage!

Summary:Linguisticparameters

Linguisticparametersaresimilartostatisticalparametersinthattheyareabstractionsabouttheobservabledata.Forlinguisticparameters,theobservabledataarelanguagedata.

Parametersmakeacquisitioneasierbecausehard-to-learnstructurescanbelearnedbyobservingeasy-to-learnstructuresthatareconnectedtothesameparameters.

Parametersmaybesimilartooverhypotheses,whichBayesianlearnersand9-month-oldsarecapableoflearning.

Questions?

Youshouldbeabletodoupthroughquestion11onthestructurereviewquestions.

ExtraMaterial

Syntax:Onereasonwhynaturallanguagecomprehensionissohardforcomputers

SolvingtheLanguageProblem(ArtificialIntelligence)

HAL9000from2001:ASpaceOdyssey(1968)

PerfectproductionandcomprehensionofEnglish.

1960s:Languagenotconsideredoneofthe“hard”problemsofartificialintelligence.

2010:Gettingbetterbutstillnotperfect.

http://www.research.att.com/~ttsweb/tts/demo.php

http://bits.blogs.nytimes.com/2012/07/15/with-apple’s-siri-a-romance-gone-sour/?_php=true&_type=blogs&_r=0

2012:Apple’sSiriisgettingcloser,thoughstillhasproblems…

Contrast:Chess-playing.

In1997,aprogramnamedDeepBluebeatthereigningworldchampioninchess.Itdidthisbyhavingenoughcomputationalresourcestoinvestigateeverymoveoptionbeforeitactuallymadethechessmove.Thisshowsthatcomputers’poorperformanceonlanguageisnotaboutinsufficientcomputationalpower,sincethereisenoughcomputationalpowertosolvethechess-playingproblem(whichsomepeoplemightconsideraverydifficultproblem).

Updatefor2011onamachine’sabilitiestodowhathumansdo:

Manvs.Machine(Watson)inJeopardy&howhardaproblemlanguagecomprehensionandproductionis

http://www.youtube.com/watch?v=dr7IxQeXr7g(approximately9minvideo)

Watsonvs.allhumanityh~ps://www.youtube.com/watch?v=WFR3lOm_xhE(approximately4minvideo)

“We'res�llveryfarfromprogramswithcommonsense-AIthatcananswercomprehensionques�onswiththeskillofachildof8,"saidSloan.Heandhiscolleagueshopethestudywillhelptofocusa~en�ononthe"hardspots"inAIresearch.

http://www.sciencedaily.com/releases/2013/07/130715151059.htm

2013:Trueon-the-flylanguagecomprehensionisstillprettyhard,aswellasdeterminingtheanswerto“commonsense”questionsthatarephrasednaturally.

“Oneofthehardestproblemsinbuildinganar�ficialintelligence,Sloansaid,isdevisingacomputerprogramthatcanmakesoundandprudentjudgmentbasedonasimplepercep�onofthesitua�onorfacts-thedic�onarydefini�onofcommonsense.

CommonsensehaseludedAIengineersbecauseitrequiresbothaverylargecollec�onoffactsandwhatSloancallsimplicitfacts—thingssoobviousthatwedon'tknowweknowthem.Acomputermayknowthetemperatureatwhichwaterfreezes,butweknowthaticeiscold.”-JeanneGalatzer-Levy

Typesofvariation

VocabularyEnglish“think”verbs:think,know,wonder,suppose,assume,…

Multipletypesoftheactionverb“think”.Eachhascertainusesthatareappropriate.

“Iwonderwhetherthegirlsavedherlittlebrotherfromthegoblins.”[grammatical]

*“Isupposewhetherthegirlsavedherlittlebrotherfromthegoblins.”[ungrammatical]

VocabularyEnglish“think”verbs:think,know,wonder,suppose,assume,…Navajo“carry”verbs:dependsonobjectbeingcarriedaah(carryasolidround-ishobject)

kaah(carryanopencontainerwithcontents)

lé(carryaflexibleobject)

TypesofvariationSounds:EachlanguageusesaparticularsubsetofthesoundsintheInternationalPhoneticAlphabet,whichrepresentsallthesoundsusedinallhumanlanguages.There’softenoverlap(ex:“m”,“p”areusedinmanylanguages),butlanguagesalsomaymakeuseofthelesscommonsounds.

lesscommonEnglishsounds:“th”[T], “th”[D] lesscommonNavajosounds:“whisperedl”,“nasalizeda”,…

Typesofvariation

Announcements Psych 156A/ Ling 150: Acquisition of...

Documents

Transcript of Announcements Psych 156A/ Ling 150: Acquisition of...

Lecture16 Ch5 optical systems

Lecture16 - Roman Roads

Ec4004 Lecture16

Lecture16 Linux Process Scheduling

Transport Lecture16

156a participation%20program

lecture16 - Massachusetts Institute of Technology

Chinese Real Estate - 156A

Docs Slides Lecture16

Algorithm lecture16

Lecture16 friction

Lecture16 fsm iii_c

Lecture16 Stereo

Arg Lecture16

Announcements Psych 156A/ Ling 150: Acquisition of ...lpearl/courses/psych156A_2016spring/lectures/Lecture16-Structure1.pdfAnother way to generate Subject Verb Object order: The linguistic

Psych 156A/ Ling 150: Psychology of Language Learning

ИНверсия №1 (156a) Январь 2015

Lecture16 F&A2011

Learning in ECE 156A,B

Psych 156A/ Ling 150: Acquisition of Language II