Formy project, I used the brain imaging technique...

21
For my project, I used the brain imaging technique electroencephalography (EEG) to study how people learning a second language process sentences with pronouns such as ‘he’ and reflexives such as ‘himself’. This experiment started as part of a class project in a seminar on Neuro-linguistics, taught by my mentors Dr. Rob Fiorentino and Dr. Alison Gabriele. Last year, after the class ended, I took over the project and completed it to fulfill the requirements to graduate with Departmental Honors in Linguistics. 1

Transcript of Formy project, I used the brain imaging technique...

Page 1: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

For myproject,Iusedthebrainimagingtechniqueelectroencephalography(EEG)tostudyhowpeoplelearningasecondlanguageprocesssentenceswithpronounssuchas‘he’andreflexivessuchas‘himself’.ThisexperimentstartedaspartofaclassprojectinaseminaronNeuro-linguistics,taughtbymymentorsDr.RobFiorentinoandDr.AlisonGabriele.Lastyear,aftertheclassended,ItookovertheprojectandcompletedittofulfilltherequirementstograduatewithDepartmentalHonorsinLinguistics.

1

Page 2: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Exploringhow peoplelearnasecondlanguagecangiveinsightintohowthebrainworks,beyondjustlinguisticknowledge.Mystudyexaminesifsecondlanguagelearnersareabletoprocesssentencesatthesamelevel,usingthesamebrainmechanisms,asnativespeakers.AddressingthisquestioncanbringinsightstothedomainofNeuroscience,sheddinglightonwhetherornotourbrainsretainplasticity.Ifitistruethatsecondlanguagelearnerscanacquirethesamerulesforsentenceprocessingasnativespeakers,thenthatisevidenceforthebrain’sabilitytoformnewneurologicalpathways,evenafteritisfullydeveloped.

Toexplorethisquestion,Ilookedatonespecificaspectofsyntacticprocessing:Pronominaldependency- whichisuseofpronounsorreflexivestorefertosomeoneelsewithinasentence.Inordertoprocesspronominaldependencies,nativespeakersuseasetofgrammaticalrulescalledBindingTheory.

2

Page 3: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

TheBindingtheoryisasetofsyntacticprincipleswhichgovernwhichelementsitemssuchasapronounorreflexivemayreferto.For myexperiment,IfocusedonPrincipleAandPrincipleBoftheBindingTheory. PrincipleAofBinding Theorystatesthatareflexivepronoun,suchas“himself”or“herself”,mustbe‘bound’withinitsminimalsentence.ThismeansthatinsentencessuchasexampleAabove:”JohnthinksthatHenrylikeshimself”,theword”himself”canonlygrammaticallyreferto“Henry”.InsentenceA“Henry”istheaccessibleantecedent,theonewhichBindingTheorystatesthat“himself”mustbereferredwith;and“John”istheinaccessibleantecedent. Conversely,PrincipleBofBindingtheorystatesthatanon-reflexivepronoun,suchas”him”or“her”,mustbeboundoutsideitsminimalsentence.So,inthecaseofexamplesentenceB,“John”istheaccessibleantecedent,and“Henry”isinaccessible.

Itiswidelyacceptedthatadultnativespeakersofalanguagehavethisknowledge,andadheretoBindingtheoryinsentenceswithpronominaldependenciessuchastheexamplesabove.StudieshaveshownthatwhentherulesofBindingtheoryarenotfollowed,forexample,iftheaccessibleantecedentdidnotmatchingenderornumberwiththeco-referencedpronoun,nativespeakersshowsensitivitytotheviolation.

3

Page 4: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Inmystudy, Iusedthebrainimagingtechniqueelectroencephalography(or EEG).EEGdatahasveryhightemporalresolution,sowecantrackbraindatainreal-time,whichallowsustoseedifferencesbetweendifferentparticipantgroupseveniftheymightperformsimilarlyonabehavioraltask.

EventRelatedPotentials,orERPs,areburstsofbrainactivitywhichhappenduringaspecificpointintimeandrepresentanaspectofprocessing.ERPsallowustoseehowandwhenasentencewasprocessed,whereabehavioralmethod,suchasacomprehensionquestion,wouldonlybeabletotelluswhetherornotthesentencewasunderstood.

ThespecificERPthatisseenwhenNativespeakersprocessaviolationtoBindingTheoryistheP600;aposteriorpositivitythatoccursbetween500-900msafteronsetoftheviolation.AnotherimportantERPthatisrelevanttomystudyistheLeftAnteriorNegativity,orLAN,whichoccursbetween300and500ms.

4

Page 5: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Oneoftheonlyrecent studiestoexamineonlineprocessBindingTheoryinSecondLanguagelearnersisLianget.al.Thisstudylooksathowsecondlanguagelearnersprocessaviolationwherethegenderofareflexivepronoundoesnotmatchwiththeantecedentthatisgrammatical.Thisiscalledagendermis-match.

Forexample,insentenceAthereflexive“himself”doesnotmatchingenderwiththeantecedent“MissZhao”.SincethesetwowordsshouldbereferencingthesamepersonaccordingtoBindingTheory,wewouldexpectaresponsetothisviolationattheonsetofthepronoun.Conversely,sentenceBiscorrectinaccordancewithBindingtheory,sowedoexpectaviolation.

TheparticipantsusedinthisstudywereagroupofChinesespeakerswhoweretestedontheprocessingoftheseviolationsinChinese,theirnativelanguageandaseparategroupofnativeChinesespeakerswhoweretestedontheprocessingoftheseviolationsinEnglish,theirsecondlanguage.

5

Page 6: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Lianget.al.foundthatconditionswithagendermis-matchviolation,showedaP600forboththegroupreadingtheirnativelanguageandthegroupreadingtheirsecondlanguage.Thisleadthemtoconcludethatsecondlanguagelearnersdoaccessthesamesyntacticrulestoprocesslanguageasnativespeakers.However,oneinterestingthingtheyfoundwasaLANresponseearlierinprocessingthatwaslargerandmoreconsistentfortheparticipantsreadingintheirnativelanguage.

6

Page 7: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Mystudyexpands ontheconceptstestedinLianget.al.,lookingnotonlyathowgender matching influencespronounreference,butalsolookingspecificallyathowtherulesofBindingTheorygovernwhichnounphraseapronounorreflexivecanreferto.Lianget.al.onlytestedreflexives,andeachsentencetypeonlyhadonlyonepotentialnounphraseprecedingthereflexive.Thisisaproblembecauseitleavesthepossibilitythatsecondlanguagelearnersjustattempttoreferthereflexivetotheonlyantecedentinthesentence(MissZhao)asopposedtolinkingthereflexivewiththenounphrasebecauseiswithinitsminimalsentence,asinaccordancewithBindingTheory.Toaddressthis,inmystudyItestedviolationsforsentenceswithbothreflexiveandnon-reflexivepronounsandallsentencesincludedtwopossibleantecedents.

MystudyaddressesatheoryinthesecondlanguageacquisitionliteraturecalledtheShallowStructurehypothesis.Relatedspecificallytopronominaldependencies,thishypothesisarguesthatsecondlanguagelearnerswilltrytolinkthepronounorreflexivetothenounphraseinsubjectposition,ratherthanthenounphrasethatiscorrectaccordingtoBindingtheory.Theyarguethatthenounphraseinsubjectpositionisprominentinthediscourseandlearnersaremorelikelytorelyondiscourseinformationthansyntacticrules.

7

Page 8: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

TheissueIamlooking atinthisstudyiswhetherornotSecondLanguageprocesslanguagethesameasNativespeakers.Iwanttoknowwhetherornotanadultcanbecometrulyfluent,toanative-likelevel,inasecondlanguage.

8

Page 9: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Inmystudy, IwantedtoaccountforthepossibilitythatSecondlanguageLearnerscouldbeusingsomethingotherthantherulesofBindingTheorytoproducesimilarresultstoNativeparticipants.Inordertoaccomplishthis,Ichosestimulithatincludedtwonounphrases,aswellastestingconditionswithbothreflexiveandnon-reflexivepronouns.Myconditionsareoutlinedabove.

Condition(a)hasnoviolation;itisagrammaticalsentencewherethepronoun“her”matchesingendertoitsreferent“Daisy.”Condition(b)hasaviolationoftheBindingTheory,because“her”doesnotmatchingenderwith“Phil,”whichisin theplaceofthegrammaticallycorrectnounphrase.Thesamepatternisshownwithreflexives.Condition(c)showsanungrammaticalsentencewherethereis agendermis-matchbetween “herself”and“Phil,”. AndCondition(d)isgrammaticalaccordingtoBindingtheory.

Eachnameusedinthesentenceswaschosentobeunambiguouslyassociatedwithonegender,sothatthesecondlanguagelearnerswouldknowiftherewasagendermis-matcherror.Theorderofthegenderofnamesineachitemwasrandomized.Theverbsusedinthestimuliwereselectedtobecompatibleinsentenceswithpronounsaswellasreflexivesentences.

9

Page 10: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Asforthefillersentences,therewerefourconditionschosentotargetsubjectverbagreement.Therewerebothgrammaticalandungrammaticalversionsofsentenceswithpluralandsingularsubjects.Thesewerechosenbecausewewereabletocreateasimilarsyntacticviolationandsimilarlylengthofsentence,butwithouthavinganypronounreference.Thesubjectsinthefillerswerechosentobeanagent-subjectofanounphrase,ratherthananameasinthetargetsentences.

Allofthesentenceswerecreatedtosoundnaturalandcheckedsothatnoneofthesubjectswererepeated.Wealsomadesurethatnoneofthefillersusedanypronounsanywhereinthesentence.

10

Page 11: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Myparticipantswere9, righthandedadultsChinesespeakersbetween18-50yearswhoaresecondlanguagelearnersofEnglish.EachparticipanttookantestcalledtheLexTale,usedtoassesEnglishvocabulary.Thescoresonthesetestsvaried,whichmeansfluencylevelofparticipantswerevariedaswell,withameanscoreof69.25percent.

AsImentionedearlier,myexperimentwasdoneonanEEGusingERPanalysis.Thismethodwaschosenbecauseitcanmeasuretimingverypreciselyandallowsustoseeexactlyhowandwhenasentenceswasprocessed.

Duringthemainexperiment,participantswereconnectedtotheEEGcapandsatinfrontofthecomputer.TheirbrainactivitywasrecordedbytheEEGsystemastheyreadsentences.

11

Page 12: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Themaintaskwasadministered onaprogramcalledParadigm.Theintroductorysectionincludedawelcomeslide,instructions forthetask,and6practiceitems.Duringthemaintaskeachparticipantssaw160targetitemsand80fillers,foratotalof240itemsrandomlyvariedinaLatin-squaredesign.Sentenceswerepresentedonewordatatimeinthecenterofthescreen,usingRapidSerialVisualPresentation.Aftereachsentencestheparticipantwasaskedtotoanswerajudgmentquestionbypressingabuttononacontroller.Participantswereoffered4breaksduringthemainexperiment,whichtookabout1hourtocomplete.

TimesforstimulipresentationlengthandthelengthoftheexperimentwerechosenbasedonpreviousL2research.

12

Page 13: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Aftereach iteminthemainERPtask,participantswereaskedwhetherornotthesentencewasacceptable,andaskedtopress”yes”or“no”onaresponsepadbeforemovingontothenextitem.Thismeasurewastakeninordertobesureparticipantswerestayingfocusedandunderstandingthesentences.

Asfortheothertasksadministered,beforetheexperiment,eachparticipantwasgivenaconsentformtolookoverandsignbeforebeginning.Theythentookashortlanguagebackgroundquestionnairewhichincludedahandednessquestionnairetoreferenceandbesuretheywerecompatiblewiththestudy.Lastly,afiveminutelexicaldecisiontaskcalledLexTalewasadministered.Thiswasusedtoassesparticipants’knowledgeofEnglishvocabularyandwasusedasaproficiencymeasure.

Afterthemainexperiment,participantsfilledouta20-questionreferencetaskaskingthemtoexplicitlychoosewhichnounphrasetheythoughtthepronounorreflexivewasreferringtointhestimulisentences.Thiswasgivenafterthemainexperiment,soasnottoprimetheexpectedresponseorinformtheparticipantofexactlywhichitemswewerelookingat.

13

Page 14: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Ifthesecondlanguagelearnersareabletoaccesstherulesofbindingtheory,andprocesssentencesinthesamewayasnativespeakers,thenwewouldexpectalargerP600forconditionswhichhadaviolationinBindingTheory,comparedtotheconditionsthatdidnothaveaviolation.ThismeansthatconditionB,theungrammaticalpronoun,willhavealargerpositivitythanconditionA,thegrammaticalpronouncondition.Thesameistrueforreflexives:conditionC,ungrammatical,willhavealargerpositivitythanconditionD,grammatical.Thisissimilartowhatwewouldexpecttoseefromnativespeakers.DuetoconcernsaboutCOVID-19,IwasnotabletotestmyownstimulionagroupofnativeEnglishspeakers,asacomparisongroup.BecauseofthisIwilluseexpectedresultsderivedfromstudiesusingsimilarstimulitounderstandhownativespeakersprocesstheseerrors.OnestudythatlookedatsentenceswithBindingTheoryviolationswasHarriset.al.(2000)TheirstudysupportedtheideathatnativespeakerswouldyieldaprominentP600forsentenceswithBindingTheoryerrors,regardlessofdiscourseprominence.

IfClahsenandFelseret.al.’sshallowstructurehypothesisiscorrect,andsecondlanguagelearnersonlyattempttorefertothenouninsubjectposition,thenwewouldexpectbenative-likeforthepronounconditions,wheretheaccessible

14

Page 15: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

antecedentisinsubjectposition,yieldingagreaterP600forconditionB,wherethegendermis-matchedwiththesubjectantecedent,thanforconditionA.Thisissimilartohowweexpectnativestopattern.WealsoexpectagreaterP600fromconditionDthanC,becauseinDthegenderofthereflexivemis-matcheswiththesubjectantecedent,regardlessofwhetherornotitwascorrectaccordingtoBindingtheory.Thisisdifferentfromwhatwewouldexpectfromnativespeakers.

Additionally,somestudiessuchasLianget.al.thatwasoutlinedearlier,foundaLeftAnteriorNegativity,orLANresponseforthesetypesofviolations.

14

Page 16: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Theraw EEGdatacollectedfromeachparticipantwasprocessedtominimizeartifacts,thenusedtogenerateaveragesforthetwotimewindowsfortheERPsofinterest.Welookedatthethewindow300-500msafteronsetoftheviolation,thisistheusualtimewindowfortheLANresponse,whichisanegativitylocalizedtowardstheanteriorregionofthebrain.Theothertimewindowwelookedatwas500-900msafteronset,whichisthetimewewouldexpectaP600,apositiveresponsefoundonposteriorelectrodes.

Usingthesegrandaverages,Icreatedfigurescomparingtheungrammaticalconditiontothegrammaticalconditionforbothsentenceswithreflexivesandnon-reflexivepronouns.

15

Page 17: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Shown abovearethefigurescomparingthegrandaverageresponsesforallparticipantsfortheungrammaticalpronouncondition,wheretherewasaviolationtoBindingtheory,tothegrammaticalpronouncondition.Theungrammaticalconditionisshowninred.

Around300-500msonthegraphtheungrammaticalconditionwasmorenegativethanthegrammaticalcondition,especiallyinelectrodeFZaround500ms.ItispossiblethatthisisanemergingLANeffect,sinceitisfoundinthetimewindowandespeciallynoticeableinanteriorelectrodes.ThisissimilartowhatwasfoundbyLianget.al.

Around500-900ms,whichisthetimewindowfortheP600effect,theungrammaticalandgrammaticalconditionswerenotverydifferentfromoneanother;neitherconditionshowedagreaterP600effect.

16

Page 18: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

These graphsshowthegrandaveragefromallparticipantsoftheresponsescomparingthereflexiveconditions.Theungrammaticalconditionisshowninred.

There wasalargernegativityfortheungrammaticalreflexivesthanforthegrammaticalreflexivesbetween300and500ms.ThiscouldbeanemergingLANeffect,similartowhatwesawinthepronounconditions.

Around500-900mstherewasagreateroverallpositivity,especiallyfortheposteriorelectrodesrepresentedbyPZ.ThiscouldbeanemergingP600effect,whichisusuallyfoundatthistimeinprocessingaroundtheposteriorelectrodes.

17

Page 19: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Thepreviousdatapatterns were similartowhatwewouldexpecttoseefromnativespeakersbasedonpreviousstudiessuchasHarriset.al.andLianget.al.Thesefindingsshowtrendssuggestingthatparticipantsaresensitivetobinding theoryviolations,meaningthattheymaybeabletoaccessthesamebrainmechanismsasnativespeakers.Theseresultslendevidencetothepossibilitythatourbrainsareabletoretainplasticityintoadulthood.

Thesearejustthepreliminaryfindingsinwhatcouldbeamuchlargerexperiment.Fluencylevelofmyparticipantsvariedalot,whichcouldexplainwhytherewasnotadifferenceintheP600effectfoundforthepronounconditions.Inthefuture,itwouldbebeneficialtotestonmorehighproficiency learners,whowouldbemoreattunetothesyntacticerrorsinthestimuli.ItwouldalsohelptohavealargerparticipantgroupoverallandtestacontrolgroupofEnglishspeakersusingmyownstimuli.

18

Page 20: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Iwouldliketothank mymentorsDr.RobFiorentinoandDr.AlisonGabrieleforhelpingmedevelopandcarryoutthisproject,especiallyforalltheydidduringtheCOVID-19quarantinetohelpmefinishthisprojectevenwithoutaccessthelabtoprocessdata.IwouldalsoliketothankXiaoYangforallherhelpteachingmehowtorunparticipants,andeveryoneelseintheNeurolinguisticslabwhohelpedmewithEEGsessionsandrecruitingparticipants.IwouldalsoliketothankthestudentsinmySpring2019Linguisticscourse,“CognitiveNeuroscienceofSecondLanguageAcquisition”,whoworkedonthestimuliandpilotstagesofdatacollectionwhenthiswasaclassproject.

19

Page 21: Formy project, I used the brain imaging technique ...symposium2020.ku.edu/sites/symposium2020.drupal.ku.edu/files/im… · In my study,I used the brain imaging technique electroencephalography

Herearemyreferences.Thankyou!

20