Lecture 12: Informa1on Extrac1on

Lecture12:Informa1onExtrac1on

ThisLecture

‣ Howdowerepresentinforma1onforinforma1onextrac1on?

‣ OpenInforma1onExtrac1on

‣ Rela1onextrac1on

‣ Slotfilling

‣ Seman1crolelabeling/abstractmeaningrepresenta1on

Represen1ngInforma1on

Seman1cRepresenta1ons

Examplecredit:AsadSayeed

personBrutusCaesarObamaBush…

stabBrutus Caesar

…

‣ “World”isasetofen11esandpredicates

president

Obama

Bush…




stabBrutus Caesar

…


president

Obama

Bush…

‣ Statementsarelogicalexpressionsthatevaluatetotrueorfalse




stabBrutus Caesar

…


president

Obama

Bush…

BrutusstabsCaesar





stabBrutus Caesar

…


president

Obama

Bush…

BrutusstabsCaesar stab(Brutus,Caesar)=>true





stabBrutus Caesar

…


president

Obama

Bush…



Caesarwasstabbed




stabBrutus Caesar

…


president

Obama

Bush…



Caesarwasstabbed ∃xstab(x,Caesar)=>true

Neo-DavidsonianEvents


BrutusstabbedCaesarwithaknifeatthetheaterontheIdesofMarch




∃estabs(e,Brutus,Caesar)




∃estabs(e,Brutus,Caesar)∧with(e,knife)




∃estabs(e,Brutus,Caesar)∧with(e,knife) ∧loca1on(e,theater)




∃estabs(e,Brutus,Caesar)∧with(e,knife) ∧loca1on(e,theater)

∧1me(e,IdesofMarch)





‣ Letsusdescribeeventsashavingproper1es

∧with(e,knife) ∧loca1on(e,theater)






‣ Letsusdescribeeventsashavingproper1es‣ Unifiedrepresenta1onofeventsanden11es:








somecleverdriverinAmerica








∃xdriver(x)∧clever(x)∧loca1on(x,America)

somecleverdriverinAmerica



RealText

BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw.

RealText


∃esign(e,BarackObama)∧pa1ent(e,ACA)∧1me(e,Tuesday)

RealText

BarackObamasignedtheAffordableCareactonTuesday.HegaveaspeechlaterthataCernoononhowtheactwouldhelptheAmericanpeople.SeveralprominentRepublicanswerequicktodenouncethenewlaw. whichTuesday?


RealText


who?


RealText


who?whichaYernoon?


RealText


who?

???

whichaYernoon?


RealText


‣ Needtoimputemissinginforma1on,resolvecoreference,etc.

who?

???

whichaYernoon?


RealText


‣ Needtoimputemissinginforma1on,resolvecoreference,etc.

‣ S1llunclearhowtorepresentsomethingspreciselyorhowthatinforma1oncouldbeleveraged(severalprominentRepublicans)

who?

???

whichaYernoon?


OtherChallenges

BobandAlicewerefriendsunGlhemovedawaytoaHendcollege

OtherChallenges


∃e1∃e2friends(e1,Bob,Alice)∧moved(e2,Bob)∧end_of(e1,e2)

OtherChallenges


‣ Howtorepresenttemporalinforma1on?


OtherChallenges




BobandAlicewerefriendsunGlaroundthe+mehemovedawaytoaHendcollege

OtherChallenges



‣ Represen1ngtrulyopen-domaininforma1onisverycomplicated!Wedon’thaveaformalrepresenta1onthatcancaptureeverything


BobandAlicewerefriendsunGlaroundthe+mehemovedawaytoaHendcollege

(Atleast)ThreeSolu1ons

(Atleast)ThreeSolu1ons‣ CraYedannota1onstocapturesomesubsetofphenomena:predicate-argumentstructures(seman1crolelabeling),1me(temporalrela1ons),…


‣ Slotfilling:specificontology,populateinforma1oninapredefinedway



(Earthquake:magnitude=8.0,epicenter=centralItaly,…)


‣ En1ty-rela1on-en1tytriples:focusonen11esandtheirrela1ons(notethatprominenteventscans1llbeen11es)

‣ CraYedannota1onstocapturesomesubsetofphenomena:predicate-argumentstructures(seman1crolelabeling),1me(temporalrela1ons),…




‣ En1ty-rela1on-en1tytriples:focusonen11esandtheirrela1ons(notethatprominenteventscans1llbeen11es)

(LadyGaga,singerOf,BadRomance)

‣ CraYedannota1onstocapturesomesubsetofphenomena:predicate-argumentstructures(seman1crolelabeling),1me(temporalrela1ons),…



OpenIE‣ En1ty-rela1on-en1tytriplesaren’tnecessarilygroundedinanontology

‣ Extractstringsandletadownstreamsystemfigureitout



(BarackObama,signed,theAffordableCareact)




(BarackObama,signed,theAffordableCareact)

(SeveralprominentRepublicans,denounce,thenewlaw)


IE:TheBigPicture

‣ Howdowerepresentinforma1on?Whatdoweextract?

‣ Slotfillers‣ En1ty-rela1on-en1tytriples(fixedontologyoropen)

‣ Seman1croles

‣ Abstractmeaningrepresenta1on

Seman1cRoleLabeling/ AbstractMeaningRepresenta1on

Seman1cRoleLabeling

Seman1cRoleLabeling

FigurefromHeetal.(2017)

Seman1cRoleLabeling

‣ Iden1fypredicate,disambiguateit,iden1fythatpredicate’sarguments


Seman1cRoleLabeling


‣ VerbrolesfromPropbank(Palmeretal.,2005)


Seman1cRoleLabeling


‣ VerbrolesfromPropbank(Palmeretal.,2005)


quicken:

Seman1cRoleLabeling


Seman1cRoleLabeling


‣ Iden1fypredicates(love)usingaclassifier(notshown)

Seman1cRoleLabeling



‣ Iden1fyARG0,ARG1,etc.asataggingtaskwithaBiLSTMcondi1onedonlove

Seman1cRoleLabeling



‣ Iden1fyARG0,ARG1,etc.asataggingtaskwithaBiLSTMcondi1onedonlove

‣ Othersystemsincorporatesyntax,jointpredicate-argumentfinding

SRLforQA

ShenandLapata(2007)

‣ Ques1onandseveralanswercandidates

Q:Whodiscoveredprions?

AC1:In1997,StanleyB.Prusiner,ascienGstintheUnitedStates,discoveredprions…

AC2:Prionswereresearchedby…

SRLforQA

ShenandLapata(2007)

‣ Ques1onandseveralanswercandidates

Q:Whodiscoveredprions?

AC1:In1997,StanleyB.Prusiner,ascienGstintheUnitedStates,discoveredprions…

AC2:Prionswereresearchedby…

Scorebymatchingexpectedanswerphrase(EAP)againstanswercandidate(AC)

AbstractMeaningRepresenta1on

‣ Graph-structuredannota1on

Theboywantstogo

Banarescuetal.(2014)



Theboywantstogo


‣ SupersetofSRL:fullsentenceanalyses,containscoreferenceandmul1-wordexpressionsaswell



Theboywantstogo



‣ F1scoresinthe60s:hard!



Theboywantstogo



‣ F1scoresinthe60s:hard!

‣ Socomprehensivethatit’shardtopredict,buts1lldoesn’thandletenseorsomeotherthings…

Summariza1onwithAMR

Liuetal.(2015)

Summariza1onwithAMR

Liuetal.(2015)

‣MergeAMRsacrossmul1plesentences

Summariza1onwithAMR

Liuetal.(2015)


‣ Summariza1on=subgraphextrac1on

Summariza1onwithAMR

Liuetal.(2015)


‣ Summariza1on=subgraphextrac1on

‣ Norealsystemsactuallyworkthisway(morewhenwetalkaboutsummariza1on)

SlotFilling

SlotFilling‣Mostconserva1ve,narrowformofIE

FreitagandMcCallum(2000)


IndianExpress—Amassiveearthquakeofmagnitude7.3struckIraqonSunday,103kms(64miles)southeastofthecityofAs-Sulaymaniyah,theUSGeologicalSurveysaid,reportsReuters.USGeologicalSurveyiniGallysaidthequakewasofamagnitude7.2,beforerevisingitto7.3.

magnitude time

epicenter




magnitude time

epicenter

Speaker:AlanClark

“GenderRolesintheHolyRomanEmpire”

AllagherCenterMainAuditorium

Thistalkwilldiscuss…

speakertitle

location




magnitude time

epicenter

Speaker:AlanClark

“GenderRolesintheHolyRomanEmpire”

AllagherCenterMainAuditorium

Thistalkwilldiscuss…

speakertitle

location


‣ Oldwork:HMMs,laterCRFstrainedperrole

SlotFilling:MUC

HaghighiandKlein(2010)

‣ Keyaspect:needtocombineinforma1onacrossmul1plemen1onsofanen1tyusingcoreference

SlotFilling:Forums

‣ Extractproductoccurrencesincybercrimeforums,butnoteverythingthatlookslikeaproductisaproduct

Portnoffetal.(2017),Durrenetal.(2017)Notaproductinthiscontext

Rela1onExtrac1on

Rela1onExtrac1on‣ Extracten1ty-rela1on-en1tytriplesfromafixedinventory

ACE(2003-2005)


ACE(2003-2005)

DuringthewarinIraq,AmericanjournalistsweresomeGmescaughtinthelineoffire


ACE(2003-2005)


Located_In

Na1onality


ACE(2003-2005)


Located_In

Na1onality

‣ UseNER-likesystemtoiden1fyen1tyspans,classifyrela1onsbetweenen1typairswithaclassifier


ACE(2003-2005)


Located_In

‣ Systemscanbefeature-basedorneural,lookatsurfacewords,syntac1cfeatures(dependencypaths),seman1croles

Na1onality



ACE(2003-2005)


Located_In

‣ Systemscanbefeature-basedorneural,lookatsurfacewords,syntac1cfeatures(dependencypaths),seman1croles

Na1onality

‣ Problem:limiteddataforscalingtobigontologies


HearstPanerns

‣ Syntac1cpanernsespeciallyforfindinghypernym-hyponympairs(“isa”rela1ons)

HearstPanerns

Hearst(1992)


HearstPanerns

Hearst(1992)


BerlinisacityYisaX

HearstPanerns

Hearst(1992)

Xsuchas[list] ciGessuchasBerlin,Paris,andLondon.


BerlinisacityYisaX

HearstPanerns

Hearst(1992)



Berlinisacity

otherciGesincludingBerlin

YisaX

otherXincludingY

HearstPanerns

Hearst(1992)



Berlinisacity

otherciGesincludingBerlin

YisaX

otherXincludingY

‣ Totallyunsupervisedwayofharves1ngworldknowledgefortaskslikeparsingandcoreference(BansalandKlein,2011-2012)

DistantSupervision

Mintzetal.(2009)

DistantSupervision

Mintzetal.(2009)

‣ Lotsofrela1onsinourknowledgebasealready(e.g.,23,000film-directorrela1ons);usethesetobootstrapmoretrainingdata

DistantSupervision

Mintzetal.(2009)

‣ Iftwoen11esinarela1onappearinthesamesentence,assumethesentenceexpressestherela1on


DistantSupervision

Mintzetal.(2009)

[StevenSpielberg]’sfilm[SavingPrivateRyan]islooselybasedonthebrothers’story



Director

DistantSupervision

Mintzetal.(2009)

[StevenSpielberg]’sfilm[SavingPrivateRyan]islooselybasedonthebrothers’story



Allisonco-producedtheAcademyAward-winning[SavingPrivateRyan],directedby[StevenSpielberg]

Director

Director

DistantSupervision

Mintzetal.(2009)

‣ Learndecentlyaccurateclassifiersfor~100Freebaserela1ons‣ Couldbeusedtocrawlthewebandexpandourknowledgebase

OpenIE

OpenInforma1onExtrac1on

‣ Typicallynofixedrela1oninventory

‣ “Open”ness—wanttobeabletoextractallkindsofinforma1onfromopen-domaintext

‣ Acquirecommonsenseknowledgejustfrom“reading”aboutit,butneedtoprocesslotsoftext(“machinereading”)

TextRunner‣ Extractposi1veexamplesof(e,r,e)triplesviaparsingandheuris1cs

‣ TrainaNaiveBayesclassifiertofiltertriplesfromrawtext:usesfeaturesonPOStags,lexicalfeatures,stopwords,etc.

Bankoetal.(2007)


BarackObama,44thpresidentoftheUnitedStates,wasbornonAugust4,1961inHonolulu

=>Barack_Obama,wasbornin,Honolulu


Bankoetal.(2007)





‣ 80xfasterthanrunningaparser(whichwasslowin2007…)

Bankoetal.(2007)





‣ 80xfasterthanrunningaparser(whichwasslowin2007…)

Bankoetal.(2007)

‣ Usemul1pleinstancesofextrac1onstoassignprobabilitytoarela1on

Exploi1ngRedundancy

Bankoetal.(2007)

Exploi1ngRedundancy

Bankoetal.(2007)

‣ 9Mwebpages/133Msentences

Exploi1ngRedundancy

Bankoetal.(2007)


‣ 2.2tuplesextractedpersentence,filterbasedonprobabili1es

Exploi1ngRedundancy

Bankoetal.(2007)

‣ Concrete:definitelytrueAbstract:possiblytruebutunderspecified



Exploi1ngRedundancy

Bankoetal.(2007)

‣ Concrete:definitelytrueAbstract:possiblytruebutunderspecified

‣ Hardtoevaluate:canassessprecision ofextractedfacts,buthowdoweknowrecall?



ReVerb

Faderetal.(2011)

‣Moreconstraints:openrela1onshavetobeginwithverb,endwithpreposi1on,becon1guous(e.g.,wasbornon)

ReVerb

Faderetal.(2011)

‣Moreconstraints:openrela1onshavetobeginwithverb,endwithpreposi1on,becon1guous(e.g.,wasbornon)

‣ Extractmoremeaningfulrela1ons,par1cularlywithlightverbs

ReVerb

Faderetal.(2011)

‣ Foreachverb,iden1fythelongestsequenceofwordsfollowingtheverbthatsa1sfyaPOSregex(V.*P)andwhichsa1sfyheuris1clexicalconstraintsonspecificity

‣ Findthenearestargumentsoneithersideoftherela1on

ReVerb

Faderetal.(2011)

‣ Foreachverb,iden1fythelongestsequenceofwordsfollowingtheverbthatsa1sfyaPOSregex(V.*P)andwhichsa1sfyheuris1clexicalconstraintsonspecificity

‣ Findthenearestargumentsoneithersideoftherela1on

‣ Annotatorslabeledrela1onsin500documentstoassessrecall

QAfromOpenIE

Choietal.(2015)

Takeaways

‣ Rela1onextrac1on:cancollectdatawithdistantsupervision,usethistoexpandknowledgebases

‣ Slotfilling:1edtoaspecificontology,butgivesfine-grainedinforma1on

‣ OpenIE:extractslotsofthings,buthardtoknowhowgoodorusefultheyare

‣ Cancombinewithstandardques1onanswering

‣ Addnewfactstoknowledgebases

‣ SRL/AMR:handleabunchofphenomena,butmoreorlesslikesyntax++intermsofwhattheyrepresent

‣Many,manyapplica1onsandtechniques

Lecture 12: Informa1on Extrac1on

Documents

Transcript of Lecture 12: Informa1on Extrac1on