AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides...
Transcript of AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides...
![Page 1: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/1.jpg)
AMR-to-TextGenerationviaGF
NormundsGrūzītis
UniversityofLatvia,InstituteofMathematicsandComputerScienceNationalinformationagencyLETA
GFSummerSchool2017,Rīga,Latvia
This work has received funding in part from theLatvian State research programs SOPHIS andNexIT, the EU Horizon 2020 project SUMMA(grant No. 688139), and the European RegionalDevelopment Fund (grant No. 1.1.1.1/16/A/219).
![Page 2: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/2.jpg)
• Framesemantics– FrameNet– PropBank
• AMR
• Text-to-AMRparsing,AMR-to-textgeneration– SemEval 2016– SemEval 2017
Agenda
![Page 3: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/3.jpg)
SemanticRoleLabelling (SRL)
TurboParser +SEMAFOR:http://demo.ark.cs.cmu.edu/parseFrameNet
LTHparser:http://barbar.cs.lth.se:8081/PropBank
![Page 4: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/4.jpg)
FrameNet (https://framenet.icsi.berkeley.edu)
![Page 5: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/5.jpg)
FrameNet (https://framenet.icsi.berkeley.edu)
![Page 6: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/6.jpg)
FrameNet (FN)• Alexico-semanticresourcebasedonthetheoryofframe
semantics(Fillmoreetal.2003)
– Asemanticframe representsacognitive,prototypicalsituation(scenario)characterizedbyframeelements(FE)– semanticvalence
– Framesare“evoked”insentencesbytargetwords – lexicalunits(LU)
– FEsaremappedbasedonthesyntacticvalence oftheLU
• ThesyntacticvalencepatternsarederivedfromFN-annotatedcorpora(foranincreasingnumberoflanguages,incl.Latvian)
– FEsaresplitintocore andnon-core ones
• CoreFEsuniquelycharacterizetheframeandsyntacticallytend tocorrespondtoverbarguments
• Non-coreFEsarenotspecifictotheframeandtypically areadjuncts
![Page 7: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/7.jpg)
BerkeleyFrameNetasInterlingua
want.v..6412 känna_för.vb..1
IntroducedinBFN,reusedinSweFN
e.g.“[I]Experiencer don't WANT [todeceive anyone]Event”|
anembeddedframe
SomevalencepatternsfoundinSweFNSomevalencepatternsfoundinBFN
e.g.“[Jag]Experiencer KÄNNER FÖR [en turpålandet]Focal_participant”
![Page 8: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/8.jpg)
FrameNetandGF• ExistingFNsarenotentirelyformalandcomputational
– Alimited butcomputational FN-based GFgrammarandlexicon
• GrammaticalFramework:– Separatesbetweenanabstractsyntax andconcretesyntaxes– Providesageneral-purposeresourcegrammarlibrary (RGL)
• Thelanguage-independent layerofFrameNet(framesandFEs)–theabstractsyntax– Thelanguage-specific layers(surfacerealizationofframesandFEs;LUs)–
concretesyntaxes
• RGLcanbeusedforunifying thesyntactictypesusedindifferentFNsandfortheconcreteimplementation offrames– FrameNetallowsforabstracting overRGL
![Page 9: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/9.jpg)
Usecase(1)• Provideasemantic APIontopofRGLtofacilitatethedevelopment
ofGFapplicationgrammars– Incombinationwiththesyntactic APIofRGL– Hidingthecomparativelycomplexconstructionofverbphrases
mkCl person (mkVP (mkVP live_V) (mkAdv in_Prep place))-- mkCl : NP -> VP -> Cl-- mkVP : V -> VP-- mkVP : VP -> Adv -> VP-- mkAdv : Prep -> NP -> Adv
Residence -- Residence : NP -> Adv -> V -> Clperson -- NP (Resident)(mkAdv in_Prep place) -- Adv (Location)live_V_Residence -- V (LU)
![Page 10: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/10.jpg)
Usecase (2)• FN-annotatedknowledgebasesàmultilingualverbalization
Imants Ziedonis ir dzimis 1933.gada 3.maijā Slokas pagastā.Imants Ziedonis wasborn in Sloka parishon 3May1933.
![Page 11: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/11.jpg)
• Frame valencepatternsarerepresentedbyfunctions– TakingoneormorecoreFEs(A-Z)andoneLUasarguments– ReturninganobjectoftypeClause whoselinearizationtypeis
{np: NP; vp: VP}
• FEsaredeclaredassemanticcategoriessubcategorizedbythesyntacticRGLtypes– NP,VP,Adv (includesprepositionalobjects),S (embeddedsentences),QS
FrameNet-basedgrammar:abstract
cat Event_VP cat Focal_participant_NP
cat Experiencer_NP cat Focal_participant_Adv
fun Desiring_V : Experiencer_NP -> Focal_participant_Adv -> V -> Clause
fun Desiring_V2 : Experiencer_NP -> Focal_participant_NP -> V2 -> Clause
fun Desiring_V2_Pass : Experiencer_NP -> Focal_participant_NP -> V2 -> Clause
fun Desiring_VV : Event_VP -> Experiencer_NP -> VV -> Clause
![Page 12: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/12.jpg)
• ThemappingfromthesemanticFrameNettypestothesyntacticRGLtypes issharedforalllanguages
– LinearizationtypesareoftypeMaybetoallowforoptional(empty)FEs
• Toimplementtheframefunctions,RGLconstructors areappliedtotheargumentsdependingontheirtypesandsyntacticroles,andthevoice
FrameNet-basedgrammar:concrete
lincat Focal_participant_NP = Maybe NP
lincat Focal_participant_Adv = Maybe Adv
lin Desiring_V2 experiencer focal_participant v2 = {
np = fromMaybe NP experiencer ;
vp = mkVP v2 (fromMaybe NP focal_participant)}
lin Desiring_V2_Pass experiencer focal_participant v2 = {
np = fromMaybe NP focal_participant ;
vp = mkVP (passiveVP v2) (mkAdv by8agent_Prep (fromMaybe NP experiencer))}
![Page 13: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/13.jpg)
http://grammaticalframework.org/framenet/
![Page 14: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/14.jpg)
SemanticRoleLabelling (SRL)
TurboParser +SEMAFOR:http://demo.ark.cs.cmu.edu/parseFrameNet
LTHparser:http://barbar.cs.lth.se:8081/PropBank
![Page 15: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/15.jpg)
PropBank (http://propbank.github.io)
![Page 16: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/16.jpg)
AMR (Abstract Meaning Representation)• FromSRLtowhole-sentencemeaningrepresentation
– Incl.PropBank SRL,NERandNEL,treatmentofmodality,negation,etc.
• Simpleandcompact datastructure– PENMANnotation:directedlabeledgraphencodedinatree-likeform– Easytoreadandwrite(forahuman),andtraverse(foraprogram)– Langkilde andKnight(1998)à Banarescu etal.(2013)
• Aimedatlarge-scale humanannotationandsemanticparsing– Practical,replicableamountofabstraction– Anactualsembank of40K+sentences
• Capturesmany aspectsofmeaning– Aimstoabstract awayfrom(English)syntax
![Page 17: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/17.jpg)
• Nodesarevariables labelledbyconcepts– Entities,events,states,properties– s / soldier:s isaninstanceofsoldier
• Edgesaresemanticrelations
• AMRabstractsinnumerouswaysbyassigningthesameconceptualstructuretodifferentsurfacerealizations
AMR (Abstract Meaning Representation)
f /fear-01
d /die-01s /soldier -
polarity
ARG1(Pustetal.,2015)
![Page 18: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/18.jpg)
SchneiderN.,Flanigan J.,O’GormanT.AMRTutorialatNAACL2015
https://github.com/nschneid/amr-tutorial/
• AMRisstillbiasedtowardsEnglishorothersourcelanguages
• Meanwhile,AMRisagnostic abouthowtoderivemeaningsfromstrings,andviceversa
• Xue N.,Bojar O.,Hajič J.,PalmerM.,Uresova Z.,ZhangX.NotanInterlingua,butclose:ComparisonofEnglishAMRstoChineseandCzech.LREC2014
AMR (Abstract Meaning Representation)
![Page 19: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/19.jpg)
Text-to-AMR:humanannotationhttps://amr.isi.edu/editor.html
![Page 20: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/20.jpg)
AMR-to-text:humanevaluation
![Page 21: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/21.jpg)
SampleAMR (1)#::snt Afourthmember,Jean-MarcRouillan,remainsbehindbars.
(r / remain-01:ARG1 (p / person
:wiki -:name (n / name
:op1 "Jean-Marc" :op2 "Rouillan"):mod (p2 / person
:ARG0-of (h / have-org-role-91:ARG2 (m / member))
:ord (o / ordinal-entity:value 4)))
:ARG3 (b / behind:op1 (b2 / bar)))
![Page 22: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/22.jpg)
SampleAMR (1)#::snt Afourthmember,Jean-MarcRouillan,remainsbehindbars.
(r / remain-01:ARG1 (p / person
:wiki -:name (n / name
:op1 "Jean-Marc" :op2 "Rouillan"):mod (p2 / person
:ARG0-of (h / have-org-role-91:ARG2 (m / member))
:ord (o / ordinal-entity:value 4)))
:ARG3 (b / behind:op1 (b2 / bar)))
Remainingmembersperson4jean-marcrouillan – behindbar.
Jean-MarcRouillan,thatisthe4thmember,isremainedbehindabar.
![Page 23: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/23.jpg)
SampleAMR (1)#::snt Afourthmember,Jean-MarcRouillan,remainsbehindbars.
(r / remain-01:ARG1 (p / person
:wiki -:name (n / name
:op1 "Jean-Marc" :op2 "Rouillan"):mod (p2 / person
:ARG0-of (h / have-org-role-91:ARG2 (m / member))
:ord (o / ordinal-entity:value 4)))
:ARG3 (b / behind:op1 (b2 / bar)))
Remainingmembersperson4jean-marcrouillan – behindbar. JAMR
Jean-MarcRouillan,thatisthe4thmember,isremainedbehindabar. GF
![Page 24: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/24.jpg)
SampleAMR (1)#::snt Afourthmember,Jean-MarcRouillan,remainsbehindbars.
(r / remain-01:ARG1 (p / person
:wiki -:name (n / name
:op1 "Jean-Marc" :op2 "Rouillan"):mod (p2 / person
:ARG0-of (h / have-org-role-91:ARG2 (m / member))
:ord (o / ordinal-entity:value 4)))
:ARG3 (b / behind:op1 (b2 / bar)))
Remainingmembersperson4jean-marcrouillan – behindbar. JAMR
Jean-MarcRouillan,that isthe4thmember,isremainedbehinda bar. GF
![Page 25: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/25.jpg)
SampleAMR (2)#::snt Theyshouldhavebeenexpelledfromschoolataminimum.
(r / recommend-01:ARG1 (e / expel-01
:ARG1 (t / they):ARG2 (s / school):degree (a / at-a-minimum)))
Shouldtheyat-a-minimumexpelschool. JAMR
Itisrecommendedthattheyareexpelledto a schoolataminimum. GF
expel-01ARG0=PAG (prototypicalagent)ARG1=PPT (prototypicalpatient)ARG2=DIR (direction)à DIR_Prepà to_Prep
ToDo:basedonstatistics fromPropBankandFrameNetcorpora,“reconstruct”Prep-s,dependingonframe/verbvalency,ARGrole,orNPhead
![Page 26: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/26.jpg)
SampleAMR (3)#::snt Texascriminalcourtsandprosecutorsdonotcoddletoanyone.
(c / coddle-01:polarity –:ARG0 (a / and
:op1 (c2 / court:ARG0-of (c4 / criminal-03):location (s / state
:wiki "Texas":name (n / name :op1 "Texas")))
:op2 (p / person:ARG0-of (p2 / prosecute-01):location s))
:ARG1 (a2 / anyone))
Notexas texas criminalcourtandprosecutorscoddleanyone. JAMR
AcriminalcourtinTexasandapersonthatprosecutes donotcoddleanyone. GF
personthatprosecutesà prosecutororganizationthatgovernsà government
![Page 27: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/27.jpg)
SampleAMR (4)#::snt HowLongareWeGoingtoTolerateJapan?
(t / tolerate-01:ARG0 (w / we):ARG1 (c / country
:wiki "Japan" :name (n / name :op1 "Japan"))
:duration (a / amr-unknown))
Wehavetoleratedthejapanamr-unknown. JAMR
HowlongdowetolerateJapan? GF
if ':mode expressive' in amr: amr = amr.replace(':mode expressive', ' ') + ' !'if ':mode imperative' in amr: amr = amr.replace(':mode imperative', ' ') + ' !'if ':mode interrogative' in amr: amr = amr.replace(':mode interrogative', ' ') + ' ?'if 'cause-01:ARG0(amr-unknown)' in amr: amr = 'why ' + amr.replace('cause-01:ARG0(amr-unknown)', ' ') + ' ?'if ':location(amr-unknown)' in amr: amr = 'where ' + amr.replace(':location(amr-unknown)', ' ') + ' ?'if ':ARG1(amr-unknown)' in amr: amr = 'who ' + amr.replace(':ARG1(amr-unknown)', ' ') + ' ?'if ':mod(amr-unknown)' in amr: amr = 'what ' + amr.replace(':mod(amr-unknown)', ' ') + ' ?'if ':duration(amr-unknown)' in amr: amr = 'how ' + amr.replace(':duration(amr-unknown)', ' ') + ' ?'if 'amr-unknown' in amr: amr = 'what ' + amr.replace('amr-unknown', ' ') + ' ?'
![Page 28: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/28.jpg)
SampleAMR (5)#::snt XinhuaNewsAgency,Tokyo,September1st,byreporterYiguo Yu
(b / byline-91:ARG0 (p2 / publication
:name (n / name:op1 "Xinhua" :op2 "News" :op3 "Agency"))
:ARG1 (p / person:name (n2 / name :op1 "Yiguo" :op2 "Yu"):ARG0-of (r / report-01))
:location (c2 / city:name (n3 / name :op1 "Tokyo"))
:time (d / date-entity:month 9:day 1))
Xinhuanewsagencyhasreportedyiguo yu byline inatokyo 19. JAMR
XinhuaNewsAgencybyYiguo Yuon1SeptemberinTokyo. GF
![Page 29: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/29.jpg)
SampleAMR (6)#::snt Alliot-MariearrivedonSunday.
(a / arrive-01:ARG1 (p / person :name (n / name :op1 "Alliot-Marie")):time (d / date-entity :weekday (s / sunday)))
Sunday'sarrivalofalliot-marie michèle_alliot-marie. JAMR
unknown qualified constant L.arrive_V2 GF
(a / arrive-01:ARG0 (p / person :name (n / name :op1 "Alliot-Marie")):time (d / date-entity :weekday (s / sunday)))
Alliot-marie michèle_alliot-marie arrivedsunday. JAMR
Alliot-MariearrivesonSunday. GF
![Page 30: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/30.jpg)
SemEval 2017:Task9• Subtask1:ParsingBiomedicalData• Subtask2:AMR-to-EnglishGeneration
JAMR(5-grams)
AMRà(U)Dàlin
UL/IMCS/LETA
Tranducerà linSMT:AMRà Eng
Approaches:• “grammar-based”• SMT/NMT• end-to-end
SemEval
ACL
![Page 31: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/31.jpg)
RIG-GOT-RIOà TriofromRigawithregardstoGOT&RIO;)
“We made the following resourcesavailable to participants: [..] TheJAMR (Flanigan et al., 2016)generation system, as a stronggeneration baseline. [..]” (May &Priyadarshi, 2017)
à
à
à
![Page 32: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/32.jpg)
Underthehood
#mkVP :VV->VP->VP#(frame1 (:ARG1(var frame2)))=>(frame1 (mkVP frame2))/VV_FRAME/ < (/:ARG1/=vp < (/VAR/=var < /FRAME/=v)) #Tregex[move v >1 vp] [relabel vp /^.+$/mkVP/] [delete var] #Tsurgeon
![Page 33: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/33.jpg)
• AlastairButler.Deterministicnaturallanguagegenerationfrommeaningrepresentationsformachinetranslation.NAACLWorkshoponSemantics-DrivenMachineTranslation,2016
InspiredbyButler (2016)
![Page 34: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/34.jpg)
MultilingualAMR-to-Text:experimentTestTrees: t01_girls_see_a_boyTestTreesEng: a girl sees a boy .TestTreesLav: meitene redz zēnu .TestTreesRus: девочка видит мальчика .
TestTrees: t04_two_pretty_girls_see_a_boyTestTreesEng: 2 pretty girls see a boy .TestTreesLav: 2 jaukas meitenes redz zēnu .TestTreesRus: 2 хорошенькие девочки видят мальчика .
TestTrees: t21_girls_who_see_the_game_like_the_boys_who_playTestTreesEng: a girl that sees a game likes a boy that plays .TestTreesLav: meitenei , kas redz spēli , patīk zēns , kas spēlē .TestTreesRus: девочка , которая видит игру нравдит мальчика , которого играет .
TestTrees: t27_they_are_thugs_and_deserve_a_bulletTestTreesEng: they are a thug and it deserves a bullet .TestTreesLav: viņi ir slepkava , un pelna lodi .
![Page 35: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/35.jpg)
UnderthehoodThe overall AMR-to-text process:1. The input AMR is rewritten from the PENMAN notation to the the
LISP-like bracketing tree syntax.2. In case of a multi-sentence AMR, the graph is split into two or more
graphs to be processed separately.3. For each AMR, a sequence of tree pattern-matching transformation
rules is applied (Tregex + Tsurgeon), acquiring a fully or partiallyconverted GF abstract syntax tree (AST).
4. In case of a partially converted AST, the pending subtrees arepruned.**
5. The resulting ASTs are passed to the GF interpreter for RGL-basedlinearization.
6. Since RGL supports many more languages (30+), this approach canbe extended to multilingual AMR-to-text generation, given a largetranslation lexicon (15+).
![Page 36: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/36.jpg)
Underthehood
** Our SemEval submission:Because the coverage of our hand-crafted AMR-to-AST transformationrules is currently far from complete, we used JAMR Generator (Flanigan etal., 2016) as a “fall-back” option for AMRs that are not fully covered bythe current rule set (~200).
However, we applied heuristic post-processing rules to the JAMR output,which might have influenced the human judgements:
• Adding a full-stop, or question mark, or exclamation mark at the endof the sentence, or a wh-word at the beginning, based on the AMRconstructs.
• Removing the remaining (unresolved) AMR constructs and concepts.
• Converting large numbers into words, adding some prepositions, etc.
![Page 37: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/37.jpg)
![Page 38: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/38.jpg)
TheRoleofCNLandAMRinScalableAbstractiveSummarizationforMultilingualMediaMonitoring
![Page 39: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/39.jpg)
BBCmonitoringjournaliststranslate from30languagesintoEnglish,follow 400socialmediaaccounts everyday.
Amonitoringjournalisttypically monitors 4TVchannelsandseveralonlinesourcessimultaneously.Thisisaboutthemaximumthatanypersoncancopewithmentallyandphysically.Therequiredhumaneffortthusscaleslinearly withthenumberofmonitoredsources.
Monitoringjournalistsconstantlyneedtobeonthelookoutformoresources andfollowimportantstories—butasitis,theyaretieddownwithmundane,routinemonitoringtasks.
Monitoring250videochannels resultsinadailybufferof2.5TB,aweeklybufferof19Tb,andanannualbufferof1Pb.
Large-scalemediamonitoring
![Page 40: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/40.jpg)
Identifypeople,places,events ofinterestDiscovertrends,emergingevents,crucialnewstories
H2020grantNo.688139
SUMMA –ScalableUnderstandingofMultilingualMediA
![Page 41: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/41.jpg)
• Event-basedmulti-documentsummarization• Storylinehighlightsacrossasetofrelatedstories
Storylinehighlights
![Page 42: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/42.jpg)
• Extractivesummarizationselectsrepresentativesentencesfromtheinputdocuments
• Abstractivesummarizationbuildsasemanticrepresentationfromwhichasummaryisgenerated
• Whatsemanticrepresentation?
– PropBank/FrameNet– AMR
SentenceA:IsawJoe’sdog,whichwasrunninginthegarden.SentenceB:Thedogwaschasingacat.Summary:Joe’sdogwaschasingacatinthegarden.
LiuF.,Flanigan J.,ThomsonS.,Sadeh N.,SmithN.A.TowardAbstractiveSummarizationUsingSemanticRepresentations.NAACL2015
Abstractivetextsummarization
![Page 43: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/43.jpg)
1. Riga (ULatvia,IMCS/LETA):0.6196
2. CAMR (UBrandeis/BoulderLearningInc./RensselaerPolytechnicInstitute):0.6195
3. ICL-HD(Ruprecht-Karls-Universität Heidelberg):0.6005
4. UCL+Sheffield (UniversityCollegeLondon/USheffield):0.5983
5. M2L(KyotoUniversity):0.5952
6. CMU(CarnegieMellonUniversity/UWashington):0.5636
7. CU-NLP(OKRobotGoLtd./UColorado):0.5566
8. UofR (URochester):0.4985
9. MeaningFactory (UGroningen):0.4702*
10. CLIP@UMD(UMaryland):0.4370
11. DynamicPower (NationalInstituteforJapaneseLanguageandLinguistics):0.3706*
* Rule/grammar-based;didnotuseAMRtrainingdata
SemEval 2016 Task8onAMRparsing
![Page 44: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/44.jpg)
• Unrestrictedlarge-scaleNLU isdifficultforgrammars– SemEval 2016:few grammar-basedsystems– SemEval 2017:no grammar-basedsystems(Boxergaveup…)
• ForNLG,grammar-basedsystemsareverycompetitive!
• ScalingupAMR-to-AST:– AddmoreTregex/Tsurgeon rules– Amoreflexibleandsystematicgraph/tree-transducer(likeUD2GF)– Learningtransformationrules(C6.0;trainingdata?)– Seq-to-seq deeplearning?
Conclusion
![Page 45: AMR-to-Text Generation - Grammatical Frameworkschool.grammaticalframework.org › 2017 › slides › Normunds-AMR... · 2017-08-25 · Multilingual AMR-to-Text: experiment TestTrees:](https://reader033.fdocuments.net/reader033/viewer/2022052802/5f199686f5ddb547764ec314/html5/thumbnails/45.jpg)
• NormundsGrūzītis,Pēteris Paikens,Guntis Bārzdiņš.FrameNetResourceGrammarLibraryforGF.CNL2012
• DanaDannélls,NormundsGrūzītis.ExtractingabilingualsemanticgrammarfromFrameNet-annotatedcorpora.LREC2014
• DanaDannélls,NormundsGrūzītis.ControllednaturallanguagegenerationfromamultilingualFrameNet-basedgrammar.CNL2014
• NormundsGrūzītis,DanaDannélls,BenjaminLyngfelt,Aarne Ranta.Formalising theSwedishConstructiconinGrammaticalFramework.GEAF2015
• NormundsGrūzītis,Guntis Bārzdiņš.TheroleofCNLandAMRinscalableabstractivesummarizationformultilingualmediamonitoring.CNL2016
• NormundsGrūzītis,DanaDannélls.AMultilingualFrameNet-basedGrammarandLexiconforControlledNaturalLanguage.LanguageResourcesandEvaluation,51(1),2017
• NormundsGrūzītis,Didzis Goško,Guntis Bārzdiņš.RIGOTRIOatSemEval-2017Task9:CombiningMachineLearningandGrammarEngineeringforAMRParsingandGeneration.SemEval 2017
Publications