Natural Language Semantics · Natural Language Semantics Leonid Kof [email protected] Technische...
Transcript of Natural Language Semantics · Natural Language Semantics Leonid Kof [email protected] Technische...
![Page 1: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/1.jpg)
Natural Language SemanticsLeonid Kof
Technische Universitat Munchen
Natural Language Semantics – p. 1
![Page 2: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/2.jpg)
Outline
1. Motivation (→ Turing Test)
2. How is NL–Semantics defined?
3. Is NL–Semantics compositional?
4. How do different sentences interact? (→ DiscourseRepresentation Theory)
5. Non–compositional approachesVerb framesParsing & annotation
Natural Language Semantics – p. 2
![Page 3: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/3.jpg)
Turing Test
Question
AnswerComputer?Human?
Natural Language Semantics – p. 3
![Page 4: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/4.jpg)
Outline
1. Motivation (→ Turing Test)
2. How is NL–Semantics defined?
3. Is NL–Semantics compositional?
4. How do different sentences interact? (→ DiscourseRepresentation Theory)
5. Non–compositional approachesVerb framesParsing & annotation
Natural Language Semantics – p. 4
![Page 5: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/5.jpg)
Semantics Definition
Verb = Main Predicate
Alice loves Bob = love(Alice, Bob)
Alice loves a man = ∃x.(man(x) ∧ love(Alice, x ))
Every woman loves Bob =∀x.(woman(x) → love(x , Bob))
Every woman loves a boxer =∃x.(boxer(x) ∧ (∀y.(woman(y) → love(y , x ))))
Every woman loves a boxer =∀y.(woman(y) → ∃x.(boxer(x) ∧ love(y , x )))
Natural Language Semantics – p. 5
![Page 6: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/6.jpg)
Outline
1. Motivation (→ Turing Test)
2. How is NL–Semantics defined?
3. Is NL–Semantics compositional?
4. How do different sentences interact? (→ DiscourseRepresentation Theory)
5. Non–compositional approachesVerb framesParsing & annotation
Natural Language Semantics – p. 6
![Page 7: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/7.jpg)
Compositionality Problem
Words are in the “wrong” order
Alice loves Bob = love(Alice, Bob) Ã
love, Alice, Bob
Alice loves a man = ∃x.(man(x) ∧ love(Alice, x )) Ã
a, man, love, Alice, . . .
. . .
Natural Language Semantics – p. 7
![Page 8: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/8.jpg)
Sidestep:λ–Calculus
Function abstraction:λx.(function expression)
Function application:expression1 expression2
β–Reduction:(λx.(function expression)) argument =function expression[x/argument]
Natural Language Semantics – p. 8
![Page 9: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/9.jpg)
Semantics withλ–Terms
Special λ–term for every word class
Proper names: Alice = λP.(P@Alice)
Common names: woman = λy.(woman(y))
Intransitive verbs: walks = λx.(walk(x ))
Transitive verbs: loves = λX.(λz.(X@(λx.love(z , x ))))
“every”: every = λP.(λQ.(∀x.((P@x) → (Q@x))))
“a”: a = λP.(λQ.(∃y.((P@y) ∧ (Q@y))))
Natural Language Semantics – p. 9
![Page 10: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/10.jpg)
Does it really work?
Alice loves Bob =
(λP.(P@Alice))@((λX.(λz.(X@(λx.love(z , x )))))@(λP.P@Bob)) =(λP.(P@Alice))@(λz.((λP.P@Bob)@(λx.love(z , x )))) =(λP.(P@Alice))@(λz.(λx.love(z , x )@Bob)) =(λP.(P@Alice))@(λz.love(z , Bob)) =(λz.love(z , Bob))@Alice =love(Alice, Bob)
Natural Language Semantics – p. 10
![Page 11: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/11.jpg)
Outline
1. Motivation (→ Turing Test)
2. How is NL–Semantics defined?
3. Is NL–Semantics compositional?
4. How do different sentences interact? (→ DiscourseRepresentation Theory)
5. Non–compositional approachesVerb framesParsing & annotation
Natural Language Semantics – p. 11
![Page 12: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/12.jpg)
Sentence Interaction
Alice is a woman. She loves Bob.
What is a possible λ–term for “she”?
Natural Language Semantics – p. 12
![Page 13: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/13.jpg)
Sentence Interaction
There is no λ–term for “she”!!!
Natural Language Semantics – p. 13
![Page 14: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/14.jpg)
Discourse Representation Structures 1/4
x1, x2, x3
P1(x1, x2, x3)
P2(x1, x2, x3)
P3(x1, x2, x3)
Natural Language Semantics – p. 14
![Page 15: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/15.jpg)
Discourse Representation Structures 2/4
Alice loves Bob
Alice, Bob
love(Alice, Bob)
Natural Language Semantics – p. 15
![Page 16: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/16.jpg)
Discourse Representation Structures 3/4
Alice loves a man
Alice, x
man(x)
love(Alice, x)
Natural Language Semantics – p. 16
![Page 17: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/17.jpg)
Discourse Representation Structures 4/4
Every women loves a boxer
x
woman(x)
y
boxer(y)love(x, y)
→
Natural Language Semantics – p. 17
![Page 18: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/18.jpg)
Anaphora Resolution
A woman loves a boxer. She walks
x, y, z
woman(x), boxer(y)
loves(x, y)
z = x
walk(z)
Natural Language Semantics – p. 18
![Page 19: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/19.jpg)
Outline
1. Motivation (→ Turing Test)
2. How is NL–Semantics defined?
3. Is NL–Semantics compositional?
4. How do different sentences interact? (→ DiscourseRepresentation Theory)
5. Non–compositional approachesVerb framesParsing & annotation
Natural Language Semantics – p. 19
![Page 20: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/20.jpg)
Verb Frames
Verb frame = verb with its arguments
Component X sends message Y to component Z=
send (Component X, message Y, component Z)
Verb frame defines:
Verb type (predicate type)
Predicate argument structure
Natural Language Semantics – p. 20
![Page 21: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/21.jpg)
Sidestep: Part–of–Speech Tagging
Each word is assigned a Part–of–Speech tag:
Coponent X sends message Y to component Z Ã
Component/NN X/NN sends/VBZ message/NN Y/NN to/TOcomponent/NN Z/NN
Natural Language Semantics – p. 21
![Page 22: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/22.jpg)
Verb Frames as Templates
templatename=communicationframe
sender(POS=NN, syn=subject, sem=agent)comm-action(pos=VB, syn=verb-phrase,
default=’send’)message (...)prep (..., default=’to’)receiver (...)
end
Natural Language Semantics – p. 22
![Page 23: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/23.jpg)
Semantics Computation with Frames
Finite number of possible frames
POS–tagging as preprocessing
Semantics computation is matching of actual sentenceswith predefined frames(Ã POS–Sequence matching)
Natural Language Semantics – p. 23
![Page 24: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/24.jpg)
Frame example
Component/NN X/NN sends/VBZ message/NN Y/NN to/TOcomponent/NN Z/NN Ã
Component/NN X/NN sendersends/VBZ send
message/NN Y/NN messageto/TOcomponent/NN Z/NN receiver
à send (Coponent X, message Y, component Z)
Natural Language Semantics – p. 24
![Page 25: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/25.jpg)
Outline
1. Motivation (→ Turing Test)
2. How is NL–Semantics defined?
3. Is NL–Semantics compositional?
4. How do different sentences interact? (→ DiscourseRepresentation Theory)
5. Non–compositional approachesVerb framesParsing & annotation
Natural Language Semantics – p. 25
![Page 26: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/26.jpg)
Sidestep: NL Parsing
Oversimplified:
Chomsky–2 Grammar
Each rule is assigned a probability
The parser calculates the most probable parse tree
Probability distribution is calculated on the basis ofmanually crafted training data
Natural Language Semantics – p. 26
![Page 27: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/27.jpg)
Training Data Example
Alice loves Bob =
NN/Alice
S/loves
NPB/Alice
VBZ/loves
VP/loves
NPB/Bob
NN/Bob
Natural Language Semantics – p. 27
![Page 28: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/28.jpg)
Semantics Annotation in Training Data
Alice loves Bob =
NN/Alice
Actor/Alice VBZ/loves Patient/Bob
Predicate/loves
S/loves
NN/Bob
Natural Language Semantics – p. 28
![Page 29: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/29.jpg)
Summary
Goal: Extract predicates (verbs) with their arguments
Firm and statistical approaches
None is really working
Natural Language Semantics – p. 29
![Page 30: Natural Language Semantics · Natural Language Semantics Leonid Kof kof@in.tum.de Technische Universitat M¨ unchen¨ Natural Language Semantics – p. 1](https://reader033.fdocuments.net/reader033/viewer/2022041717/5e4c2882d4e0d66023031142/html5/thumbnails/30.jpg)
That’s all, folks !!!
Natural Language Semantics – p. 30