Open hpi semweb-06-part6
-
Upload
nadine-ludwig -
Category
Documents
-
view
70 -
download
0
description
Transcript of Open hpi semweb-06-part6
This file is licensed under the Creative Commons Attribution-NonCommercial 3.0 (CC BY-NC 3.0)
Dr. Harald Sack
Hasso Plattner Institute for IT Systems Engineering
University of Potsdam
Spring 2013
Semantic Web Technologies
Lecture 6: Applications in the Web of Data06: Named Entity Recognition
Semantic Web Technologies , Dr. Harald Sack, Hasso-Plattner-Institut, Universität Potsdam
2
Lecture 6: Applications in the Web of DataOpen HPI - Course: Semantic Web Technologies
Semantic Web Technologies , Dr. Harald Sack, Hasso-Plattner-Institut, Universität Potsdam
3
06 - Named Entity RecognitionOpen HPI - Course: Semantic Web Technologies - Lecture 6: Applications in the Web of Data
Context
Pragmatics
Experience
Experience
Semantic Web Technologies , Dr. Harald Sack, Hasso Plattner Institute, University of Potsdam
4
Meaning
Symbol Objectstands for
sender
receiver
refers tosymbolizes
Concept
„Jaguar“
Ogden, Richards: The Meaning of Meaning: A Study of the Influence of Language upon Thought and of the Science of Symbolism (1923)
Armstrong
,Armstrong‘ is more than just a character string
Neil Armstrong
,Armstrong‘ is more than just a character string
Neil Armstrong
Astronaut
is a
,Armstrong‘ is more than just a character string
Neil Armstrong
Astronaut
is a
Science Occupation
subClassOf
,Armstrong‘ is more than just a character string
Neil Armstrong
Astronaut
is a
Science Occupation
subClassOf
Employment
subClassOf
,Armstrong‘ is more than just a character string
Neil Armstrong
Astronaut
is a
Person
is a
Science Occupation
subClassOf
Employment
subClassOf
,Armstrong‘ is more than just a character string
Neil Armstrong
Astronaut
is a
Person
is a
Science Occupation
subClassOf
Employment
subClassOfhas an
,Armstrong‘ is more than just a character string
Neil Armstrong
Astronaut
is a
Person
is a
Science Occupation
subClassOf
Employment
subClassOf
Entities
Ontologies
has an
,Armstrong‘ is more than just a character string
Neil Armstrong
Astronaut
is a
Person
is a
Science Occupation
subClassOf
Employment
subClassOf
Entities
Ontologies
has an
,Armstrong‘ is more than just a character string
is NOT a
Neil Armstrong
Astronaut
is a
Person
is a
Science Occupation
subClassOf
Employment
subClassOf
Entities
Ontologies
has an
,Armstrong‘ is more than just a character string
Cosmonautsame as
is NOT a
Neil Armstrong
Astronaut
is a
Person
is a
Science Occupation
subClassOf
Employment
subClassOf
Entities
Ontologies
has an
,Armstrong‘ is more than just a character string
Cosmonautsame as
Juri Gagarin
is a
is NOT a
Neil Armstrong
Astronaut
is a
Person
is a
Science Occupation
subClassOf
Employment
subClassOf
Entities
Ontologies
has an
,Armstrong‘ is more than just a character string
Kosmonautsame as
Juri Gagarin
is a
is NOT a
Named Entity Recognition
(also Entity Identification or Entity Extraction)
„locating and classifying atomic elements...into
predefined categories such as names, persons,
organizations, locations, expressions of time,
quantities, monetary values, etc.“
C.J.Rijsbergen, Information Retrieval (1979)
Where does the knowledge come from...?
Where does the knowledge come from...?
Where does the knowledge come from...?
Web of Data = Linked Open Data
Armstrong
Astronaut Person
Neil Armstrong
Science Occupation
Employment
is a is a
subClassOf
subClassOf
Entity Mapping
Armstrong
Pragmatics
Experience
Experience
Semantic Web Technologies , Dr. Harald Sack, Hasso Plattner Institute, University of Potsdam
12
Meaning
Symbol Objectstands for
sender
receiver
refers tosymbolizes
Concept
Armstrong
Ogden, Richards: The Meaning of Meaning: A Study of the Influence of Language upon Thought and of the Science of Symbolism (1923)
http://commons.wikimedia.org/wiki/User:McSmit
Pragmatics
Experience
Experience
Semantic Web Technologies , Dr. Harald Sack, Hasso Plattner Institute, University of Potsdam
12
Meaning
Symbol Objectstands for
sender
receiver
refers tosymbolizes
Concept
Armstrong
Ogden, Richards: The Meaning of Meaning: A Study of the Influence of Language upon Thought and of the Science of Symbolism (1923)
http://commons.wikimedia.org/wiki/User:McSmit
Context
Armstrong landed the Eagle on the Moon.
Armstrong landed the Eagle on the Moon.
Determine all possible Entity Mapping Candidates
• linguistic analysis (POS tagging)• normalization• encoding and spelling• special (language dependent) characters• language dependent spellings• abbreviations, acronyms• type dependent spellings• alternative names and synonyms• fuzzy string mapping• ...
Armstrong landed the Eagle on the Moon.
Determine all possible Entity Mapping Candidates
Armstrong landed the Eagle on the Moon.
Determine all possible Entity Mapping Candidates
Armstrong, Florida
Armstrong, Ontario
Armstrong County, Texas
Armstrong Tunnel
Louis Armstrong
Armstrong Tools
Armstrong (moon crater)
Armstrong (car)
The Armstrongs
Craig Armstrong
Anton Armstrong
Edward Armstrong
Gary Armstrong
George Armstrong
The Armstrong Twins
Ian Armstrong
+ 400 more...
Neil Armstrong
Armstrong Bridge
Lance Armstrong
Armstrong, Ontario
Armstrong landed the Eagle on the Moon.
Entity Selection process is determined by• context• ambiguity of source data / mapping• accuracy /reliability of source data / mapping
Armstrong landed the Eagle on the Moon.
Armstrong, Florida
Armstrong, Ontario
Armstrong County, Texas
Armstrong Tunnel
Louis Armstrong
Armstrong Tools
Armstrong (moon crater)
Armstrong (car)
The Armstrongs
Craig Armstrong
Anton Armstrong
Edward Armstrong
Gary Armstrong
George Armstrong
The Armstrong Twins
Ian Armstrong
+ 400 more...
Neil Armstrong
Armstrong Bridge
Lance Armstrong
Armstrong, Ontario
Entity Selection process is determined by• context• ambiguity of source data / mapping• accuracy /reliability of source data / mapping
Armstrong
George Armstrong Custer
Neil Armstrong
The Armstrong Twins
Armstrong, Florida
Armstrong, Ontario
Armstrong Automobile
Joe ArmstrongArmstrong County, Texass
Armstrong Gun
Craig Armstrong
Armstrong (Moon Crater)
Louis Armstrong
Armstrong Tunnel
Louis Armstrong International Airport
Armstrong‘s Theorem
Sir Thomas Armstrong
Ian Armstrong
Eagle Moon
Eagle (Bird)
Eagle (heraldry)
USCGC Eagle
The Eagle (2011 film)
Eagle (song)
John H. EagleEagle (typeface)
Eagle Falls (Washington)
Eagle (Moon Crater)
Eagle (comic)
Eagle (lunar module)
Eagle TV
Armstrong Tunnel
The Eagle (Pub)
War Eagle
The Eagle (newspaper)
Eagle (racehorse)
Angela EagleLinda Eagle
James Philipp Eagle
95 entities448 entities
Armstrong (British Columbia)Karen Armstrong
Curtis Armstrong
Gillian Armstrong Hilary Armstrong
William L. Armstrong
156 entities
Man on the Moon (film)
Moon (song)
Moon Son-Ri
C Moon
The Moon (Tarot card)
Edgar Moon
Moon OSMoon (Band)
Moon
Moon 44
Man on the Moon (soundtrack)
William Moon
Lottie Moon
Mr. Moon (song)
Man on the Moon (musical)
Darvin Moon
Moon 83
Francis MoonGary Moon
Robert Charles Moon
Black Moon
Allan Moon
Ban-Ki Moon
Fly me to the Moon (song)
Consider all entities within the same context
Armstrong landed the Eagle on the Moon.
Select matching entities from all possible candidate entities:
• Popularity based strategies
• Linguistical strategies
• Statistical strategies
• Semantic based strategies
General Approach
1. Make an assumption
2. Do the strategies support or contradict your assumption
3. Make decision according to logical and probabilistic rules/constraints
Named Entity Recognition Strategies
N. Ludwig, H. Sack, “Named entity recognition for user-generated tags,TIR 2011
• reference text corpus(wikipedia)
• link graph (wikipedia)
• semantic graph(dbpedia)
Entity Selection Process
Consider all entities within the same context
Armstrong landed the Eagle on the Moon.
Consider all entities within the same context
Armstrong landed the Eagle on the Moon.
Consider all entities within the same context
Armstrong landed the Eagle on the Moon.
Consider all entities within the same context
Armstrong landed the Eagle on the Moon.
Consider all entities within the same context
Armstrong landed the Eagle on the Moon.
Consider all entities within the same context
Armstrong landed the Eagle on the Moon.
Armstrong
George Armstrong Custer
The Armstrong Twins
Armstrong, Florida
Armstrong, Ontario
Armstrong Automobile
Joe ArmstrongArmstrong County, Texass
Armstrong Gun
Craig Armstrong
Armstrong (Moon Crater)
Armstrong Tunnel
Louis Armstrong International Airport
Armstrong‘s Theorem
Sir Thomas Armstrong
Ian Armstrong
Eagle Moon
Eagle (Bird)
Eagle (heraldry)
USCGC Eagle
The Eagle (2011 film)
Eagle (song)
John H. EagleEagle (typeface)
Eagle Falls (Washington)
Eagle (Moon Crater)
Eagle (comic)
Eagle TV
Armstrong Tunnel
The Eagle (Pub)
War Eagle
The Eagle (newspaper)
Eagle (racehorse)
Angela EagleLinda Eagle
James Philipp Eagle
95 entities448 entities
Armstrong (British Columbia)Karen Armstrong
Curtis Armstrong
Gillian Armstrong Hilary Armstrong
William L. Armstrong
156 entities
Man on the Moon (film)
Moon (song)
Moon Son-Ri
C Moon
The Moon (Tarot card)
Edgar Moon
Moon OSMoon (Band)
Moon 44
Man on the Moon (soundtrack)
William Moon
Lottie Moon
Mr. Moon (song)
Man on the Moon (musical)
Darvin Moon
Moon 83
Francis MoonGary Moon
Robert Charles Moon
Black Moon
Allan Moon
Ban-Ki Moon
Neil Armstrong
Eagle (lunar module)
Moon
Louis Armstrong
Fly me to the Moon (song)
N. Steinmetz, H.Sack: Semantic Multimedia Information Retrieval Based on Contextual Descriptions, 2013
Entity Selection Process(Semantic) Graph Analysis
Armstrong landed the Eagle on the Moon.
Armstrong landed the Eagle on the Moon.
http://dbpedia.org/resource/Neil_Armstrong
http://dbpedia.org/resource/Apollo_Lunar_Module
http://dbpedia.org/resource/Moon
Semantic Web Technologies , Dr. Harald Sack, Hasso-Plattner-Institut, Universität Potsdam
22
07 - Semantic SearchOpen HPI - Course: Semantic Web Technologies - Lecture 6: Applications in the Web of Data