Silviu Cucerzan Researcher Microsoft Corporation.
40
Silviu Cucerzan Silviu Cucerzan Researcher Researcher Microsoft Corporation Microsoft Corporation
-
Upload
leon-lewis -
Category
Documents
-
view
218 -
download
2
Transcript of Silviu Cucerzan Researcher Microsoft Corporation.
Silviu CucerzanSilviu CucerzanResearcherResearcherMicrosoft CorporationMicrosoft Corporation
Browsed Browsed DocumentDocument
Search BoxSearch Box
heat shield
------------------------------------------------------------------------------------------------------------
ALL PREVIOUS INTERACTIONSALL PREVIOUS INTERACTIONS
Browsed Browsed DocumentDocument
Search BoxSearch Box
heat shield
NASANASA
Space stationSpace station
Solar panelsSolar panels
DiscoveryDiscovery
Space shuttleSpace shuttle
Space labSpace lab
John CurryJohn Curry
AtmosphericAtmospheric
reentryreentry
Power systemPower system
Peter KingPeter King
CBS NewsCBS News
Associated PressAssociated Press
Real-time user intent
distribution
moviesnewsfan clubbiographygalleryofficial siteinterviewspictureswallpaperpostersimdbquotesscreensavers
...28 airplane invention27 printing press invention42 light bulb invention
29 airplane inventor18 printing press inventor18 light bulb inventor
13 inventor of the airplane 27 inventor of the printing press 35 inventor of the light bulb
58 invention of airplane 50 invention of printing press 66 invention of light bulb
4 who invented airplanes3 who invented light bulbs
3 who invented the first airplane
5 who invented the first light bulb
...
...22 bicycle invention25 bicycle inventor9 bicycle inventors2 invented the bicycle2 inventers of the bicycle25 invention of bicycle31 invention of the bicycle3 invention of the first bicycle4 inventions of the bicycle13 inventor of bicycle15 inventor of the bicycle2 inventorofbicycles10 the invention of the bicycle6 the inventor of the bicycle2 when the bicycle was invented4 when was the bicycle invented2 when was the first bicycle invented3 where was the bicycle invented11 who invented bicycle77 who invented the bicycle3 who invented the first bicycle
...
bicycleWeb
Encarta Text
AskMSR who invented the bicycle?
Surface form Mention of an entityreferred to as “Bush”
George W. BushGeorge H. W. BushBush, music bandReggie Bush…
Bush
The entity George W. Bush: George W. Bush, George Bush, President Bush, Bush, …
Text document
Named entityNamed entityrecognizerrecognizer
George W. BushGeorge H. W. BushBush, music bandReggie Bush…
Texas, US stateTexas, pop bandTexas, novelUniversity of Texas at Austin…
Texas, US state
George W. Bush
Named entityNamed entityrecognizerrecognizer
Bush
Text document
Texas
Challenges:Challenges:Reference Reference
entitiesentitiesWorld World
knowledge knowledge
Page TitleFirst Paragraph
Surface Form/Disambiguation
such as 'Let Me Blow Ya Mind' by Eve and [[Gwen Stefani]] (whom he would produce …
In the video ''[[Cool (song)|Cool]]'', [[Gwen Stefani]] is made-up as Monroe. …
'[[South Side (song)|South Side]]' (featuring [[Gwen Stefani]]) #14 US …
[[1969]] - [[Gwen Stefani]], American singer ([[No Doubt]]) …
[[Rosie Gaines]], [[Carmen Electra]], [[Gwen Stefani]], [[Chuck D]], [[Angie Stone]], …
In late [[2004]], [[Gwen Stefani]] released a hit song called 'Rich Girl' which …
[[Gwen Stefani]] - lead singer of the band [[No Doubt]], who is now a successful …
[[Social Distortion]], and [[TSOL]]. [[Gwen Stefani]], lead vocalist of the [[alternative rock]] ...
main proponents (along with [[Gwen Stefani]] and [[Ashley Judd]]) in bringing back the …
The [[United States|American]] singer [[Gwen Stefani]] references Harajuku in several …
which also features vocals by [[No Doubt]]'s [[Gwen Stefani]]. The cover was included on …
co-written by [[Eric Stefani]] and [[Gwen Stefani]] and co-produced by Matthew Wilder …
…
E.g.: 385 references of Gwen Stefani in other Wikipedia articles
Texas
Texas (US State)University of Texas
AustinUSS Texas
Texas (band)Texas (musical)
Texas (TV Series)Texas (novel)
Texas (SpongeBob episode)
Texas InstrumentsTexas County, OK
...
≈ 30
e.g.: Texas
Surface FormsSurface Forms
Texas (TV Series)
Tags: NBC network showsAmerican television
soapsTelevision spin-offs
Contexts:Another World
Pam LongPaul Rauch
...
EntitiesEntities
the titles of entity pagesthe titles of redirecting pagesthe disambiguation pagesthe references to entity pages in other Wikipedia articles.
• the titles of entity pages
the titles of entity pagesthe titles of redirecting pagesthe disambiguation pagesthe references to entity pages in other Wikipedia articles.
• the titles of redirecting pages
the titles of entity pagesthe titles of redirecting pagesthe disambiguation pagesthe references to entity pages in other Wikipedia articles.
• the disambiguation pages
the titles of entity pagesthe titles of redirecting pagesthe disambiguation pagesthe references to entity pages in otherWikipedia articles.
• the references to entity pages in other
• Wikipedia articles
Texas (TV Series)
List pages (“List of [...]” “Table of [...]”)
540,000 pairs
Wikipedia categories2.65 million pairs
Lexicosyntactic patternsnoisy
• List pages (“List of [...]” “Table of [...]”)
List pages (“List of [...]” “Table of [...]”)
540,000 pairs
Wikipedia categories2.65 million pairs
Lexicosyntactic patternsnoisy
• Wikipedia categories
List pages (“List of [...]” “Table of [...]”)
540,000 pairs
Wikipedia categories2.65 million pairs
Lexicosyntactic patternsnoisy
• Lexicosyntactic patterns
LEX_Scotland_Music_#1
Appositives and parentheticals in the titlesE.g.:Texas (TV Series)
Texas, Queensland
Entity references (links)
Appositives and parentheticals in the titlesE.g.:Texas (TV Series)
Texas, Queensland
Entity references (links)
Appositives and parentheticals in the titlesE.g.:Texas (TV Series)
Texas, Queensland
Entity references (links)• Entity references (links)
Truecasing
Named EntityRecognition
DocumentAnalysis
Disambiguation
CoreferenceResolution
Stage 1: Sentence boundary detection and truecasing (sentence beginnings and titles)
Stage 2: Structural ambiguity resolutionConjunctions (e.g., Barnes and Noble)Possessives (e.g., Britain’s Tony Blair)Pp attachment (e.g., Whitney Museum in
New York)
by using Wikipedia and Web statistics:T1 Particle T2 search engine query “T1”
“T2”
Stage 3: 5-way named entity classification
Stage 4: Coreference resolutionShorter to longer formse.g., Brown/PERSON Michael Brown/PERSON Acronyms
Web and Corpus StatsRegular ExpressionsGazetteers
GazetteersWeb SearchQuery LogsWikipedia Entities
CoNLL 2003 StatisticsGazetteers
Heuristics
1
1
1)|(|1 ,...,
ss
s ee
i
i
ii ss
sk
s eee )|(|1 ,...,,...,
Text document Ds1
si
sj
snMaximize the similarity between the
document context d and each entity’s contextsas well as the category tags of each entity pair.
C = {c1,…,cM} - known contexts (all surface forms and appositives/parentheticals)T = {t1,…,tN} - known category tags
d = D ∩ C
1
1
1)|(|1 ,...,
ss
s ee
i
i
ii ss
sk
s eee )|(|1 ,...,,...,
j
j
jj ss
sl
s eee )|(|1 ,...,,...,
n
n
n ss
s ee )|(|1 ,...,
ii sk
sk TC ,
jj sl
sl TC ,
Optimization problem:
n
i
n
jee
n
ie
eeij
jii
nssn
TTdC1 11),..,(
,,maxarg)(..)1(
1
n
ieee
sseeiii
nn
TdTC1)(..)(),..,(
),0(),,(maxarg11
niTdTCiii
ii
eeese
..1,||||),,(maxarg 2
)(
# category tags of ei
More robust and simpler :
)( )(DSs se
eTdd
Development:Reference: Wikipedia ver. 04/02/2006100 news stories from MSNBC
Evaluation:Reference: Wikipedia ver. 09/11/2006Test sets:
Wikipedia data: 88.3%News: 91.4%
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after
the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.
Microsoft Research Faculty Summit 2007
