Human Language Technology - Cornell University · 2020-04-16 · • memorable movie quotes (in...
53
Human Language Technology and where it’s headed Jason Baldridge Lillian Lee Philip Resnik @jasonbaldridge (Google me) @psresnik Tuesday, March 13, 2012
Transcript of Human Language Technology - Cornell University · 2020-04-16 · • memorable movie quotes (in...
Human Language Technologyand where it’s headed
Jason Baldridge Lillian Lee Philip Resnik
@jasonbaldridge (Google me) @psresnik
Tuesday, March 13, 2012
the promise
Tuesday, March 13, 2012
Why is this man smiling?
http://www.nature.com/nature/journal/v482/n7386/full/482440a.html
Tuesday, March 13, 2012
The Turing test: AI ≤ language use
http://bittersweetsage.blogspot.com/2010/01/comic-converse-turing-test.html
Turing predicted we’d be close in about 50 years.
Tuesday, March 13, 2012
http://www.openamplify.com/
http://www.desktopmates.com/main.html
=
Operators are standing by
Tuesday, March 13, 2012
lo, the field of sentiment analysis
[http://www.youtube.com/watch?v=vzm6pvHPSGo]
It is the year 2000, but where are the flying cars? I was promised flying cars.
Why isn’t this man smiling?
Instead we got 140 characters.[http://www.foundersfund.com/the-future]
Tuesday, March 13, 2012
we take language-technology successes for granted
Tuesday, March 13, 2012
+
=+
Crowding out spam
Tuesday, March 13, 2012
Machine translation: it’s what’s for news
Slide from Kevin Knight, ISI
Tuesday, March 13, 2012
Siri
http://www.apple.com/iphone/features/siri.html
Tuesday, March 13, 2012
Watson
Ken Jennings, left, and Brad Rutter, right, pose after the episode of "Jeopardy!" that aired Wednesday, Feb. 16, 2011, when Watson, the IBM computer, beat the veteran champs with a total of $77, 147 over two exhibition matches. Credit: AP Photo/Jeopardy Productions Inc.
Tuesday, March 13, 2012
Why is this man smiling?
Tuesday, March 13, 2012
what are realistic expectations?
Tuesday, March 13, 2012
All your meaning are belong to us (?)
Tuesday, March 13, 2012
ALPAC yer bags
Tuesday, March 13, 2012
It’s cold out there, after the hype
Tuesday, March 13, 2012
The Hype Cycle (Gartner)
Tuesday, March 13, 2012
The Hype Cycle (Gartner, 2011)
Tuesday, March 13, 2012
the challenges
Tuesday, March 13, 2012
Child’s play?
What’s a difficult choice you’ve faced?
http
://st
arw
ars.
wik
ia.c
om/w
iki/R
2-D
2
Beep.[htt
p://w
ww
.thes
nick
etco
de.c
om/T
BB.h
tm] Bath or pink dress.
[htt
p://w
ww
.thes
nick
etco
de.c
om/T
BB.h
tm]
Clean my room or listen to my mother sing my least favorite song over and over.
Tuesday, March 13, 2012
What does this sentence mean?
[http://casablancapa.blogspot.com/2010/05/fore.htm]l [http://www.supercoloring.com/pages/duck-outline/]
I saw her duck with a telescope.
verb noun
[http://www.clker.com/clipart-3163.html][http://www.clker.com/clipart-green-eyes-3.html]
[http://www.simonpalfrader.com/category/tournament-poker]
[http://casablancapa.blogspot.com/2010/05/fore.htm]l
Tuesday, March 13, 2012
Ambiguity is pervasive
the a are of I [Steve Abney]
an “are” (100 m2)
another “are”
Tuesday, March 13, 2012
What about this?
我不会说中文的，我只是生成这个例子中，使用谷歌翻译 （所以不要怪我，如果这样做没有任何意义）.
Tuesday, March 13, 2012
[http
://br
owse
.dev
iant
art.c
om/?
qh=
&se
ctio
n=&
glob
al=
1&q=
mus
cled
uck#
/d14
nst5
]I’m sorry, Dave, I’m afraid I can’t do that.
I’m afraid you might be right.
[htt
p://s
elco
uth.
com
/201
1/03
]
Tuesday, March 13, 2012
the game-changers:
• data-driven approaches
• models of language
Tuesday, March 13, 2012
You’ve come a long way, NLP
30,000 now being se
rved
Tuesday, March 13, 2012
Text is pervasive
Tuesday, March 13, 2012
Metadata is plentiful
Tuesday, March 13, 2012
Learning and structure
Tuesday, March 13, 2012
Watson architecture
[http://blog.stephenwolfram.com/2011/01/jeopardy-ibm-and-wolframalpha]/
All knowledge is extracted from pre-stored databases and free form text.
Tuesday, March 13, 2012
Extraction approach: paraphrase learning
Is Snooki on stork watch?
[All 8 results are from March 2011 or earlier]
Ex: Barzilay and Lee, NAACL 2003surveys: http://www.jair.org/media/2985/live-2985-5001-jair.pdf, http://www.mitpressjournals.org/doi/pdfplus/10.1162/coli_a_00002
Tuesday, March 13, 2012
Extraction approach: paraphrase learning
Snooki and fiancé Jionni LaValle are expecting their first child together
Angie Harmon on Stork WatchBy Marcus Errico
Angie Harmon's going from assistant district attorneying to diaper duty.The former Law & Order legal dish is expecting her first child with football stud hubby Jason Sehorn, her publicist confirmed Tuesday.
Bowie & Iman On Stork WatchBY GEORGE RUSH DAILY NEWS COLUMNISTMonday, February 14, 2000
Rock legend David Bowie and supermodel Iman said yesterday they're expecting their first child
Is Snooki on stork watch?
Snooki?!Tuesday, March 13, 2012
onward: Where we’re headed
Tuesday, March 13, 2012
Meme me up http://memetracker.org/
Tuesday, March 13, 2012
The pulse of the media
J. Leskovec, L. Backstrom, J. Kleinberg. Meme-tracking and the Dynamics of the News Cycle. ACM SIGKDD Intl. Conf. on Knowledge Discovery and Data Mining, 2009.
Tuesday, March 13, 2012
Why is this man smiling?
C. Danescu-Niculescu-Mizil et al. ACL 2012
Beyond situational effects, phrasing also affects memorability:
• memorable movie quotes (in aggregate) are unusual word choices built on a scaffolding of common part-of-speech patterns ‣shown via language models
• carries over to ad slogans
http
://w
ww
.sch
wim
mer
lega
l.com
/200
6/11
/evi
denc
e-of
-sec
onda
ry-m
eani
ng-in
-tv-
catc
hphr
ases
.htm
l
Tuesday, March 13, 2012
Using social interaction: Twitter sentiment
Obama is making the repubs look silly and petty
bird images from http://www.mytwitterlayout.com/
http
://st
arw
ars.
wik
ia.c
om/w
iki/R
2-D
2
“Obama”, “silly”, “petty”
is happy Obama is president
Obama’s doing great!
=
=
(hopefully)
“Obama”, “silly”, “petty”
Papers: Speriosu et al. 2011; Tan et al. KDD 2011
Tuesday, March 13, 2012
Social interaction: who has the lead?Communicative behaviors are “patterned and coordinated, like a dance” [Niederhoffer and Pennebaker, ‘02]
http
://m
inim
alm
ovie
post
ers.
tum
blr.c
om/p
ost/
1608
2323
317/
pulp
-fict
ion-
by-a
na-b
alde
rram
as
adah ja ad to the adajkj the
adah ja ad at a adajkj the
adah ja ad of adajkj the
adah ja ad of adajkj the
adah to ja ad an adajkj gh
adah ja ad the adajkj forhgh
Those with less power tend to immediately match the function-word choices of those with less power. [C. Danescu-Niculescu-Mizil et al. WWW 2012]
Tuesday, March 13, 2012
Moderator asked what?
Tuesday, March 13, 2012
What does a word mean?
Tuesday, March 13, 2012
mountainbeach
wine barbecue
Where’s a word on Earth?
Tuesday, March 13, 2012
cool
kool coo
kewl
Ur so kool so I know ur in Houston
Tuesday, March 13, 2012
Automatic geolocation
Tuesday, March 13, 2012
Mapping conflicts
Tuesday, March 13, 2012
Temporality of words, by hour http://www.tweetolife.com/hour/
Tuesday, March 13, 2012
Temporality of expressions, by day: http://www.google.com/trends
Tuesday, March 13, 2012
He says, she says http://www.tweetolife.com/gender/
Tuesday, March 13, 2012
public service announcement
Tuesday, March 13, 2012
Mistakes are consequential
http://davidrothman.net/2009/09/02/all-your-healthbase-are-belong-to-us-want-em-back/
Tuesday, March 13, 2012
Being right can be consequential too
Narayanan et al 2012: “On the Feasibility of Internet-Scale Author Identification”Tuesday, March 13, 2012
wrapping up
Tuesday, March 13, 2012
Some final text (finally)
• Things are moving fast
• learning
• scalability, both data and computation
• depth of representation
Tuesday, March 13, 2012
Why is this man smiling?
We may hope that machines will eventually compete with men in all purely intellectual fields. But which are the best ones to start with? Even this is a difficult decision.... I do not know what the right answer is, but I think [different] approaches should be tried.
We can only see a short distance ahead, but we can see plenty there that needs to be done.
Tuesday, March 13, 2012
