Toyoaki Nishida Kyoto University · Potential motivations: (1)Interactional goal: to achieve social...
Transcript of Toyoaki Nishida Kyoto University · Potential motivations: (1)Interactional goal: to achieve social...
1. Introduction
Toyoaki NishidaKyoto University
Artificial Intelligence Adv., April 10th, 2013
Copyright © 2013 Toyoaki Nishida All Rights Reserved.
At a marketplace
Under cherry blossom
At a seminar room
Conversation is everywhere in our life
Potential motivations:
(1) Interactional goal: to achieve social goals… inform, inquiry, request, propose, admit, greet, …
(2) Transactional goal: to create and maintain stories… storytelling as understanding and knowledge creation
(3) For entertainment: to play… conversation as a play
Why do people converse with each other?
Conversation is a complex business
Eye gaze
Hand gesture PosturePara linguistic
AskingNegotiating
Proposing
ConvivialitySocial networksTrust
Conversation is a complex business
[Clark 1996]
Adam: Sit down here [pointing at a chair] would youBart: ...
A
B
A+B
AdamBart
Sit down here would you
Conversation is a complex business
Level A’s actions in progress4 A is proposing to B that B sit here for A.3 A is asking B to sit here.2 A is presenting to B a signal composed of “here”
plus pointing at the chair.1 A is executing for B’s perception the articulation of “here”
and the movement of his arm.
Level B’s actions in progress4 B is considering A’s proposal that B sit here for A.3 B is recognizing A’s request for B to sit here.2 B is identifying A’s signal as composed of “here” plus
pointing at the chair.1 B is attending to A’s articulation of “here” and
the movement of A’s arm.
Level Speaker A’s actions Addressee B’s actions4 A is proposing joint project w to B B is considering A’s proposal of w3 A is signaling that p for B B is recognizing that p from A2 A is presenting signal s to B B is identifying signal s from A 1 A is executing behavior t for B B is attending to behavior t from A
[Kendon 2004]
A context‐of‐use study of Open Hand Prone gestures suggests that they all share the semantic theme of stopping or interrupting a line of action that is in progress.
Gestures as a part of speaker’s utterances
The Open Hand Prone Pointing Gesture specifying size, shape and structure of an object
Stop / interrupt
Index Finger Extended Supine (palm down).
Size‐shape‐specifier gesture serving as a referent for the deictic pronoun ‘that’.
[Brown & Yule 1983] [Clark 1996]
Is it very rough down there though?
There are no cobbles
Rough in terms of people
Oh I see
Town
Is it very rough down there though There
are no cobblesThere are no
cobbles
Rough in terms of people?
Are the people
rough?
Town
Town
Is it very rough down there though
Are
the
road
rough?
There
are
no
cobbles
There
are
no
cobbles
There are no cobbles
Fix
Rough in terms of people?
Sync
Is it very rough down there though
Are the people rough?
Town
Town
Is it very rough down there though
Are the road rough?
There are no cobblesThere are no cobbles
There are no cobbles
FixRough in terms of people?
Is it very rough down there though
A B
Conversation is a complex business
Challenge: A robot that can participate in conversation
Augmenting conversation in the realworld
Challenge: Synthetic character who guides the user through the virtual world
Augmenting conversation in virtual environment
What is AI?What is AI?
Artificial intelligence
Artificial mind
Example→ Enthiran (The Robot), 2010
Year AI ICT1940~ 1936: Turing Machine, 1947: von Neumann Computer, 1948: Information
Theory, by C. Shannon and W. Weaver, 1948: Cybernetics by Wiener
1950~ 1952‐62: Checker program by A.Samuel1956: Dartmouth Conference 1957: FORTRAN by J.Backus
1960~ 1961: Symbolic Integration program SAINT by J.Slagle1962: Perceptron by F.Rosenblatt1966: The ALPAC report against Machine Translation by R. Pierce1967: Formula Manipulation System Macsyma by J.Moses1967: Dendral for Mass Spectrum Analysis by E.Feigenbaum
1961: Mathematical theory of Packet Networks by L. Kleinrock1963: Interactive Computer Graphics by I.Sutherland
1968: Mouse and Bitmap display for oN Line System (NLS) by D.C.Engelbart1969: ARPA‐net
1970~ 1971: Natural Language Dialogue System SHRDLU, by T.Winograd1973: Combinatorial Explosion problem pointed out in The Lighthill report1974: MYCIN by T.ShortliffeMid 1970’s: Prial Sketch and Visual Perceptron by D.Marr1976: Automated Mathematician (AM) by D.Lenat1979: Autonomous Vehicle Stanford Cart by H.Moravec
1970: ALOHAnet1970: Relational Database Theory by E.F.Codd1972: Theory of NP‐completeness by S.Cook and R.KarpMid 1970’s: Alto Machine by A.Kay and A.Goldberg1976: Ethernet1979: Spreadsheet Program Visicalc by D.Bricklin
1980~ 1982: Fifth Generation Computer Project1984: The CYC Project by D.LenatMid 1980’s: Back‐propagation algorithm was widely used1985: the Cybernetic Artist Aaron by H.Cohen1986: Subsumption Architecture by R.Brooks1989: An Autonomous Vehicle ALVINN by D.Pomerleau
1982:TCP/IP Protocol by B.Kahn and V.CerfMid 1980’s: First Wireless Tag Products1987: UUNET started the Commercial UUCP Network Connection Service1988: Internet worm (Morris Worm)1989: World Wide Web by T.Berners‐Lee1989: The number of hosts on the Internet has exceeded 100,000.
1990~ 1990: Genetic Programming by J.R.KozaEarly1990’s: TD‐Gammon by G.TesauroMid 1990’s: Data Mining Technology1997: DeepBlue defeated the World Chess Champion G.Kasparov1997: The First Robocup by H.Kitano1999: Robot pets became commercially available
1992: The number of hosts on the Internet has exceeded 1,000,000.1994: Shopping malls on the Internet1994: W3C was founded by T. Berners‐Lee1997: Google Search1998: XML1.0(eXtensible Markup Language) by W3C1998: PayPal
2000~ 2000: Honda Asimo
2004: The Mars Exploration Rovers (Spirit & Opportunity)
2001: Wikipedia.2003: Skype / iTunes store2004: Facebook2005: YouTube / Google Earth2006: Twitter2007: Google Street View
2010~ 2010: Google Driverless Car / Kinect2011: IBM Watson Jeopardy defeated two of the greatest champions2012: Siri
History of AI research in contrast with ICT
Autonomous Vehicles‐ Lego Robots (1998 ‐)‐ European Land‐Robot Trial (2006‐) (original source not found)‐ DARPA Urban Challenge (2007‐)‐The Microtransat Challenge: a transatlantic race of fully autonomous sailing boats. (2006‐)‐ Aerial Robotics (Sept. 28, 2011)Chess (competition ended)‐ Deep Blue defeated Gary Kasparov on May 11th, 1997Education‐ STEM Grand Challenge to develop adaptive, generalizable intelligent tutors (June 5, 2011‐)‐ Hewlett Foundation: Improve Automated Scoring of Student Essays (Jan, 2012)Face Recognition‐ the Face Recognition Vendor test (FRVT) (2002‐)Go‐ Entertainment and Cognitive Science, The University of Electro‐CommunicationLanguage Learning and Understanding‐ Loebner Prize (1990‐)‐ IBM WatsonLunar Robotics‐ NASA Prize for Digging Moon Dirt (September 20, 2005)‐ Google Lunar X Prize (2007‐)Medical Diagnosis and Monitoring‐ Nokia Sensing X Challenge (may 24, 2012)Rescue Operations‐ Robocup Rescue (2001‐)Robotics‐ The DARPA Robotics Challenge (October 2012‐)Japanese Chess (Shogi)‐World Computer Shogi Championship,IPSJ Computer Shogi ProjectShredder Challenge‐ DARPA Shredder Challenge (October 27th‐December 2nd, 2011; solved)Soccer‐ Robocup (1997 ‐)Entrance examination of the University of Tokyo‐ NII Artificial Brain Project: “U Tokyo Robot”
ConceptualTuring Test (1950)
Adapted from AAAI>AITopics>Grand Challenges in AI
Grand Challenges in AIGrand Challenges in AI
Successful Topics of AI
Large-scale Search Knowledge-based Systems Language, Speech, Vision Planning Machine Learning and Data Mining Using AI in Creating Works of Art
AARON (1985)
The Mars Exploration Rovers (2003)
Experiments in Musical Intelligence (1987)
DeepBlue (1997)http://www.research.ibm.com/deepblue/
http://marsrovers.jpl.nasa.gov/mission/spacecraft_surface_rover.html
http://www.kurzweilcyberart.com/
http://arts.ucsc.edu/faculty/cope/http://artsites.ucsc.edu/faculty/cope/mp3page.htm
IBM Watson (2011)http://www-03.ibm.com/innovation/us/watson/index.shtml
ALVINN (An Autonomous Land Vehicle in a Neural Network) on Navlab (1989)http://dl.acm.org/citation.cfm?id=89891
‐ From philosophy to science‐technology
‐ Toy problems to the real world
‐ Powerful tools
‐ Grand challenges and competitions
Change in the style of AI research
Super Intelligence
1997: Deep Blue defeated G. Kasparov… Source: IBM Deep Blue, wikipedia
1997: Official opening of Robocup (H. Kitano)… Source: robocup.org, robocup.or.jp, Wikipedia
1997: Mars Pathfinder… Source: NASA Mars Pathfinfer, Wikipedia
1999: Robot pet SONY AIBO… Source: SONY AIBO, Wikipedia
1999: OpenCV Project… Source: OpenCVWiki,wikipedia
2000: Honda ASIMO… Source: Honda ASIMO, Wikipedia
2004: Mars Exploration Rovers… Source: NASA‐JPL
2010: Google Driverless Car… Source: Wikipedia, Sebastian Thrun’s home page, 3P
2010: Kinect… Source: xbox.com, Wikipedia
2011: IBM Watson defeated two Jeopardy! champions… Source: IBM Watson, Wikipedia
2011: iPhone Siri… Source: Apple, Wikipedia
2011: Google Voice Search… Source: Google
2012: Zen Takemiya Masaki with 4 stones … Source: Sig ECS, UEC2012: Google Glass Project
… Source: Project Glass2012: NTT DOCOMO’s Shabette Concier
… NTT DOCOMOOther: Smarter than You Think (New York Times)
Year Title 邦題 Who Trailers Wikipedia
1968 2001: A Space Odyssey 2001年宇宙の旅 HAL9000
http://www.youtube.com/watch?v=uU4TQ1NTo50
http://ja.wikipedia.org/wiki/2001%E5%B9%B4%E5%AE%87%E5%AE%99%E3%81%AE%E6%97%85
1977 Star Wars スターウォーズ C‐3PO, R2‐D2 http://www.starwars.com/
http://ja.wikipedia.org/wiki/%E3%82%B9%E3%82%BF%E3%83%BC%E3%83%BB%E3%82%A6%E3%82%A9%E3%83%BC%E3%82%BA%E3%83%BB%E3%82%B7%E3%83%AA%E3%83%BC%E3%82%BA
1982 Blade Runner ブレードランナー Replicantshttp://wn.com/Trailer_Blade_Runner
http://ja.wikipedia.org/wiki/%E3%83%96%E3%83%AC%E3%83%BC%E3%83%89%E3%83%A9%E3%83%B3%E3%83%8A%E3%83%BC
1984 The Terminator ターミネーター The terminatorhttp://wn.com/terminator_1_trailer
http://ja.wikipedia.org/wiki/%E3%82%BF%E3%83%BC%E3%83%9F%E3%83%8D%E3%83%BC%E3%82%BF%E3%83%BC_(%E6%98%A0%E7%94%BB)
1987 RoboCop ロボコップ RoboCop (cyborg)http://movies.yahoo.com/movie/robocop/
http://ja.wikipedia.org/wiki/%E3%83%AD%E3%83%9C%E3%82%B3%E3%83%83%E3%83%97
1993 War Games ウォー・ゲームWOPR: War Operation Plan Response
http://wn.com/trailer_war_games
http://ja.wikipedia.org/wiki/%E3%82%A6%E3%82%A9%E3%83%BC%E3%83%BB%E3%82%B2%E3%83%BC%E3%83%A0_(%E6%98%A0%E7%94%BB)
1994 Disclosure ディスクロージャー Angelhttp://www.cinemagia.ro/trailer/disclosure‐hartuire‐sexuala‐5931/
http://ja.wikipedia.org/wiki/%E3%83%87%E3%82%A3%E3%82%B9%E3%82%AF%E3%83%AD%E3%83%BC%E3%82%B8%E3%83%A3%E3%83%BC_(%E6%98%A0%E7%94%BB)
1998 Bicentennial ManアンドリューNDR114
Andrew, a new NDR‐114 robot
http://www.filmsnmovies.com/video/13004/bicentennial_man_trailer/
http://ja.wikipedia.org/wiki/%E3%82%A2%E3%83%B3%E3%83%89%E3%83%AA%E3%83%A5%E3%83%BCNDR114
1999 The Matrix マトリクス Computerhttp://trailers.apple.com/trailers/wb/thematrix/trailer/
http://ja.wikipedia.org/wiki/%E3%83%9E%E3%83%88%E3%83%AA%E3%83%83%E3%82%AF%E3%82%B9_(%E6%98%A0%E7%94%BB)
2001 A.I. Artificial Intelligence A.I. David , achild Mecha
http://wn.com/artificial_intelligence
http://ja.wikipedia.org/wiki/A.I.
2002 Minority Report マイノリティレポートInsect robots(user interface is interesting, too)
http://wn.com/minority_report_official_trailer
http://ja.wikipedia.org/wiki/%E3%83%9E%E3%82%A4%E3%83%8E%E3%83%AA%E3%83%86%E3%82%A3%E3%83%BB%E3%83%AA%E3%83%9D%E3%83%BC%E3%83%88
2004 I, ROBOT アイ,ロボット V.I.K.I . , Sonnyhttp://trailers.apple.com/trailers/fox/i_robot/trailer3/ap_lg.html
http://ja.wikipedia.org/wiki/%E3%82%A2%E3%82%A4,%E3%83%AD%E3%83%9C%E3%83%83%E3%83%88
2009 ATOM Astro boy Astro boy Astro boyhttp://www.bing.com/videos/watch/video/astro‐boy‐trailer/5farfvx
http://ja.wikipedia.org/wiki/ATOM_(%E6%98%A0%E7%94%BB)
2009 Avatar アバター (tele‐existence) http://movies.foxjapan.com/avatar/
http://ja.wikipedia.org/wiki/%E3%82%A2%E3%83%90%E3%82%BF%E3%83%BC
2009 Surrogate サロゲート (tele‐existence)http://trailers.apple.com/trailers/touchstone/surrogates/
http://ja.wikipedia.org/wiki/%E3%82%B5%E3%83%AD%E3%82%B2%E3%83%BC%E3%83%88_(%E6%98%A0%E7%94%BB)
Recent topics AI in the movies
Traditional AI Wow!Wow!
Wow!Wow!
Wow!
Wow!Wow!
Wow!
Wow!Wow!
Wow!
Wow!Wow!
Wow!Wow!
Wow!
Wow!Wow!
Wow!
Wow!Wow!
Wow!
‐ Machine intelligence alone will not help much.
‐ Process is more important than result.
‐ Researcher’s satisfaction may not benefit society.
Problems with the traditional AI framework
Dark side of super intelligenceDark side of super intelligence
Technology abuse
Responsibility flaw
Moral in crisis
Over‐dependency on technology
(Technological) singularity(Technological) singularity
The day when machine intelligence surpasses human intelligence.
IEEE Spectrum June 2008 issuehttp://spectrum.ieee.org/biomedical/ethics/signs‐of‐the‐singularity
“The AI Scenario: We create superhuman artificial intelligence (AI) in computers.”
“The IA Scenario: We enhance human intelligence through human‐to‐computer interfaces‐‐that is, we achieve intelligence amplification (IA).”
The fear of utopia
So what?So what?
Dismiss as nonsense.
Neo‐Luddism.
Invent a better solution.
Endow AI with empathic capabilities.
Future AI
Glad to stay with you!
• Service• Presence• Empathy
Embedding AI in the society
DeepBlue Entertain with a game
IBM Watson Entertain with a game
Siri Conversation partner
(AI that can pass entrance exam) Effective and affective tutor
Traditional AI:High competence
Future AI:High empathy
EmpathyEmpathy
I am in difficultyTell me
Can we endow artifacts with empathic capabilities?Can we endow artifacts with empathic capabilities?
‐> ”Can machines have minds?”
The impossibility of artificial mind(Hubert Dreyfus,…).
The media equation (Byron Reeves, Clifford Nass)
The intentional stance(Daniel Dennet)
The brain creates our mental world (Chris Frith)
Can we build artificial minds?Can we build artificial minds?
Machine‐like humansHuman‐like artifacts
Brain
The mental world created by our brain
Super intelligence
Clouded Society
Sharing hypothesisSharing hypothesis
The more is shared, the more empathy is gained.
Thought
Perception
Embodiment
Life
Common Ground
The role of conversational intelligence
CI People
Bootstrapping approach to endow computational intelligence with a capability to build a common ground with people for proficient communication.
Conversational IntelligenceConversational Intelligence
I have a problem
May I help you?
Problem Solving
Intelligence
EmotionalIntelligence
ConversationalIntelligence
SocialIntelligence
Our approach
Application
Platform
Evaluation
Content production Model building
Analysis
Conversational interactions
Theory
Measurement
1. This course centers on conversations.2. Why conversations?
‐> Foundation of thought and communication3. Why do people converse with each other?
‐> As a part of social interaction, for creating and maintaining stories, for fun.
4. The complexity of conversations:‐> Multi‐level, multi‐layered, polysemy, polymorphism, coordination of multi‐modality.
5. People are not only proficient in expressing ideas but also skillful in interpreting utterances, thereby they learn from each other.
6. Building a conversationally intelligent agents helps people effectively communicate with each other by conversations.
7. Conversational intelligence can be counted as an important branch of artificial intelligence.
8. We will integrate the engineering and scientific approached to conversation.
Summary
References
[Brown & Yule 1983] Gillian Brown and George Yule. Discourse Analysis, Cambridge University Press, 1983.[Clark 1996] Herbert H. Clark. Using Language. Cambridge, Cambridge University Press (1996)[Kendon 2004] Kendon, A.: Gesture, Cambridge University Press, 2004[Nishida 2012a] Toyoaki Nishida: The Best of AI in Japan - Prologue. AI Magazine 33(2): 108-111, 2012
http://www.aaai.org/ojs/index.php/aimagazine/article/view/2358/2288[Nishida 2012b] Toyoaki Nishida: Artificial intelligence research in the second half century, Journal of Information Processing and Management 55(7):
461-471, 2012 (in Japanese)http://dx.doi.org/10.1241/johokanri.55.461
[Nishida 2013a] Toyoaki Nishida: What’s AI, Journal of Japanese Society for Artificial Intelligence 28(2): 326-335, 2013 (in Japanese)[Nishida 2013b] Toyoaki Nishida: Conversation Quantization as a Foundation of Conversational Intelligence. DNIS 2013: 230-245, 2013.
http://dx.doi.org/10.1007/978-3-642-37134-9_18
Agenda of this course
Credits:Will be awarded based on one or more reports on subjects given at the class.
Calendar (tentative)
1. Artificial intelligence and conversational intelligence (April 10)2. History of conversational system development (April 17)3. The architecture of conversational systems (April 24)4. Conversation measurement and analysis (May 1)5. Learning by mimicking and time‐series data mining (May 15)6. Techniques for time‐series data mining (May 22)7. Formation and maintenance of joint intentions (May 29)8. Production and management of conversation content (June 5)9. Conversation as phenomenon (June 12)10. Gestures (June 19)11. Turn‐taking system (June 26)12. Language use (July 3)13. Affective computing (July 10)14. Cognitive mechanism underlying conversation (July 17)15. Summary (July 24)
For more details: http://www.ii.ist.i.kyoto‐u.ac.jp/?page_id=4467&lang=ja