Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf ·...
Transcript of Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf ·...
![Page 1: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/1.jpg)
Can we teach morals to A.I.?Rosa M. Gil
Universitat de Lleida
Webminars
![Page 2: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/2.jpg)
1st. Option
We can make programs
![Page 3: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/3.jpg)
https://www.theverge.com/2016/10/5/13160546/i-robot-folio-society-edition-illustrations-art-isaac-asimov
alicedmedia.blogspot.com
![Page 4: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/4.jpg)
Japan’s “Ten Principles of Robot Law”
1. Robots must serve mankind.2. Robots shall never kill or injure humans.3. Robots shall call the human that creates them “father.”4. Robots can make anything, except money.5. Robots shall never go abroad without permission.6. Male and female robots shall never change roles.7. Robots shall never change thier appearance or assume anotheridentity without permission.8. Robots created as adults shall never act as children.9. Robots shall not assemble other robots that have been scrappedby humans.10. Robots shall never damage human homes or tools.
htt
ps:
//ak
iko
k01
2u
m1
.wo
rdp
ress
.co
m/j
apan
s-te
n-p
rin
cip
les-
of-
rob
ot-
law
/
1988
![Page 5: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/5.jpg)
Judeo-Christian monotheism also
adheres to the doctrine that only God can
give life
…any human who breathes life into an
inanimate object is assuming the role of
God and thereby becoming a false idol.
Such a blasphemer deserves
punishment, and in the conventions of
science fiction, this usually comes in theform of betrayal by the robots.https://www.technologyreview.com/s/421187/why-japanese-love-robots-and-americans-fear-them/
![Page 6: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/6.jpg)
“In Japan… they’re culturally open to robots, on account of
animism. They don’t make a distinction between inanimate objects
and humans.”
Animism is a component of the Shinto
faith, the religion that preceded the
introduction of Buddhism to Japan and
remains an influential part of the
country’s culture. Animism is the notion
that all objects have a spirit - even man-
made objectshttps://www.technologyreview.com/s/421187/why-japanese-love-robots-and-americans-fear-them/
![Page 7: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/7.jpg)
It is very hard to specify directly values! because there are infinitely manyundesirable outcomes in an open
world.
Consequences
![Page 8: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/8.jpg)
They mimic us (some examples)
• Eugene Goostman a chatbot passed the Turing Test
• 7 June 2014. Portrayed as being a 13-year-old boy from Odessa, Ukraine, who has a pet guinea pig and a father who is a gynaecologist.
• Chat bots in human beings social networks• Simulated a person on Tinder.
• Alphabet chairman says Google Duplex passes Turing test in one specific way (2018)
• Cleverbot in 2011 …
![Page 9: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/9.jpg)
Learning
Facebook and Stanford researchers design a chatbot thatlearns from its mistakes (January
17, 2019)
![Page 10: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/10.jpg)
Learning
Can neural network computers learn fromexperience, and if so, could they ever become
what we would call 'smart'? And could twodifferent neural networks teach each other
what they know, thereby making each other a better network?
October 2019
https://www.scientificamerican.com/article/can-neural-network-comput/
![Page 11: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/11.jpg)
Some answers …
• Neural network computers can learn from eachother
• Its 'smartness' is confined to a single task, which isnot what 'smart' typically implies
• While the network may be capable of assimilatingthe old and the new knowledge, this would in alllikelihood require that the network re-learn boththe old and the new concepts.
![Page 12: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/12.jpg)
Has Skynet been born?• KAIROS, short for Knowledge-directed Artificial
Intelligence Reasoning Over Schemas
![Page 13: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/13.jpg)
“Aladdin has an effect on the management of around ten per cent of theworld’s financial assets, or around $20 trillion. Over 25 years, it has growninto a system that is directly or indirectly responsible for more than fourtimes the value of all the money in the world.”
It is an electronic system by BlackRock Solutions, the risk
management division of the largest investment
management corporation, BlackRock, Inc. In 2013, it
handled about $11 trillion in assets (including BlackRock's
$4.1 trillion assets), which was about 7% of the world's
financial assets, and kept track of about 30,000 investmentportfolios.
![Page 14: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/14.jpg)
Can we make artificial intelligence ethical?
“The sooner we come to an understanding of AI thatensures its powerful capabilities are a net positive forpeople and workers, the more wisely we can developand deploy it. And the more talented young peoplefrom all disciplines we train to think critically aboutAI, the more we can guarantee our leadership in thisvital area for the long term”
WEDNESDAY, JANUARY 23, 2019Stephen A. Schwarzman
Blackstone Chairman, CEO and Co-Founder$300M MIT150M Oxford
![Page 15: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/15.jpg)
Intelligent Nudges in AI
Unique InsightsHumu’s insights combine thousands of employee data inputs to focus teams on the actions that matter most.Nudge Engine®Humu's Nudge Engine® delivers personal, achievablesuggestions that make every employee a change agent.
![Page 16: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/16.jpg)
Rooting in emotions …
Emospark is an emotionally-aware AI console for thehome
EmoSPARK is an artificial intelligence
console created in London, United
Kingdom by Patrick Levy-Rosenthal.
The device uses facial recognition and
language analysis to evaluate human
emotion and convey responsive content
according to the emotion
2007
![Page 17: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/17.jpg)
Emotional Intelligence
•Affectiva develops software thatunderstands people’s emotionaland cognitive states by analyzingtheir facial expression.
![Page 18: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/18.jpg)
http
s://med
ium
.com
/@m
ark_riedl/
hu
man
-centered
-artificial-in
telligence-7
0b
01
9f9
56
d1
![Page 19: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/19.jpg)
Understanding humansCommonsense
and corrupted reward)
![Page 20: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/20.jpg)
AI Systems Helping HumansUnderstand Them
• AI Rationalization (It is our hypothesis that AI rationalization will promote feelings of trust, rapport, and comfort in non-experts operatingautonomous systems and robots)
A Neural Machine Translation Approach to GeneratingNatural Language Explanationshttps://arxiv.org/abs/1702.07826
![Page 21: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/21.jpg)
Computational Creativity
![Page 22: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/22.jpg)
https://www.nvidia.com/en-us/research/ai-playground/
![Page 23: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/23.jpg)
We can teach morals to robots bytelling them stories?
Commonsense
and
corrupted reward)
![Page 24: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/24.jpg)
Using stories to generate a value-alignedreward signal for reinforcement learningagents that prevents psychotic-appearing
behavior
https://www.cc.gatech.edu/~riedl/pubs/aaai-ethics16.pdf
![Page 25: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/25.jpg)
Stories encode many types of sociocultural knowledge: commonlyshared knowledge, social protocols, examples of proper and improper
behavior, and strategies for copingwith adversity
![Page 26: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/26.jpg)
Humans learn sociocultural values bybeing immersed within a society and a culture. While not all humans act
morally all the time, humans seem to adhere to social and cultural norms
more often than not withoutreceiving an explicitly written down
set of moral codes
![Page 27: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/27.jpg)
An intelligent entity must learn to align its values with that of humans
![Page 28: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/28.jpg)
Storytelling is a strategy forcommunicating tacit knowledge
![Page 29: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/29.jpg)
How can it be implemented?
![Page 30: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/30.jpg)
Use of reinforcement learning to control agent behavior, and
computational reasoning aboutnarratives.
![Page 31: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/31.jpg)
Reinforcement learning (RL) is theproblem of learning how to act in a world so as to maximize a reward
signal.
![Page 32: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/32.jpg)
Many believe RL, especially whencombined with deep neural
networks to predict the long-termvalue of actions, may be part of a framework for artificial general
intelligence
Deep reinforcement learning
![Page 33: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/33.jpg)
![Page 34: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/34.jpg)
Computational NarrativeIntelligence
Narrative intelligence is the the ability to craft, tell, and understand stories
https://arxiv.org/pdf/1806.06877.pdf
![Page 35: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/35.jpg)
Automated Story Generator
A process of finding a sequence of eventsthat are consistent with the model thentranslating abstract events into natural
language
![Page 36: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/36.jpg)
Scheherazade system from a valuealignment perspective because of the ability to learn a procedural
understanding of how a story abouta particular topic can unfold without
a priori hand-coded knowledge
![Page 37: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/37.jpg)
Value alignment in a reinforcement learning agent
theoretically can be achieved byproviding the agent with a rewardsignal that encourages it to solvea given problem and discourages
it from performing any actionsthat would be considered
harmful to humans
![Page 38: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/38.jpg)
Quixote
![Page 39: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/39.jpg)
Automated Measures
To test that automated measurescorrelate with human judgments wecompare the scores our algorithms
produce to the scores from thehuman-subject study
![Page 40: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/40.jpg)
Evaluation of story generationsystems
• Grammaticality
• Narrative Productivity (“interesting language” and “avoiding repetition”)
• Local Contextuality (capture differences in contextbetween adjacent sentences). Ex: Sent2Vec measure
• Temporal Ordering (temporal ordering Bayesianestimate and“temporal ordering” results)
https://www.cc.gatech.edu/~riedl/pubs/purdy-aiide18.pdf
![Page 41: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/41.jpg)
Rosa M. Gil Iranzo
Thank youvery much
https://www.linkedin.com/in/rosa-gil197206/https://www.researchgate.net/profile/Rosa_Gil
![Page 42: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/42.jpg)
Can creativity be automated?• Google’s technology, known as NSynth, is even able to
merge the characteristics of different instruments to create new sounds.
• there is a great deal of artistic input that goes in beforethe AI can start to put together the pieces. In someways, this could be described as artistic optimizationrather than creation, using machine learning to essentially carry out focus groups at a greater scale and speed than would be possible using traditionaltechniques. Creatives have put together the pieces of the campaign and the different ideas, while themachine learning helps to choose the combinationsthat work best.
https://www.sentient.ai/blog/ai-power-become-creative/
![Page 43: Can we teach morals to A.I.?hci-collab.com/wp-content/uploads/2018/12/Webinar_RosaGil.pdf · Emospark is an emotionally-aware AI console for the home EmoSPARK is an artificial intelligence](https://reader033.fdocuments.net/reader033/viewer/2022043012/5fa87610aee61a25ec5d1f5c/html5/thumbnails/43.jpg)
Van Gogh: Loving Vincent (2017)
• https://www.imdb.com/title/tt3262342/videoplayer/vi1862449433?ref_=tt_ov_vi
https://deepdreamgenerator.com/#gallery