Common Sense is not so Common Sense is not so commoncommon

Presented by Subhendra BasuPresented by Subhendra Basu

MotivationMotivation

• Computers can :Computers can :a)a) Beat people at chessBeat people at chessb)b) Recognise patternsRecognise patternsc)c) Assemble cars in factoriesAssemble cars in factoriesd)d) Pilot planes or shipsPilot planes or ships• But NO computer canBut NO computer cana)a) Read a bookRead a bookb)b) Clean a houseClean a housec)c) Baby-sitBaby-sitd)d) Drive on Noida roadsDrive on Noida roads

Motivation (contd)Motivation (contd)

• Whats wrong with computers ?Whats wrong with computers ?

a)a) Do they need more memory, speed, Do they need more memory, speed, complexity ?complexity ?

b)b) Is it due to wrong kinds of instruction sets ?Is it due to wrong kinds of instruction sets ?

Answer: Deficiencies of today’s machines stem Answer: Deficiencies of today’s machines stem from the limited ways of programming themfrom the limited ways of programming them

IntroductionIntroduction

• This presentation deals with questions about what it This presentation deals with questions about what it takes to have common sense like us.takes to have common sense like us.

• Can machines have common sense ?Can machines have common sense ?• Is it possible to have intelligence without emotion ?Is it possible to have intelligence without emotion ?• Are we machines ?Are we machines ?• Most of the statements in this presentation are Most of the statements in this presentation are

speculations. speculations. • This is not an evidence of scientific scholarship but an This is not an evidence of scientific scholarship but an

adventure story for the imaginationadventure story for the imagination

Uncommon SenseUncommon Sense

• A 1956 program solved hard problems in mathematical A 1956 program solved hard problems in mathematical logic. It was only in the 1970s could people come up logic. It was only in the 1970s could people come up with a robot programs to play with children’s building with a robot programs to play with children’s building blocks.blocks.

• To be considered an “expert”, one needs a large To be considered an “expert”, one needs a large amount of knowledge of only a relatively few varieties. amount of knowledge of only a relatively few varieties. In contrast, an ordinary person’s “common sense” In contrast, an ordinary person’s “common sense” involves a much larger variety of different types of involves a much larger variety of different types of knowledge-and this requires more complicated knowledge-and this requires more complicated management systems.management systems.

Common SenseCommon Sense• ““Common Sense is not so common. Instead, it is an immense Common Sense is not so common. Instead, it is an immense

society of hard-earned practical ideas-of multitudes of life-society of hard-earned practical ideas-of multitudes of life-learned rules and exceptions, disposition and tendencies, learned rules and exceptions, disposition and tendencies, balances and checks.”balances and checks.”

• Here is a part of a story: “Taniya was invited to Basu’s party. She Here is a part of a story: “Taniya was invited to Basu’s party. She wondered if he would like a pen. She went to her room and wondered if he would like a pen. She went to her room and shook her piggy bank. It made no sound”shook her piggy bank. It made no sound”

Why did Taniya shake her piggy bank ? Why did Taniya shake her piggy bank ? No computer yet knows how to answer a question like that.No computer yet knows how to answer a question like that.• A computer program with some “common sense” was made by A computer program with some “common sense” was made by

Dr. Push Singh at MIT. It was implemented in LISP with a Dr. Push Singh at MIT. It was implemented in LISP with a PROLOG subsystemPROLOG subsystem

• We are least aware of what our minds do best.We are least aware of what our minds do best.

Society of MindSociety of Mind

• The term “Society of Mind” was coined by Prof. The term “Society of Mind” was coined by Prof. Marvin Minsky at MIT Media LabMarvin Minsky at MIT Media Lab

• Mind is made of many smaller processes called Mind is made of many smaller processes called agents. Each agent by itself has no intelligence agents. Each agent by itself has no intelligence but when organised in societies leads to true but when organised in societies leads to true intelligence.intelligence.

• ““The Author” = Prof Marvin MinskyThe Author” = Prof Marvin Minsky• The Author says, “In science, one can learn the The Author says, “In science, one can learn the

most by studying what seems the least”most by studying what seems the least”

The World of BlocksThe World of BlocksBUILDER

BEGIN ADD END

FIND PUTGET

SEE GRASP MOVE RELEASE

Choose a place to start the tower Add a new block to the towerDecide whether it is high enough

First ADD must FIND a new block.Then the hand must GET that block and PUT it on the tower top

Double LifeDouble Life

• Builder leads a double life.Builder leads a double life.• Its “knowing-how-to-build” does not reside in Its “knowing-how-to-build” does not reside in

any part. Where does it get its ability ?any part. Where does it get its ability ?• The answer: Its not sufficient to know what each The answer: Its not sufficient to know what each

agent does. We have to know which agent talks agent does. We have to know which agent talks to which of the other and in what ways.to which of the other and in what ways.

• Builder, as an agency knows its jobBuilder, as an agency knows its job• Builder, as an agent knows nothing at all.Builder, as an agent knows nothing at all.

PanalogyPanalogy

““Rajeev gave Bikram the book.”Rajeev gave Bikram the book.”Physical Realm: “give” refers to book’s motion through spacePhysical Realm: “give” refers to book’s motion through spaceSocial Realm: Rajeev’s motivation. Was Rajeev just being generous, Social Realm: Rajeev’s motivation. Was Rajeev just being generous,

or hoping to ingratiate himselfor hoping to ingratiate himselfDominion Realm: Bikram is not only holding the book but also has Dominion Realm: Bikram is not only holding the book but also has

gained permission to hold it.gained permission to hold it.When we select an inappropriate realm of thought, we immediately When we select an inappropriate realm of thought, we immediately

switch to a relevant point of view, without starting over again. switch to a relevant point of view, without starting over again. The Author argues that our brains use special machinery that The Author argues that our brains use special machinery that links corresponding aspects of each view to the same ‘role’ or links corresponding aspects of each view to the same ‘role’ or ‘slot’ in a larger-scale structure that is shared across several ‘slot’ in a larger-scale structure that is shared across several different realms. Such a structure is called “Panalogy” or different realms. Such a structure is called “Panalogy” or “Parallel Analogy” “Parallel Analogy”

Mystery of the MindMystery of the Mind

• How is a personality more than just a set of How is a personality more than just a set of traits? (subjective)traits? (subjective)

Why is a chain more than its various links ? Why is a chain more than its various links ? (objective)(objective)

• Mind still holds its mystery – because we still Mind still holds its mystery – because we still know so little how mental agents interact to know so little how mental agents interact to accomplish all the things they do.accomplish all the things they do.

Are we machines ?Are we machines ?

• The Author claims, “Each one of us already has experienced The Author claims, “Each one of us already has experienced what it is like to be simulated by a computer.”what it is like to be simulated by a computer.”

• ““I certainly don’t feel like a machine.” But if you’re not a I certainly don’t feel like a machine.” But if you’re not a machine how can you say how it feels like to be a machine. machine how can you say how it feels like to be a machine.

• ““I think, therefore I know how the mind works.” == “I drive I think, therefore I know how the mind works.” == “I drive my car so I know how the engine works.” Knowing to use my car so I know how the engine works.” Knowing to use something is not the same as knowing how it works.something is not the same as knowing how it works.

• Still even if our brain is a kind of computer, its scale is very large. Still even if our brain is a kind of computer, its scale is very large. The Author argues that when we finally discover how to make The Author argues that when we finally discover how to make intelligent programs, the task of building machines for them to intelligent programs, the task of building machines for them to inhabit will be a solved problem.inhabit will be a solved problem.

ConflictConflict

PLAY

PLAY-WITH-DOLLS PLAY-WITH-BLOCKS PLAY-WITH-ANIMALS

BUILDER WRECKER

BEGIN ADD END PUSHER

EAT SLEEP

NoncompromiseNoncompromise

• Its easy to ward off small distractions when Its easy to ward off small distractions when things are going well. But when there is conflict things are going well. But when there is conflict or the agents are individually incompetent, a or the agents are individually incompetent, a different interest takes control.different interest takes control.

• Tiny mental agents simply cannot know enough Tiny mental agents simply cannot know enough to be able to negotiate with one another or to to be able to negotiate with one another or to find effective ways to adjust to each other’s find effective ways to adjust to each other’s interference. Only larger agencies could be interference. Only larger agencies could be resourceful enough to do such things.resourceful enough to do such things.

MiscellanyMiscellany

• Hierarchy or HeterarchyHierarchy or Heterarchy• What happens if another agent wrests control What happens if another agent wrests control

from Play and what happens to the agents Play from Play and what happens to the agents Play controlled ?controlled ?

Ans: Many different possibilities:Ans: Many different possibilities:a)a) Wrecker, freed from Play’s constraint wrecks Wrecker, freed from Play’s constraint wrecks

the whole thingthe whole thingb)b) Child goes to bed but “builds” towers in his Child goes to bed but “builds” towers in his

head.head.

Pain, Pleasure and InfatuationPain, Pleasure and Infatuation

• Pain and pleasure simplifies our point of view. They engage the Pain and pleasure simplifies our point of view. They engage the same agencies so they appear opposed. Both distract us from same agencies so they appear opposed. Both distract us from long term goals. They interfere with our ability to plan by making long term goals. They interfere with our ability to plan by making us focus to relieve/prolong our present feelings.us focus to relieve/prolong our present feelings.

• “ “I can scarcely think of anything else.” (Most of my mind has I can scarcely think of anything else.” (Most of my mind has stopped working)stopped working)

“ “Unbelievably perfect” (No sensible person believes such things)Unbelievably perfect” (No sensible person believes such things) “ “She has flawless character” (I’ve abandoned my critical faculties)She has flawless character” (I’ve abandoned my critical faculties) “ “There is nothing I would not do for her” (I’ve forsaken most of There is nothing I would not do for her” (I’ve forsaken most of

my usual goals)my usual goals)

SelfSelf

• Single-self view: “I think, I want, I feel. Its me, myself, Single-self view: “I think, I want, I feel. Its me, myself, who think my thoughts. Its not some nameless crowd who think my thoughts. Its not some nameless crowd or cloud of selfless parts.”or cloud of selfless parts.”

• Multiple-self view: “One part of me wants this, another Multiple-self view: “One part of me wants this, another part wants that. I must get better control of myself.”part wants that. I must get better control of myself.”

• A paradox: Perhaps its because there are no persons in A paradox: Perhaps its because there are no persons in our heads to make us do the things we want – nor even our heads to make us do the things we want – nor even ones to make us want to want – that we construct the ones to make us want to want – that we construct the myth that we’re inside ourselves.myth that we’re inside ourselves.

ConsciousnessConsciousness

• In every normal person’s mind, there are In every normal person’s mind, there are processes that we call consciousness. According processes that we call consciousness. According to popular belief, they enable use to know what to popular belief, they enable use to know what is happening inside our minds. This is is happening inside our minds. This is misleading.misleading.

• Our conscious thoughts use signal-signs to steer Our conscious thoughts use signal-signs to steer the engines in our minds, controlling countless the engines in our minds, controlling countless processes of which we’re never much aware.processes of which we’re never much aware.

Problem SolvingProblem Solving

• Puzzle Principle: We can program a computer to solve Puzzle Principle: We can program a computer to solve any problem by “generate and test”, without knowing any problem by “generate and test”, without knowing how to solve it in advance, provided only that we have how to solve it in advance, provided only that we have a way to recognize when the problem is solved.a way to recognize when the problem is solved.

• The only problem is the lack of connection between its The only problem is the lack of connection between its generator and its test. Without some notion of progress generator and its test. Without some notion of progress towards a goal, its hard to do better than mindless towards a goal, its hard to do better than mindless chance.chance.

• The most powerful way is to divide the problem into The most powerful way is to divide the problem into smaller subproblems.smaller subproblems.

Difference EnginesDifference Engines

SITUATION

GOAL – DESCRIPTION

AGENTS

Actual Inputs

Ideal Inputs

DIFFERENCES

IntentionsIntentions

• Do difference-engines “really” want ?Do difference-engines “really” want ?• ““Rolling ball”: Eighteenth-century physicist Rolling ball”: Eighteenth-century physicist

d’Alembert showed that one predict the d’Alembert showed that one predict the behavior of a rolling ball by describing it as a behavior of a rolling ball by describing it as a difference-engine whose goal is to reduce its difference-engine whose goal is to reduce its own energy.own energy.

• The ball isn’t “trying” to do anything; the The ball isn’t “trying” to do anything; the impression of intention is only in the observer’s impression of intention is only in the observer’s mind.mind.

GeniusGenius

• How do we explain our Einsteins and Beethovens ?How do we explain our Einsteins and Beethovens ?• Its not enough to learn a lot; one also has to manage Its not enough to learn a lot; one also has to manage

what one learns.what one learns.• These masters have, beneath the surface of their These masters have, beneath the surface of their

mastery, some special knacks of “higher-order” mastery, some special knacks of “higher-order” expertise, which help them organize and apply the expertise, which help them organize and apply the things they learn. things they learn.

• It is these hidden tricks of mental management that It is these hidden tricks of mental management that produce the systems that create these works of genius.produce the systems that create these works of genius.

Memory : K-LinesMemory : K-Lines• The Author proposes a theory of memory based on the idea of a The Author proposes a theory of memory based on the idea of a

type of agent called a “Knowledge-line” or “K-Line” for short.type of agent called a “Knowledge-line” or “K-Line” for short.• We keep each thing we learn close to the agents that learn it in We keep each thing we learn close to the agents that learn it in

the first place.the first place.• Whenever you “get a good idea”, solve a problem or have a Whenever you “get a good idea”, solve a problem or have a

memorable experience, you activate a K-line to represent it. A K-memorable experience, you activate a K-line to represent it. A K-Line is a wirelike structure that attaches itself to whichever Line is a wirelike structure that attaches itself to whichever mental agents are active when you solve a problem or have a mental agents are active when you solve a problem or have a good idea.good idea.

• When you activate that K-Line later, the agents attached to it are When you activate that K-Line later, the agents attached to it are aroused, putting you in a “mental state” much like the one you aroused, putting you in a “mental state” much like the one you were in when you solved the problem or got that idea. This were in when you solved the problem or got that idea. This should make it relatively easy for you to solve new, similar should make it relatively easy for you to solve new, similar problems.problems.

Do you want what you like ?Do you want what you like ?

• Liking’s job is to shut off alternatives. Liking’s job is to shut off alternatives. • To choose between alternatives, the highest levels of To choose between alternatives, the highest levels of

the mind demand the simplest summaries. If your “top-the mind demand the simplest summaries. If your “top-level” feelings are mixed, you wouldn’t be able to take a level” feelings are mixed, you wouldn’t be able to take a decision. At the level of action, you’re forced to decision. At the level of action, you’re forced to simplify right down to expressions like “Yes” or “No”.simplify right down to expressions like “Yes” or “No”.

• To “enjoy” an experience, some of our agents must To “enjoy” an experience, some of our agents must summarize success – but other agents must be summarize success – but other agents must be censuring their subordinates for failing to achieve their censuring their subordinates for failing to achieve their goals.goals.

• The surer you are that you like what you are doing, the The surer you are that you like what you are doing, the more completely your other ambitions are being more completely your other ambitions are being suppressed.suppressed.

Enjoying discomfortEnjoying discomfort

• What makes ordinary people work for years at jobs they What makes ordinary people work for years at jobs they hate, so that someday they will be able to…some seem hate, so that someday they will be able to…some seem to have forgotten what ? Why do children enjoy rides in to have forgotten what ? Why do children enjoy rides in Appu Ghar, knowing that they will be scared, even Appu Ghar, knowing that they will be scared, even sick ?sick ?

• There is more to motivation than immediate reward. There is more to motivation than immediate reward. Once we have solved a problem, our agencies get down Once we have solved a problem, our agencies get down to catering to a higher-level cause for discontent. to catering to a higher-level cause for discontent. Nothing gets done if we were satisfied.Nothing gets done if we were satisfied.

• When a situation gets completely out of control, we When a situation gets completely out of control, we construct some inner plan for tolerating it. For construct some inner plan for tolerating it. For example, “I certainly shall learn from this.”example, “I certainly shall learn from this.”

EmotionEmotion• ““There is no such thing as an There is no such thing as an emotion machineemotion machine.”.”• We’re always using images and fantasies in ordinary thought.We’re always using images and fantasies in ordinary thought. We use “imagination” to solve a geometry problem, or choose We use “imagination” to solve a geometry problem, or choose

what to eat for dinner. what to eat for dinner. • The use of fantasies, emotional or not, is indispensable for every The use of fantasies, emotional or not, is indispensable for every

complicated problem-solving process.complicated problem-solving process.• Our culture wrongly teaches us that thoughts and feelings lie in Our culture wrongly teaches us that thoughts and feelings lie in

almost separate worlds. In fact, they’re always intertwined. almost separate worlds. In fact, they’re always intertwined. • Emotions are varieties or types of thoughts, each based on a Emotions are varieties or types of thoughts, each based on a

different brain-machine that specializes in some particular different brain-machine that specializes in some particular domain of thought. domain of thought.

• The question is not whether intelligent machines can have The question is not whether intelligent machines can have emotions, but whether machines can be intelligent without any emotions, but whether machines can be intelligent without any emotions.emotions.

Mathematics Made HardMathematics Made Hard

• Mathematics is the quest for absolute consistencyMathematics is the quest for absolute consistency• Teachers try to convince their students that equations Teachers try to convince their students that equations

and formulas are more expressive than words. and formulas are more expressive than words. • Unless the new ideas become connected to the rest of Unless the new ideas become connected to the rest of

the child’s world, that knowledge can’t be put to work.the child’s world, that knowledge can’t be put to work.• The ordinary goals of ordinary citizens are not the same The ordinary goals of ordinary citizens are not the same

as those of professional mathematicians and as those of professional mathematicians and philosophers- who like to put things into forms with as philosophers- who like to put things into forms with as few connections as possible.few connections as possible.

JokesJokes• In 1905, Sigmund Freud published a book explaining that we In 1905, Sigmund Freud published a book explaining that we

form censors in our minds as barriers against forbidden form censors in our minds as barriers against forbidden thoughts. Most jokes, he said, are stories designed to fool the thoughts. Most jokes, he said, are stories designed to fool the censors.censors.

• A joke’s power comes from a description that fits two different A joke’s power comes from a description that fits two different frames at once. The first meaning must be transparent and frames at once. The first meaning must be transparent and innocent, while the second meaning is disguised and innocent, while the second meaning is disguised and reprehensible.reprehensible.

• The censors recognize only the innocent meaning because they The censors recognize only the innocent meaning because they are too simple-minded to penetrate the forbidden meaning’s are too simple-minded to penetrate the forbidden meaning’s disguise. Then, once that first interpretation is firmly planted in disguise. Then, once that first interpretation is firmly planted in the mind, a final turn of word or phrase suddenly replaces it with the mind, a final turn of word or phrase suddenly replaces it with the other one. The censored thought has been slipped through; a the other one. The censored thought has been slipped through; a prohibited wish has been enjoyed.prohibited wish has been enjoyed.

ConclusionConclusion

• A brain or a machine that has a mind must be A brain or a machine that has a mind must be composed of smaller things that cannot think at all. The composed of smaller things that cannot think at all. The structure of this presentation reflects this idea.structure of this presentation reflects this idea.

• A mind is too complex to fit the mold of narratives that A mind is too complex to fit the mold of narratives that start out here and end up there; a human intellect start out here and end up there; a human intellect depends upon the connections in a tangled web-which depends upon the connections in a tangled web-which simply wouldn’t work at all if it were neatly straightened simply wouldn’t work at all if it were neatly straightened out. out.

• We are very far from developing true intelligence in a We are very far from developing true intelligence in a machine but it is good to have a beginningmachine but it is good to have a beginning

ReferencesReferences

1.1. ““The Society of Mind” by Dr. Marvin Minsky, The Society of Mind” by Dr. Marvin Minsky, Simon & Schuster Paperbacks, 1988Simon & Schuster Paperbacks, 1988

2.2. ““Computing Commonsense”, P.Singh, Computing Commonsense”, P.Singh, M.Minsky and I Eslick, BT Technology M.Minsky and I Eslick, BT Technology Journal, Vol 22 No 4, Oct 2004Journal, Vol 22 No 4, Oct 2004

3.3. ““The Emotion Machine” by Marvin Minsky, The Emotion Machine” by Marvin Minsky, draft (http://web.media.mit.edu/~minsky)draft (http://web.media.mit.edu/~minsky)

DISCUSSION