Post on 03-Jan-2016
LearningLearning
Modules (Chapters) 20, 21, 22Modules (Chapters) 20, 21, 22Pages 303 - 338Pages 303 - 338
LearningLearning LearningLearning
relatively relatively permanent permanent change in an change in an organism’s organism’s behavior due behavior due to experienceto experience
AssociationAssociation We learn by associationWe learn by association
Our minds naturally connect events that Our minds naturally connect events that occur in sequenceoccur in sequence
Associative LearningAssociative Learning learning that two events occur togetherlearning that two events occur together
a response and its consequencesa response and its consequences
AssociationAssociation
Learning to Learning to associate associate two eventstwo events
Event 1 Event 2
Sea snail associates splash with a tail shock
Seal learns to expect a snack for its showy antics
Classical or Pavlovian Classical or Pavlovian ConditioningConditioning
We learn We learn to to associate associate two two stimulistimuli
OperantOperant ConditioningConditioning
We learn to We learn to associate a associate a response response and its and its consequencconsequencee
Classical Classical ConditioningConditioning
Ivan PavlovIvan Pavlov 1849-19361849-1936 Russian Russian
physician/ physician/ neurophysiologisneurophysiologistt
Nobel Prize in Nobel Prize in 19041904
studied digestive studied digestive secretionssecretions
Pavlov’s Classic Pavlov’s Classic ExperimentExperiment
Before Conditioning
During Conditioning After Conditioning
UCS (foodin mouth)
Neutralstimulus(tone)
Nosalivation
UCR (salivation)
Neutralstimulus(tone)
UCS (foodin mouth)
UCR(salivation)
CS(tone)
CR (salivation)
ClassicalClassical ConditioningConditioning
Pavlov’s Pavlov’s device for device for recording recording salivationsalivation
Pavlov VideoPavlov Video
Classical Classical ConditioningConditioning Classical ConditioningClassical Conditioning
organism comes to associate two organism comes to associate two stimulistimuli
a neutral stimulus that signals an a neutral stimulus that signals an unconditioned stimulus begins to unconditioned stimulus begins to produce a response that produce a response that anticipates and prepares for the anticipates and prepares for the unconditioned stimulusunconditioned stimulus
Classical Classical ConditioningConditioning Unconditioned Stimulus (UCS)Unconditioned Stimulus (UCS)
stimulus that unconditionally--stimulus that unconditionally--automatically and naturally--triggers a automatically and naturally--triggers a responseresponse
Unconditioned Response (UCR)Unconditioned Response (UCR) unlearned, naturally occurring response unlearned, naturally occurring response
to the unconditioned stimulusto the unconditioned stimulus salivation when food is in the mouth salivation when food is in the mouth
Classical Classical ConditioningConditioning
Conditioned Stimulus (CS)Conditioned Stimulus (CS) originally irrelevant stimulus that, after originally irrelevant stimulus that, after
association with an unconditioned association with an unconditioned stimulus, comes to trigger a conditioned stimulus, comes to trigger a conditioned responseresponse
Conditioned Response (CR)Conditioned Response (CR) learned response to a previously neutral learned response to a previously neutral
conditioned stimulusconditioned stimulus
Classical Classical ConditioningConditioning
AcquisitionAcquisition the initial stage in classical conditioningthe initial stage in classical conditioning the phase associating a neutral stimulus the phase associating a neutral stimulus
with an unconditioned stimulus so that with an unconditioned stimulus so that the neutral stimulus comes to elicit a the neutral stimulus comes to elicit a conditioned responseconditioned response
in operant conditioning, the in operant conditioning, the strengthening of a reinforced responsestrengthening of a reinforced response
Classical Classical ConditioningConditioning
ExtinctionExtinction diminishing of a CR diminishing of a CR in classical conditioning, when in classical conditioning, when
a UCS does not follow a CSa UCS does not follow a CS in operant conditioning, when in operant conditioning, when
a response is no longer a response is no longer reinforced reinforced
Classical Classical ConditioningConditioning Spontaneous RecoverySpontaneous Recovery
reappearance, after a rest reappearance, after a rest period, of an extinguished CRperiod, of an extinguished CR
GeneralizationGeneralization tendency for stimuli similar to tendency for stimuli similar to
CS to elicit similar responsesCS to elicit similar responses AltoidAltoid
Classical Classical ConditioningConditioning DiscriminationDiscrimination
in classical conditioning, the in classical conditioning, the learned ability to distinguish learned ability to distinguish between a CS and other stimuli between a CS and other stimuli that do not signal a UCSthat do not signal a UCS
Big Bang VideoBig Bang Video
BehaviorismBehaviorism John B. WatsonJohn B. Watson
Baby Albert HandoutBaby Albert Handout Baby Albert VideoBaby Albert Video
Nausea Conditioning in Nausea Conditioning in Cancer PatientsCancer Patients
UCS(drug)
UCR(nausea)
CS(waiting room)
CS(waitingroom) CR
(nausea)
UCS(drug)
UCR(nausea)
Operant ConditioningOperant Conditioning
Operant ConditioningOperant Conditioning type of learning in which behavior is type of learning in which behavior is
strengthened if followed by reinforcement strengthened if followed by reinforcement or diminished if followed by punishmentor diminished if followed by punishment
Law of EffectLaw of Effect Thorndike’s principle that behaviors Thorndike’s principle that behaviors
followed by favorable consequences followed by favorable consequences become more likely, and behaviors become more likely, and behaviors followed by unfavorable consequences followed by unfavorable consequences become less likelybecome less likely
Operant Conditioning vs. Operant Conditioning vs. Classical ConditioningClassical Conditioning
Operant Conditioning involves Operant Conditioning involves voluntary actions! Rolling voluntary actions! Rolling over, playing dead, Retrieving over, playing dead, Retrieving the newspaper. Navy pigeons.the newspaper. Navy pigeons.
Classical Conditioning involves Classical Conditioning involves involuntary actions! Salivating, involuntary actions! Salivating, blinking, feeling sick. Shock blinking, feeling sick. Shock baby in hospital.baby in hospital.
Operant ConditioningOperant Conditioning
B.F. SkinnerB.F. Skinner (1904-1990)(1904-1990) elaborated elaborated
Thorndike’s Law Thorndike’s Law of Effectof Effect
developed developed behavioral behavioral technologytechnology
Operant ChamberOperant Chamber
Skinner BoxSkinner Box chamber with a chamber with a
bar or key that an bar or key that an animal animal manipulates to manipulates to obtain a food or obtain a food or water reinforcerwater reinforcer
contains devices contains devices to record to record responsesresponses
Chinatown Chinatown ChickenChicken
Operant ConditioningOperant Conditioning ReinforcerReinforcer
anything that strengthens the anything that strengthens the behavior it follows (scooby behavior it follows (scooby snacks, trophies, good grades, snacks, trophies, good grades, high fives)high fives)
ShapingShaping operant conditioning procedure operant conditioning procedure
in which in which reinforcersreinforcers guide guide behavior toward closer behavior toward closer approximations of a desired goalapproximations of a desired goal
Skinner VideoSkinner Video
Operant ConditioningOperant Conditioning
Principles of Principles of ReinforcementReinforcement
Primary ReinforcerPrimary Reinforcer innately reinforcing stimulusinnately reinforcing stimulus i.e., satisfies a biological need – i.e., satisfies a biological need –
food, water, sleep.food, water, sleep. Conditioned ReinforcerConditioned Reinforcer
stimulus that gains its reinforcing stimulus that gains its reinforcing power through its association with power through its association with primary reinforcerprimary reinforcer
secondary reinforcer – ex. Money secondary reinforcer – ex. Money (just paper)(just paper)
Schedules of Schedules of ReinforcementReinforcement Continuous ReinforcementContinuous Reinforcement
reinforcing the desired response each time it reinforcing the desired response each time it occursoccurs
Partial (Intermitent) ReinforcementPartial (Intermitent) Reinforcement reinforcing a response only part of the timereinforcing a response only part of the time results in slower acquisitionresults in slower acquisition greater resistance to extinctiongreater resistance to extinction
Ex. If you throw a tennis ball to two dogs.Ex. If you throw a tennis ball to two dogs.
Changing Behavior With Operant Conditioning VideoChanging Behavior With Operant Conditioning Video
Schedules of Schedules of ReinforcementReinforcement
Fixed Ratio (FR)Fixed Ratio (FR) reinforces a response only after a reinforces a response only after a
specified specified number of responsesnumber of responses Ex. $5 for every 3 bushels of applesEx. $5 for every 3 bushels of apples
Schedules of Schedules of ReinforcementReinforcement
Variable Ratio (VR)Variable Ratio (VR) reinforces a response after an reinforces a response after an
unpredictable unpredictable number of number of responsesresponses
Ex. gambling (slot machines), Ex. gambling (slot machines), fishingfishing
very hard to extinguish because very hard to extinguish because of unpredictabilityof unpredictability
Schedules of Schedules of ReinforcementReinforcement
Fixed Interval (FI)Fixed Interval (FI) reinforces a response only after reinforces a response only after
a specified a specified timetime has elapsed has elapsed Ex. Getting paid every two Ex. Getting paid every two
weeks.weeks.
Schedules of Schedules of ReinforcementReinforcement
Variable Interval (VI)Variable Interval (VI) reinforces a response at reinforces a response at
unpredictable unpredictable timetime intervals intervals Ex. pop quizEx. pop quiz Give a pop quiz Give a pop quiz
PunishmentPunishment
PunishmentPunishment aversive event that aversive event that
decreases the behavior that decreases the behavior that it followsit follows
powerful controller of powerful controller of unwanted behaviorunwanted behavior
Use of Reinforcement and Punishment VideoUse of Reinforcement and Punishment Video
PunishmentPunishment
Cognition and Operant Cognition and Operant ConditioningConditioning Cognitive MapCognitive Map
mental representation of the layout of mental representation of the layout of one’s environmentone’s environment
Example: after exploring a maze, rats Example: after exploring a maze, rats act as if they have learned a cognitive act as if they have learned a cognitive map of itmap of it
FeedbackFeedback Two demos on feedbackTwo demos on feedback
Drawing shapes with no Drawing shapes with no feedback and tennis ball toss feedback and tennis ball toss
Cognition and Operant Cognition and Operant ConditioningConditioning
Overjustification EffectOverjustification Effect the effect of promising a reward the effect of promising a reward
for doing what one already likes for doing what one already likes to doto do
the person may now see the the person may now see the reward, rather than intrinsic reward, rather than intrinsic interest, as the motivation for interest, as the motivation for performing the taskperforming the task
Cognition and Operant Cognition and Operant ConditioningConditioning
Intrinsic MotivationIntrinsic Motivation Desire to perform a behavior for Desire to perform a behavior for
its own sake and to be effectiveits own sake and to be effective
Extrinsic MotivationExtrinsic Motivation Desire to perform a behavior due Desire to perform a behavior due
to promised rewards or threats of to promised rewards or threats of punishmentspunishments
Observational LearningObservational Learning
Observational LearningObservational Learning learning by observing otherslearning by observing others Alda Videos (Monkey See Monkey Do #80 & Octopus #81)Alda Videos (Monkey See Monkey Do #80 & Octopus #81)
ModelingModeling process of observing and imitating a specific behaviorprocess of observing and imitating a specific behavior Bandura’s Bobo DollsBandura’s Bobo Dolls
Prosocial BehaviorProsocial Behavior positive, constructive, helpful behaviorpositive, constructive, helpful behavior opposite of antisocial behavioropposite of antisocial behavior http://www.youtube.com/watch?v=frpp6DjCaJU&safet
y_mode=true&persist_safety_mode=1
• Learned HelplessnessLearned Helplessness– The hopelessness and passive resignation The hopelessness and passive resignation
learned when an animal or human is learned when an animal or human is unable to avoid repeated aversive events.unable to avoid repeated aversive events.
ExpectanciesExpectanciesIf you think you are able to learn or If you think you are able to learn or accomplish something, you will. If you accomplish something, you will. If you think you can’t, you won’t.think you can’t, you won’t.