Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow...
-
Upload
ellen-jordan -
Category
Documents
-
view
216 -
download
0
Transcript of Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow...
![Page 1: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/1.jpg)
Schedules of Reinforcement
CH 17,18,19
![Page 2: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/2.jpg)
Divers of Nassau
• Diving for coins
• Success does not follow every attempt
• Success means reinforcement
![Page 3: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/3.jpg)
Intermittent Reinforcement
• A reinforcer follows the response only once in a while.
![Page 4: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/4.jpg)
Continuous Reinforcement (CRF)
• A reinforcer follows every response.
• Best used for shaping or maintaining difficult behavior.
![Page 5: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/5.jpg)
Shaping with Reinforcement
Before:
Andrew has no gum
Behavior Initial: NA
Intermed: Moves lips only
Terminal: Says words unclearly
Behavior Initial: Andrew moves lips
Intermed: Andrew makes croaking sound
Terminal: Says words clearly
After:
Andrew receives no gum
After:
Andrew receives gum
Reinforcement
Extinction
![Page 6: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/6.jpg)
Schedule of Reinforcement
• The way reinforcement occurs because of the number of responses, time between responses, and stimulus conditions.
![Page 7: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/7.jpg)
Schedules of Reinforcement
• Ratio– Fixed Ratio (FR)– Variable Ratio (VR)
• Interval– Fixed Interval (FI)– Variable Interval (VI)
![Page 8: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/8.jpg)
Fixed Ratio (FR) Schedule of Reinforcement
• A reinforcer follows a fixed number of responses.
![Page 9: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/9.jpg)
FR Responding
• After a response is reinforced, no responding occurs for a period of time, then responding occurs at a high, steady rate until the next reinforcer is delivered.
![Page 10: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/10.jpg)
Pauses
Reinforcers Reinforcement always immediately follows the 5th response!!!!
This is an FR5 schedule of reinforcement.
![Page 11: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/11.jpg)
Postreinforcement Pause (PRP)
• The name for the pause after the consumption of the reinforcer and before the next ratio of responses begins.
![Page 12: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/12.jpg)
FR & PRP
• Length of the pause is proportional to the size of the ratio.
• Small ratio – pausing is short
• Large ratio – pausing is long
![Page 13: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/13.jpg)
General Rule for establishing intermittently reinforced
behavior:First use CRF and gradually increase the intermittency of reinforcement as responding
stabilizes at a high rate.
![Page 14: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/14.jpg)
FR120
• What are the response requirements?
• When will reinforcement be delivered?
• What will the pattern of responding look like?
![Page 15: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/15.jpg)
Cumulative Graph for FR
0
20
40
60
80
100
120
140
Time
Cum
ulat
ive
Num
ber
of R
espo
nses
Reinforcers
Post reinforcement pauses
![Page 16: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/16.jpg)
Variable Ratio (VR) Schedule
• A reinforcer follows after a variable number of responses
![Page 17: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/17.jpg)
VR Responding
• VR schedules produce a high, constant rate of responding, with almost no postreinforcement pausing.
![Page 18: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/18.jpg)
0
20
40
60
80
100
120
140
160
180
Time
Cum
ulat
ive N
umbe
r of R
espo
nses
VR 50
![Page 19: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/19.jpg)
VR 50
• Schedule notation
• Number designates the average number of responses required for reinforcement
![Page 20: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/20.jpg)
How do typical schedules of reinforcement differ from
gambling?
• See pages 290-291
![Page 21: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/21.jpg)
Skinner Box vs. 1 Armed Bandit
Typical VR Gambling Schedule
Many interspersed learned reinforcers
No Yes
Amount of reinforcer varies from ratio to ratio
No Yes
Small ratio No Yes
Emotional reinforcers No Yes
![Page 22: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/22.jpg)
Time Dependent Schedules
• Fixed Interval (FI)
• Variable Interval (VI)
![Page 23: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/23.jpg)
FI Schedule of Reinforcement
• A reinforcer is contingent on the first response after a fixed interval of time since the last opportunity for reinforcement.
![Page 24: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/24.jpg)
Fixed Interval 10s Schedule of Reinforcement
0
50
100
150
200
0 10 20
Seconds
Cum
ulat
ive
Num
ber
of
Res
pons
es
Reinforcer
![Page 25: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/25.jpg)
Fixed Interval 200-s Schedule of Reinforcement
0
20
40
60
80
100
120
140
160
180
200
Seconds
Cu
mu
lati
ve N
um
ber
of
Resp
on
ses
Reinforcer
Example: Fixed Interval (FI) Schedule of Reinforcement
FI 200-s
200 seconds
400 seconds
600 seconds
![Page 26: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/26.jpg)
Fixed-Interval Scallop
• A FI schedule often produces a scallop – a gradual increase in the rate of responding with responding occurring at a high rate just before reinforcement is available. No responding occurs for some time after reinforcement (Post Reinforcement Pause.
![Page 27: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/27.jpg)
Fixed Interval 200-s Schedule of Reinforcement
0
20
40
60
80
100
120
140
160
180
200
Seconds
Cu
mu
lati
ve N
um
ber
of
Resp
on
ses
Reinforcer
Example: Fixed Interval (FI) Schedule of Reinforcement
FI 200-s
200 seconds
400 seconds
600 seconds
Scallop
PRP
![Page 28: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/28.jpg)
Fixed Interval 200 s
0
0.1
0.2
0.3
20 40 60 80 100 120 140 160 180 200
Time (sec)
Rel
ativ
e F
requ
ency
+/+
+/rl
rl/rl
A
Lever Pressing of Mice after Training
![Page 29: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/29.jpg)
Term paper vs. FI
• Term paper does not have a deadline.
![Page 30: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/30.jpg)
FI vs. Term Paper
FI Term PaperDoes early responding effect anything?
No Yes
Do you get more if you work harder?
No Yes
Is the relevant response class clear?
Yes No
Are there calendars and clocks?
No Yes
Is there a deadline? No YesIs the reinforcer too delayed?
No Yes
![Page 31: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/31.jpg)
Fixed Time & Superstitious Behavior
• Fixed time schedules of reinforcement– A reinforcer is delivered after the passage of a
fixed period of time, independently of the response.
• Superstitious behavior– Behaving as if the response causes some
specific outcome when it really does not.
![Page 32: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/32.jpg)
Superstitious behavior of the pigeon:
Experiment by SkinnerFixed Time Schedule
![Page 33: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/33.jpg)
Variable Interval (VI) Schedule of Reinforcement
• A reinforcer is contingent on the first response after a variable interval of time since the last opportunity for reinforcement.
![Page 34: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/34.jpg)
VI Responding
• VI schedules produce a moderate rate of responding with almost no postreinforcement pausing.
![Page 35: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/35.jpg)
Comparing/Contrasting Ratio and Interval Schedules
• Pg. 305: table
• Pg. 305: cumulative records
![Page 36: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/36.jpg)
Continuous vs. Intermittent
• CRF – every response is reinforced
• Intermittent reinforcement – only some responses produce a reinforcer.
![Page 37: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/37.jpg)
Intermittent Reinforcement
• Makes the response more resistant to extinction than does continuous reinforcement.
![Page 38: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/38.jpg)
Resistance to Extinction
• The number of responses or the amount of time before a response extinguishes
![Page 39: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/39.jpg)
Resistant to Extinction and Intermittent Reinforcement
• Intermittent reinforcement makes the response more resistant to extinction than does continuous reinforcement.
• Why? Hard for the rat to tell the difference between only an occasional reinforcement and no reinforcement
• CRF followed by EXT: rats quickly stop responding: easy discrimination between reinforcement & extinction contingencies
![Page 40: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/40.jpg)
4 Types of Concurrent Contingencies
1. Two compatible responses
2. Compatible contingencies for a single response
3. Incompatible contingencies for a single response
4. Two incompatible responses
![Page 41: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/41.jpg)
Concurrent Contingencies
• Contingencies that are available at the same time.
• More than one contingency of reinforcement or punishment is available at the same time.
![Page 42: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/42.jpg)
Concurrent Contingencies
• Two levers in chamber– VI 300 s on Left lever– VI 30 s on Right lever
• Will animal allocate more responses to the left or the right lever?
• Matching Law (pg. 330)% of Left lever presses = % Left-lever reinforcers
![Page 43: Schedules of Reinforcement CH 17,18,19. Divers of Nassau Diving for coins Success does not follow every attempt Success means reinforcement.](https://reader030.fdocuments.net/reader030/viewer/2022032722/56649f4f5503460f94c7107e/html5/thumbnails/43.jpg)
Matching Law
• Relative Frequency of responding on two concurrent schedules of reinforcement equals the relative value of reinforcement on those two schedules