THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2...

16
THE JOURNAL OF EDUCATIONAL PSYCHOLOGY Volume XXX December, 1939 Number 9 STUDIES IN RETENTION HERBERT F. SPITZER State University of Iowa* The present investigation was planned with special reference to (1) the effect of recall on retention, (2) the relationship between the rate of forgetting and the ability of the subjects, and (3) the effect of item difficulty on the form of retention curves. PROBLEM The importance of retention is shown by the fact that growth or improvement in skills, knowledges, and attitudes is dependent upon the learner's retention of the effects of previous experience. The use of recall as an aid to retention has been emphasized by theorists on methods of study and by investigators in the field of memory. The lack of experimental evidence on the effect of recall on retention where conditions approach those of actual schoolroom practice prompted this investigation. The primary purpose of the investigation was to deter- mine the effect of recall on retention of facts which children acquire through reading when the materials and the methods of study are similar to those used in classroom situations. Two subsidiary prob- lems of the investigation relate to the effect of item difficulty upon the form of retention curves and to the relationship between the learning ability of the students and the rate of forgetting. Related Research.—A number of experimental studies have dealt with various aspects of the problem of this investigation. Myers 8 found that immediate recall in the form of written reproduction was beneficial to later reproduction of a list of unrelated words. An indi- rect or incidental method of learning the words had been employed. * This article reports, in part, an investigation conducted by the writer as a partial fulfillment of the requirements for the Ph.D. degree in the College of Education of the State University of Iowa. The assistance of Dr. Ernest Horn, under whose direction the study was conducted, is gratefully acknowledged. 641

Transcript of THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2...

Page 1: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

THE JOURNAL OF

EDUCATIONAL PSYCHOLOGYVolume XXX December, 1939 Number 9

STUDIES IN RETENTIONHERBERT F. SPITZER

State University of Iowa*

The present investigation was planned with special reference to(1) the effect of recall on retention, (2) the relationship between therate of forgetting and the ability of the subjects, and (3) the effect ofitem difficulty on the form of retention curves.

PROBLEM

The importance of retention is shown by the fact that growth orimprovement in skills, knowledges, and attitudes is dependent uponthe learner's retention of the effects of previous experience. The useof recall as an aid to retention has been emphasized by theorists onmethods of study and by investigators in the field of memory. Thelack of experimental evidence on the effect of recall on retention whereconditions approach those of actual schoolroom practice prompted thisinvestigation. The primary purpose of the investigation was to deter-mine the effect of recall on retention of facts which children acquirethrough reading when the materials and the methods of study aresimilar to those used in classroom situations. Two subsidiary prob-lems of the investigation relate to the effect of item difficulty upon theform of retention curves and to the relationship between the learningability of the students and the rate of forgetting.

Related Research.—A number of experimental studies have dealtwith various aspects of the problem of this investigation. Myers8

found that immediate recall in the form of written reproduction wasbeneficial to later reproduction of a list of unrelated words. An indi-rect or incidental method of learning the words had been employed.

* This article reports, in part, an investigation conducted by the writer as apartial fulfillment of the requirements for the Ph.D. degree in the College ofEducation of the State University of Iowa. The assistance of Dr. Ernest Horn,under whose direction the study was conducted, is gratefully acknowledged.

641

Page 2: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

642 The Journal of Educational Psychology

Gates2 found that some recall in the form of recitation was an aid inmemorizing biographical prose. This was true when tests were givenimmediately and also after four hours. Gates also reports finding ahigh positive correlation between immediate and delayed recall.Yoakam7 concluded that an immediate recall in the form of a test wasof more value to retention than was a single reading. Jones3 foundthat recall tests aided the retention of information acquired fromlectures by college students Other studies which are related to somephases of this study are reported by Dietze,1 Keys,4 Raffel,6 andYoung.8

SUBJECTS AND MATERIAL

The subjects for this experiment were thirty-six hundred fivesixth-grade pupils of nine Iowa cities. This was the entire sixth-gradepopulation of ninety-one elementary schools. These schools werearbitrarily divided into ten groups. Groups I, II, III, IV, V, VI, VII,and VIII, each comprising approximately four hundred children, wereused to obtain the data for the main part of the experiment. Group IXwas used to obtain data on the effect of immediate repetition of tests,and Group X was used to obtain information on previous knowledge.Thus Groups IX and X were, in a sense, used as control groups.

The reading materials used in this study were two articles, sixhundred four and five hundred seventy-seven words in length, printedin a six-page folder. The first of these articles entitled "Peanuts,"designated A, and the accompanying test, were used as a sectioningdevice; while the second article, entitled "Bamboos," designated B,and the accompanying test, were used to obtain the data on retention.An attempt was made to write articles with content that would berelatively new to the children, highly factual, authentic, of the properdifficulty, and similar in type to the material that children read in theirregular school work. Both of the topics dealt with are treated brieflyif at all in geography books used by the children. The first paragraphof Article B and five of the items of Test B, which are wholly or partiallybased on the content of this paragraph, are given below.

Near Savannah, Georgia, is the Plant Introduction Garden of the UnitedStates Department of Agriculture. In one section of this garden are thebamboos. These plants are members of the grass family. They resembletheir relatives, corn and wheat, in structure of stem which is rounded, dividedinto joints, and more or less hollow. Bamboos also resemble pines andspruces by having tall, straight trunks and cone shaped heads or crowns, and

Page 3: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

Studies in Retention 643

by being evergreens. Although they are evergreens, a new set of leavesappears each spring. On rare occasions bamboos flower and produce seeds.After flowering, the plant usually dies.

1. Who maintains an experimental garden near Savannah, Georgia?( ) The Bamboo Growers Association ( ) The U. S. Government ( )The U. S. Custom Office ( ) The florists of Savannah ( ) The State ofGeorgia.

2. To which family of plants do bamboos belong? ( ) trees ( ) ferns( ) grasses ( ) mosses ( ) fungi.

4. Which two trees do the bamboos resemble most? ( ) royal and datepalms ( ) willow and tamarack ( ) white oak and burch ( ) walnut andhickory ( ) pine and spruce.

18. How often do bamboos produce seed? ( ) every spring ( ) never( ) on rare occasions ( ) every other year ( ) every third year.

19. What usually happens to a bamboo plant after the flowering period?( ) It dies ( ) It begins a new growth ( ) It sends up new plants fromthe roots ( ) It begins to branch out ( ) It begins to grow a rough bark.

A twenty-five item test (see example above) on each article wasused to measure retention. Through an item analysis of each test, thedifficulty and discriminating power (tetrachoric " r " ) of each itemwere obtained. Items too difficult or of poor discriminating powerwere eliminated after the preliminary trials, leaving a total of twenty-five items in each test. The reliability of the two tests determined byequal halves technique was .77 and .80, respectively. The correlationbetween Test A and Test B based on scores of six hundred twenty-twopupils who took both tests immediately after reading the articleswas .76.

PROCEDURE

Both the reading material and the tests were presented to thepupils by their regular teachers according to directions supplied bythe investigator. In the printed directions given at the beginning ofthe experiment, the children were told that they were taking part in alearning experiment. They were also told that they were to try toremember the information given in the articles. Similar directionswere printed at the top of each article.

On the first day of the experiment, all the children in Groups I-VIIIread Article A and took Test A. They also read Article B, but onlyGroups I and II took Test Bi.* The other six groups took a test

* The first time pupils took Test B, it was labeled Bi\ the second time they tookTest B, it was labeled Bi\ and the third time, it was labeled B».

Page 4: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

644 The Journal of Educational Psychology

TABLE I.—DIAGRAM OP PROCEDUBB

Time in days

GroupsI

IIIIIIVV

VIVII

VIII

0

B,B,

1

B,

B,

7

B,

Bi

14

B\

B.

21

B,

B2

B,

• •

28

B,

B,••

63

B,

B,

B,

which had little relation to the content of Article B. This test wasgiven in order to keep them from expecting a later test. The realTest B was given to these six groups (III-VIII) at varying timeintervals after the start of the experiment. A diagram of the testingprocedure followed is given in Table I. This table shows that thepupils of Group I took Test Bi immediately after reading Article B,repeated the test (Test 2?2) after one day, and again repeated the sametest (Test B3) after twenty-one days. The pupils of Group IV tookTest JBI seven days after reading Article B and repeated the test(Test B^ twenty-one days after reading the article. The procedurefollowed by the other six groups is shown in the table.

The reading materials were not referred to after the initial studyperiod, nor did the pupils know that there were to be delayed tests.The teachers were instructed not to discuss the articles or the testswith the pupils. Pupils were given eight minutes to read the articlesand ten minutes for each of the tests.

The pupils of Group IX read both articles and took both tests onthe first day of the experiment. They took Test B a second timeimmediately after completing the first attempt. For this second testthey were instructed to try to improve their first score. This pro-cedure was followed for the purpose of obtaining information on theeffect of repetition of the tests. The pupils of Group X took Test Bwithout having read Article B, for the purpose of obtaining data onprevious knowledge.

RESULTS

Effect of Recall.—From a single frequency distribution of the scoreson Test A, the mean score and the standard deviation of scores of the

Page 5: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

Studies in Retention 645

population studied were determined. The means and standarddeviations of the scores of the pupils on Test A in each of Groups I-VIIIwere then calculated. A comparison of these means with the meanfor the entire population showed that each of the groups was practicallyrepresentative of the population. However, some pupil scores weredeleted from two of the groups in order to make the groups morenearly equal. The means of these equated groups are given inTable II. The critical ratio of the largest difference between meanson Test A of any two of these equalized groups is only .18.

TABLE II.—TEST B RESULTS OF THE GROUPS THAT MADE EQUIVALENT SCORES ONTEST A

Group

III

IIIIII

IIIIIIIVIVVV

VIVI

VIIVIII

N

286284266338335312367349337323371353379352365350

M test A

15.03

15 05

15.00

15.00

15.04

15 04

15 0015.03

Test*

B,B ,B,B,B,B,B,Bt

B,B,B,B,B,B,B,B,

M test B

13 2313 0712.1813 2011 8410 749 568.937 878.156 977 106.497.076.806 38

SD test B

4 694 574 594.504 644.224.244 063 563.833 533.212 913 083 032.71

* For identification of various Test B's and the tune after learning that eachwas taken, see Table I.

The mean scores of all groups of pupils who took Test B are shownin Table II. In interpreting the data of this table the assumption ismade that the eight groups of pupils profited equally from the readingand that the groups possessed equal ability to retain the effects of thereading. This assumption is based on the fact that the groups wereequated on the sectioning test (Test A). According to the assumptionstated above, Group I would have made a mean score of approximately9.56 (mean score of Group III on Test Bi) one day after reading thearticle if the group had not been given the immediat erecall test. Thislast statement is based on the fact that Groups I and III were originally

Page 6: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

646 The Journal of Educational Psychology

equal. Therefore, had Group I delayed taking Test B until one dayafter reading, the mean score made by the group would have beenthe same as that made by Group III, or 9.56. On the same basis, hadGroups III, IV, V, VI, VII, and VIII been tested immediately after read-ing Article B, each group would have made a mean score of approxi-mately 13.22. The data of this table show that more is forgotten in oneday without recall than is forgotten in sixty-three days with the aid ofrecall, as is shown by a comparison of the scores of II B3 and VIII Bt.The differences between originally comparable groups and now differingby only one recall and the critical ratio of these differences are shownin Table III. These critical ratios would have been larger had thestandard error of difference formula for matched groups been used.*This formula was not used because a statistically significant differencewas obtained without its use. The data summarized in Tables IIand III show clearly that retention benefited significantly by recall.

The effects of recall on retention are shown graphically in thefigures (see Figs. 1, 2,3, and 4). The points on the graph represent themean performance of the different groups. For example, the "PointIII Bi" represents the mean score of the pupils of Group III on their

TABLE III.—COMPARISON OP TEST B RESULTS FOB GROUPS DIFFERING BY ONLTONE RECALL

Group

IIII

IIVII

IVII

VIIII

VIVVIV

VII

Test

B,B,B,B s

Bt

B,B,B,B,B,B,B,B,Bx

AM

13 079.56

12.188.15

11.847.87

10.747.078.936.978 156.497.106.80

SE, AM

.27

.2228

.21

.25

.19

.24

.16

.22

.18

.21

.1618

.16

Difference

3.51

4.03

3 97

3 67

1 96

1 66

.30

SEdifference

346

.350

317

288

286

.264

241

CR

10.10

11.51

12 50

12.74

6.85

6.29

1.25

* Lindquist, E. F. and Wilks, S. S.: "The Significance of a Difference betweenMatched Groups." J. Educ. Psycho., Vol. xxn, 1931, pp. 197-204, 205-208.

Page 7: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

Studies in Retention 647

first attempt on Test B. This trial was taken one day after readingArticle B. Since the eight groups were equalized according to theirperformance on Test A, which was quite similar to Test B, it isassumed that the facts which Groups I and II acquired through readingwould have been forgotten at the rate shown by the solid line if theyhad not been given the intervening recall tests. Thus, the spaceseparating a point on the solid line and a vertical point on any of thebroken lines represents the effect of the recall test on retention for thatparticular situation. Figures 1 and 2, which are based on the entirepopulation, show that immediate forgetting unaided by recall was veryrapid and that in every case recall was beneficial to retention.

18

12

10

a g

»-

P «* .to

to

0

\ wM-1

SB,

M7B,JVS,

r- . 1

Unaided tv

Aided ty

SB,

FIG

14 21

TIME IN DATS (

CURVES OF RETENTION FOR THE ENTIRE POPULATION WHEN THEAMOUNT RETAINED IS EXPRESSED IN RAW SCORES

When the papers were corrected for guessing through use of theWformula, S = R — (N _ ,y the critical ratios of differences remained

practically the same as those shown in Table III.The one hundred sixty-nine children of Group IX who were given

a second Test B immediately after taking the first test improved theirmean score only .03. Thus, an immediate repetition of the test did notresult in a large increase in the number of facts acquired.

The mean score of the three hundred one children of Group X whowere tested for previous knowledge was 5.27. The assumption thatthis score represents the previous knowledge of Groups I-VIII israther questionable since the foils or wrong responses of items in thetest were not as plausible for those who had not read the article(group tested for previous knowledge) as these responses were for those

Page 8: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

648 The Journal of Educational Psychology

pupils who had read the article. The previous knowledge of GroupsI-VIII, then, was probably less than 5.27. Since no other measure ofprevious knowledge was available, this amount was subtracted fromthe mean score of each group in obtaining the data from which Fig. 2was constructed. This figure, subject to the limitation given above,shows the curves of retention when the amount retained is given as aper cent of the amount learned. The figure shows the same trend asthat shown in Fig. 1. In this case, however, forgetting is more rapid

100

• • 5 ,

» - O

• h

1—

VA

JUS*

s52.

' • *

re,

A'c/rtY ty

— _va,

7 M 21

TIME IN DAYS

FIG. 2 CURVES OF RETENTION FOR THE ENTIRE POPULATION WHENTHE AMOUNT RETAINED IS EXPRESSED AS A PER CENT OF THE

AMOUNT LEARNED

and the curve of retention unaided by recall begins to level muchnearer the zero line.

LEARNING ABILITY AND RETENTION

In order to determine whether ability to learn affected the shape ofthe retention curve, the Test B scores of those pupils who scored in theupper one third on Test A were compared with the Test B scores ofthose in the lower one third on Test A. The data for making thesecomparisons are shown in Tables IV and V. The data on the upperand lower thirds are shown graphically in Figs. 3 and 4. An examina-tion of these figures shows that the curve of retention of pupils ofinferior learning ability begins to level or to have reached the horizontalseven days after learning. At the same time the curve for the pupilswith superior learning ability does not begin to level until twenty-onedays after the learning period.

Page 9: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

Studies in Retention 649

TABLE IV.—TEST B RESULTS OF PUPILS WHO MADE SCORES IN THE UPPER ANDLOWER THIRDS ON TEST A

Group

IIIIII

IIIIIIIII I

IIIIII I IIVIVVV

VIVI

VIIVII

VIIIVIII

Division

UpperUpperUpperLowerLowerLowerUpperUpperUpperLowerLowerLowerUpperLowerUpperLowerUpperLowerUpperLowerUpperLowerUpperLower

N

959588959589

112120111112120111123123113113124124130130122122117117

AMtest A

19.62

10.42

19.17

10.92

19.3310.9019.2710.9219.5410.8419.5810.7619.4710.5719.4310.79

Test

B,BtB,B,B,B,B,B,B,B,B,B,B,B,B,B,B,B,B,B,B,B,B,B,

AMtest B

17.0216.7615.479.679.679 19

17.1816.1014.5710.018.557.39

12.587.09

10.395.489.285.228.466.338.505.577.745.16

SDofB scores

3.573.363.873.403.213.362.70*3.64f3.42f3.233.252.494.022.523.362.433.472.303.212.033 112.132.841.95

* Unusually small because high scores were deleted in the equalizationprocedure.

t Not equalized.TABLE V.—COMPARISON or TEST B RESULTS OF UPPER AND LOWER THIRDS FOB

GROUPS DIFFERING BY ONLY ONE RECALL

Group

IIII

IIII

IIIVII

IV

Division

UpperUpperLowerLowerUpperUpperLowerLower

Test

B,B,B,B,B,B,B,B,

AM

16.7612.589.677.09

16.1010.398.555.48

SE,AM

.34

.36

.33

.23

.3331

.30

.23

Differ-ence ofAM's

4.18

2.58

5.71

3.07

SE

differ-ence

.495

.402

.463

.378

CR

8.44

6.41

12.33

8.12

Page 10: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

650 The Journal of Educational Psychology

Because of the fact that the data of Tables IV and V and Figs. 3and 4 are based on scores neither corrected for guessing nor correctedfor previous knowledge, the rate of forgetting shown is probably muchless rapid than the true rate of forgetting. According to the data aspresented the pupils in the upper one third forgot twenty-six per cent

' \\l&MB,

' l?4-~-

-

\l!B,

.aw1

'% —

zae,

Una/dec/ £y

MO,

7 14 21TIME IN DAYS

FIS. 3 CURVES OF RETENTION FOR THE PUPILS IN THE UPPER ONETHIRD OF SCORES ON TEST A

14 1

-

ire,

W

TIME IN

21

DAYS

FIG 4 CURVES OF RETENTION FOR PUPILS IN THE LOWER ONETHIRD OF SCORES ON TEST A

of their original score in one day while the pupils in the lower one thirdforgot twenty-eight per cent. For one week, the figures were thirty-nine per cent and forty-four per cent. When scores were correctedfor guessing the upper one third forgot within one day thirty-threeper cent while the lower one third forgot forty-nine per cent. Itshould be remembered that the upper and lower thirds referred to are

Page 11: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

Studies in Retention 651

based on the pupils' scores on Test A. The data show that the pupilsin the lower third tend to have a more rapid initial rate of forgetting.

Additional data on the relationship between learning ability andretention were secured by correlating the immediate score of pupils onTest A with their delayed score on Test B. The score on Test A wasconsidered a measure of the pupils' ability to learn, while the delayedscore on Test B was considered as a measure of the pupils' ability toretain. The " r ' s " obtained in the above manner ranged from .60 forone day to .44 for sixty-three days. Since the correlation between thetwo tests on immediate recall was only .76, the " r ' s " given for the rela-tionship between immediate and delayed recall, or between ability to

~- "-—1

_ - ^ —

_

14 21

- TIME IN DAYS -63 PREVIOUS

KNOWLEBGC

FIG S CURVES OF FORGETTING FOR ITEMS NUMBER 9, I I , 15, 0 23.(PER CENTS UNCORRECTEO)

learn and retention, are probably very conservative. In connectionwith the relationship between immediate and delayed recall, the atten-tion of the reader is called to the fact that in some previous studies thisrelationship was found by correlating the immediate and delayed scoreson the same test. The results of such a procedure are almost certainto be spuriously high because of the effect of recall on retention. Whenthis procedure was used in the present investigation, a correlation of.91 between the scores on immediate recall and recall after one daywas obtained.

EFFECT OF ITEM DIFFICULTY ON THE FORM OF RETENTION CURVES

From an item analysis of the papers of all pupils who took Test B,the data on forgetting of individual items shown in Table VI were

Page 12: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

652 The Journal of Educational Psychology

obtained. The first seven columns represent the per cent of pupilstested at various times who answered each item correctly. The lastcolumn shows the per cent of the pupils tested for previous knowledgewho answered the items correctly. An examination of the data inTable VI will show that there is little relationship between the rate offorgetting of items and the initial difficulty of the items. This fact isshown graphically in Fig. 5. The four items (9, 11, 15, and 23) forwhich curves of retention are shown were approximately of equaldifficulty on the initial test. Two of the items (11 and 23) were alsoabout equal on the previous knowledge score. In spite of these simi-larities, widely differing curves of retention were found. The onegeneral characteristic of the data on each item is the fact that the rate

TABLE VI.—THB PER CENT OP CORRECT RESPONSES FOR EACH OF THE ITEMS ONTEST B

Item

number

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

I andII

40

61

81

80

55

76

4332

75

55

7229

67

77

73

41

40

37

68

53

63

24

73

35

31

III

28

30

62

56

42

57

4024

60

28

50

22

30

64

46

28

28

20

39

39

27

17

56

31

21

IV

21

20

52

38

40

573318

53

21

29

19

245734

27

22

1932

32

16

14

54

27

21

V

19

15

45

36

3755

29

19

46

20

23

16

19

44

24

17

18

17

22

34

14

19

52

2719

VI

17

16

43

31

39

59

2522

45

14

23

15

20

46

26

13

19

14

17

33

16

16

50

26

17

VII

20

16

43

33

41

61

24

18

44

18

23

14

2541

22

17

19

14

17

27

13

13

51

29

21

VIII

14

15

50

28

46

61

25

19

40

13

31

10

26

3314

14

13

9

9

32

13

17

50

28

20

X

10

14

60

18

56

66

17

9

26

11

38

6

19

20

9

78

4

4

21

14

934

22

10

SE of the per cents varies from 2.1 to 2.7.

Page 13: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

Studies in Retention 653

of forgetting is more rapid during the first day than during any sub-sequent period.

The data for items 3, 5, 6, and 11 (Table VI) show that reading orstudy of material can be detrimental to success on a test over thecontent of that material. Children who had read the article madelower scores on some tests over these four items than those who had notread the articles. In the case of these four items, the differenceascribed to this interference was statistically significant.

The data on items 13, 24, and 25 seem to be evidence for reminis-cence. However, none of the differences or gains ascribed to reminis-cence are statistically significant.

When the amount of previous knowledge (last column in Table VI)is subtracted from the per cents given in the other columns of Table VI,a very different picture is presented. (See Table VII.) The difficulty

TABLE VII.—ITEMS IN RANK ORDER OF PER CENT ANSWERED CORRECTLY AFTERSUBTRACTION OP THE AMOTJNT CREDITED TO PREVIOUS KNOWLEDGE

Item number

15194149132121023111618172017812325222465

I and II

646462574948474744393434333232302623232121131310

- 1

III

3535384434111316172212211620181823151621189

- 9-14

IV

25282037275261020

- 9201514111116913

- 81155

- 9-16

V

1518182420001918

-15101310139121010

-159105

-11-19

VI

1713132619122316

-15610111278139

-17774

- 7-17

VII

13131521186

- 12717

-15101011610798

-171147

- 5-15

VIII

551013147

- 11216

- 77551148104

-101086

- 5-10

Page 14: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

654 The Journal of Educational Psychology

rank of some items changes considerably. However, even after thischange, no relationship between difficulty and rate of forgetting isevident.

TABLE VIII.—THE EFFECT OF RECALL ON RETENTION FOR INDIVIDUAL ITEMS

Item number

12345678910111213141516171819202122232425

GroupII percent

correcton Bi

39618180557642317451722863767241403768545926693531

GroupII percent

correcton B,

25406367618133176537412143655533353752363722683726

GroupVTTTV XXX

per cent

141550284661251940133110263314141399321317502820

Differ-ence

Bt-B,

14211813

- 6- 5

91491431720111785016182221

- 25

Per centfor-

gotten

36342216

-11- 72145122743253214242013024333781

- 616

Differ-ence

B.-VIII

25463152915171234384118374358272728582246919711

Per centfor-

gotten

64753865162040394675576459578166687685417835282035

In order to determine what effect recall had on the retention ofindividual items, a comparison of the amount forgotten by Group II(with recall) and Group VIII (without recall) was made. In each casethe time elapsed was sixty-three days. The data for making thi6comparison are given in Table VIII. The data show that recall wasbeneficial to retention for every item. When the pupils were dividedinto an upper and a lower group on the basis of their Test A scores and

Page 15: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

Studies in Retention 655

data similar to that of Table VIII prepared, it was found that thesuperior pupils benefited more from recall.

The high scores made by the pupils of Groups I and II on therepeated tests might be attributed to the pupils' remembering how thetest was marked the first time. If this assumption were valid, then,both correct and incorrect responses would be repeated with equalconsistency. In order to test the assumption, one hundred of theTest Bi and Test B2 papers of Group II were analyzed to determine theconsistency of responses. It was found that right answers wererepeated seventy-nine per cent of the time; while wrong answers wererepeated only fifty per cent. Since right answers were repeated moreconsistently than wrong answers, only a small portion of the unusuallyhigh scores on the second trial of the test can be ascribed to the pupils'remembering how the test was marked the first time. Chance alonewould give twenty per cent repetition of responses. The fact thatwrong answers were repeated more often than chance would allow isnot in conflict with the assumption that recall and not mere repetitionis the factor that aids retention. In giving some wrong responses, thepupils were sometimes recalling information given in the article, formany of the false responses were taken from the content of the article.Thus, recall can also aid the retention of erroneous ideas.

Limitations.—The findings of this study are subject to a numberof limitations. The most important of these are the following: (1)The method of measurement employed a type of cue not used inrecalling information in everyday school or life situations. (2) Thetests were repeated. (3) The learning was of little practical use tothe children. (4) The children were given no opportunity to refer tothe material after the initial learning period. (5) The pupils did notknow whether their responses were correct or incorrect. (6) Theeffect of reacting to one item upon the response to other items is notknown.

EDUCATIONAL IMPLICATIONS

The findings of this study seem to warrant the following educa-tional implications: (1) Immediate recall in the form of a test is aneffective method of aiding the retention of learning and should, there-fore, be employed more frequently in the elementary school. (2)Because recall can aid in fixing erroneous ideas, all tests or examina-tions should be returned to the pupil corrected, or the pupil should begiven an opportunity to correct his own paper. (3) Achievement

Page 16: THE JOURNAL OF EDUCATIONAL PSYCHOLOGY - Gwern · 642 The Journal of Educational Psychology Gates2 found that some recall in the form of recitation was an aid in memorizing biographical

656 The Journal of Educational Psychology

tests or examinations are learning devices and should not be consideredonly as tools for measuring achievement of pupils. (4) Since readingabout a topic can interfere with the knowledge the subject alreadypossesses, careful consideration should be given to what is supposedto be learned and to the thoroughness of learning. (5) In all studieswhere the same tests are repeated, the possible effects of recall onretention should be recognized.

BIBLIOGRAPHY

1. Dietze, A. G., and Jones, G. E.: "Factual Memory of Secondary-School Pupilsfor a Short Article Which They Read a Single Time." / . Ed. Psycho., Vol.xxn, 1931, pp. 586-598, and 667-676.

2. Gates, A. I.: "Correlation of Immediate and Delayed Recall." / . Ed.Psycho., Vol. ix, 1918, pp. 489-496.

3. Jones, H. E.: "Experimental Studies of College Teaching." Archives ofPsychology, No. 68, 1923.

4. Keys, Noel: "The Influence on Learning of Weekly as Opposed to MonthlyTests." J. Exp. Psycho., Vol. xxv, 1934, pp. 427-436.

5. Myers, G. C : "Recall in Relation to Retention." J. Ed. Psycho., Vol. v, 1914,pp. 119-130.

6. Raffel, Gertrude: "The Effect of Recall on Recognition." J . Exp. Psycho.,Vol. xvn, 1931, pp. 828-837.

7. Yoakam, G. A.: The Effect of a Single Beading on the Retention of Various Typesof Materials in the Content Subjects of the Elementary-School Curriculum asMeasured by Immediate and Delayed Recall. Ph. D. Thesis, State Universityof Iowa, 1922, p. 254.

8. Young, William E.: The Relation of Reading Comprehension and Retention toHearing Comprehension and Retention. Ph. D. Thesis, State University ofIowa, 1930.