A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166...

24
A Meta-Analysis of the Experimental Evidence on the Near- and Far-Transfer Effects Among Children’s Executive Function Skills Reka Kassai ELTE Eötvös Loránd University and MTA-ELTE Lendület Adaptation Research Group Judit Futo and Zsolt Demetrovics ELTE Eötvös Loránd University Zsofia K. Takacs ELTE Eötvös Loránd University and MTA-ELTE Lendület Adaptation Research Group In the present meta-analysis we examined the near- and far-transfer effects of training components of children’s executive functions skills: working memory, inhibitory control, and cognitive flexibility. We found a significant near-transfer effect (g 0.44, k 43, p .001) showing that the interventions in the primary studies were successful in training the targeted components. However, we found no convincing evidence of far-transfer (g 0.11, k 17, p .11). That is, training a component did not have a significant effect on the untrained components. By showing the absence of benefits that generalize beyond the trained components, we question the practical relevance of training specific executive function skills in isolation. Furthermore, the present results might explain the absence of far-transfer effects of working memory training on academic skills (Melby-Lervag & Hulme, 2013; Sala & Gobet, 2017). Public Significance Statement The present meta-analysis suggests that it is possible to foster executive functions in childhood by explicitly training them. However, these programs have limited practical relevance as they only promote the component(s), (working memory, inhibitory control, and cognitive flexibility) that are targeted in the training and do not have far-transfer effects to untrained component(s). Keywords: executive functions, children, meta-analysis, intervention Supplemental materials: http://dx.doi.org/10.1037/bul0000180.supp Executive functions in childhood are crucial skills as they have an important role in social-emotional and cognitive development (Zelazo & Carlson, 2012). These fundamental cognitive skills in the preschool age are strongly related to school readiness (Bier- man, Nix, Greenberg, Blair, & Domitrovich, 2008; Blair, 2002) and they are more predictive of later academic achievement than IQ (Blair & Razza, 2007). In a previous meta-analysis on the concurrent and predictive relations of executive function skills and (later) academic achievement in childhood (Jacob & Parkinson, 2015) moderate associations were found both regarding math and reading skills. When children enter formal schooling, executive functions are also of high importance in the adjustment to the learning environment and developing social relationships (Liew, 2012). Children’s ability to focus their attention on the relevant objects, inhibit distractors and impulsive responses, practice self- regulation and self-control by resisting the immediate gratification of their momentary needs, and solve problems in a flexible and creative manner are all necessary for academic success as well as for thriving in social relationships (McClelland & Cameron, 2012). Thus, the importance of executive functions in childhood is clear. Executive functions are a set of cognitive skills that is respon- sible for planning and organizing our deliberate and goal-directed behavior (Lezak, 1982). These processes make us able to con- stantly monitor and flexibly adjust to the changes in the environ- ment, to solve new and complex problems, and practice self- control (Jurado & Rosselli, 2007). Behavior regulation via these top-down processes is discussed in several theoretical frameworks. While some approaches consider executive functions as a unitary Reka Kassai, Doctoral School of Psychology, ELTE Eötvös Loránd University, and MTA-ELTE Lendület Adaptation Research Group; Judit Futo and Zsolt Demetrovics, Institute of Psychology, ELTE Eötvös Loránd University; Zsofia K. Takacs, Institute of Education, ELTE Eötvös Loránd University, and MTA-ELTE Lendület Adaptation Research Group. This research was funded by the Hungarian National Research, Devel- opment and Innovation Office [grant PD121297], the ÚNKP-17-4 New National Excellence Program of the Ministry of Human Capacities [grant U ´ NKP-17-4-I-ELTE-125], and the Hungarian Academy of Sciences in the framework of the Lendület II. program (project N: 2018-412). Correspondence concerning this article should be addressed to Zsofia K. Takacs, Institute of Education, ELTE Eötvös Loránd University, 1075 Budapest, Kazinczy u. 23–27, Hungary. E-mail: [email protected] This document is copyrighted by the American Psychological Association or one of its allied publishers. This article is intended solely for the personal use of the individual user and is not to be disseminated broadly. Psychological Bulletin © 2019 American Psychological Association 2019, Vol. 145, No. 2, 165–188 0033-2909/19/$12.00 http://dx.doi.org/10.1037/bul0000180 165

Transcript of A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166...

Page 1: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

A Meta-Analysis of the Experimental Evidence on the Near- andFar-Transfer Effects Among Children’s Executive Function Skills

Reka KassaiELTE Eötvös Loránd University and MTA-ELTE Lendület

Adaptation Research Group

Judit Futo and Zsolt DemetrovicsELTE Eötvös Loránd University

Zsofia K. TakacsELTE Eötvös Loránd University and MTA-ELTE Lendület Adaptation Research Group

In the present meta-analysis we examined the near- and far-transfer effects of training components ofchildren’s executive functions skills: working memory, inhibitory control, and cognitive flexibility. Wefound a significant near-transfer effect (g� � 0.44, k � 43, p � .001) showing that the interventions inthe primary studies were successful in training the targeted components. However, we found noconvincing evidence of far-transfer (g� � 0.11, k � 17, p � .11). That is, training a component did nothave a significant effect on the untrained components. By showing the absence of benefits that generalizebeyond the trained components, we question the practical relevance of training specific executivefunction skills in isolation. Furthermore, the present results might explain the absence of far-transfereffects of working memory training on academic skills (Melby-Lervag & Hulme, 2013; Sala & Gobet,2017).

Public Significance StatementThe present meta-analysis suggests that it is possible to foster executive functions in childhood byexplicitly training them. However, these programs have limited practical relevance as they onlypromote the component(s), (working memory, inhibitory control, and cognitive flexibility) that aretargeted in the training and do not have far-transfer effects to untrained component(s).

Keywords: executive functions, children, meta-analysis, intervention

Supplemental materials: http://dx.doi.org/10.1037/bul0000180.supp

Executive functions in childhood are crucial skills as they havean important role in social-emotional and cognitive development(Zelazo & Carlson, 2012). These fundamental cognitive skills inthe preschool age are strongly related to school readiness (Bier-man, Nix, Greenberg, Blair, & Domitrovich, 2008; Blair, 2002)and they are more predictive of later academic achievement thanIQ (Blair & Razza, 2007). In a previous meta-analysis on the

concurrent and predictive relations of executive function skills and(later) academic achievement in childhood (Jacob & Parkinson,2015) moderate associations were found both regarding math andreading skills. When children enter formal schooling, executivefunctions are also of high importance in the adjustment to thelearning environment and developing social relationships (Liew,2012). Children’s ability to focus their attention on the relevantobjects, inhibit distractors and impulsive responses, practice self-regulation and self-control by resisting the immediate gratificationof their momentary needs, and solve problems in a flexible andcreative manner are all necessary for academic success as well asfor thriving in social relationships (McClelland & Cameron, 2012).Thus, the importance of executive functions in childhood is clear.

Executive functions are a set of cognitive skills that is respon-sible for planning and organizing our deliberate and goal-directedbehavior (Lezak, 1982). These processes make us able to con-stantly monitor and flexibly adjust to the changes in the environ-ment, to solve new and complex problems, and practice self-control (Jurado & Rosselli, 2007). Behavior regulation via thesetop-down processes is discussed in several theoretical frameworks.While some approaches consider executive functions as a unitary

Reka Kassai, Doctoral School of Psychology, ELTE Eötvös LorándUniversity, and MTA-ELTE Lendület Adaptation Research Group; JuditFuto and Zsolt Demetrovics, Institute of Psychology, ELTE Eötvös LorándUniversity; Zsofia K. Takacs, Institute of Education, ELTE Eötvös LorándUniversity, and MTA-ELTE Lendület Adaptation Research Group.

This research was funded by the Hungarian National Research, Devel-opment and Innovation Office [grant PD121297], the ÚNKP-17-4 NewNational Excellence Program of the Ministry of Human Capacities [grantUNKP-17-4-I-ELTE-125], and the Hungarian Academy of Sciences in theframework of the Lendület II. program (project N: 2018-412).

Correspondence concerning this article should be addressed to Zsofia K.Takacs, Institute of Education, ELTE Eötvös Loránd University, 1075Budapest, Kazinczy u. 23–27, Hungary. E-mail: [email protected]

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

Psychological Bulletin© 2019 American Psychological Association 2019, Vol. 145, No. 2, 165–1880033-2909/19/$12.00 http://dx.doi.org/10.1037/bul0000180

165

Page 2: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

construct, others highlight the distinction between different com-ponents of executive functioning while hypothesizing varying de-grees of unity among different numbers of components.

In Norman and Shallice’s (1986) model the supervisory atten-tional system is responsible for the deliberate regulation ofthoughts and behavior instead of giving schematic responses.Activation of this system makes us able to react in a more adaptivemanner when it is required by the circumstances, for example, innew or unexpected situations when habitual responses would notbe successful. In Baddeley and Hitch’s (1994) model of workingmemory the central executive has a similar role; this component isresponsible for the coordination and the regulation of the twosubsystems: the phonological loop and the visuospatial sketchpad.

Other models argue that executive function skills can be con-sidered to be a unitary construct with different numbers of sepa-rable components. In their seminal work, Miyake et al. (2000)examined the associations between the latent variables behinddifferent types of executive function measures designed to tapworking memory (updating), inhibition, and switching in adults.The factor analyses that provided the best fit resulted in threeclearly separable but moderately correlated factors: (a) updating(also labeled as working memory) that is used to keep informationin mind and to manipulate it; (b) inhibition that makes us able tocontrol our attention, emotions, and behavior by restraining auto-matic or prepotent responses; and (c) shifting (also labeled ascognitive flexibility) which makes us able to look at a problemfrom different points of views and to switch between differentrules and dimensions.

Lehto, Juujärvi, Kooistra, and Pulkkinen (2003) found evidencefor three factors within children’s executive function skills. How-ever, as stated above, there is no general consensus on the numberof components. Supporting this, in a sample of 11- to 12-year-oldchildren, St. Clair-Thompson and Gathercole (2006) found evi-dence for two factors: one for updating (working memory) and onefor inhibition. On the other hand, Wiebe, Espy, and Charak (2008)found that a unitary factor was just as good of a fit for 2- to6-year-old children’s results on working memory and inhibitiontasks as models with separate factors for working memory andinhibitory control. Diamond (2013) considers executive functionskills as a unitary construct with three separable components,however, she broadens this view with a developmental aspect: Sheposits that the executive function (EF) components of workingmemory and inhibitory control skills are mutually supportive ofeach other, and that cognitive flexibility is the latest to develop andbuilds on the other two components.

Although weak or at most moderate correlations among thecomponents are consistently found in the literature (Bull & Scerif,2001; Carlson, Moses, & Breton, 2002; Senn, Espy, & Kaufmann,2004; St. Clair-Thompson & Gathercole, 2006), in most studiesthose disappear after controlling for age and other control variableslike IQ (e.g., Hughes, 1998). It is important to note that studiesusing latent variables (Miyake et al., 2000) generally show stron-ger associations among different EF components. This discrepancybetween results based on single tests as opposed to latent variablesmight imply that measurement imperfections such as task impuritymight indeed play a major role in weakening the associationsfound among the components.

In sum, there is no consensus regarding whether the componentsof executive functions form a unitary construct in childhood.

Accordingly, it is highly questionable whether training one of thecomponents has an effect on the untrained executive function skillsof children. In fact, in literature reviews on the efficacy of differentinterventions aiming to foster children’s executive function skills,doubts have been expressed about the rationale of training specificcomponents in isolation. Diamond and Lee (2011) suggested thatCogmed, a software that trains working memory skills, does nothave significant effects on untrained executive function skills.Diamond and Ling (2016) concluded that while working memorytrainings are successful in training working memory skills, gainsdo not generalize to either inhibitory control or flexibility. Finally,Blair (2017) postulated that results are mixed regarding the far-transfer effects of computerized working memory trainings andactivities embedded in children’s everyday lives should be moreeffective in training executive function skills in general.

The most important aim of the present meta-analysis was to gaina deeper understanding of whether and to what extent the differentcomponents of executive functions are trainable and whether train-ing a specific executive function has an ameliorating effect onother main executive function components. This is of crucialimportance because in the long run the main aim of trainingexecutive functions skills is to improve children’s everyday func-tioning; for example, academic and social skills as well as emotionregulation. These complex skills are not supported by one soleexecutive function but generally rely on the interplay among mostof them (Blair & Razza, 2007).

Meta-analytic studies so far have shown that training workingmemory is possible (Melby-Lervag & Hulme, 2013; Melby-Lervåg, Redick, & Hulme, 2016; Sala & Gobet, 2017); however,it has limited far-transfer effects on the above mentioned complexsocial, emotional, and academic skill sets. Melby-Lervåg andHulme (2013) found no transfer effects of computerized workingmemory training on verbal and nonverbal ability, word decoding,or arithmetic. Further, Sala and Gobet (2017) found small far-transfer effects of working memory training on mathematics andliteracy/word decoding, and no transfer to fluid or crystallizedintelligence or science.

One possible explanation for the lack of far-transfer effect foundon these complex skills is that there might not even be a far-transfer effect among the executive function components them-selves (working memory, inhibition, cognitive flexibility) togetherwhich form the basis of the more complex social, academic, andemotional skills examined. In fact, previous meta-analyses(Melby-Lervag & Hulme, 2013; Sala & Gobet, 2017) have onlyconfirmed the existence of near-transfer effects of working mem-ory trainings (e.g., working memory training improving workingmemory), but could not show a far-transfer effect in children oninhibitory control (operationalized as Stroop-like tests in Melby-Lervag & Hulme, 2013, and as Stroop-tests, go/no-go tests, and thedichotic-listening task in Sala & Gobet, 2017), the only executivefunction component investigated in this respect to date. Althoughworking memory training in childhood have received considerableattention, data about training other EF components which are justas important for complex everyday skills as working memory havenot yet been synthetized to our knowledge.

Accordingly, our study aims to fill this gap in the literature byexamining the evidence regarding the near- and far-transfer effectsof training any and all of the main executive function componentsin childhood: working memory, inhibition, and cognitive flexibil-

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

166 KASSAI, FUTO, DEMETROVICS, AND TAKACS

Page 3: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

ity. Near-transfer effect was defined as effects on the same exec-utive function component(s) that were trained (excluding tasks thatwere practiced during the training), while far-transfer effect in thepresent study was considered as effects on executive functioncomponents that were untrained. By investigating these effects onall three main components of executive function skills in onemeta-analytic study including data of both typically and atypicallydeveloping children, this study provides a unique extension of ourexisting knowledge on the clinically relevant question of trainingexecutive functions and therefore potentially improves the every-day functioning of children.

Based on the literature the following hypotheses were tested:

Hypothesis 1: We expected significant near-transfer effectsbut small or no far-transfer effects of training components ofexecutive functions in childhood.

Hypothesis 2: Regarding the associations between the differ-ent pairs of components there is little evidence in the litera-ture. Melby-Lervåg and Hulme’s (2013) meta-analytic resultssuggest that working memory programs have a small butsignificant effect on inhibitory control measured by Stroop-like tasks. However, this effect was not significant in childsamples (although this was based on a very limited number ofstudies). Accordingly, we expected that training workingmemory might have an effect on inhibitory control. Regardingthe rest of the pairs of components, we had no priorexpectations.

The results of the present meta-analysis are highly relevant tothe clinical practice. A number of developmental psychopatholo-gies are characterized by executive dysfunctions, some of whichare directly linked to the behavioral symptoms. Many computer-based training programs aim to ameliorate the functioning of asingle executive function component; for example, working mem-ory trainings are frequently used with children living with atten-tion-deficit/hyperactivity disorder (ADHD; e.g., Lomas, 2001).However, it is still questionable whether the benefits observedtransfer to other skills such as inhibitory control or flexibility. Incase training a single component does not affect the others, morecomplex trainings that target different executive function compo-nents are probably more suitable in the clinical practice.

Method

Operational Definition

The aim of the present meta-analysis was to examine the near-and far-transfer effects among the following executive functionskills: working memory, inhibitory control, and cognitive flexibil-ity or shifting. Accordingly, we categorized the interventions andthe outcome measures of the primary studies based on the com-ponent(s) they targeted (see the online supplementary material).Most of the training programs utilized a game-like activity eitherin a computer (e.g., Alloway, Bibile, & Lau, 2013; Bennett,Holmes, & Buckley, 2013) or in a noncomputer setting (e.g.,Caviola, Mammarella, Cornoldi, & Lucangeli, 2009; Dowsett &Livesey, 2000) but all of them trained executive function skillsexplicitly by practicing tasks that require one or more executivefunction skills. When the intervention contained elements fostering

different components of executive functions, we considered themmulticomponent trainings (e.g., Goldin et al., 2014; Traverso,Viterbori, & Usai, 2015), while if the targeted skill was clearlyassociated with one core executive component, we defined it as asingle-component training (e.g., de Vries, Prins, Schmand, &Geurts, 2015; Volckaert & Noël, 2015).

In order to be able to assess near- and far-transfer effects we alsocategorized the outcome measures according to which componentit assessed. Instead of relying on the interpretation of the primarystudies’ authors of the tests, we categorized which component thetask loaded on according to the previous considerations in theliterature (Diamond, 2013; Friedman & Miyake, 2004; Garon,Bryson, & Smith, 2008; Miyake et al., 2000). For instance, back-ward digit, word, or spatial (e.g., Corsi block test) span tasks (e.g.,Chacko et al., 2014) were coded as measures of working memory.It is important to note that forward span tests were considered toreflect short-term memory (STM) because they require no manip-ulation of the information kept in mind (Alloway, Gathercole, &Pickering, 2006) and were thus excluded in the present study. Incase a measure including both forward and backward span taskwas reported in a study, it was still included as a measure ofworking memory (e.g., Dovis, Van der Oord, Wiers, & Prins,2015). Additionally, we decided to combine results over verbaland visuospatial working memory because we found very similarresults on the two kinds of working memory tasks (near-transfereffect on verbal working memory tasks: g� � 0.48, k � 20, SE �0.09, 95% CI [0.30, 0.66], p � .001; near-transfer effect onnonverbal working memory tasks: g� � 0.45, k � 22, SE � 0.07,95% CI [0.32, 0.61], p � .001; far-transfer effect on verbalworking memory tasks: g� � �0.04, k � 3, SE � 0.27, 95% CI[�0.56, 0.49], p � .89; far-transfer effect on nonverbal workingmemory tasks: g� � �0.30, k � 3, SE � 0.43, 95% CI [�1.13,0.54], p � .49). This is also in line with the evidence showing thatworking memory is a domain-general capacity (Alloway et al.,2006). It is important to note that the working memory interven-tions in the primary studies used both verbal and nonverbal tasksso we also could not differentiate trainings using verbal andnonverbal stimuli.

Tests that required children to inhibit either a prepotent/autom-atized reaction, a previously learnt response, or a distractor wereincluded as measures of inhibitory control: go/no-go (Dowsett &Livesey, 2000), flanker (e.g., Röthlisberger, Neuenschwander, Ci-meli, Michel, & Roebers, 2011), Stroop-like tests (e.g., Thorell,Lindqvist, Bergman Nutley, Bohlin, & Klingberg, 2009), andAX-CPT (e.g., Dörrenbächer, Müller, Tröger, & Kray, 2014) wereconsidered just like different tasks using the delay of gratificationparadigm like the toy wait test (e.g., Rueda, Checa, & Cómbita,2012) based on Diamond (2013). Similarly, the head-toes-shoulders-knees test was also considered a measure of inhibitorycontrol (Ponitz, McClelland, Matthews, & Morrison, 2009) be-cause children need to inhibit an automatized response—for in-stance, inhibit touching their head when the experimenter says soyet touching their toes instead. Although a second rule is intro-duced in the second phase of the test, it does not interfere with thefirst rule and does not require switching.

Tests that require children to switch between rules that refer tothe same stimuli such as the dimensional card sorting test (e.g.,Howard, Powell, Vasseleu, Johnstone, & Melhuish, 2016; Schmitt,2013) and tasks requiring flexible adjustment of strategies such as

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

167TRANSFER AMONG CHILDREN’S EXECUTIVE FUNCTIONS

Page 4: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

the trail making test part B (e.g., Dovis et al., 2015), the Tower ofLondon test (e.g., Goldin et al., 2014), or the Wisconsin cardsorting test (Lomas, 2001) were categorized as measures of cog-nitive flexibility.

Search Strategy

As the present study was a part of a more extensive meta-analytic project (Takacs & Kassai, 2018) in which we synthetizedall the available experimental results on the effectiveness of dif-ferent kinds of behavioral interventions that aimed to promoteexecutive functions (Diamond & Lee, 2011, e.g., physical exer-cise, art activity, executive function-specific curricula, martial arts,and mindfulness-based practice), we conducted a systematicsearch in the literature based on a detailed search string (seeAppendix A). Four databases (PsycINFO, Web of Science, Psy-cARTICLES, and ERIC) were scanned to identify all the availablejournal articles and unpublished studies like dissertations andconference papers that reported on the effects of an explicit train-ing of component(s) of executive functions with children. Afterexcluding duplicates, 7,287 studies remained. Two independentresearch assistants scanned all of them based on their title andabstract. As a secondary search, the references of the selectedstudies in addition to relevant review articles and meta-analyseswere checked to find all suitable results. Finally, as shown inAppendix B, we identified 38 studies with 47 contrasts that weresuitable for the present study.

Inclusion Criteria

The included studies had to meet the following criteria:

• Randomized controlled design was utilized (The random-ization was done either on an individual or on a group[e.g., classroom] basis).

• The results of the intervention group were compared witha passive or an active control group.

• The aim of the intervention was to explicitly train at leastone of the three core executive function components:working memory, inhibitory control, or cognitive flexibil-ity.

• The age of the sample was no more than 12 years at thebeginning of the study.

• The paper reported the results of at least one outcomemeasure that used a neurocognitive test of executive func-tions.

• The paper was written in English.

Exclusion Criteria

To begin, we excluded all the studies that utilized an implicitapproach for training. Accordingly, we did not include studies onphysical exercise (e.g., Fisher et al., 2011), art activity (e.g.,Schellenberg, 2004), executive function-specific curricula (e.g.,Bierman et al., 2008), mindfulness-based meditation (e.g., Flook,Goldberg, Pinger, & Davidson, 2015), or neuro/biofeedback train-ing (e.g., Beauregard & Lévesque, 2006), and those studies whereteachers or parents were trained instead of the children (Lewis-Morrarty, Dozier, Bernard, Terracciano, & Moore, 2012). Wecould not include correlational studies (e.g., Wiebe, Espy, &

Charak, 2008), as we wanted to draw conclusions about the causalrelationships between the components.

As outcome measures, we only included neurocognitive tests ofexecutive function conducted with the children. Accordingly, otherkinds of instruments were excluded: We did not include teacher-,parent-, or self-reported assessment of executive functions like theBehavior Rating Inventory of Executive Function (e.g., de Vries etal., 2015). Additionally, instead of reaction time (RT), we pre-ferred accuracy on these neurological tests (e.g., Röthlisberger,Neuenschwander, Cimeli, Michel, & Roebers, 2011) because ac-curacy or error rates are considered a more reliable measure ofexecutive functions in childhood (Diamond, Barnett, Thomas, &Munro, 2007). Finally, it is important to note that we did notinclude measures that were the same as the task the childrenpracticed during the intervention as we considered these as directmeasures of training efficacy and to reflect no near- or far-transfereffects. For instance, children practiced a go/no-go apparatus in thestudy of Dowsett and Livesey (2000) and were tested on the samemachine afterward. As these tasks were explicitly practiced duringthe intervention, we excluded them from the analyses in order notto overestimate near-transfer effects. Finally, results had to beexcluded in case we could not locate the full text in English (e.g.,Aghababaei, Malekpour, & Abedi, 2012) or if we did not havesufficient statistics to calculate an effect size even after contactingthe authors (e.g., St. Clair-Thompson & Holmes, 2008).

Coding

During the coding process, two research assistants coded everyarticle according to a predefined coding schema regarding thefollowing information: (a) bibliographic information (e.g., title,author(s), year of publication, and the country where the data wascollected); (b) sample characteristics (e.g., the number and themean age of the participants in the intervention and control groups,other characteristics of the sample such as IQ, SES, and clinicalstatus); (c) study design (e.g., passive or active control); (d) char-acteristics of the intervention (e.g., the executive function compo-nent(s) it targeted, whether the training was conducted individuallyor in groups, whether it was applied on a computer or not); (e) thekind of outcome measure (e.g., working memory, inhibitory con-trol, or flexibility) and whether it was a near-transfer measure (thecomponent targeted in the intervention was the same as tested bythe outcome measure) or far-transfer (the component targeted inthe intervention was different from what the outcome measuretested) measure. Interrater reliability (ranging from 78% to 100%agreement between two coders) was acceptable in all cases.

As shown in Table 1 and 2, from the studies that reported on theresults of more than one intervention or control conditions that metour inclusion criteria we included more contrasts. If there were twoor more suitable intervention conditions, all of them were includedas compared with the control group. The same strategy was usedwhen a study contained more control conditions like an active anda passive control. For instance, Kyttälä, Kanerva, and Kroesbergen(2015) tested the effects of a combined working memory and acounting training alone by comparing them to a passive controlcondition. In this case only the combined working memory andcounting training met our inclusion criteria, the counting trainingalone condition was considered an active control condition. There-fore, the results of the participants who received the working

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

168 KASSAI, FUTO, DEMETROVICS, AND TAKACS

Page 5: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

Tab

le1

Ove

rvie

wof

the

Stud

ies

Incl

uded

inth

eF

irst

Met

a-A

naly

sis

Reg

ardi

ngN

ear-

Tra

nsfe

rE

ffec

ts

Firs

tau

thor

Publ

icat

ion

year

Plac

eA

ge(i

nye

ars)

Clin

ical

stat

usof

the

sam

ple

Inte

rven

tion

cond

ition

Con

trol

cond

ition

Out

com

em

easu

re

Allo

way

Con

tras

t1

2013

Flor

ida,

Nor

thA

mer

ica

M�

10.7

6D

iagn

osed

:L

earn

ing

impa

irm

ents

Wor

king

mem

ory

trai

ning

:“J

ungl

eM

emor

y”(n

�24

)A

ctiv

eco

ntro

l(n

�32

)W

orki

ngm

emor

y(2

mea

sure

s):

1.M

ixof

back

war

ddi

git

reca

llan

dpr

oces

sing

lette

rre

call

2.Sh

ape

reca

ll

Allo

way

Con

tras

t2

2013

Flor

ida,

Nor

thA

mer

ica

M�

10.7

6D

iagn

osed

:L

earn

ing

impa

irm

ents

Wor

king

mem

ory

trai

ning

:“J

ungl

eM

emor

y”(n

�24

)Pa

ssiv

eco

ntro

l(n

�32

)W

orki

ngm

emor

y(2

mea

sure

s):

1.M

ixof

back

war

ddi

git

reca

llan

dpr

oces

sing

lette

rre

call

2.Sh

ape

reca

ll

Ben

nett

2013

Uni

ted

Kin

gdom

,E

urop

e7–

12D

iagn

osed

:D

own

synd

rom

eW

orki

ngm

emor

ytr

aini

ng:

“Jun

ior

Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

10)

Pass

ive

cont

rol

(n�

11)

Wor

king

mem

ory

(2m

easu

res)

:1.

Cou

ntin

gre

call

2.O

ddon

eou

t

Ber

gman

Nut

ley

Con

tras

t1

2011

Swed

en,

Eur

ope

4T

ypic

ally

deve

lopi

ngW

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

25)

Act

ive

cont

rol

(n�

25)

Wor

king

mem

ory

(1m

easu

re):

1.O

ddon

eou

t

Ber

gman

Nut

ley

2011

Swed

en,

Eur

ope

4T

ypic

ally

deve

lopi

ngW

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo

�N

onve

rbal

reas

onin

g”(n

�27

)

Act

ive

cont

rol

(n�

25)

Wor

king

mem

ory

(1m

easu

re):

Con

tras

t2

1.O

ddon

eou

t

Big

orra

2016

Spai

n,E

urop

e7–

12D

iagn

osed

:A

DH

DW

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

31)

Act

ive

cont

rol

(n�

30)

Wor

king

mem

ory

(2m

easu

res)

:1.

Spat

ial

reca

ll2.

Let

ter

num

ber

sequ

enci

ng

Bla

key

2015

Eng

land

,E

urop

eM

�4.

33;

SD�

3.58

Typ

ical

lyde

velo

ping

Wor

king

mem

ory

and

inhi

bito

ryco

ntro

lan

dtr

aini

ng:

“Sho

rtex

ecut

ive

func

tion

trai

ning

prog

ram

”(n

�26

)

Act

ive

cont

rol

(n�

28)

Wor

king

mem

ory

(1m

easu

re):

1.B

ackw

ard

wor

dta

skIn

hibi

tory

cont

rol

(1m

easu

re):

1.Pe

gta

ppin

g

Cav

iola

2009

Ital

y,E

urop

e9

Typ

ical

lyde

velo

ping

Wor

king

mem

ory

trai

ning

:“M

etac

ogni

tive

visu

ospa

tial

wor

king

mem

ory

trai

ning

”(n

�22

)

Act

ive

cont

rol

(n�

24)

Wor

king

mem

ory

(2m

easu

res)

:1.

Bac

kwar

ddi

git

reca

ll2.

Cor

sibl

ock

test

Cha

cko

2014

New

Yor

k,N

orth

Am

eric

a7–

11D

iagn

osed

:A

DH

DW

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

44)

Act

ive

cont

rol

(n�

41)

Wor

king

mem

ory

(2m

easu

res)

:1.

Lis

teni

ngre

call

2.Sp

atia

lre

call

deV

ries

2015

Hol

land

,E

urop

e8–

12D

iagn

osed

:A

SDW

orki

ngm

emor

ytr

aini

ng:

“Bra

inga

me

Bri

an”

(n�

31)

Act

ive

cont

rol

(n�

29)

Wor

king

mem

ory

(1m

easu

re):

Con

tras

t1

1.N

-bac

kte

st

deV

ries

2015

Hol

land

,E

urop

e8–

12D

iagn

osed

:A

SDC

ogni

tive

flex

ibili

tytr

aini

ng:

“Bra

inga

me

Bri

an”

(n�

26)

Act

ive

cont

rol

(n�

29)

Cog

nitiv

efl

exib

ility

(2m

easu

re):

Con

tras

t2

1.N

umbe

r-gn

ome

switc

h2.

Gen

der-

emot

ion

switc

h(t

able

cont

inue

s)

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

169TRANSFER AMONG CHILDREN’S EXECUTIVE FUNCTIONS

Page 6: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

Tab

le1

(con

tinu

ed)

Firs

tau

thor

Publ

icat

ion

year

Plac

eA

ge(i

nye

ars)

Clin

ical

stat

usof

the

sam

ple

Inte

rven

tion

cond

ition

Con

trol

cond

ition

Out

com

em

easu

re

Don

gen-

Boo

msm

a(D

isse

rtat

ion,

Cha

pter

VI)

2014

Hol

land

,E

urop

e5–

7D

iagn

osed

:A

DH

DW

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

26)

Act

ive

cont

rol

(n�

21)

Wor

king

mem

ory

(2m

easu

res)

:1.

Kno

xC

ubes

Lei

dse

Dia

gnos

tisch

eT

est

2.B

ackw

ard

digi

tsp

an

Dov

is20

15H

olla

nd,

Eur

ope

10D

iagn

osed

:A

DH

DW

orki

ngm

emor

y,in

hibi

tory

cont

rol

and

cogn

itive

flex

ibili

tytr

aini

ng:

“Bra

inga

me

Bri

an”

(Ful

lac

tive;

n�

31)

Act

ive

cont

rol

(n�

15)

Wor

king

mem

ory

(1m

easu

re):

Con

tras

t1

1.D

igit

Span

(WIS

C)

Cog

nitiv

efl

exib

ility

(1m

easu

re):

1.T

rail

Mak

ing

Tes

t(s

witc

h-co

st)

Dov

is20

15H

olla

nd,

Eur

ope

10D

iagn

osed

:A

DH

DIn

hibi

tory

cont

rol

and

cogn

itive

flex

ibili

tytr

aini

ng:

“Bra

inga

me

Bri

an”

(Par

tially

activ

e;n

�31

)

Act

ive

cont

rol

(n�

30)

Cog

nitiv

efl

exib

ility

(1m

easu

re):

Con

tras

t2

1.T

rail

Mak

ing

Tes

t(s

witc

h-co

st)

Dör

renb

äche

r20

14G

erm

any,

Eur

ope

8–11

Typ

ical

lyde

velo

ping

Cog

nitiv

efl

exib

ility

trai

ning

:“T

ask

switc

hing

trai

ning

”(h

igh

mot

ivat

ion;

n�

13)

Act

ive

cont

rol

(n�

14)

Cog

nitiv

efl

exib

ility

(1m

easu

re):

Con

tras

t1

1.T

ask

switc

hing

task

Dör

renb

äche

r20

14G

erm

any,

Eur

ope

8–11

Typ

ical

lyde

velo

ping

Cog

nitiv

efl

exib

ility

:“T

ask

switc

hing

trai

ning

”(l

owm

otiv

atio

n;n

�14

)

Act

ive

cont

rol

(n�

14)

Cog

nitiv

efl

exib

ility

(1m

easu

re):

Con

tras

t2

1.T

ask

switc

hing

task

Dun

ning

2013

Uni

ted

Kin

gdom

,E

urop

e7–

9L

owE

F:“L

oww

orki

ngm

emor

y”W

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

34)

Pass

ive

cont

rol

(n�

30)

Wor

king

mem

ory

(2m

easu

res)

:C

ontr

ast

11.

Mix

ofba

ckw

ard

digi

tsp

anan

dlis

teni

ngre

call

2.M

ixof

Mr.

X,

Odd

one

out

Dun

ning

2013

Uni

ted

Kin

gdom

,E

urop

e7–

9L

owE

F:“L

oww

orki

ngm

emor

y”W

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

34)

Act

ive

cont

rol

(n�

30)

Wor

king

mem

ory

(2m

easu

res)

:C

ontr

ast

21.

Mix

ofba

ckw

ard

digi

tsp

anan

dlis

teni

ngre

call

2.M

ixof

Mr.

X,

Odd

one

out

Esp

inet

2012

Can

ada,

Nor

thA

mer

ica

2–4

Typ

ical

lyde

velo

ping

Cog

nitiv

efl

exib

ility

trai

ning

:“R

efle

ctio

ntr

aini

ng”

(n�

15)

Act

ive

cont

rol

(n�

14)

Cog

nitiv

efl

exib

ility

(1m

easu

re):

Exp

erim

ent

11.

Dim

ensi

onal

Cha

nge

Car

dSo

rtE

spin

etC

anad

a,N

orth

Am

eric

a2–

4T

ypic

ally

deve

lopi

ngC

ogni

tive

flex

ibili

tytr

aini

ng:

“Ref

lect

ion

trai

ning

”(n

�14

)

Act

ive

cont

rol

(n�

14)

Cog

nitiv

efl

exib

ility

(1m

easu

re):

Exp

erim

ent

21.

Dim

ensi

onal

Cha

nge

Car

dSo

rtE

spin

etC

anad

a,N

orth

Am

eric

a2–

4T

ypic

ally

deve

lopi

ngC

ogni

tive

flex

ibili

tytr

aini

ng:

“Ref

lect

ion

trai

ning

”(n

�20

)

Act

ive

cont

rol

(n�

16)

Cog

nitiv

efl

exib

ility

(1m

easu

re):

Exp

erim

ent

31.

Dim

ensi

onal

Cha

nge

Car

dSo

rtC

ontr

ast

1

Esp

inet

Can

ada,

Nor

thA

mer

ica

2–4

Typ

ical

lyde

velo

ping

Cog

nitiv

efl

exib

ility

trai

ning

:“R

efle

ctio

ntr

aini

ng”

(n�

20)

Act

ive

cont

rol

(n�

20)

Cog

nitiv

efl

exib

ility

(1m

easu

re):

Exp

erim

ent

31.

Dim

ensi

onal

Cha

nge

Car

dSo

rtC

ontr

ast

2

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

170 KASSAI, FUTO, DEMETROVICS, AND TAKACS

Page 7: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

Tab

le1

(con

tinu

ed)

Firs

tau

thor

Publ

icat

ion

year

Plac

eA

ge(i

nye

ars)

Clin

ical

stat

usof

the

sam

ple

Inte

rven

tion

cond

ition

Con

trol

cond

ition

Out

com

em

easu

re

Gol

din

2014

Arg

entin

a,So

uth

Am

eric

a6–

7T

ypic

ally

deve

lopi

ngW

orki

ngm

emor

y,in

hibi

tory

cont

rol

and

cogn

itive

flex

ibili

tytr

aini

ng:

“Mat

eM

arot

e”(n

�73

)

Act

ive

cont

rol

(n�

38)

Inhi

bito

ryco

ntro

l(2

mea

sure

s):

1.C

hild

Atte

ntio

nN

etw

ork

Tas

k—in

cong

ruen

t2.

Hea

rtan

dFl

ower

s—Fi

xin

cong

ruen

tC

ogni

tive

flex

ibili

ty(3

mea

sure

s):

1.H

eart

and

Flow

ers—

Mix

cong

ruen

t2.

Hea

rtan

dFl

ower

s—M

ixin

cong

ruen

t3.

Tow

erof

Lon

don

Hol

mes

2009

Uni

ted

Kin

gdom

,E

urop

e8–

11L

owE

F:“L

oww

orki

ngm

emor

y”W

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

22)

Act

ive

cont

rol

(n�

20)

Wor

king

mem

ory

(2m

easu

re):

1.M

ixof

Mr.

X,

Odd

one

out

2.C

ount

ing

reca

ll

Hov

ik20

13N

orw

ay,

Eur

ope

10–1

2D

iagn

osed

:A

DH

DW

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

33)

Pass

ive

cont

rol

(n�

34)

Wor

king

mem

ory

(2m

easu

res)

:1.

Lei

ter

Rfo

rwar

dan

dba

ckw

ard

2.M

ixof

lette

r–nu

mbe

rse

quen

cing

and

sent

ence

span

How

ard

2016

Aus

tral

ia4

Typ

ical

lyde

velo

ping

Wor

king

mem

ory,

inhi

bito

ryco

ntro

lan

dco

gniti

vefl

exib

ility

trai

ning

:“S

hare

dbo

okre

adin

gon

eon

one–

Qui

ncey

Quo

kka’

sQ

uest

”(n

�22

)

Act

ive

cont

rol

(n�

18)

Wor

king

mem

ory

(1m

easu

re):

Stud

y1,

Con

tras

t1

1.M

r.A

ntIn

hibi

tory

cont

rol

(1m

easu

re):

1.G

o/N

o-G

oC

ogni

tive

flex

ibili

ty(1

mea

sure

):1.

Dim

ensi

onal

Cha

nge

Car

dSo

rt

How

ard

2016

Aus

tral

ia4

Typ

ical

lyde

velo

ping

Wor

king

mem

ory,

inhi

bito

ryco

ntro

lan

dco

gniti

vefl

exib

ility

trai

ning

:“S

hare

dbo

okre

adin

gin

agr

oup–

Qui

ncey

Quo

kka’

sQ

uest

”(n

�25

)

Act

ive

cont

rol

(n�

18)

Wor

king

mem

ory

(1m

easu

re):

Stud

y1,

Con

tras

t2

1.M

r.A

ntIn

hibi

tory

cont

rol

(1m

easu

re):

1.G

o/N

o-G

oC

ogni

tive

flex

ibili

ty(1

mea

sure

):1.

Dim

ensi

onal

Cha

nge

Car

dSo

rt

How

ard

2016

Aus

tral

ia4

Typ

ical

lyde

velo

ping

Wor

king

mem

ory,

inhi

bito

ryco

ntro

lan

dco

gniti

vefl

exib

ility

trai

ning

:“S

hare

dbo

okre

adin

gon

e-on

-one

–Q

uinc

eyQ

uokk

a’s

Que

st”

(n�

19)

Act

ive

cont

rol

(n�

21)

Wor

king

mem

ory

(1m

easu

re):

Stud

y2

1.M

r.A

ntIn

hibi

tory

cont

rol

(1m

easu

re):

1.G

o/N

o-G

oC

ogni

tive

flex

ibili

ty(1

mea

sure

):1.

Dim

ensi

onal

Cha

nge

Car

dSo

rtH

owar

d20

16A

ustr

alia

4T

ypic

ally

deve

lopi

ngW

orki

ngm

emor

y,in

hibi

tory

cont

rol

and

cogn

itive

flex

ibili

tytr

aini

ng:

“Sha

red

book

read

ing

one-

on-o

ne–

Qui

ncey

Quo

kka’

sQ

uest

”(n

�19

)

Act

ive

cont

rol

(n�

15)

Wor

king

mem

ory

(1m

easu

re):

Stud

y3

1.M

r.A

ntIn

hibi

tory

cont

rol

(1m

easu

re):

1.G

o/N

o-G

oC

ogni

tive

flex

ibili

ty(1

mea

sure

):1.

Dim

ensi

onal

Cha

nge

Car

dSo

rt(t

able

cont

inue

s)

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

171TRANSFER AMONG CHILDREN’S EXECUTIVE FUNCTIONS

Page 8: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

Tab

le1

(con

tinu

ed)

Firs

tau

thor

Publ

icat

ion

year

Plac

eA

ge(i

nye

ars)

Clin

ical

stat

usof

the

sam

ple

Inte

rven

tion

cond

ition

Con

trol

cond

ition

Out

com

em

easu

re

Klin

gber

g20

05Sw

eden

,E

urop

e7–

12D

iagn

osed

:A

DH

DW

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

20)

Act

ive

cont

rol

(n�

24)

Wor

king

mem

ory

(1m

easu

re):

1.Sp

anbo

ard

task

�K

loo

2003

Aus

tria

,E

urop

e2–

4T

ypic

ally

deve

lopi

ngC

ogni

tive

flex

ibili

tytr

aini

ng:

“Car

dSo

rtin

g”(n

�14

)A

ctiv

eco

ntro

l(n

�15

)C

ogni

tive

flex

ibili

ty(1

mea

sure

):1.

Dim

ensi

onal

Cha

nge

Car

dSo

rt

Kro

esbe

rgen

2014

Hol

land

,E

urop

e5

Typ

ical

lyde

velo

ping

Wor

king

mem

ory

trai

ning

:“D

omai

nge

nera

lw

orki

ngm

emor

ytr

aini

ng”

(n�

15)

Pass

ive

cont

rol

(n�

21)

Wor

king

mem

ory

(2m

easu

res)

:C

ontr

ast

11.

Wor

dre

call

back

war

d2.

Odd

one

out

Kro

esbe

rgen

2014

Hol

land

,E

urop

e5

Typ

ical

lyde

velo

ping

Wor

king

mem

ory

trai

ning

:“D

omai

nsp

ecif

icw

orki

ngm

emor

ytr

aini

ng”

(n�

15)

Pass

ive

cont

rol

(n�

21)

Wor

king

mem

ory

(2m

easu

res)

:C

ontr

ast

21.

Wor

dre

call

back

war

d2.

Odd

one

out

Kyt

tälä

2015

Finl

and,

Eur

ope

5.9

Typ

ical

lyde

velo

ping

Wor

king

mem

ory

trai

ning

:“W

orki

ngm

emor

yan

dco

untin

gtr

aini

ng”

(n�

23)

Act

ive

cont

rol

(n�

23)

Wor

king

mem

ory

(3m

easu

res)

:C

ontr

ast

11.

Bac

kwar

dw

ord

span

2.B

ackw

ard

digi

tsp

an3.

Odd

one

out

Kyt

tälä

2015

Finl

and,

Eur

ope

5.9

Typ

ical

lyde

velo

ping

Wor

king

mem

ory

trai

ning

:“W

orki

ngm

emor

yan

dco

untin

gtr

aini

ng”

(n�

23)

Pass

ive

cont

rol

(n�

17)

Wor

king

mem

ory

(3m

easu

res)

:C

ontr

ast

21.

Bac

kwar

dw

ord

span

2.B

ackw

ard

digi

tsp

an3.

Odd

one

out

Lom

as(D

isse

rtat

ion)

2001

Vir

gini

a,N

orth

Am

eric

a7–

9D

iagn

osed

:A

DH

DW

orki

ngm

emor

y,in

hibi

tory

cont

rol

and

cogn

itive

flex

ibili

tytr

aini

ng:

Pass

ive

cont

rol

(n�

15)

Inhi

bito

ryco

ntro

l(1

mea

sure

):1.

Con

tinuo

usPe

rfor

man

ceT

est—

com

mis

sion

erro

rs“L

ocuT

our

Mul

timed

iaC

ogni

tive

Reh

abili

tatio

n”(n

�16

)

Cog

nitiv

efl

exib

ility

(1m

easu

re):

1.W

CST

—to

tal

corr

ect

Luo

2013

Chi

na,

Asi

a8–

11D

iagn

osed

:D

ysle

xia

Wor

king

mem

ory

and

inhi

bito

ryco

ntro

ltr

aini

ng:

“Wor

king

mem

ory

and

cent

ral

exec

utiv

eta

sks”

(n�

15)

Act

ive

cont

rol

(n�

15)

Wor

king

mem

ory

(2m

easu

res)

:1.

Wor

dsp

anta

skba

ckw

ard

2.D

igit

span

back

war

dIn

hibi

tory

cont

rol

(1m

easu

res)

:1.

Stro

op

Mar

kom

icha

li(D

isse

rtat

ion)

Stud

y1,

Con

tras

t1

2015

New

Ham

pshi

re,

Nor

thA

mer

ica

4–5

Typ

ical

lyde

velo

ping

Inhi

bito

ryco

ntro

ltr

aini

ng:

“Wai

ting

Gam

e”(n

�12

)A

ctiv

eco

ntro

l(n

�13

)In

hibi

tory

cont

rol

(1m

easu

re):

1.T

heT

eddi

esT

ask

Mar

kom

icha

li(D

isse

rtat

ion)

2015

New

Ham

pshi

re,

Nor

thA

mer

ica

4–5

Typ

ical

lyde

velo

ping

Inhi

bito

ryco

ntro

ltr

aini

ng:

“Wai

ting

Gam

e”(n

�12

)Pa

ssiv

eco

ntro

l(n

�13

)In

hibi

tory

cont

rol

(1m

easu

re):

1.T

heT

eddi

esT

ask

Stud

y1,

Con

tras

t2

Mar

kom

icha

li(D

isse

rtat

ion)

2015

New

Ham

pshi

re,

Nor

thA

mer

ica

4–6

Low

EF:

“Low

inhi

bitio

n”In

hibi

tory

cont

rol

trai

ning

:“W

aitin

gG

ame”

(n�

19)

Pass

ive

cont

rol

(n�

18)

Inhi

bito

ryco

ntro

l(2

mea

sure

s):

1.T

heT

eddi

esT

ask

2.B

eeD

elay

Tas

kSt

udy

2

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

172 KASSAI, FUTO, DEMETROVICS, AND TAKACS

Page 9: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

Tab

le1

(con

tinu

ed)

Firs

tau

thor

Publ

icat

ion

year

Plac

eA

ge(i

nye

ars)

Clin

ical

stat

usof

the

sam

ple

Inte

rven

tion

cond

ition

Con

trol

cond

ition

Out

com

em

easu

re

Re

2007

Ital

y,E

urop

e5

Dia

gnos

ed:

AD

HD

Wor

king

mem

ory,

inhi

bito

ryco

ntro

lan

dco

gniti

vefl

exib

ility

trai

ning

:“W

orki

ngM

emor

yC

ontr

olT

rain

ing

Prog

ram

”(n

�5)

Pass

ive

cont

rol

(n�

5)W

orki

ngm

emor

y(1

mea

sure

):1.

Dua

lR

eque

stSe

lect

ive

Tas

kIn

hibi

tory

cont

rol

(1m

easu

re):

1.W

alk/

Don

’tW

alk

Re

2015

Ital

y,E

urop

e5

Low

EF:

“AD

HD

sym

ptom

s”W

orki

ngm

emor

y,in

hibi

tory

cont

rol

and

cogn

itive

flex

ibili

tytr

aini

ng:

“Wor

king

Mem

ory

Con

trol

Tra

inin

gPr

ogra

m”

(n�

13)

Act

ive

cont

rol

(n�

13)

Wor

king

mem

ory

(1m

easu

re):

Sam

ple

11.

Dua

lR

eque

stSe

lect

ive

Tas

kIn

hibi

tory

cont

rol

(1m

easu

re):

1.W

alk/

Don

’tW

alk

Re

2015

Ital

y,E

urop

e5

Typ

ical

lyde

velo

ping

Wor

king

mem

ory,

inhi

bito

ryco

ntro

lan

dco

gniti

vefl

exib

ility

trai

ning

:“W

orki

ngM

emor

yC

ontr

olT

rain

ing

Prog

ram

”(n

�13

)

Act

ive

cont

rol

(n�

13)

Wor

king

mem

ory

(1m

easu

re):

Sam

ple

21.

Dua

lR

eque

stSe

lect

ive

Tas

kIn

hibi

tory

cont

rol

(1m

easu

re):

1.W

alk/

Don

’tW

alk

Röt

hlis

berg

er20

11Sw

iss,

Eur

ope

5T

ypic

ally

deve

lopi

ngW

orki

ngm

emor

y,in

hibi

tory

cont

rol

and

cogn

itive

flex

ibili

tytr

aini

ng:

“Sm

all

grou

pin

terv

entio

nde

velo

ped

topr

omot

eE

F”(n

�33

)

Pass

ive

cont

rol

(n�

38)

Wor

king

mem

ory

(1m

easu

re):

Sam

ple

11.

Com

plex

Span

Tas

kIn

hibi

tory

cont

rol

(1m

easu

re):

1.Si

mpl

eFl

anke

rT

ask

Cog

nitiv

efl

exib

ility

(1m

easu

re):

1.M

ixed

Flan

ker

Tas

k

Röt

hlis

berg

er20

11Sw

iss,

Eur

ope

6T

ypic

ally

deve

lopi

ngW

orki

ngm

emor

y,in

hibi

tory

cont

rol

and

cogn

itive

flex

ibili

tytr

aini

ng:

“Sm

all

grou

pin

terv

entio

nde

velo

ped

topr

omot

eE

F”(n

�30

)

Pass

ive

cont

rol

(n�

34)

Wor

king

mem

ory

(1m

easu

re):

Sam

ple

21.

Com

plex

Span

Tas

kIn

hibi

tory

cont

rol

(1m

easu

re):

1.Si

mpl

eFl

anke

rT

ask

Cog

nitiv

efl

exib

ility

(1m

easu

re):

1.M

ixed

Flan

ker

Tas

k

Rue

da20

12Sp

ain,

Eur

ope

5T

ypic

ally

deve

lopi

ngIn

hibi

tory

cont

rol

trai

ning

:“C

ompu

teri

zed

trai

ning

ofat

tent

ion”

(n�

19)

Act

ive

cont

rol

(n�

18)

Inhi

bito

ryco

ntro

l(4

mea

sure

s):

1.D

elay

ofG

ratif

icat

ion–

Self

2.D

elay

ofG

ratif

icat

ion–

Oth

er3.

Chi

ldG

ambl

ing

Tas

k4.

Chi

ldA

NT

—om

issi

oner

ror

Schm

itt20

13O

rego

n,N

orth

Am

eric

a3–

5T

ypic

ally

deve

lopi

ngIn

hibi

tory

cont

rol

and

cogn

itive

flex

ibili

tytr

aini

ng:

“Sel

f-re

gula

tion

inte

rven

tion”

(n�

126)

Pass

ive

cont

rol

(n�

150)

Inhi

bito

ryco

ntro

l(1

mea

sure

):(D

isse

rtat

ion)

1.H

ead-

Toe

s-K

nees

-Sho

ulde

rsT

ask

Cog

nitiv

efl

exib

ility

(1m

easu

re):

1.D

CC

SSt

.C

lair

-Tho

mps

on20

08U

nite

dK

ingd

om,

Eur

ope

6–7

Typ

ical

deve

lopi

ngW

orki

ngm

emor

ytr

aini

ng:

“Mem

ory

Boo

ster

”(n

�22

)

Pass

ive

cont

rol

(n�

22)

Wor

king

mem

ory

(2m

easu

res)

:St

udy

11.

Lis

teni

ngre

call

task

2.C

ount

ing

reca

llta

sk

St.

Cla

ir-T

hom

pson

2008

Uni

ted

Kin

gdom

,E

urop

e6–

7T

ypic

ally

deve

lopi

ngW

orki

ngm

emor

ytr

aini

ng:

“Mem

ory

Boo

ster

”(n

�18

)

Pass

ive

cont

rol

(n�

18)

Wor

king

mem

ory

(2m

easu

res)

:St

udy

21.

Lis

teni

ngre

call

task

2.B

ackw

ard

digi

tre

call

St.

Cla

ir-T

hom

pson

2010

Uni

ted

Kin

gdom

,E

urop

e5–

8T

ypic

ally

deve

lopi

ngW

orki

ngm

emor

ytr

aini

ng:

“Mem

ory

Boo

ster

”(n

�11

7)

Act

ive

cont

rol

(n�

137)

Wor

king

mem

ory

(1m

easu

re):

1.L

iste

ning

reca

ll

(tab

leco

ntin

ues)

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

173TRANSFER AMONG CHILDREN’S EXECUTIVE FUNCTIONS

Page 10: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

Tab

le1

(con

tinu

ed)

Firs

tau

thor

Publ

icat

ion

year

Plac

eA

ge(i

nye

ars)

Clin

ical

stat

usof

the

sam

ple

Inte

rven

tion

cond

ition

Con

trol

cond

ition

Out

com

em

easu

re

Tho

rell

2009

Swed

en,

Eur

ope

4–5

Typ

ical

deve

lopi

ngW

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

17)

Act

ive

cont

rol

(n�

14)

Wor

king

mem

ory

(2m

easu

res)

:C

ontr

ast

11.

Span

Boa

rdT

ask

(WA

IS-R

-N

I)2.

Wor

dSp

anT

ask

Tho

rell

2009

Swed

en,

Eur

ope

4–5

Typ

ical

lyde

velo

ping

Wor

king

mem

ory

trai

ning

:“C

ogm

edW

orki

ngM

emor

yT

rain

ing:

Rob

oMem

o”(n

�17

)

Pass

ive

cont

rol

(n�

16)

Wor

king

mem

ory

(2m

easu

res)

:C

ontr

ast

21.

Span

Boa

rdT

ask

(WA

IS-R

-N

I)2.

Wor

dSp

anT

ask

Tho

rell

2009

Swed

en,

Eur

ope

4–5

Typ

ical

lyde

velo

ping

Inhi

bito

ryco

ntro

ltr

aini

ng:

“Cog

med

Inhi

bitio

nT

rain

ing:

Rob

oMem

o”(n

�18

)

Act

ive

cont

rol

(n�

14)

Inhi

bito

ryco

ntro

l(2

mea

sure

s):

Con

tras

t3

1.D

ay-N

ight

Stro

opT

ask—

erro

r2.

Go/

No-

Go

Tas

k—co

mm

issi

oner

ror

Tho

rell

2009

Swed

en,

Eur

ope

4–5

Typ

ical

lyde

velo

ping

Inhi

bito

ryco

ntro

ltr

aini

ng:

“Cog

med

Inhi

bitio

nT

rain

ing:

Rob

oMem

o”(n

�18

)

Pass

ive

cont

rol

(n�

16)

Inhi

bito

ryco

ntro

l(2

mea

sure

s):

Con

tras

t4

1.D

ay-N

ight

Stro

opT

ask—

erro

r2.

Go/

No-

Go

Tas

k—co

mm

issi

oner

ror

Tom

iney

2011

Ore

gon,

Nor

thA

mer

ica

3–5

Typ

ical

lyde

velo

ping

Inhi

bito

ryco

ntro

lan

dco

gniti

vefl

exib

ility

trai

ning

:“C

ircl

eT

ime

Gam

es”

(n�

28)

Pass

ive

cont

rol

(n�

37)

Inhi

bito

ryco

ntro

l(1

mea

sure

):1.

Hea

d-T

oes-

Kne

es-S

houl

ders

Tas

k

Tra

vers

o20

15It

aly,

Eur

ope

5T

ypic

ally

deve

lopi

ngW

orki

ngm

emor

yan

din

hibi

tory

cont

rol

trai

ning

:“E

Fpr

omot

ing

smal

lgr

oup

prog

ram

–Chi

cco

and

Nan

a”(n

�32

)

Pass

ive

cont

rol

(n�

43)

Wor

king

mem

ory

(2m

easu

res)

:1.

Bac

kwar

dW

ord

Span

2.K

eep

Tra

ckIn

hibi

tory

cont

rol

(4m

easu

res)

:1.

Cir

cle

draw

ing

task

2.A

rrow

flan

ker

task

3.G

ift

wra

p4.

Del

ayta

sk

Vol

ckae

rt20

15B

elgi

um,

Eur

ope

4–5

Typ

ical

lyde

velo

ping

Inhi

bito

ryco

ntro

ltr

aini

ng:

“Inh

ibiti

ontr

aini

ng”

(n�

24)

Act

ive

cont

rol

(n�

23)

Inhi

bito

ryco

ntro

l(1

mea

sure

):1.

Mix

ofT

raff

iclig

hts,

Cat

-D

og-F

ish,

Mon

ster

Stro

op,

Hea

d-T

oes-

Kne

es-S

houl

ders

(Inh

ibiti

onfa

ctor

)

Won

g20

14C

hina

,A

sia

6–12

Low

EF:

“Low

wor

king

mem

ory”

Wor

king

mem

ory

trai

ning

:“C

ompu

teri

zed

wor

king

mem

ory

trai

ning

”(n

�26

)

Pass

ive

cont

rol

(n�

25)

Wor

king

mem

ory

(1m

easu

re):

1.Sp

anB

oard

task

Not

e.A

DH

D�

atte

ntio

n-de

fici

t/hyp

erac

tivity

diso

rder

;ASD

�au

tism

spec

trum

diso

rder

;EF

�ex

ecut

ive

func

tion.

The

stud

ym

arke

dby

�w

asex

clud

edfr

omth

ean

alys

esbe

caus

eit

had

anou

tlyin

gef

fect

size

.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

174 KASSAI, FUTO, DEMETROVICS, AND TAKACS

Page 11: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

Tab

le2

Ove

rvie

wof

the

Stud

ies

Incl

uded

inth

eSe

cond

Met

a-A

naly

sis

Reg

ardi

ngF

ar-T

rans

fer

Eff

ects

Firs

tau

thor

Publ

icat

ion

year

Plac

eA

ge(i

nye

ars)

Clin

ical

stat

usof

the

sam

ple

Inte

rven

tion

cond

ition

Con

trol

cond

ition

Out

com

em

easu

re

Big

orra

2016

Spai

n,E

urop

e7–

12D

iagn

osed

:A

DH

DW

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g”(n

�31

)

Act

ive

cont

rol

(n�

30)

Inhi

bito

ryco

ntro

l(1

mea

sure

):1.

CPT

II(c

omm

issi

oner

rors

)C

ogni

tive

flex

ibili

ty(3

mea

sure

s):

1.T

ower

ofL

ondo

n2.

WC

ST(p

erse

vera

tive

erro

rs)

3.T

rail

mak

ing

test

B

Bla

key

2015

Eng

land

,E

urop

eM

�4.

33;

SD�

3.58

Typ

ical

lyde

velo

ping

Wor

king

mem

ory

and

inhi

bito

ryco

ntro

lan

dtr

aini

ng:

“Sho

rtex

ecut

ive

func

tion

trai

ning

prog

ram

”(n

�26

)

Act

ive

cont

rol

(n�

28)

Cog

nitiv

efl

exib

ility

(2m

easu

res)

:1.

FIST

2.SW

IFT

mix

edsw

itch

Cha

cko

2014

New

Yor

k,N

orth

Am

eric

a7–

11D

iagn

osed

:A

DH

DW

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g”(n

�44

)

Act

ive

cont

rol

(n�

41)

Inhi

bito

ryco

ntro

l(1

mea

sure

):1.

CPT

(com

mis

sion

erro

rs)

deV

ries

2015

Hol

land

,E

urop

e8–

12D

iagn

osed

:A

SDW

orki

ngm

emor

ytr

aini

ng:

“Bra

inga

me

Bri

an”

(n�

31)

Act

ive

cont

rol

(n�

29)

Inhi

bito

ryco

ntro

l(1

mea

sure

):C

ontr

ast

11.

Stop

task

(com

mis

sion

erro

r)C

ogni

tive

flex

ibili

ty(2

mea

sure

):1.

Num

ber-

gnom

esw

itch

2.G

ende

r-em

otio

nsw

itch

deV

ries

2015

Hol

land

,E

urop

e8–

12D

iagn

osed

:A

SDC

ogni

tive

flex

ibili

tytr

aini

ng:

“Bra

inga

me

Bri

an”

(n�

31)

Act

ive

cont

rol

(n�

29)

Wor

king

mem

ory

(1m

easu

re):

Con

tras

t2

1.N

-bac

kte

stIn

hibi

tory

cont

rol

(1m

easu

re):

1.St

opta

sk(c

omm

issi

oner

ror)

Don

gen-

Boo

msm

a20

14H

olla

nd,

Eur

ope

5–7

Dia

gnos

ed:

AD

HD

Wor

king

mem

ory

trai

ning

:“C

ogm

edW

orki

ngM

emor

yT

rain

ing:

Rob

oMem

o”(n

�24

)

Act

ive

cont

rol

(n�

21)

Inhi

bito

ryco

ntro

l(3

mea

sure

s):

(Dis

sert

atio

n,C

hapt

erV

I.)

1.D

ay/N

ight

Stro

op2.

Shap

esc

hool

cont

rol

red

3.Sh

ape

scho

olco

ntro

lye

llow

Cog

nitiv

efl

exib

ility

(2m

easu

res)

:1.

Shap

esc

hool

switc

hre

d2.

Shap

esw

itch

yello

w

Dov

is20

15H

olla

nd,

Eur

ope

10D

iagn

osed

:A

DH

DIn

hibi

tory

cont

rol

and

cogn

itive

flex

ibili

tytr

aini

ng:

“Bra

inga

me

Bri

an”

(Par

tially

activ

e;n

�28

)

Act

ive

cont

rol

(n�

30)

Wor

king

mem

ory

(1m

easu

re):

Con

tras

t2

1.D

igit

Span

(WIS

C)

Dow

sett

2000

Aus

tral

ia3

Low

EF:

“Low

inhi

bitio

n”C

ogni

tive

flex

ibili

tytr

aini

ng:

Prac

ticin

gE

Fpr

omot

ing

task

s(n

�7)

Pass

ive

cont

rol

(n�

5)In

hibi

tory

cont

rol

(1m

easu

re):

Con

tras

t1

1.G

o/N

o-go

disc

rim

inat

ion

appa

ratu

s

Dow

sett

2000

Aus

tral

ia4–

5L

owE

F:“L

owin

hibi

tion”

Cog

nitiv

efl

exib

ility

trai

ning

:Pr

actic

ing

EF

prom

otin

gta

sks

(n�

8)

Pass

ive

cont

rol

(n�

4)In

hibi

tory

cont

rol

(1m

easu

re):

Con

tras

t2

1.G

o/N

o-go

disc

rim

inat

ion

appa

ratu

s(t

able

cont

inue

s)

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

175TRANSFER AMONG CHILDREN’S EXECUTIVE FUNCTIONS

Page 12: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

Tab

le2

(con

tinu

ed)

Firs

tau

thor

Publ

icat

ion

year

Plac

eA

ge(i

nye

ars)

Clin

ical

stat

usof

the

sam

ple

Inte

rven

tion

cond

ition

Con

trol

cond

ition

Out

com

em

easu

re

Dör

renb

äche

r20

14G

erm

any,

Eur

ope

8–11

Typ

ical

lyde

velo

ping

Cog

nitiv

efl

exib

ility

trai

ning

:“T

ask

switc

hing

trai

ning

(hig

hm

otiv

atio

n”(n

�13

)

Act

ive

cont

rol

(n�

14)

Wor

king

mem

ory

(2m

easu

res)

:C

ontr

ast

11.

Bac

kwar

ddi

git

span

2.C

ount

ing

span

Inhi

bito

ryco

ntro

l(3

mea

sure

s):

1.C

PTA

Y2.

CPT

BX

3.St

roop

test

Dör

renb

äche

r20

14G

erm

any,

Eur

ope

8–11

Typ

ical

lyde

velo

ping

Cog

nitiv

efl

exib

ility

trai

ning

:“T

ask

switc

hing

trai

ning

(low

mot

ivat

ion”

(n�

13)

Act

ive

cont

rol

(n�

14)

Wor

king

mem

ory

(2m

easu

res)

:C

ontr

ast

21.

Bac

kwar

ddi

git

span

2.C

ount

ing

span

Inhi

bito

ryco

ntro

l(3

mea

sure

s):

1.C

PTA

Y2.

CPT

BX

3.St

roop

test

Dun

ning

2013

Uni

ted

Kin

gdom

,E

urop

e7–

9L

owE

F:“L

oww

orki

ngm

emor

y”W

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

17)

Pass

ive

cont

rol

(n�

30)

Inhi

bito

ryco

ntro

l(1

mea

sure

):C

ontr

ast

11.

CPT

(com

mis

sion

erro

r)

Dun

ning

2013

Uni

ted

Kin

gdom

,E

urop

e7–

9L

owE

F:“L

oww

orki

ngm

emor

y”W

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

31)

Act

ive

cont

rol

(n�

29)

Inhi

bito

ryco

ntro

l(1

mea

sure

):C

ontr

ast

21.

CPT

(com

mis

sion

erro

r)

Ege

land

2013

Nor

way

,E

urop

e10

–12

Dia

gnos

ed:

AD

HD

Wor

king

mem

ory

trai

ning

:“C

ogm

edW

orki

ngM

emor

yT

rain

ing:

Rob

oMem

o”(n

�33

)

Pass

ive

cont

rol

(n�

34)

Inhi

bito

ryco

ntro

l:1.

Col

orw

ord

test

2.C

ontin

uous

Perf

orm

ance

Tes

t—H

yper

activ

ity-I

mpu

lsiv

ityC

ogni

tive

Flex

ibili

ty1.

Tra

ilm

akin

gte

st(T

ask

4—di

vide

dat

tent

ion)

Kar

bach

2009

Ger

man

y,E

urop

e8–

10T

ypic

ally

deve

lopi

ngC

ogni

tive

flex

ibili

tytr

aini

ng:

“Tas

k-sw

itchi

ngtr

aini

ng”

(n�

14)

Act

ive

cont

rol

(n�

14)

Wor

king

mem

ory

(2m

easu

res)

:C

ontr

ast

11.

Mix

ofre

adin

gsp

anan

dco

untin

gsp

an2.

Mix

ofsy

mm

etry

span

and

navi

gatio

nsp

anIn

hibi

tory

cont

rol

(1m

easu

re):

1.M

ixof

colo

ran

dnu

mbe

rSt

roop

task

Kar

bach

2009

Ger

man

y,E

urop

e8–

10T

ypic

ally

deve

lopi

ngC

ogni

tive

flex

ibili

tytr

aini

ng:

“Tas

k-sw

itchi

ngtr

aini

ng�

verb

alse

lf-i

nstr

uctio

ns”

(n�

14)

Act

ive

cont

rol

(n�

14)

Wor

king

mem

ory

(2m

easu

res)

:C

ontr

ast

21.

Mix

ofre

adin

gsp

anan

dco

untin

gsp

an2.

Mix

ofsy

mm

etry

span

and

navi

gatio

nsp

anIn

hibi

tory

cont

rol

(1m

easu

re):

1.M

ixof

colo

ran

dnu

mbe

rSt

roop

task

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

176 KASSAI, FUTO, DEMETROVICS, AND TAKACS

Page 13: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

Tab

le2

(con

tinu

ed)

Firs

tau

thor

Publ

icat

ion

year

Plac

eA

ge(i

nye

ars)

Clin

ical

stat

usof

the

sam

ple

Inte

rven

tion

cond

ition

Con

trol

cond

ition

Out

com

em

easu

re

Kar

bach

2009

Ger

man

y,E

urop

e8–

10T

ypic

ally

deve

lopi

ngC

ogni

tive

flex

ibili

tytr

aini

ng:

“Sw

itch

trai

ning

�ve

rbal

inst

ruct

ions

�va

riab

letr

aini

ng”

(n�

14)

Act

ive

cont

rol

(n�

14)

Wor

king

mem

ory

(2m

easu

res)

:C

ontr

ast

31.

Mix

ofre

adin

gsp

anan

dco

untin

gsp

an2.

Mix

ofsy

mm

etry

span

and

navi

gatio

nsp

anIn

hibi

tory

cont

rol

(1m

easu

re):

1.M

ixof

colo

ran

dnu

mbe

rSt

roop

task

Klin

gber

g20

05Sw

eden

,E

urop

e7–

12D

iagn

osed

:A

DH

DW

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

20)

Act

ive

cont

rol

(n�

24)

Inhi

bito

ryco

ntro

l(1

mea

sure

):1.

Stro

opte

st

Tho

rell

2009

Swed

en,

Eur

ope

4–5

Typ

ical

deve

lopi

ngW

orki

ngm

emor

ytr

aini

ng:

“Cog

med

Wor

king

Mem

ory

Tra

inin

g:R

oboM

emo”

(n�

17)

Act

ive

cont

rol

(n�

14)

Inhi

bito

ryco

ntro

l(2

mea

sure

s):

Con

tras

t1

1.D

ay-N

ight

Stro

opT

ask—

erro

r2.

Go/

No-

Go

Tas

k—co

mm

issi

oner

ror

Tho

rell

2009

Swed

en,

Eur

ope

4–5

Typ

ical

lyde

velo

ping

Wor

king

mem

ory

trai

ning

:“C

ogm

edW

orki

ngM

emor

yT

rain

ing:

Rob

oMem

o”(n

�17

)

Pass

ive

cont

rol

(n�

16)

Inhi

bito

ryco

ntro

l(2

mea

sure

s):

Con

tras

t2

1.D

ay-N

ight

Stro

opT

ask—

erro

r2.

Go/

No-

Go

Tas

k—co

mm

issi

oner

ror

Tho

rell

2009

Swed

en,

Eur

ope

4–5

Typ

ical

lyde

velo

ping

Inhi

bito

ryco

ntro

ltr

aini

ng:

“Cog

med

Inhi

bitio

nT

rain

ing:

Rob

oMem

o”(n

�18

)

Act

ive

cont

rol

(n�

14)

Wor

king

mem

ory

(2m

easu

res)

:C

ontr

ast

31.

Span

Boa

rdT

ask

(WA

IS-R

-NI)

2.W

ord

Span

Tas

k

Tho

rell

2009

Swed

en,

Eur

ope

4–5

Typ

ical

lyde

velo

ping

Inhi

bito

ryco

ntro

ltr

aini

ng:

“Cog

med

Inhi

bitio

nT

rain

ing:

Rob

oMem

o”(n

�18

)

Pass

ive

cont

rol

(n�

15)

Wor

king

mem

ory

(2m

easu

res)

:C

ontr

ast

41.

Span

Boa

rdT

ask

(WA

IS-R

-NI)

2.W

ord

Span

Tas

k

Tra

vers

o20

15It

aly,

Eur

ope

5T

ypic

ally

deve

lopi

ngW

orki

ngm

emor

yan

din

hibi

tory

cont

rol

trai

ning

:“E

Fpr

omot

ing

smal

lgr

oup

prog

ram

–C

hicc

oan

dN

ana”

(n�

32)

Pass

ive

cont

rol

(n�

43)

Cog

nitiv

efl

exib

ility

(1m

easu

re):

1.G

o/N

o-G

o(s

hift

ing

phas

e)2.

Dot

sta

sk

Vol

ckae

rt20

15B

elgi

um,

Eur

ope

4–5

Typ

ical

lyde

velo

ping

Inhi

bito

ryco

ntro

ltr

aini

ng:

“Inh

ibiti

ontr

aini

ng”

(n�

24)

Act

ive

cont

rol

(n�

23)

Wor

king

mem

ory

(1m

easu

re):

1.M

ixof

Cat

egos

pan,

Wor

dsSp

an,

Blo

ckta

ppin

gte

st(W

orki

ngm

emor

yfa

ctor

)C

ogni

tive

flex

ibili

ty(1

mea

sure

):1.

Mix

ofT

raff

iclig

hts

Hea

d-T

oes-

Kne

es-S

houl

ders

Mon

ster

Stro

op(F

lexi

bilit

yfa

ctor

)

Won

g20

14C

hina

,A

sia

6–12

Low

EF:

“Low

wor

king

mem

ory”

Wor

king

mem

ory

trai

ning

:“C

ompu

teri

zed

wor

king

mem

ory

trai

ning

”(n

�26

)

Pass

ive

cont

rol

(n�

25)

Inhi

bito

ryco

ntro

l(1

mea

sure

):1.

Stro

opta

sk

Not

e.A

DH

D�

atte

ntio

n-de

fici

t/hyp

erac

tivity

diso

rder

;A

SD�

autis

msp

ectr

umdi

sord

er;

EF

�ex

ecut

ive

func

tion.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

177TRANSFER AMONG CHILDREN’S EXECUTIVE FUNCTIONS

Page 14: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

memory and counting training were contrasted to the results of theparticipants of the counting training (active control) and to thosewho did not participated in any intervention (passive control; for asimilar procedure see: Bakermans-Kranenburg, van IJzendoorn, &Juffer, 2003; Mol, Bus, de Jong, & Smeets, 2008; Takacs, Swart,& Bus, 2015).

Meta-Analytic Procedures

We used the software Comprehensive Meta-Analysis (CMA),Version 3.0 (Borenstein, Hedges, Higgins, & Rothstein, 2005) tocalculate the effect size for each contrast for the standardized meandifference between the intervention and the control conditions,which was the dependent variable in the present meta-analysis. Wechose the effect size of Hedges’ g over Cohen’s d because itcorrects for small sample sizes (Borenstein, Hedges, Higgins, &Rothstein, 2009). A positive effect size reflected the advantage ofthe intervention condition, while a negative effect suggested thatthe control condition outperformed the intervention group. Forcalculating the effect sizes, the raw means and standard deviationson the posttests in the intervention and the control groups wereused or other statistics regarding the difference between the twogroups on the posttest (e.g., t- or F-statistics). When more than oneappropriate outcome measure was reported in a study, we calcu-lated effect sizes for all of those. The software takes the average ofthe effect sizes found on all outcome measures per study beforetaking the average over all contrasts; thus, these measures are notconsidered independent. The results were scanned for outliers witha standardized residual exceeding �3.29 (Tabachnik & Fidell,2007).

We conducted two meta-analyses: one for the near-transfer andone for the far-transfer effect. Thus, we tested the effects oftraining an executive function component on that specific compo-nent in the first model, and the effects of training an executivefunction component on the untrained components. Because therewas a wide range of different samples, interventions, and outcomemeasures, we used the random-effects model to calculate theaverage effect sizes. The random-effects model allows for suchbetween-study variance (Borenstein et al., 2009). Under this modelthe average effect size is calculated after weighting the contrastsby the inverse of the sampling error. Thus, studies with largersamples weigh more into the average. We conducted retrospectivestatistical power calculations to assess whether we had sufficientpower for testing the average near- and far-transfer effects. Wefound that statistical power was above 80% in both cases, using thevariance estimates found in the analyses, to show a small effect of0.20 (Borenstein et al., 2009).

It is plausible that there is an effect whether, for instance,children practice on a computer during the intervention and havenoncomputerized tests as outcome measures. Thus, we calculatedthe near- and far-transfer effects when the medium of the inter-vention and the outcome measure was congruent (both applied onthe computer or both were noncomputer based) and when not.Results were very similar, therefore the effect of medium was notconsidered further.

Additionally, we inspected the average near- and far-transfereffects on each component separately. Further, the Q-statistics wasutilized to calculate the heterogeneity of the average effect sizes. Asignificant Q-value indicates a heterogeneous effect. Finally, we

selected the contrasts in which they only trained a single compo-nent and assessed the effect on the untrained components sepa-rately in order to conduct fine-grained analyses regarding thespecific relations among the components.

In order to assess the effects of differences between theprimary studies that might have an influence on the results suchas the clinical status and the age of the sample, the length of theintervention, whether the study utilized an active or a passivecontrol condition, the year of publication, or the continentthe study was conducted in, subgroup analyses were planned tobe conducted in order to compare the contrasts based on cate-gorical moderator variables (e.g., clinical status of the sample),while metaregression was planned in case of continuous vari-ables (e.g., publication year) in both meta-analyses. Moderatorvariables had to have at least four contrasts in each category to sufficefor testing statistical significance (Bakermans-Kranenburg et al.,2003). Moreover, power analyses for the moderator and metare-gression analyses were conducted (Hedges & Pigott, 2004). Thatis, because a nonsignificant effect could reflect the lack of statis-tical power instead of truly no effect (Hedges & Pigott, 2004). Infact, power estimates showed low power for all moderator vari-ables except for the mean age of the sample, the number ofintervention sessions, and the year of publication in case of thefar-transfer effect. Thus, we decided to report preliminary descrip-tive results instead of statistical testing when the analysis wasunderpowered: the average effects in the different categories with-out statistically contrasting them for subgroup analyses and regres-sion coefficients without the corresponding p value for metare-gression analyses.

Publication bias was inspected in both sets of studies becausestudies with significant results are more likely to be published.Thus, significant findings are more likely to be included in ameta-analysis and this tendency may lead to an overestimationof the average effect size (Rothstein, Sutton, & Borenstein,2006). Moreover, Rosenthal’s fail-safe n was calculated, whichis an estimate regarding how many missing studies with a nullfinding would be needed for the average effect size to turnnonsignificant. In case of a robust effect, this fail-safe numbershould exceed 5k � 10 where k is the number of contrastsincluded (Rosenthal, 1979).

Finally, we conducted an additional meta-analysis to be able todirectly compare the near- and far-transfer effects. We selected thestudies that reported on both near- and far-transfer measures andcalculated the standardized mean difference between the near- andfar-transfer effect sizes found in each study, which was the depen-dent variable in this final analysis. In case there were more thanone near- or far-transfer measures, we took the average effect. Apositive effect size in this analysis showed that the near-transfereffect was larger, while a negative effect suggested a larger far-transfer effect.

Results

Preliminary Analyses

Near-transfer effect. There was one outlying contrast in themodel that was excluded (Kloo & Perner, 2003). The extremelylarge effect size in that study might be due to the fact that theoutcome measure was very similar to the intervention task. In fact,

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

178 KASSAI, FUTO, DEMETROVICS, AND TAKACS

Page 15: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

the same paradigm was used but with different stimuli. Thus, theaverage effect of near-transfer was calculated based on the resultsof 35 studies including 43 contrasts with 2,402 children in totalbetween the ages of 2 and 11 years shown in Table 1. The studieswere published between 2001 and 2016. Thirty-nine contrasts werepeer-reviewed journal articles and four of the contrasts were foundin nonrefereed reports such as doctorate dissertations. The studieswere geographically dispersed: 27 contrasts were from Europe, 10from North America, three from Australia, two from Asia, and onefrom South America. From the 43 contrasts, 25 used a typicallydeveloping sample of children, while 18 sampled children witheither a clinical diagnosis or behavioral problems reported byparents or teachers. In 23 of the contrasts, the intervention wascompared with an active control condition. In 15 contrasts, apassive control group was used, while in five studies the results ofthe intervention group were compared with both kinds of controlgroups.

Twenty-seven of these contrasts used a single-componenttraining program: In 19 contrasts working memory skills, infive contrasts inhibitory control, and in five contrasts cognitiveflexibility were trained. Additionally, there were 16 contrastsutilizing a training in which more than one of the componentswere trained: Three contrasts included an intervention for work-ing memory and inhibition and in three contrasts they trainedinhibition and flexibility and in 11 contrasts all three compo-nents were targeted.

For assessing potential bias, we planned to conduct subgroupand metaregression analyses. We could not test the moderator ofthe continent the study was conducted in because not all categorieshad at least four contrasts (Europe: g� � 0.50, k � 27, SE � 0.08,95% CI [0.35, 0.66], p � .001; North America: g� � 0.30, k � 10,SE � 0.11, 95% CI [0.09, 0.51], p � .01; Asia: g� � 0.50, k � 2,SE � 0.22, 95% CI [0.07, 0.94], p � .02; South America: Hedges’g � 0.15, k � 1, SE � 0.20, 95% CI [�0.24, 0.54], p � .45;Australia: g� � 0.40, k � 3, SE � 0.19, 95% CI [0.04, 0.77], p �.03).

Studies with children who were diagnosed with a neurodevel-opmental disorder or showed behavioral problems had an effectsize of g� � 0.39, k � 18, SE � 0.08, 95% CI [0.22, 0.55], p �.001, while studies with typically developing samples showed asimilar result, g� � 0.47, k � 25, SE � 0.08, 95% CI [0.31, 0.63],p � .001. Studies using an active control group had an averageeffect size of g� � 0.38, k � 28, SE � 0.06, 95% CI [0.27, 0.49],p � .001, while contrasts utilizing a passive control group showeda standardized mean difference of g� � 0.45, k � 20, SE � 0.11,95% CI [0.24, 0.65], p � .001. The mean age of the sample(coefficient: �0.02, SE � 0.03, 95% CI [�0.08, 0.03]), the num-ber of intervention sessions (coefficient: �0.003, SE � 0.01, 95%CI [�0.02, 0.01]), and the year of publication (coefficient: �0.03,SE � 0.02, 95% CI [�0.07, 0.01]) had very small relationshipswith the effect size.

According to the visual examination of the funnel plot, therewas no asymmetry around the average effect size and therefore thepresent results did not seem to be affected by a possible publica-tion bias. Moreover, the fail-safe number was found to be 1,126,which suggests a robust effect in case of 43 contrasts.

Far-transfer. Far-transfer effect was assessed based on 16studies including 17 contrasts with the data of 810 children in totalbetween the ages of 3 to 12 years shown in Table 2. All the studies

were peer-reviewed journal articles, published between 2000 and2015. Again, the set of the studies was geographically diverse:Data for 13 contrasts was collected in Europe, two in Australia,one in North America, and one in Asia. From these contrasts, fivefocused on typically developing children, while 12 used either adiagnosed (ADHD, autism spectrum disorder [ASD]) sample orchildren whose parents or teachers reported behavioral problems.Twelve contrasts compared the training with an active controlcondition, seven with a passive control condition, while in twostudies the results of the intervention group were compared withboth kinds of control groups. In nine contrasts, the training focusedon working memory skills, in two contrasts on inhibitory skills, infive contrasts on cognitive flexibility, while only in three contraststhey trained more than one component (that is, working memoryand inhibition in two contrast, and inhibition and flexibility in onecontrast).

We could not test the effect of continent as a moderator becausethere were not enough contrasts in each category (Europe: g� �0.18, k � 13, SE � 0.08, 95% CI [0.02, 0.33], p � .02; Australia:g� � �0.28, k � 2, SE � 0.41, 95% CI [�1.08, 0.52], p � .49;North America: Hedges’ g � �0.02, k � 1, SE � 0.22, 95% CI[�0.44, 0.40], p � .93; Asia: Hedges’ g � �0.30, k � 1, SE �0.28, 95% CI [�0.85, 0.24], p � .28).

Studies that included clinical samples or children whoshowed behavioral problems had an effect size of g� � 0.08,k � 12, SE � 0.08, 95% CI [�0.08, 0.24], p � .31, whilestudies with typically developing samples showed an averageeffect size of g� � 0.20, k � 5, SE � 0.14, 95% CI [�0.07,0.47], p � .15. Studies using an active control group had anaverage effect size of g� � 0.13, k � 12, SE � 0.08, 95% CI[�0.03, 0.29], p � .11, while contrasts utilizing a passivecontrol group also showed an effect of g� � 0.06, k � 7, SE �0.13, 95% CI [�0.19, 0.30], p � .66.

However, due to sufficient estimated statistical power, we testedthe effects of the mean age, the number of intervention sessions,and the year of publication in metaregression analyses; neither ofthese variables had a significant effect on the effect size (mean ageof the sample: coefficient: 0.006, SE � 0.03, 95% CI [�0.06,0.07], p � .86; number of intervention sessions: coefficient:�0.001, SE � 0.01, 95% CI [�0.02, 0.02], p � .88; year ofpublication: coefficient: �0.01, SE � 0.02, 95% CI [�0.05, 0.03],p � .75).

Assessing the funnel plot, the studies were evenly distributedaround the average effect size suggesting no evidence of pub-lication bias. As the average effect was not significant, thefail-safe n estimate was meaningless. No outlying contrastswere found.

Near-Transfer Effect

To test our first hypotheses, we calculated the average effectsize in the first meta-analysis for the difference between theintervention and the control conditions on the executive func-tion component(s) that were trained in the intervention. Asshown in Table 3, a significant moderate overall effect (g� �0.44) was found, which was heterogeneous, Q (42) � 75.62,p � .001 (see Figure 1 for the forest plot). When inspecting theresults separately for the three components, near-transfer ef-fects were significant on each of them. There was a medium-

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

179TRANSFER AMONG CHILDREN’S EXECUTIVE FUNCTIONS

Page 16: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

sized near-transfer effect on working memory (g� � 0.50),while the effects were small on the other two components(inhibitory control: g� � 0.24, cognitive flexibility: g� �0.37).

As a second step, we tested whether single-component trainingshad a different near-transfer effect as compared with multicompo-nent interventions. This was done because it is plausible that anintervention that is more focused on training one skill is moreeffective than aiming an intervention to foster more skills at a time.Single-component working memory trainings and multicomponentinterventions including working memory training had similar near-transfer effects on working memory (single-component: g� �

0.54, k � 19, SE � 0.10, 95% CI [0.35, 0.72], p � .001;multicomponent: g� � 0.42, k � 12, SE � 0.11, 95% CI [0.20,0.63], p � .001). Similarly, single-component inhibition trainingshad similar near-transfer effects on inhibition as compared withmulticomponent interventions including inhibitory control training(single-component: g� � 0.18, k � 5, SE � 0.15, 95% CI [�0.11,0.47], p � .21; multicomponent: g� � 0.25, k � 15, SE � 0.07,95% CI [0.12, 0.39], p � .001). Finally, single-component flexi-bility trainings had a similar near-transfer effect on flexibilitymeasures as multicomponent interventions including flexibilitytraining (single-component: g� � 0.51, k � 5, SE � 0.25, 95% CI

Table 3Near- and Far-Transfer Effects on the Different Executive Function Components

Outcome measure Transfer effectNumber of contrasts

(k)Average effect size

(g�)Standard error

(SE)95% confidence

interval p

Overall Near-transfer 43 .44 .06 [.32, .55] �.001Far-transfer 17 .11 .07 [�.03, .25] .11

Working memory Near-transfer 31 .50 .07 [.35, .64] �.001Far-transfer 6 �.01 .15 [�.31, .29] .94

Inhibitory control Near-transfer 20 .24 .06 [.12, .36] �.001Far-transfer 13 .11 .09 [�.06, .28] .21

Cognitive flexibility Near-transfer 14 .37 .09 [.19, .54] �.001Far-transfer 7 .15 .10 [�.05, .34] .14

Study name Statistics for each study Sample size

Hedges's Standard Lower Upper g error Variance limit limit Z-Value p-Value Interv ention Control

Lomas (2001) -0,190 0,352 0,124 -0,879 0,500 -0,539 0,590 16 15Dörrenbacher (2014) -0,127 0,383 0,146 -0,878 0,623 -0,333 0,739 14 13Markomichali (2015) - Chapter 6 -0,056 0,324 0,105 -0,690 0,578 -0,172 0,863 19 18Markomichali (2015) - Chapter 5 -0,005 0,388 0,151 -0,766 0,756 -0,013 0,990 12 13de Vries (2015) 0,017 0,261 0,068 -0,494 0,529 0,067 0,947 29 29Alloway (2012) 0,141 0,269 0,072 -0,386 0,668 0,525 0,600 24 32Thorell (2009) 0,148 0,345 0,119 -0,528 0,823 0,428 0,669 18 15Goldin (2014) 0,151 0,199 0,040 -0,239 0,541 0,759 0,448 73 38Re (2015) A 0,166 0,469 0,220 -0,754 1,086 0,353 0,724 10 10Kyttala (2015) 0,175 0,305 0,093 -0,422 0,772 0,574 0,566 23 20Chacko (2014) 0,178 0,216 0,047 -0,245 0,602 0,826 0,409 44 41Bennett (2013) 0,218 0,421 0,177 -0,606 1,043 0,519 0,604 10 11Rõthlisberger (2001) B 0,233 0,249 0,062 -0,255 0,720 0,936 0,349 30 34Hovik (2013) 0,242 0,243 0,059 -0,234 0,717 0,996 0,319 33 34Schmitt (2013) 0,265 0,121 0,015 0,027 0,502 2,186 0,029 126 150Dovis (2015) 0,275 0,259 0,067 -0,234 0,783 1,059 0,289 30 30Tominey (2011) 0,279 0,249 0,062 -0,209 0,766 1,120 0,263 28 37Traverso (2015) 0,292 0,235 0,055 -0,168 0,753 1,244 0,214 32 43Rõthlisberger (2001) A 0,334 0,238 0,057 -0,132 0,800 1,405 0,160 33 38Howard (2016) A 0,339 0,311 0,097 -0,271 0,949 1,090 0,276 24 18Caviola (2009) 0,374 0,294 0,086 -0,201 0,949 1,274 0,203 22 24Rueda (2012) 0,397 0,326 0,106 -0,242 1,035 1,218 0,223 19 18Luo (2013) 0,406 0,361 0,130 -0,302 1,113 1,123 0,261 15 15Howard (2016) B 0,408 0,316 0,100 -0,211 1,028 1,292 0,196 19 21Volckaert (2015) 0,430 0,290 0,084 -0,139 0,999 1,481 0,139 24 23Dongen-Boomsma (2014) 0,434 0,302 0,091 -0,158 1,025 1,437 0,151 24 20Howard (2016) C 0,477 0,344 0,119 -0,198 1,152 1,385 0,166 19 15Re (2015) B 0,489 0,470 0,220 -0,431 1,409 1,042 0,298 10 10Wong (2014) 0,560 0,281 0,079 0,008 1,111 1,989 0,047 26 25Holmes (2009) 0,579 0,310 0,096 -0,029 1,187 1,868 0,062 22 20Bergman Nutly (2011) 0,607 0,282 0,080 0,053 1,160 2,148 0,032 26 25Blakey (2015) 0,609 0,275 0,076 0,071 1,148 2,217 0,027 26 28Bigorra (2015) 0,641 0,259 0,067 0,132 1,149 2,469 0,014 31 30St Clair-Thompson (2008) B 0,678 0,303 0,092 0,083 1,272 2,233 0,026 22 22Kroesbergen (2014) 0,682 0,341 0,117 0,012 1,351 1,996 0,046 15 21Dunning (2013) 0,757 0,257 0,066 0,252 1,261 2,941 0,003 34 30Espinet (2012) A 0,840 0,378 0,143 0,100 1,580 2,224 0,026 15 14Espinet (2012) B 0,858 0,384 0,148 0,104 1,611 2,231 0,026 14 14Klingberg (2005) 1,019 0,317 0,100 0,399 1,639 3,219 0,001 20 24Espinet (2012) C 1,079 0,342 0,117 0,408 1,750 3,152 0,002 20 18St Clair-Thompson (2010) 1,146 0,135 0,018 0,881 1,411 8,463 0,000 117 137St Clair-Thompson (2008) A 1,305 0,359 0,129 0,601 2,009 3,633 0,000 18 18Re (2007) 2,229 0,760 0,578 0,740 3,719 2,933 0,003 5 5

0,438 0,059 0,003 0,323 0,553 7,451 0,000

-1,00 -0,50 0,00 0,50 1,00

Fav ours control Fav ours interv ention

Near-transfer effect

Figure 1. Forest plot of the studies that assessed near-transfer effects.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

180 KASSAI, FUTO, DEMETROVICS, AND TAKACS

Page 17: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

[0.02, 1.01], p � .04; multicomponent: g� � 0.31, k � 9, SE �0.08, 95% CI [0.16, 0.47], p � .001).

Far-Transfer Effect

Far-transfer effect was tested in the second meta-analysis bycomputing the average standardized difference between the inter-vention and the control groups on the executive function compo-nents that were not trained in the interventions. As shown in Table3 and Figure 2, the overall between-component far-transfer effectwas small and not significant. This effect was not heterogeneous,Q (16) � 15.39, p � .50. In the same vein, inspecting thefar-transfer effects on the components separately, there was nosignificant effect on any of the three components. In sum, com-ponents of executive function skills do not seem to be facilitatedunless directly trained.

The Effects of Single-Component Trainings

In order to further examine the specific relations between thethree components, we tested the far-transfer effects of single-component trainings on the other two untrained components. Afterexcluding the contrasts in the set of studies assessing far-transfereffects that targeted more than one component, there remained 22contrasts. As shown on Figure 3, there were no significant far-transfer effects among the components. However, it is important tonote that in most cases we had a very limited number of contraststo test the connections between the components and the issue ofstatistical power has to be considered. It might be interesting tonote that only one study (Volckaert & Noël, 2015) assessed theeffects of inhibitory control training on cognitive flexibility skillsand it showed a moderate effect, Hedges’ g � 0.55, SE � 0.29,95% CI [�0.02, 1.12], p � .06.

Comparing Near- and Far-Transfer Effects

Finally, in order to be able to statistically compare the near-and far-transfer effects, we conducted an additional meta-

analysis including only the 13 studies that reported on bothnear- and far-transfer measures (see Figure 4). We took theaverage near- and far-transfer effects found in each study andcalculated the effect size for the standardized mean differencebetween the two effects. There were 13 studies that could beincluded. The average effect was g� � 0.28 (SE � 0.09, 95%CI [0.11, 0.45], p � .001), which confirmed that on average thenear-transfer effect was significantly larger than the far-transfereffect.

Discussion

The present meta-analysis is a quantitative synthesis of theliterature on the near- and far-transfer effects among the three corecomponents of executive functioning: working memory, inhibitorycontrol, and cognitive flexibility in childhood. As a first step, weassessed whether training has a significant effect on tasks tappingon the same component but other than the ones explicitly trainedduring the intervention. Moreover, we tested if training a specificcomponent of executive functions has a significant transfer effecton any of the untrained components and whether this far-transfereffect is similar in size to the near-transfer effect observed in thecase of the trained component. Finally, we directly compared thenear- and far-transfer effects.

Overall, we found a significant, medium-sized near-transfereffect. However, no far-transfer effect appeared. More specifi-cally, there were significant near-transfer effects on all threecomponents: a moderate-sized effect on working memory andsmall-sized effects on inhibition and cognitive flexibility. Incontrast, no far-transfer effects were found on working mem-ory, inhibitory control, or flexibility. The finding that there wasa significant near-transfer effect excludes the possibility thatthe interventions in the primary studies were not effective intraining the components that they targeted. Instead, perfor-mance on the components that were trained did significantlyimprove, however, these gains did not transfer to the untrainedcomponents. No effects were found when we tested the specific

Study name Statistics for each study Sample size

Hedges's Standard Lower Upper g error Variance limit limit Z-Value p-Value Intervention Control

Dowsett (2000) A -0,487 0,567 0,321 -1,598 0,625 -0,858 0,391 7 5Thorell (2009) -0,384 0,356 0,127 -1,082 0,314 -1,079 0,281 18 15Wong (2014) -0,301 0,277 0,077 -0,845 0,243 -1,085 0,278 26 25Bigorra (2015) -0,085 0,255 0,065 -0,585 0,415 -0,333 0,739 31 30Dowsett (2000) B -0,057 0,592 0,350 -1,217 1,102 -0,097 0,923 8 4Chacko (2014) -0,020 0,215 0,046 -0,441 0,401 -0,092 0,926 44 41Dovis (2015) 0,000 0,259 0,067 -0,508 0,508 0,000 1,000 28 30de Vries (2015) 0,002 0,254 0,064 -0,495 0,499 0,009 0,993 33 29Karbach (2009) 0,056 0,370 0,137 -0,670 0,781 0,150 0,881 14 14Blakey (2015) 0,114 0,269 0,072 -0,412 0,641 0,426 0,670 26 28Dongen-Boomsma (2014) 0,161 0,310 0,096 -0,447 0,769 0,519 0,604 23 18Egeland (2013) 0,175 0,243 0,059 -0,301 0,651 0,722 0,471 33 34Dörrenbacher (2014) 0,204 0,384 0,148 -0,549 0,957 0,532 0,595 13 13Dunning (2013) 0,350 0,267 0,071 -0,174 0,873 1,309 0,191 31 26Traverso (2015) 0,376 0,234 0,055 -0,082 0,835 1,610 0,107 32 43Volckaert (2015) 0,395 0,290 0,084 -0,174 0,964 1,360 0,174 24 23Klingberg (2005) 0,840 0,311 0,096 0,232 1,449 2,706 0,007 20 24

0,112 0,070 0,005 -0,025 0,249 1,602 0,109

-1,00 -0,50 0,00 0,50 1,00

Favours control Favours intervention

Far-transfer effect

Figure 2. Forest plot of the studies that assessed far-transfer effects.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

181TRANSFER AMONG CHILDREN’S EXECUTIVE FUNCTIONS

Page 18: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

far-transfer effects of single-component trainings either. In linewith the results of Melby-Lervåg and Hulme (2013) and Salaand Gobet (2017), who found no significant transfer effect ofworking memory trainings on inhibitory control in child sam-ples, we also revealed no transfer effect of working memorytrainings on inhibitory control. The only study where a single-component training had marginally significant far-transfer ef-fect was a preliminary result based on only one contrast (Vol-ckaert & Noël, 2015) revealing that training inhibition mighthave an ameliorating effect on cognitive flexibility. However, itis important to note that in this study the flexibility outcomemeasures used were based on typical inhibitory control tests(e.g., the traffic lights task, the head-toes-knees-shoulders task,a semantic Stroop-test [Monster Stroop]), at the end of whichthey added an extra block that required switching between thepreviously practiced rules. Thus, these measures might be

somewhat similar to the inhibitory control games that werepracticed during the intervention. In sum, the present resultsneither confirm nor disprove the conclusions of Diamond andLing (2016) who showed in a narrative literature review that theeffects of computerized working memory training do not trans-fer to self-control or flexibility.

The lack of far-transfer effect found in the present meta-analysiseven within the set of executive function skills makes it—thoughlogically not impossible—still highly unlikely that training uniqueexecutive functions could have measurable ameliorating transfereffect on more distantly related and complex constructs, such asacademic and social skills (Blair & Razza, 2007) that rely just asmuch on the trained executive function component as on the otheruntrained and largely unaffected components. The results of thepresent meta-analysis therefore provide a possible explanation forthe previously found absence of far-transfer effects of working

Figure 3. The specific training effects among the three executive function components in childhood. Contin-uous lines show significant effects, dotted lines signal nonsignificant effects, while the broken line suggests asignificant result that is based on only one study.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

182 KASSAI, FUTO, DEMETROVICS, AND TAKACS

Page 19: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

memory trainings on academic skills (Melby-Lervag & Hulme,2013; Melby-Lervåg et al., 2016; Sala & Gobet, 2017).

The present meta-analysis shows that there are limited practicalbenefits—other than on the trained component—of training singleexecutive function components in childhood. Thus, it might bemore advisable, both in the educational and in the clinical practice,to use approaches that target multiple executive function compo-nents.

Most moderator analyses were underpowered in the presentmeta-analyses. Thus, those results should be interpreted with cau-tion. For instance, considering the wide age range of the samplesin the primary studies of the present meta-analysis (2–12 years),we intended to test the effect of children’s age. The patternsuggested a very weak relationship between age and the effectsizes. However, considering the lack of statistical power in case ofthe near-transfer effect, we cannot draw firm conclusions. Furtherstudies are needed to clarify the connection between age and thestrength of near- and far-transfer effects among executive functioncomponents.

Beyond the practical implications of the present meta-analysis, it might also raise issues on the construct of executivefunctioning in childhood on a theoretical level. The lack ofcausal evidence for significant relationships among the threecore components might contradict accounts of executive func-tions as a single construct (Wiebe et al., 2008) or a unitaryconstruct with dissociable components (Miyake et al., 2000).Instead the present results seem to support the notion thatworking memory, inhibitory control, and cognitive flexibilityare mutually independent constructs and suggest that the cor-relations among them (Bull & Scerif, 2001; Carlson et al., 2002;Hughes, 1998; Senn et al., 2004; St. Clair-Thompson & Gath-ercole, 2006; Wiebe et al., 2008) might simply reflect co-occurrences. For example, the three components might simplybe maturing in a parallel timeframe as a consequence of theircommon neural correlates. Alternatively, there might be a pos-sible third variable such as verbal or nonverbal IQ or socioeco-nomic status that results in observable correlations among thecomponents. Another possibility is that there might be a com-

mon component that the three executive skills share, whichmight not be sufficiently affected by training single compo-nents. This latter account could result in a lack of transfer effectobserved even in case a unitary executive function constructexisted.

Limitations

Several problems emerge with measuring executive func-tions. First, the issue of task impurity means that most executivetasks do not exclusively tap on the executive functions ofinterest, but also on other executive and nonexecutive processes(Miyake et al., 2000). An example for the first is the Wisconsincard sorting task, which is a widely used measure of cognitiveflexibility as it requires switching between rules. However, inorder to switch between the rules, inhibition skills are alsorequired to restrain acting according to the previously used,now inappropriate rule. Examples for the second are that scoreson a verbal fluency test can be biased by the participant’svocabulary skills, or performance on a Stroop test can beaffected by reading skills.

Second, we face the problem of (what could be called)“component impurity” meaning, that the correlation betweendifferent tasks that are believed or intended to measure the sameexecutive functions components tend to be low to moderate(see, e.g., Miyake et al., 2000). Therefore, in case of ourmeta-analytic study on interventions that aimed to analyze thetransfer effects of training executive functions, the effect sizesmight be weakened by the relatively low correlations betweenthe within-component tasks. This problem could have beenalleviated by using “latent variables” (proposed by Miyake etal., 2000), variables that have been created by statistically“extracting” the “overlap” among tasks intended to measure thesame EF component. However, in our case this could not bedone as primary studies reported on performance on singletests. Further, because all measurable tasks have only a partialoverlap with the hypothetical background construct that theyaim to measure, the effects of training task “A” only partially

Study name Statistics for each study

Hedges's Standard Lower Upper g error Variance limit limit Z-Value p-Value Total

Dörrenbacher (2014) -0,322 0,372 0,139 -1,052 0,408 -0,865 0,387 27Traverso (2015) -0,083 0,232 0,054 -0,538 0,372 -0,358 0,720 75de Vries (2015) 0,015 0,254 0,064 -0,482 0,513 0,060 0,953 58Volckaert (2015) 0,035 0,286 0,082 -0,525 0,594 0,121 0,904 47Klingberg (2005) 0,176 0,308 0,095 -0,428 0,779 0,570 0,568 44Chacko (2014) 0,196 0,213 0,046 -0,222 0,615 0,920 0,358 85Dongen-Boomsma (2014) 0,268 0,301 0,090 -0,322 0,857 0,890 0,373 44Dovis (2015) 0,271 0,256 0,066 -0,230 0,773 1,060 0,289 60Dunning (2013) 0,402 0,259 0,067 -0,105 0,910 1,553 0,120 64Blakey (2015) 0,488 0,268 0,072 -0,037 1,013 1,821 0,069 54Thorell (2009) 0,519 0,342 0,117 -0,151 1,190 1,517 0,129 33Bigorra (2015) 0,717 0,254 0,065 0,218 1,215 2,820 0,005 61Wong (2014) 0,848 0,275 0,076 0,308 1,387 3,081 0,002 51

0,279 0,086 0,007 0,110 0,448 3,234 0,001

-1,00 -0,50 0,00 0,50 1,00

Favours far-transfer Favours near-transfer

Figure 4. Forest plot of the studies in which we could directly compare the near- and far-transfer effects.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

183TRANSFER AMONG CHILDREN’S EXECUTIVE FUNCTIONS

Page 20: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

transfers to the background construct, which only has a partialoverlap with task “B,” which further weakens the measurableeffect of training task “A” on the performance on task “B.”Finally, it is also problematic that different tests are used withdifferent age groups and it is questionable how comparablethose are.

Further, when analyzing the effects of training certain exec-utive function components, it would have been very useful tohave an intervention check, for example, to have data availableon the difference between the scores on a specific task at thebeginning and at the end of the training. The sizes of themeasured near- and far-transfer effects would have been moremeaningful if compared with this original measurement on the“effectiveness of training.”

As mentioned above, it was difficult to gather data on single-component trainings. Training multiple executive functions com-ponents at once might actually decrease the duration of the trainingof one specific executive function component, therefore potentiallylowering the effectiveness of the training on that specific compo-nent, which eventually can lead to an underestimation of thetransfer effects. Available data on the duration and intensity of thetraining of specific executive function components would havebeen useful.

In the same vein, although we could locate enough contrasts totest the near- and far-transfer effects of the trainings on a compo-nent, fine-grained analyses regarding the specific relationshipsamong the specific components lacked more studies for a robustsynthesis thus only allowing for preliminary results.

Conclusions

The results of the present meta-analysis provide an importantcontribution to our knowledge about training executive functionsin childhood. Our meta-analytic findings show that it is possible toimprove children’s executive functions. However, the findingsalso suggest that there is limited rationale for training a singlecomponent of executive functions in the clinical or educationalpractice, as these gains do not seem to transfer to untrainedcomponents. Thus, the practical relevance of training a singleexecutive function component, as it is the case for widespreadworking memory training programs like Cogmed, has very limitedpractical relevance when applied in the treatment of neuropsycho-logical disorders such as ADHD.

References

References marked with an asterisk indicate studies included in themeta-analysis.

Aghababaei, S., Malekpour, M., & Abedi, A. (2012). Effectiveness ofexecutive functions training on academic performance of children withspelling learning disability. Advances in Cognitive Science, 14, 63–72.

�Alloway, T. P., Bibile, V., & Lau, G. (2013). Computerized workingmemory training: Can it lead to gains in cognitive skills in students?Computers in Human Behavior, 29, 632–638. http://dx.doi.org/10.1016/j.chb.2012.10.023

Alloway, T. P., Gathercole, S. E., & Pickering, S. J. (2006). Verbal andvisuospatial short-term and working memory in children: Are theyseparable? Child Development, 77, 1698–1716. http://dx.doi.org/10.1111/j.1467-8624.2006.00968.x

Baddeley, A. D., & Hitch, G. J. (1994). Developments in the concept ofworking memory. Neuropsychology, 8, 485–493. http://dx.doi.org/10.1037/0894-4105.8.4.485

Bakermans-Kranenburg, M. J., van IJzendoorn, M. H., & Juffer, F. (2003).Less is more: Meta-analyses of sensitivity and attachment interventionsin early childhood. Psychological Bulletin, 129, 195–215. http://dx.doi.org/10.1037/0033-2909.129.2.195

Beauregard, M., & Lévesque, J. (2006). Functional magnetic resonanceimaging investigation of the effects of neurofeedback training on theneural bases of selective attention and response inhibition in childrenwith attention-deficit/hyperactivity disorder. Applied Psychophysiologyand Biofeedback, 31, 3–20. http://dx.doi.org/10.1007/s10484-006-9001-y

�Bennett, S. J., Holmes, J., & Buckley, S. (2013). Computerized memorytraining leads to sustained improvement in visuospatial short-term mem-ory skills in children with Down syndrome. American Journal on Intel-lectual and Developmental Disabilities, 118, 179–192. http://dx.doi.org/10.1352/1944-7558-118.3.179

�Bergman Nutley, S., Söderqvist, S., Bryde, S., Thorell, L. B., Humphreys,K., & Klingberg, T. (2011). Gains in fluid intelligence after trainingnon-verbal reasoning in 4-year-old children: A controlled, randomizedstudy. Developmental Science, 14, 591–601. http://dx.doi.org/10.1111/j.1467-7687.2010.01022.x

Bierman, K. L., Nix, R. L., Greenberg, M. T., Blair, C., & Domitrovich,C. E. (2008). Executive functions and school readiness intervention:Impact, moderation, and mediation in the Head Start REDI program.Development and Psychopathology, 20, 821–843. http://dx.doi.org/10.1017/S0954579408000394

�Bigorra, A., Garolera, M., Guijarro, S., & Hervás, A. (2016). Long-termfar-transfer effects of working memory training in children with ADHD:A randomized controlled trial. European Child & Adolescent Psychiatry,25, 853–867. http://dx.doi.org/10.1007/s00787-015-0804-3

Blair, C. (2002). School readiness. Integrating cognition and emotion in aneurobiological conceptualization of children’s functioning at schoolentry. American Psychologist, 57, 111–127. http://dx.doi.org/10.1037/0003-066X.57.2.111

Blair, C. (2017). Educating executive function. Wiley InterdisciplinaryReviews: Cognitive Science. Advance online publication. http://dx.doi.org/10.1002/wcs.1403

Blair, C., & Razza, R. P. (2007). Relating effortful control, executivefunction, and false belief understanding to emerging math and literacyability in kindergarten. Child Development, 78, 647–663. http://dx.doi.org/10.1111/j.1467-8624.2007.01019.x

�Blakey, E., & Carroll, D. J. (2015). A short executive function trainingprogram improves preschoolers’ working memory. Frontiers in Psychol-ogy, 6, 1827. http://dx.doi.org/10.3389/fpsyg.2015.01827

Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. (2005). Compre-hensive meta-analysis, Version 2. Englewood, NJ: Biostat.

Borenstein, M., Hedges, L. V., Higgins, J., & Rothstein, H. R. (2009).Introduction to meta-analysis. Chichester, UK: Wiley. http://dx.doi.org/10.1002/9780470743386

Bull, R., & Scerif, G. (2001). Executive functioning as a predictor ofchildren’s mathematics ability: Inhibition, switching, and working mem-ory. Developmental Neuropsychology, 19, 273–293. http://dx.doi.org/10.1207/S15326942DN1903_3

Carlson, S. M., Moses, L. J., & Breton, C. (2002). How specific is therelation between executive function and theory of mind? Contributionsof inhibitory control and working memory. Infant and Child Develop-ment, 11, 73–92. http://dx.doi.org/10.1002/icd.298

�Caviola, S., Mammarella, I. C., Cornoldi, C., & Lucangeli, D. (2009). Ametacognitive visuospatial working memory training for children. Inter-national Electronic Journal Environmental Education, 2, 122–136.

�Chacko, A., Bedard, A. C., Marks, D. J., Feirsen, N., Uderman, J. Z.,Chimiklis, A., . . . Ramon, M. (2014). A randomized clinical trial of

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

184 KASSAI, FUTO, DEMETROVICS, AND TAKACS

Page 21: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

Cogmed Working Memory Training in school-age children with ADHD:A replication in a diverse sample using a control condition. Journal ofChild Psychology and Psychiatry, 55, 247–255. http://dx.doi.org/10.1111/jcpp.12146

�de Vries, M., Prins, P. J. M., Schmand, B. A., & Geurts, H. M. (2015).Working memory and cognitive flexibility-training for children with anautism spectrum disorder: A randomized controlled trial. Journal ofChild Psychology and Psychiatry, 56, 566–576. http://dx.doi.org/10.1111/jcpp.12324

Diamond, A. (2013). Executive functions. Annual Review of Psychology,64, 135–168. http://dx.doi.org/10.1146/annurev-psych-113011-143750

Diamond, A., Barnett, W. S., Thomas, J., & Munro, S. (2007). Preschoolprogram improves cognitive control. Science, 318, 1387–1388. http://dx.doi.org/10.1126/science.1151148

Diamond, A., & Lee, K. (2011). Interventions shown to aid executivefunction development in children 4 to 12 years old. Science, 333,959–964. http://dx.doi.org/10.1126/science.1204529

Diamond, A., & Ling, D. S. (2016). Conclusions about interventions,programs, and approaches for improving executive functions that appearjustified and those that, despite much hype, do not. DevelopmentalCognitive Neuroscience, 18, 34 – 48. http://dx.doi.org/10.1016/j.dcn.2015.11.005

�Dongen-Boomsma, M. V. (2014). Need, quest & evidence. Resting-stateoscillations, neurofeedback, and working memory training in ADHD.(Unpublished doctoral dissertation). Radbound University, Nijmegen,the Netherlands.

�Dörrenbächer, S., Müller, P. M., Tröger, J., & Kray, J. (2014). Dissociableeffects of game elements on motivation and cognition in a task-switching training in middle childhood. Frontiers in Psychology, 5,1275.

�Dovis, S., Van der Oord, S., Wiers, R. W., & Prins, P. J. (2015).Improving executive functioning in children with ADHD: Trainingmultiple executive functions within the context of a computer game. arandomized double-blind placebo controlled trial. PLoS ONE, 10,e0121651. http://dx.doi.org/10.1371/journal.pone.0121651

�Dowsett, S. M., & Livesey, D. J. (2000). The development of inhibitorycontrol in preschool children: Effects of “executive skills” training.Developmental Psychobiology, 36, 161–174. http://dx.doi.org/10.1002/(SICI)1098-2302(200003)36:2�161::AID-DEV7�3.0.CO;2-0

�Dunning, D. L., Holmes, J., & Gathercole, S. E. (2013). Does workingmemory training lead to generalized improvements in children with lowworking memory? A randomized controlled trial. Developmental Sci-ence, 16, 915–925.

�Egeland, J., Aarlien, A. K., & Saunes, B. K. (2013). Few effects of fartransfer of working memory training in ADHD: A randomized con-trolled trial. PLoS ONE, 8, e75660. http://dx.doi.org/10.1371/journal.pone.0075660

�Espinet, S. D., Anderson, J. E., & Zelazo, P. D. (2013). Reflection trainingimproves executive function in preschool-age children: Behavioral andneural effects. Developmental Cognitive Neuroscience, 4, 3–15. http://dx.doi.org/10.1016/j.dcn.2012.11.009

Fisher, A., Boyle, J. M., Paton, J. Y., Tomporowski, P., Watson, C.,McColl, J. H., & Reilly, J. J. (2011). Effects of a physical educationintervention on cognitive function in young children: Randomized con-trolled pilot study. BMC Pediatrics, 11, 97. http://dx.doi.org/10.1186/1471-2431-11-97

Flook, L., Goldberg, S. B., Pinger, L., & Davidson, R. J. (2015). Promotingprosocial behavior and self-regulatory skills in preschool childrenthrough a mindfulness-based Kindness Curriculum. Developmental Psy-chology, 51, 44–51. http://dx.doi.org/10.1037/a0038256

Friedman, N. P., & Miyake, A. (2004). The relations among inhibition andinterference control functions: A latent-variable analysis. Journal ofExperimental Psychology: General, 133, 101–135. http://dx.doi.org/10.1037/0096-3445.133.1.101

Garon, N., Bryson, S. E., & Smith, I. M. (2008). Executive function inpreschoolers: A review using an integrative framework. PsychologicalBulletin, 134, 31–60. http://dx.doi.org/10.1037/0033-2909.134.1.31

�Goldin, A. P., Hermida, M. J., Shalom, D. E., Elias Costa, M., Lopez-Rosenfeld, M., Segretin, M. S., . . . Sigman, M. (2014). Far transfer tolanguage and math of a short software-based gaming intervention. Pro-ceedings of the National Academy of Sciences of the United States ofAmerica, 111, 6443–6448. http://dx.doi.org/10.1073/pnas.1320217111

Hedges, L. V., & Pigott, T. D. (2004). The power of statistical tests formoderators in meta-analysis. Psychological Methods, 9, 426 – 445.http://dx.doi.org/10.1037/1082-989X.9.4.426

�Holmes, J., Gathercole, S. E., & Dunning, D. L. (2009). Adaptive trainingleads to sustained enhancement of poor working memory in children.Developmental Science, 12, F9–F15. http://dx.doi.org/10.1111/j.1467-7687.2009.00848.x

�Hovik, K. T., Saunes, B. K., Aarlien, A. K., & Egeland, J. (2013). RCT ofworking memory training in ADHD: Long-term near-transfer effects.PLoS ONE, 8, e80561. http://dx.doi.org/10.1371/journal.pone.0080561

�Howard, S. J., Powell, T., Vasseleu, E., Johnstone, S., & Melhuish, E.(2016). Enhancing preschoolers’ executive functions through embed-ding cognitive activities in shared book reading. Educational Psychol-ogy Review, 29, 153–174.

Hughes, C. (1998). Executive function in preschoolers: Links with theoryof mind and verbal ability. British Journal of Developmental Psychol-ogy, 16, 233–253. http://dx.doi.org/10.1111/j.2044-835X.1998.tb00921.x

Jacob, R., & Parkinson, J. (2015). The potential for school-based interven-tions that target executive function to improve academic achievement: Areview. Review of Educational Research, 85, 512–552. http://dx.doi.org/10.3102/0034654314561338

Jurado, M. B., & Rosselli, M. (2007). The elusive nature of executivefunctions: A review of our current understanding. NeuropsychologyReview, 17, 213–233. http://dx.doi.org/10.1007/s11065-007-9040-z

�Karbach, J., & Kray, J. (2009). How useful is executive control training?Age differences in near and far transfer of task-switching training.Developmental Science, 12, 978–990. http://dx.doi.org/10.1111/j.1467-7687.2009.00846.x

�Klingberg, T., Fernell, E., Olesen, P. J., Johnson, M., Gustafsson, P.,Dahlström, K., . . . Westerberg, H. (2005). Computerized training ofworking memory in children with ADHD—A randomized, controlledtrial. Journal of the American Academy of Child & Adolescent Psychi-atry, 44, 177–186. http://dx.doi.org/10.1097/00004583-200502000-00010

�Kloo, D., & Perner, J. (2003). Training transfer between card sorting andfalse belief understanding: Helping children apply conflicting descrip-tions. Child Development, 74, 1823–1839. http://dx.doi.org/10.1046/j.1467-8624.2003.00640.x

�Kroesbergen, E. H., van ’t Noordende, J. E., & Kolkman, M. E. (2014).Training working memory in kindergarten children: Effects on workingmemory and early numeracy. Child Neuropsychology, 20, 23–37. http://dx.doi.org/10.1080/09297049.2012.736483

�Kyttälä, M., Kanerva, K., & Kroesbergen, E. (2015). Training countingskills and working memory in preschool. Scandinavian Journal of Psy-chology, 56, 363–370. http://dx.doi.org/10.1111/sjop.12221

Lehto, J. E., Juujärvi, P., Kooistra, L., & Pulkkinen, L. (2003). Dimensionsof executive functioning: Evidence from children. British Journal ofDevelopmental Psychology, 21, 59 – 80. http://dx.doi.org/10.1348/026151003321164627

Lewis-Morrarty, E., Dozier, M., Bernard, K., Terracciano, S. M., & Moore,S. V. (2012). Cognitive flexibility and theory of mind outcomes amongfoster children: Preschool follow-up results of a randomized clinicaltrial. The Journal of Adolescent Health, 51, S17–S22. http://dx.doi.org/10.1016/j.jadohealth.2012.05.005

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

185TRANSFER AMONG CHILDREN’S EXECUTIVE FUNCTIONS

Page 22: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

Lezak, M. D. (1982). The problem of assessing executive functions.International Journal of Psychology, 17, 281–297. http://dx.doi.org/10.1080/00207598208247445

Liew, J. (2012). Effortful control, executive functions, and education:Bringing self-regulatory and social-emotional competencies to the table.Child Development Perspectives, 6, 105–111. http://dx.doi.org/10.1111/j.1750-8606.2011.00196.x

�Lomas, K. M. (2001). Computer-assisted cognitive training with elemen-tary school-age children diagnosed with attention-deficit/hyperactivitydisorder and mild/moderate comorbidity: A short-term prospective studyon attention, planning and behavior (Unpublished doctoral dissertation).Howard University, Washington, DC.

�Luo, Y., Wang, J., Wu, H., Zhu, D., & Zhang, Y. (2013). Working-memory training improves developmental dyslexia in Chinese children.Neural Regeneration Research, 8, 452–460.

�Markomichali, P. (2015). Learning to wait: The development and initialevaluation of a training intervention designed to help impulsive pre-school children at risk for ADHD learn to wait for rewards (Unpub-lished doctoral dissertation). University of Southampton, Southampton,United Kingdom.

McClelland, M. M., & Cameron, C. E. (2012). Self-regulation in earlychildhood: Improving conceptual clarity and developing ecologicallyvalid measures. Child Development Perspectives, 6, 136–142. http://dx.doi.org/10.1111/j.1750-8606.2011.00191.x

Melby-Lervag, M., & Hulme, C. (2013). Is working memory trainingeffective? A meta-analytic review. Developmental Psychology, 49, 270–291. http://dx.doi.org/10.1037/a0028228

Melby-Lervåg, M., Redick, T. S., & Hulme, C. (2016). Working memorytraining does not improve performance on measures of intelligence orother measures of “far transfer” evidence from a meta-analytic review.Perspectives on Psychological Science, 11, 512–534. http://dx.doi.org/10.1177/1745691616635612

Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A.,& Wager, T. D. (2000). The unity and diversity of executive functionsand their contributions to complex “Frontal Lobe” tasks: A latent vari-able analysis. Cognitive Psychology, 41, 49–100. http://dx.doi.org/10.1006/cogp.1999.0734

Mol, S. E., Bus, A. G., de Jong, M. T., & Smeets, D. J. (2008). Added valueof dialogic parent–child book readings: A meta-analysis. Early Educa-tion and Development, 19, 7–26. http://dx.doi.org/10.1080/10409280701838603

Norman, D. A., & Shallice, T. (1986). Attention to action. In R. J.Davidson, G. E. Schwartz, & D. Shapiro (Eds.), Consciousness andself-regulation (pp. 1–18). Boston, MA: Springer. http://dx.doi.org/10.1007/978-1-4757-0629-1_1

Ponitz, C. C., McClelland, M. M., Matthews, J. S., & Morrison, F. J.(2009). A structured observation of behavioral self-regulation and itscontribution to kindergarten outcomes. Developmental Psychology, 45,605–619. http://dx.doi.org/10.1037/a0015365

�Re, A. M., Capodieci, A., & Cornoldi, C. (2015). Effect of trainingfocused on executive functions (attention, inhibition, and working mem-ory) in preschoolers exhibiting ADHD symptoms. Frontiers in Psychol-ogy, 6, 1161. http://dx.doi.org/10.3389/fpsyg.2015.01161

�Re, A. M., & Cornoldi, C. (2007). ADHD at five: A diagnosis-intervention program. Advances in Learning and Behavioral Disabili-ties, 20, 223–240. http://dx.doi.org/10.1016/S0735-004X(07)20009-6

Rosenthal, R. (1979). The file drawer problem and tolerance for nullresults. Psychological Bulletin, 86, 638–641. http://dx.doi.org/10.1037/0033-2909.86.3.638

�Röthlisberger, M., Neuenschwander, R., Cimeli, P., Michel, E., & Roe-bers, C. M. (2011). Improving executive functions in 5-and 6-year-olds:Evaluation of a small group intervention in prekindergarten and kinder-garten children. Infant and Child Development, 21, 411–429. http://dx.doi.org/10.1002/icd.752

Rothstein, H. R., Sutton, A. J., & Borenstein, M. (Eds.). (2006). Publica-tion bias in meta-analysis: Prevention, assessment and adjustments.New York, NY: Wiley.

�Rueda, M. R., Checa, P., & Cómbita, L. M. (2012). Enhanced efficiencyof the executive attention network after training in preschool children:Immediate changes and effects after two months. Developmental Cog-nitive Neuroscience, 2, S192–S204. http://dx.doi.org/10.1016/j.dcn.2011.09.004

Sala, G., & Gobet, F. (2017). Working memory training in typicallydeveloping children: A meta-analysis of the available evidence. De-velopmental Psychology, 53, 671. http://dx.doi.org/10.1037/dev0000265

Schellenberg, E. G. (2004). Music lessons enhance IQ. PsychologicalScience, 15, 511–514. http://dx.doi.org/10.1111/j.0956-7976.2004.00711.x

�Schmitt, S. A. (2013). Strengthening school readiness for children at risk:Evaluating self-regulation measures and an intervention using class-room games. (Unpublished doctoral dissertation). Oregon State Univer-sity, Corvallis, OR

Senn, T. E., Espy, K. A., & Kaufmann, P. M. (2004). Using path analysisto understand executive function organization in preschool children.Developmental Neuropsychology, 26, 445– 464. http://dx.doi.org/10.1207/s15326942dn2601_5

St. Clair-Thompson, H. L., & Gathercole, S. E. (2006). Executive functionsand achievements in school: Shifting, updating, inhibition, and workingmemory. Quarterly Journal of Experimental Psychology: Human Ex-perimental Psychology, 59, 745–759. http://dx.doi.org/10.1080/17470210500162854

St. Clair-Thompson, H., & Holmes, J. (2008). Improving short-term andworking memory: Methods of memory training. In N. B. Johansen (Ed.),New research on short-term memory (pp. 125–154). New York, NY:Nova Science.

�St. Clair-Thompson, H., Stevens, R., Hunt, A., & Bolder, E. (2010).Improving children’s working memory and classroom performance.Educational Psychology, 30, 203–219. http://dx.doi.org/10.1080/01443410903509259

Tabachnik, B. G., & Fidell, S. L. (2007). Using multivariate statistics (5thed.). Boston, MA: Pearson Education Inc.

Takacs, Z. K., & Kassai, R. (2018). The efficacy of different interventionsto foster children’s executive functions skills: A series of meta-analyses.Manuscript submitted for publication.

Takacs, Z. K., Swart, E. K., & Bus, A. G. (2015). Benefits and pitfalls ofmultimedia and interactive features in technology-enhanced storybooksa meta-analysis. Review of Educational Research, 85, 698–739. http://dx.doi.org/10.3102/0034654314566989

�Thorell, L. B., Lindqvist, S., Bergman Nutley, S., Bohlin, G., & Kling-berg, T. (2009). Training and transfer effects of executive functions inpreschool children. Developmental Science, 12, 106–113. http://dx.doi.org/10.1111/j.1467-7687.2008.00745.x

�Tominey, S. L., & McClelland, M. M. (2011). Red light, purple light:Findings from a randomized trial using circle time games to improvebehavioral self-regulation in preschool. Early Education and Devel-opment, 22, 489 –519. http://dx.doi.org/10.1080/10409289.2011.574258

�Traverso, L., Viterbori, P., & Usai, M. C. (2015). Improving executivefunction in childhood: Evaluation of a training intervention for 5-year-old children. Frontiers in Psychology, 6, 525. http://dx.doi.org/10.3389/fpsyg.2015.00525

�Volckaert, A. M. S., & Noël, M. P. (2015). Training executive functionin preschoolers reduce externalizing behaviors. Trends in Neurosci-ence and Education, 4, 37– 47. http://dx.doi.org/10.1016/j.tine.2015.02.001

Wiebe, S. A., Espy, K. A., & Charak, D. (2008). Using confirmatory factoranalysis to understand executive control in preschool children: I. Latent

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

186 KASSAI, FUTO, DEMETROVICS, AND TAKACS

Page 23: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

structure. Developmental Psychology, 44, 575–587. http://dx.doi.org/10.1037/0012-1649.44.2.575

�Wong, A. S., He, M. Y., & Chan, R. W. (2014). Effectiveness ofcomputerized working memory training program in Chinese commu-nity settings for children with poor working memory. Journal of

Attention Disorders, 18, 318 –330. http://dx.doi.org/10.1177/1087054712471427

Zelazo, P. D., & Carlson, S. M. (2012). Hot and cool executive function inchildhood and adolescence: Development and plasticity. Child Devel-opment Perspectives, 6, 354–360.

Appendix A

Search String

(Training OR intervention OR curricul� OR Mindful� OR medi-tat� OR sport� OR exercise OR physical activity OR aerobic� ORmartial OR yoga OR mindful� OR “tools of the mind” OR mon-tessori OR “Promoting Alternative Thinking Strategies” OR Cog-Meg OR “Head Start REDI” OR “Chicago School ReadinessProject”) AND (“cognitive control” OR “behavioral control” OR

“self-control” OR “effortful control” OR “self-regulat�” OR regu-lat� OR “executive functi�” OR attention OR “working memory”OR inhibit� OR planning OR “cognitive flexibility” OR “delayedgratification” OR monitoring) AND (child� OR student� OR tod-dler� OR preschooler� OR kindergartner�) AND (experiment� orquasi-experiment�)

(Appendices continue)

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

187TRANSFER AMONG CHILDREN’S EXECUTIVE FUNCTIONS

Page 24: A meta-analysis of the experimental evidence on the near- and far … · 2021. 1. 12. · 166 KASSAI, FUTO, DEMETROVICS, AND TAKACS. ity. Near-transfer effect was defined as effects

Appendix B

Received November 27, 2017Revision received October 19, 2018

Accepted October 22, 2018 �

Full-text ar�cles excluded (n=52)

because the interven�on did not explicitly train an execu�ve func�on skill

Records iden�fied through database searching

Screening

Included

Eligibility

Iden�fica�on Addi�onal records found on the reference lists of included papers

and reviews

Records a�er duplicates removed (n=7284)

Records screened based on �tle and abstract

(n=7284)

Records excluded (n=7034)

Full-text ar�cles assessed for eligibility

(n=250)

Full-text ar�cles excluded (n = 160)

For the following reasons: not appropriate sample (n=31) not appropriate interven�on (n=23) only acute effects (n=19) no appropriate control condi�on or

not an experimental design (n=27) no appropriate outcome measure

(n=47) no sufficient sta�s�cs, even a�er

a�emp�ng to contact authors (n=13) Studies included in the

larger meta-analy�c project (n=90)

Studies included in the present meta-analysis

(n=38)

Figure B. PRISMA Flow Diagram. See the online article for the color version of this figure.

Thi

sdo

cum

ent

isco

pyri

ghte

dby

the

Am

eric

anPs

ycho

logi

cal

Ass

ocia

tion

oron

eof

itsal

lied

publ

ishe

rs.

Thi

sar

ticle

isin

tend

edso

lely

for

the

pers

onal

use

ofth

ein

divi

dual

user

and

isno

tto

bedi

ssem

inat

edbr

oadl

y.

188 KASSAI, FUTO, DEMETROVICS, AND TAKACS