The structure of mental health research: networks of influence … · 2016-12-05 · investigating...
Transcript of The structure of mental health research: networks of influence … · 2016-12-05 · investigating...
Swinburne University of Technology | CRICOS Provider 00111D | swinburne.edu.au
Swinburne Research Bank http://researchbank.swinburne.edu.au
Haslam, N., & Lusher, D. (2011). The structure of mental health research: networks of influence among psychiatry and clinical psychology journals.
Originally published in Psychological Medicine, 41(2), 2661–2668.
Available from: http://dx.doi.org/10.1017/S0033291711000821
Copyright © 2011 Cambridge University Press. This is the author’s version of the work, posted here with the permission of the publisher for your personal use. No further distribution is permitted. You may also be able to access the published version from your library. The definitive version is available at http://journals.cambridge.org/.
Running head: PSYCHIATRY & CLINICAL PSYCHOLOGY JOURNALS
The structure of mental health research:
Networks of influence among psychiatry and clinical psychology journals
Nick Haslam Dean Lusher
University of Melbourne
2
Abstract
Background. Psychiatry and clinical psychology are the two dominant disciplines in
mental health research, but the structure of scientific influence and information flow
within and between them has never been mapped.
Methods. Citations among 96 of the highest impact psychiatry and clinical psychology
journals were examined, based on 10,052 articles published in 2008. Network analysis
explored patterns of influence between journal clusters.
Results. Psychiatry journals tended to have greater influence than clinical psychology
journals, and their influence was asymmetrical: clinical psychology journals cited
psychiatry journals at a much higher rate than the reverse. Eight journal clusters were
found, most dominated by a single discipline. Their citation network revealed an
influential central cluster of “core psychiatry” journals which had close affinities with a
“psychopharmacology” cluster. A group of “core clinical psychology” journals was
linked to a “behavior therapy” cluster but both were subordinate to psychiatry journals.
Clinical psychology journals were less integrated than psychiatry journals, and “health
psychology/behavioral medicine” and “neuropsychology” clusters were relatively
peripheral to the network.
Conclusions. Scientific publication in the mental health field is largely organized along
disciplinary lines, and is to some degree hierarchical, with clinical psychology journals
tending to be structurally subordinate to psychiatry journals.
Keywords: bibliometrics, citations, clinical psychology, network analysis, psychiatry
3
Psychiatry and clinical psychology are the two dominant professions within the
mental health field. Although they share a mission of understanding and treating mental
illness, they differ in professional training, clinical activities, and numerous other respects.
Researchers have documented points of difference, and sometimes conflict and rivalry, in
such matters as professional roles (Schindler, Berren, & Beigel, 1981), practice
characteristics (Pingitore, Scheffler, Sentell, & West, 2002), and beliefs about the nature,
etiology, and treatment of mental health problems (Wyatt & Livson, 1994).
One difference between psychiatry and clinical psychology that has received little
attention involves scientific research and publication. Although researchers with
psychiatry and psychology backgrounds frequently collaborate and publish together, the
journals in which they do so remain largely segregated by discipline. Publication
databases tend to locate psychiatry journals in the broad Science category, whereas
clinical psychology journals tend to be located in Social Science. Although journals in
both fields are numerous and well-established, the relations among them have not been
systematically examined. Little is known, for example, about the nature of subareas
within the mental health domain or the affinities among these subareas. Similarly, little is
known about the degree and direction of influence between psychiatry and clinical
psychology journals. The extent to which journals in each set cite research published in
their own discipline rather than in the other remains to be determined, as does any
tendency for one discipline to primarily serve as a consumer of the other’s knowledge
rather than a supplier of knowledge to it.
Questions of this sort are often answered using bibliometric analyses of journal
citations. Such analyses allow relationships among journals and research fields to be
4
mapped and visualized, often on a very large scale (e.g., Boyack, Klavans, & Borner,
2005). In addition to representing the closeness of research areas in spatial terms, these
analyses can also represent the dynamics of information flow between them. Patterns of
citation are frequently asymmetric, and these imbalances imply differences in scientific
influence. A journal that receives more citations from a source than it sends to it is likely
to be knowledge supplier, whereas one that cites other journals more than it is cited by
them is a knowledge consumer, disseminating ideas and findings generated by suppliers.
In principle, hierarchies of scientific influence among research fields can be inferred by
examining patterns of citation asymmetries.
There have been few studies of citation patterns within psychiatry, and these have
focused on specific disorders or clinical practices (e.g., Clement, Singh, & Burns, 2003;
Lopez-Munoz et al., 2008) rather than attempting to map the field as a whole. Citation
analyses have been more widespread in psychology, where researchers have examined
the organization of knowledge across key journals or subdisciplines (Pinski & Narin,
1979; Yang & Chiu, 2009). Studies such as these have documented the relationships
among psychology journals and research fields across the entire discipline, and how these
have changed over time. However, no studies have focused specifically on clinical
psychology and none have crossed the disciplinary boundary by examining its journals
alongside psychiatry journals, with the partial exception of a very early study (Cason &
Lubotsky, 1936), which examined citation patterns among 20 journals across psychology
and 8 journals in physiology, psychiatry, or psychoanalysis.
The only relevant recent study was carried out by Boyack et al. (2005), who
examined psychiatry and clinical psychology journals as two among 212 clusters of 7000
5
journals across the natural and social sciences. They found that psychiatry journals
tended to be more insular than clinical psychology journals (i.e., less likely to cite outside
their field) and tended to be cited more by clinical psychology journals than the reverse,
implying that knowledge and influence tended to flow from psychiatry to clinical
psychology. However, this analysis treated psychiatry and clinical psychology as
monolithic and did not allow a more fine-grained analysis of their research domains.
The present study examined the structure of scientific research in mental health by
investigating the flow of influence between journals in the broad fields of psychiatry and
clinical psychology, the flow of influence among their specialized subfields, and the
extent to which these citation networks are organized by the disciplinary distinction
between psychiatry and clinical psychology. A data set of all articles published in a single
year by a large sample of the most prominent journals in both fields was assembled for
that purpose.
Method
Sample
A large sample of prominent journals from the disciplines of psychiatry and
clinical psychology was drawn from the Thomson ISI Journal Citation Reports (JCR)
database. The 2008 Science edition of JCR lists 101 journals under ‘Psychiatry’ and the
2008 Social Science edition lists 88 under ‘Psychology, Clinical.’ The two lists have
modest overlap. The 50 highest-ranked journals from each list were selected based on
their 2008 impact factor (IF). Three selected journals appeared in both samples and one
psychiatry journal with no recorded publications in 2008 was excluded, leaving 96
6
unique journals. Five journals appearing in the clinical psychology top-50 also appeared
in the psychiatry journal list but outside its top-50. Thus, the final journal sample (see
Appendix) contained 46 that appeared only on the Psychiatry list, 42 that appeared only
on the Clinical Psychology list, and 8 that appeared on both (i.e., a Mixed journal set).
Data collection
The JCR database was used to record the number of times articles published in
2008 in each of the 96 journals cited articles published in each of the 96 journals. For
example, a value of 10 would indicate that when the references cited by one journal’s
2008 articles are combined, 10 of these citations are articles from a particular journal.
The former journal is the “citing” journal and the latter is the “cited” journal. This
exercise yielded a 96×96 matrix of citing and cited journals which was asymmetric:
columns represent the propensity of a journal to cite other journals and rows represent the
propensity of a journal to be cited by other journals. JCR only reports cited journals that
were cited two or more times, so journals cited a single time in a year are not recorded.
Results
The 96 journals collectively published 10,052 articles in 2008 (excluding editorial
material, letters, corrections, and book reviews), which made a total of 480,398 citations.
Of these, 181,148 (37.71%) citations were to the 96 journals themselves. Descriptive data
for the three journal sets are presented in Table 1. Psychiatry journals tended to publish
more articles, make more citations, and have higher IFs than Clinical Psychology journals
7
(all p < .0001), with Mixed journals intermediate. As a result, Psychiatry journals as a set
made many more total citations than Clinical Psychology journals.
Citation patterns across journal sets
The extent to which journals in each set cited articles from the same versus
different sets is presented in Figure 1. The Psychiatry journals display a strong within-
discipline citation preference, with 84.05% of their citations being to Psychiatry journals
and only 7.94% to Clinical Psychology journals. The Clinical Psychology journal set also
displayed a within-discipline preference, albeit weaker, with 58.75% of citations to
Clinical Psychology journals and 36.02% to Psychiatry journals. Despite the Clinical
Psychology journals making only 38.3% as many total citations as the Psychiatry journals,
they made 73.3% more cross-disciplinary citations. Stated differently, Psychiatry was a
net supplier of knowledge and scientific influence to Clinical Psychology.
Journal clusters
To assess the structure of scientific influence among narrower groupings of the 96
journals, a cluster analysis of the citation data was conducted. Clustering was carried out
using Ward’s method on pairwise correlations among all journals (i.e., journals with
similar citing profiles correlated highly and were clustered together). An eight-cluster
solution was selected on the basis of interpretability (see Appendix). In decreasing order
of number of journals, these were a “Core Psychiatry” cluster (generalist psychiatry
journals), a “Core Clinical Psychology” cluster (including many child and family-related
journals), a “Health Psychology/ Behavioral Medicine” cluster (including sexuality-
8
related journals), a “Behavior Therapy” cluster, a “Psychopharmacology” cluster, and
“Neuropsychology”, “Addiction”, and “Geriatric Psychiatry” clusters.
Each cluster tended to be predominantly composed of psychiatry or clinical
psychology journals, with the exception of Addiction, which was evenly split. Excluding
the eight “mixed” journals the association between discipline and journal cluster was very
strong (χ2 (7) = 60.40, p<.00001). The Core Psychiatry, Psychopharmacology, and
Geriatric Psychiatry clusters contained no clinical psychology journals (excluding those
jointly classified as psychiatry journals), but the Core Clinical Psychology, Behavior
Therapy, Neuropsychology, and Health Psychology/Behavioral Medicine clusters
contained at least one journal classified as psychiatry only. Table 2 displays the mean
number of articles from the eight clusters that were cited by articles from each cluster: for
example, the average Core Psychiatry article cited 1.64 Core Clinical Psychology articles,
and the average Core Clinical Psychology article cited 5.93 Core Psychiatry articles.
The 96×96 matrix of citations between journals was submitted to a blockmodel
analysis (White, Boorman, & Breiger, 1976) using the UCINET program (Borgatti,
Everett & Freeman, 2002). Blockmodeling is a well-established form of network analysis
that examines the level of relational activity both between and within blocks – in the
present case, within and between the journal clusters. The analysis identifies relationships
within and between journal clusters that exceed a threshold based on the overall density
of relationships in the network (i.e., elevated levels of citations received or sent, taking
account of the overall number of citations sent and received by each cluster). While often
used with binary matrix data, blockmodels can also accommodate valued data
(Wasserman & Faust, 1994).
9
In the present blockmodel, the 96×96 matrix was partitioned (or blocked) into
submatrices according to the 8 clusters. Using the average function (i.e., the arithmetic
mean of all cells in each submatrix), and excluding diagonal values (i.e., journal self-
citations) in accordance with previous citation analyses (e.g., Boyack et al., 2005; Yang
& Chiu, 2009), the result was a reduced 8×8 block density matrix that represents the 8
journal clusters. By dividing the densities of each cell of this reduced block matrix with
the overall density of the 96×96 network, any value above one indicates citation activity
greater than average (i.e., above expectation based on the overall network density). In this
reduced 8×8 matrix there are 64 possible directional links, of which 56 are between
clusters (the remaining 8 involve tendencies to cite within each cluster). Figure 2 is a
visualization using Pajek software (Batagelj & Mrvar, 2010) of the 10 between-cluster
links that exceeded the mean network density, with arrows indicating the direction of
flow of citations (i.e., arrows point toward the journal cluster that is cited above
expectation). The size of the nodes representing each cluster is proportional to its number
of articles published in 2008, and their fill is based on the cluster’s predominance of
psychiatry or clinical psychology journals. While not represented visually, all clusters
other than Health Psychology/Behavioral Medicine have above-average cluster self-
citations.
Figure 2 reveals that the Core Psychiatry cluster occupies a central position in the
network. In addition to being the largest cluster in number of journals and articles, it
receives elevated levels of citations from five of the seven other clusters, implying a flow
of knowledge, information and scientific influence from Core Psychiatry to these clusters.
Only one of these links is bidirectional: Core Psychiatry receives high levels of citations
10
from Psychopharmacology journals, and sends high levels of citations to them. Indeed,
all psychiatry-dominated clusters (and the psychiatry-heavy Addiction cluster) were
linked to the Core Psychiatry cluster, implying a high degree of interconnection.
In contrast to the psychiatry-dominated clusters, the clinical psychology-
dominated clusters were less clearly organized. Two clusters—Health Psychology/
Behavioral Medicine and Neuropsychology—were not linked to any other clinical
psychology-dominated cluster, and the former was isolated from all clusters. The Core
Clinical Psychology and Behavior Therapy journal sets were closely linked, with the
latter sending high levels of citations to the former and both sending high levels of
citations to the Core Psychiatry journal set. By implication, there is a primary axis of
clinical psychology publishing organized around general clinical psychology and
cognitive-behavioral approaches to etiology and treatment, but this axis is somewhat
subordinate to psychiatry research and relatively unintegrated with research on health
psychology and neuropsychology.
Discussion
This study investigated the dynamics of influence and information flow among a
large set of psychiatry and clinical psychology journals. It has three key findings. First, it
demonstrates that psychiatry journals substantially exceed clinical psychology journals in
the volume of research they report, in the number of citations they make, and in
conventional indices of scientific influence such as the impact factor. Second, it shows
that psychiatry journals are more insular in their citation patterns than clinical psychology
journals: 92% of the citations that psychiatry journals made to our complete journal set
11
were to psychiatry journals, whereas 64% of the citations that clinical psychology
journals made were to one another (both figures include the 8 “mixed” journals in the
respective citation-receiving journal sets). In short, clinical psychology journals were
much more likely to cite psychiatry journals than vice versa. This finding accords with
the less fine-grained analysis of Boyack et al. (2005). Third, the 96 journals formed 8
recognizable clusters based on similarities in inter-citation patterns, and the flow of
citations among these sets clarified the structure of affinity and influence among them. In
particular, psychiatry journals tended to be more central to the scientific network and
their journal sets were more integrated with one another, whereas clinical psychology
journals were less central, less integrated, and more likely to receive knowledge from
psychiatry journals than to send knowledge to them.
The finding that psychiatry journals tend to publish a greater and more influential
body of research is unsurprising as psychiatry is the pre-eminent profession in the mental
health domain. Over and above their much greater publication volume, the greater
average citation impact of psychiatry journals is consistent with a general trend for
journals in natural science fields to obtain higher impact factors than those in social
science fields. As a result, the aggregate scientific impact of psychiatry journals easily
outweighs the impact of clinical psychology journals.
This quantitative advantage may partly explain our second main finding, namely
the greater citational insularity of psychiatry journals. It is easier to be insular on a larger
island. If psychiatry research dominates in volume, it would be expected that psychiatry
journals will cite one another more than they cite journals in smaller and less influential
fields. Similarly, it would be expected that research in such fields, such as clinical
12
psychology, will tend to take more knowledge and information from the larger, dominant
field than they provide to it.
However, it is unlikely that this pattern of asymmetric influence between
psychiatry and clinical psychology is entirely a function of size. It is also likely to depend
on the differential institutional power and prestige of the two fields. It is well documented
within the network literature that entities occupying central network positions, such as the
psychiatry journal sets in our network analysis, are advantaged and prestigious (Bavelas,
1950; Freeman, 1979). Indeed, clinical psychology journals were more subordinate to
psychiatry journals in terms of citation flows than would be expected based on their
relative collective impact. In our dataset, clinical psychology journals published a little
less than half as many articles as psychiatry journals and made a little less than half as
many citations, but they cited psychiatry journals at more than four times the rate that
psychiatry journals cited them. This imbalance may reflect the fact that psychiatry
frequently sets the research agenda for clinical psychology, that clinical psychology
research is often insufficiently relevant to psychiatry researchers, or that psychiatry
researchers pay less attention to clinical psychology research than clinical psychology
researchers pay to theirs. Future work should aim to clarify these issues.
The journal clusters identified in our study are readily recognizable to researchers
in the mental health arena, and the extent to which they are segregated by discipline is not
surprising. Core Psychiatry, Psychopharmacology, and Geriatric Psychiatry are research
domains that reflect psychiatry’s traditional emphasis on serious mental illness (all
journals devoted to psychotic conditions fall in the first cluster), pharmacological
treatment, and biomedical etiology. Core Clinical Psychology, Behavior Therapy, Health
13
Psychology/Behavioral Medicine, and Neuropsychology are research domains that reflect
clinical psychology’s traditional emphases on milder mental illness (journals devoted to
mood and especially anxiety disorders fall in these clusters), psychotherapeutic
treatments, cognitive-behavioral approaches to etiology, and assessment.
Although the extent to which scientific publication in mental health is organized
into clusters along disciplinary lines is not unexpected, the network of relations among
these clusters is less obvious. Even after accounting for its greater size, the Core
Psychiatry cluster of journals plays a central or hub role in the network, receiving
citations at a high rate from many other clusters, including those dominated by clinical
psychology journals. By implication this journal cluster, which includes the four highest
impact factor journals among our 96, largely defines research directions for the field and
sends knowledge and influence to more peripheral research areas more than it receives
from them. The only journal cluster from which it receives knowledge to a substantial
degree is Psychopharmacology, the second largest cluster in terms of published articles.
Thus, scientific publishing in mental health is dominated by a biomedical psychiatry-
psychopharmacology axis, around which most other subfields are organized.
The low level of integration among clinical psychology-dominated journal
clusters contrasts with strong links among psychiatry clusters. Although Core Clinical
Psychology and Behavior Therapy journals had strong citational links, perhaps indicating
the prominence of cognitive-behavioral approaches to etiology and treatment in
mainstream clinical psychology, both journal sets were relatively disconnected from
Neuropsychology and Health Psychology/Behavioral Medicine. Neuropsychology, a
speciality whose traditional focus is on neurological conditions, tends not to share clinical
14
psychology’s emphasis on functional conditions and psychotherapeutic treatments, which
may explain why the average clinical psychology article cited only 0.12 neuropsychology
articles. Instead, neuropsychology has a closer affinity with areas in psychiatry that share
its emphasis on organic conditions (e.g., stroke, dementia), hence its single link to
Geriatric Psychiatry. Health Psychology/Behavioral Medicine was even less integrated
with other research areas, focusing on physical health and illness in a way that
distinguishes it from other domains of clinical psychology but lacking strong scientific
links to mainstream psychiatry journals that might be expected to share its medical
preoccupations. Whatever the reasons for the relatively loose interconnections among the
clinical psychology-dominated journal clusters, they do suggest that as a field clinical
psychology research is more dispersed and less integrated than psychiatry research.
The present study aimed to clarify the structure of mental health research at a
single point in time, and therefore cannot illuminate changing patterns of scientific
publication. It also excludes mental health-related journals from fields such as psychiatric
nursing and social work. Nevertheless, the study reveals intriguing patterns in the flow of
knowledge and influence within the mental health field, reminding us how, although the
field is a diverse and pluralistic one (McHugh & Slavney, 1998), some research topics
and approaches are more central and influential than others.
15
References
Batagelj V, Mrvar A. (2010). Pajek (Version 2.00). Llublijana, Slovenia.
Bavelas A (1950). Communication patterns in task-oriented groups. Journal of the
Acoustical Society of America 22, 723-730.
Borgatti SP, Everrett MG, Freeman LC. (2002). UCINET 6 for Windows: Software for
social network analysis. Analytic Technologies: Cambridge.
Boyack KW, Klavans R, Borner K (2005). Mapping the backbone of science.
Scientometrics 64, 351-374.
Cason H, Lubotsky M (1936). The influence and dependence of psychological journals
on each other. Psychological Bulletin 33, 95-103.
Clement S, Singh SP, Burns T (2003). Status of bipolar disorder research: Bibliometric
study. British Journal of Psychiatry 182, 148-152.
Freeman LC (1979). Centrality in social networks: Conceptual clarification. Social
Networks 1, 215-239.
Lopez-Munoz F, Garcia-Garcia P, Saiz-Ruiz J, Mezzich J, Rubio G, Vieta E, Alamo
C (2008). A bibliometric study of the use of the classification and diagnostic
system in psychiatry over the last 25 years. Psychopathology 41, 214-225.
McHugh PR, Slavney PR. (1998). The perspectives of psychiatry, 2nd. ed. Johns
Hopkins University Press: Baltimore.
Pingitore DP, Scheffler RM, Sentell T, West JC (2002). Comparison of psychiatrists
and psychologists in clinical practice. Psychiatric Services 53, 977-984.
Pinski G, Narin F (1979). Structure of the psychological literature. Journal of the
American Society for Information Science 30, 161-168.
16
Schindler FE, Berren MR, Beigel A (1981). A study of the causes of conflict between
psychiatrists and psychologists. Hospital and Community Psychiatry 32, 263-266.
Wasserman S, Faust, K (1994). Social network analysis: Methods and applications.
Cambridge University Press: Cambridge.
White HC, Boorman SA, Breiger RL (1976). Social structure from multiple networks. I.
Blockmodels of roles and positions. American Journal of Sociology 81, 730-780.
Wyatt RC, Livson N (1994). The not so great divide? Psychologists and psychiatrists
take stands on the medical and psychosocial models of mental illness.
Professional Psychology: Research and Practice 25, 120-131.
Yang YJ, Chiu CY (2009). Mapping the structure and dynamics of psychological
knowledge: Forty years of APA journal citations (1970-2009). Review of General
Psychology 13, 349-356.
17
Table 1
Descriptive summary of the three citing journal sets
Clinical Psychiatry Psychology Mixed Number of journals 46 42 8
Mean IF 4.40 2.43 2.77
Total 2008 articles 6,415 2,813 824
Total citations 308,929 136,044 35,425
Citations to the 96 journals 118,840 45,363 16,945
% citations to the 96 journals 38.47 33.34 47.83
Mean articles per journal 139.46 66.98 103.00
Mean citations per journal 6,715.85 3,239.14 4,428.13
Mean citations per article 48.16 48.36 42.99
18
Table 2: Mean number of articles from each journal cluster (rows) cited by articles in
each cluster (columns)
Citing journal cluster
Cited journal cluster 1 2 3 4 5 6 7 8
1. Core psychiatry 16.40 5.93 2.39 6.17 11.27 2.94 3.03 2.98
2. Core clinical psychology 1.64 10.06 1.49 5.19 0.52 2.01 1.98 0.14
3. Health psychology/ Behavioral medicine
0.26 0.59 4.24 0.58 0.13 0.15 0.25 0.15
4. Behavior therapy 0.49 2.00 0.79 7.75 0.28 0.10 0.39 0.04
5. Psychopharmacology 1.62 0.19 0.10 0.31 7.31 0.16 1.41 0.22
6. Neuropsychology 0.19 0.12 0.04 0.10 0.08 6.87 0.06 0.40
7. Addiction 0.27 0.50 0.26 0.24 0.78 0.05 6.30 0.04
8. Geriatric psychiatry 0.28 0.06 0.11 0.09 0.30 1.08 0.03 2.81
19
Figure 1: Percent citations made by each citing journal type to journals of the same or different
type
0%10%20%30%40%50%60%70%80%90%
100%
Cite
d jo
urna
l typ
e
Citing journal type
Mixed
Clinical psychology
Psychiatry
20
Figure 2: Visualization of blockmodel analysis. Arrows indicate high levels of citations
sent in indicated direction, node size is proportional to number of articles published, and
node fill indicates journal cluster is predominantly Psychiatry (black) or Clinical
Psychology (white)
21
Appendix: Journals listed within clusters in decreasing order of 2008 impact factor
Core psychiatry: Archives of General Psychiatry; Molecular Psychiatry; American
Journal of Psychiatry; Biological Psychiatry; Schizophrenia Bulletin; British Journal of
Psychiatry; Journal of Clinical Psychiatry; Psychological Medicine; Journal of
Psychiatric Research; Schizophrenia Research; Journal of Psychiatry & Neuroscience;
Bipolar Disorders; American Journal of Medical Genetics-B: Neuropsychiatric Genetics;
World Psychiatry; Psychoneuroendocrinology; Current Opinion in Psychiatry; Acta
Psychiatrica Scandinavica; Journal of Affective Disorders; European Archives of
Psychiatry and Clinical Neuroscience; Canadian Journal of Psychiatry; Psychiatry
Research; Journal of Child and Adolescent Psychopharmacology; Psychiatry Research-
Neuroimaging; Psychiatric Services; European Psychiatry
Core clinical psychology: Clinical Psychology Review; Journal of Consulting and
Clinical Psychology; Journal of the American Academy of Child Psychiatry; Journal of
Child Psychology and Psychiatry; Annual Review of Clinical Psychology; Journal of
Abnormal Psychology; Psychiatry-Interpersonal and Biological Processes; Journal of
Clinical Child and Adolescent Psychology; Psychological Assessment; Journal of
Abnormal Child Psychology; Clinical Child and Family Psychology; Assessment;
Journal of Family Psychology; British Journal of Clinical Psychology; Journal of
Personality Assessment; International Journal of Clinical and Health Psychology;
Psychotherapy Research; Journal of Clinical Psychology; Criminal Justice and Behavior;
Journal of Family Therapy; Journal of Sex Research; Family Process; Journal of Social
and Clinical Psychology
22
Health psychology/behavioral medicine: Health Psychology; Psychosomatic Medicine;
Journal of Behavioral Medicine; Journal of Psychosomatic Research; Archives of Sexual
Behavior; Journal of Sex and Marital Therapy; British Journal of Health Psychology;
Journal of Health Psychology; Journal of Psychosomatic Obstetrics and Gynecology;
Zeitschrift fur Psychosomatische Medizin und Psychotherapie; International Journal of
Behavioral Medicine
Behavior therapy: Psychotherapy and Psychosomatics; Behaviour Research and Therapy;
Journal of Anxiety Disorders; Behavior Therapy; Depression and Anxiety; Clinical
Psychology-Science and Practice; International Journal of Eating Disorders;
International Journal of Clinical and Experimental Hypnosis; Journal of Behaviour
Therapy and Experimental Psychiatry; Journal of Traumatic Stress; Behavior
Modification
Psychopharmacology: Neuropsychopharmacology; International Journal of
Neuropsychopharmacology; Journal of Clinical Psychopharmacology; Journal of
Psychopharmacology; CNS Drugs; Psychopharmacology; European
Neuropsychopharmacology; World Journal of Biological Psychiatry; International
Clinical Psychopharmacology; Progress in Neuro-psychopharmacology & Biological
Psychiatry; Pharmacopsychiatry
Neuropsychology: Neuropsychology Review; Neuropsychology; Journal of the
International Neuropsychological Society; Journal of Clinical and Experimental
Neuropsychology; Archives of Clinical Neuropsychology; Clinical Neuropsychology
Addiction: Addiction; Drug and Alcohol Dependence; Experimental and Clinical
Psychopharmacology; Journal of Substance Abuse Treatment; Addictive Behavior
23
Geriatric psychiatry: Journal of Neurology, Neurosurgery and Psychiatry; American
Journal of Geriatric Psychiatry; Dementia and Geriatric Cognitive Disorders;
International Psychogeriatrics