Bibliometric Analysis of Psychotherapy Research: Performance Assessment and Position in the Journal Landscape
Abstract
The authors provide an overview of advanced bibliometric methods for (a) an objective and transparent assessment of journal performance and (b) positioning of a journal in relation to other journals. These methods are applied to Psychotherapy Research, an international journal within the field of clinical psychology. In the first analysis, the authors focus on journal performance in an international comparative perspective (i.e., the performance of the journal in relation to all other journals in the same field of science) and introduce a novel type of journal impact factor. In the second analysis, the authors position the journal on the basis of total citation relations among all relevant journals, including those outside the specific field of science to which the journal belongs. A multitude of interdisciplinary relations between the journal under investigation and many other journals is revealed. The investigators discuss briefly the potential of such a "journal citation mapping" for unraveling interdisciplinary developments and "interfaces" between different fields of science.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Moed, H. F., Bruin, R. E. D., & van Leeuwen, T. N. (1995) · Scientometrics · doi:10.1007/bf02017338 · Cited by 502 · see citing works
The Philosophical Basis of Peer Review and the Suppression of Innovation
Horrobin, D. F. (1990) · JAMA · doi:10.1001/jama.1990.03440100162024 · Cited by 420 · see citing works
van Raan, A. F. J. (1996) · Scientometrics · doi:10.1007/bf02129602 · Cited by 390 · see citing works
Moed, H., & van Leeuwen, T. V. (1996) · Nature · doi:10.1038/381186a0 · Cited by 232 · see citing works
Improving the accuracy of institute for scientific information's journal impact factors
Moed, H. F., & van Leeuwen, T. N. (1995) · Journal of the American Society for Information Science · doi:10.1002/(sici)1097-4571(199507)46:6 · Cited by 223 · see citing works
Comparative analysis of a set of bibliometric indicators and central peer review criteria
Rinia, E. J., van Leeuwen, T. N., van Vuren, H. G., & van Raan, A. F. J. (1998) · Research Policy · doi:10.1016/s0048-7333(98)00026-2 · Cited by 193 · see citing works
Statistical reliability of comparisons based on the citation impact of scientific publications
Schubert, A. P., & Glänzel, W. (1983) · Scientometrics · doi:10.1007/bf02097178 · Cited by 92 · see citing works
Bibliometric mapping as a science policy and research management tool
Noyons, E. (1999) · Leiden Repository (Leiden University) · Cited by 76 · see citing works
Mapping co-word structures: A comparison of multidimensional scaling and leximappe
Tijssen, R., & van Raan, A. F. J. (1989) · Scientometrics · doi:10.1007/bf02017203 · Cited by 47 · see citing works
Dahl, H. M. (2004) · Acta Sociologica · doi:10.1177/0001699304048666 · Cited by 40 · see citing works
Social psychological research in The Netherlands, 1980‐1988
Meertens, R. W., Nederhof, A. J., & Wilke, H. A. M. (1992) · European Journal of Social Psychology · doi:10.1002/ejsp.2420220110 · Cited by 8 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- Glänzel, W. (1992). Publication dynamics and citation impact: A multi-dimensional approach to scientometric research evaluation. In P. Weingart, R. Sehringer, & M. Winterhager (Eds.), Representations of science and technology (pp. 209-224). Leiden, the Netherlands: DSWO Press.
- Tijssen, R. J. W. (1992). Cartography of science: Scientometric mapping with multidimensional scaling methods. Leiden, the Netherlands: DSWO Press.
Cited by
Sorted by citations
What do citation counts measure? A review of studies on citing behavior
Bornmann, L., & Daniel, H. (2008) · Journal of Documentation · doi:10.1108/00220410810844150 · Cited by 1,607 · see citing works
“In these studies the number of citations of peer reviewed papers was used to measure the impact of the work of scientists on the scientific community, as high quality work by a scientist will trigger more responses (citations) from scientific colleagues than low quality work ( Van Raan et al. , 2003”
MethodWhat factors determine citation counts of publications in chemistry besides their quality?
Bornmann, L., Schier, H., Marx, W., & Daniel, H. (2011) · Journal of Informetrics · doi:10.1016/j.joi.2011.08.004 · Cited by 242 · see citing works
Miao, L., Ji, J., Liu, W., Zhang, J., Yin, L., & Pu, Y. (2019) · Environmental Science and Pollution Research · doi:10.1007/s11356-019-06470-7 · Cited by 46 · see citing works
Assessing the value of a journal beyond the impact factor
Coleman, A. S. (2007) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20599 · Cited by 44 · see citing works
Global ontology research progress: a bibliometric analysis
Zhu, Q., Kong, X., Hong, S., Li, J., & He, Z. (2015) · Aslib Journal of Information Management · doi:10.1108/ajim-05-2014-0061 · Cited by 34 · see citing works
Research on drought stress in Medicago sativa L. from 1998 to 2023: a bibliometric analysis
Zhou, Z., Li, J., Gao, Y., Wang, X., Wang, R., Huang, H., Zhang, Y., Zhao, L., & Wang, P. (2024) · Frontiers in Plant Science · doi:10.3389/fpls.2024.1406256 · Cited by 31 · see citing works
Bu, Y., Lu, W. P., Wu, Y., Chen, H., & Huang, Y. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2020.102429 · Cited by 21 · see citing works
A Quantitative Exploration on Reasons for Citing Articles from the Perspective of Cited Authors
Wang, B., Bu, Y., & Xu, Y. (2018) · Scientometrics · doi:10.1007/s11192-018-2787-6 · Cited by 19 · see citing works
“Many studies also utilized the number of citations of peer reviewed papers to measure the impact of the scholar’s work, where high quality work may trigger more responses such as citations from others (Van Raan et al. 2003).”
InfluentialAuthorship pattern and degree of collaboration in psychology
Zafrunnisha, N., & Pullareddy, V. (2009) · Cited by 19 · see citing works
The exploration of travel motivation research : A scientometric analysis based on CiteSpace
Chen, J., & Zhou, W. H. (2020) · Collnet Journal of Scientometrics and Information Management · doi:10.1080/09737766.2021.1906779 · Cited by 12 · see citing works
“The work with high quality will receive more responses which are also citations from scientific colleagues (Cawkell, 1968; Van Raan et al., 2003).”
BackgroundGlobal trends in smoking cessation research from 2002 to 2021: A bibliometric and visual analysis
Xu, Y., Gu, Z., Zhang, Y., He, M., Gerber, B. S., Sadasivam, R. S., Liu, F., & Wang, Z. (2022) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2022.101991 · Cited by 10 · see citing works
The impact of library and information science knowledge from the perspective of external citations
Si, L., & Guo, C. (2022) · The Electronic Library · doi:10.1108/el-06-2022-0130 · Cited by 8 · see citing works
What Do We Know About EMDR Therapy Research? A Bibliometric Analysis
Bogolyubova, O., & Lovakov, A. V. (2022) · Journal of EMDR Practice and Research · doi:10.1891/emdr-2021-0008 · Cited by 7 · see citing works
Beaudry, C., & Allaoui, S. (2011) · Atlanta Conference on Science and Innovation Policy · doi:10.1109/acsip.2011.6064461 · Cited by 7 · see citing works
“[54], being part of the first group, suggest that high quality work should gain more citations from colleagues than low quality work.”
BackgroundHow is HRD doing in research and publications? An assessment of journals by AHRD (2005-2011)
Sun, J. Y., & Wang, G. G. (2013) · European journal of training and development · doi:10.1108/ejtd-03-2013-0031 · Cited by 7 · see citing works
A BIBLIOMETRIC STUDY OF THE LIBRARY PHILOSOPHY AND PRACTICE (E-JOURNAL) FOR THE PERIOD 2005-2014
Verma, A., Sonkar, S. K., & Gupta, V. (2015) · Lincoln (University of Nebraska) · Cited by 6 · see citing works
Gao, M., & Lou, W. (2024) · Journal of Clinical Psychology · doi:10.1002/jclp.23726 · Cited by 6 · see citing works
“For example, bibliometric methods have been used to identify publications related to COVID-19 in psychology (Ho et al., 2021), forecast trends in the field (Krampen et al., 2011), and conduct reviews of treatment research (Van Raan et al., 2003).”
MethodPark, S., Bowen, W. M., & Steinbacher, R. (2012) · Biodemography and Social Biology · doi:10.1080/19485565.2012.672919 · Cited by 5 · see citing works
“The entire set of articles was analyzed using both content analysis ( Bowen and Bowen 2008 ; Neuendorf 2002 ) and bibliometric analysis ( Van Raan et al.”
MethodCitation Patterns and Scientific Impact of the Nordic Journal of Music Therapy, 1992–2005
Gold, C., & Rolvsjord, R. (2006) · Nordic Journal of Music Therapy · doi:10.1080/08098130609478160 · Cited by 4 · see citing works
“An example from a related field can be found in van Raan, Visser, Van Leeuwen, and van Wijk (2003) , who analysed how closely the content of one journal (Psychotherapy Research) was linked to a number of other journals, based on articles citing and cited by the journals.”
BackgroundColeman, A. S. (2006) · UA Campus Repository (The University of Arizona) · Cited by 4 · see citing works
Contribution of Iranian scholars to medical sciences: A holistic overview of 140-years publication
Sedghi, S., Razmgir, M., & Moradzadeh, M. (2020) · Medical Journal of the Islamic Republic of Iran · doi:10.47176/mjiri.34.158 · Cited by 3 · see citing works
“Moreover, the literature suggests that the papers published via high ranked journals receive more citations compared to others (5-7).”
BackgroundA combination of quantitative and qualitative maps in an evaluative bibliometric context
Buter, R. K., Noyons, E. C. M., & van Raan, A. F. J. (2004) · International Conference on Information Visualisation (IV) · doi:10.1109/iv.2004.1320260 · Cited by 3 · see citing works
“For example, maps built from words or phrases (see for example [3], [12], [4]) taken from scientific papers provide an overview of the wordusage in these papers; while maps built from references between, say, journals provide an overview of the usage of papers in (and relative to) these journals (see for a recent appl…”
BackgroundA combination of quantitative and qualitative maps in an evaluative bibliometric context
Buter, R. K., Noyons, E., & van Raan, A. F. J. (2004) · doi:10.1109/iv.2004.4 · Cited by 3 · see citing works
Making software cost data available for meta-analysis
Mair, C. (2004) · doi:10.1049/ic:20040397 · Cited by 3 · see citing works
“We show for a sample of 12 empirical studies drawn from two journals between 1999 and 2003 that meta-analysis is greatly hindered by the lack of essential information.”
BackgroundMitigating consequences of prestige in citations of publications
Balzer, M., & Benlahlou, A. (2025) · Scientometrics · doi:10.1007/s11192-025-05455-3 · Cited by 3 · see citing works
“These studies typically use the number of citations of peer-reviewed papers as a measure of a scientist’s impact on the scientific community, under the assumption that high-quality work generates more citations (Cawkell, 1968; Van Raan et al., 2003).”
Xie, H., Cebulla, A., Bastani, P., & Balasubramanian, M. (2024) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph21030361 · Cited by 2 · see citing works
“The purpose of a bibliometric analysis is to examine the multiple facets of a body of published literature using both quantitative and visual methods [32–34].”
MethodFardian, D., Suryadi, D., Prabawanto, S., & Hayuningrat, S. (2024) · Jurnal Elemen · doi:10.29408/jel.v10i2.25539 · Cited by 7 · see citing works
How do academic gatherings promote knowledge production and dissemination?
Hou, L., & Yang, R. (2025) · Journal of Informetrics · doi:10.1016/j.joi.2025.101659 · Cited by 1 · see citing works
Hou, H., & Zhū, L. (2025) · Frontiers in Clinical Diabetes and Healthcare · doi:10.3389/fcdhc.2025.1596938 · Cited by 1 · see citing works
Systematic mapping and development track analysis of the climate economy research
Chen, J., Meng, W., Xiao, Q., & Zhou, W. H. (2025) · Environment Development and Sustainability · doi:10.1007/s10668-025-06779-z · Cited by 1 · see citing works
(2010) · Elsevier eBooks · doi:10.1016/b978-1-84334-626-5.50018-5
Xie, H., Cebulla, A., Bastani, P., & Balasubramanian, M. (2023) · Research Square · doi:10.21203/rs.3.rs-3049634/v1
Banoğlu, K. (2026) · Journal of Educational Administration & History · doi:10.1080/00220620.2026.2739228
- Authors
- van Raan, A. F. J., Visser, M. S., Van Leeuwen, T. N., & van Wijk, E.
- ORCID
- Visser, Martijn S.
- Venue
- Psychotherapy Research
- Publisher
- Informa UK Limited
- Published
- 2003-10-01
- Volume
- 13
- Issue
- 4
- Pages
- 511-528
- ISSN
- 1050-3307 (ISSN-L)
- 1468-4381
- OpenAlex
- W2114431544
- Cited by
- 34
- References
- 11
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 4 · 2023: 1 · 2022: 3 · 2020: 3 · 2019: 1 · 2018: 1 · 2015: 2 · 2014: 1 · 2013: 1 · 2012: 1
- FWCI
- 2.29
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychotherapy Research (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › scientometrics and bibliometrics research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Computer Science › Information Systems › Web visibility and informetrics
- Keywords
- journal impact factor, interdisciplinary connections, journal positioning, bibliometric methods
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
