Back to Basics: The Importance of Conceptual Clarification in Psychological Science
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
Although the lack of conceptual clarity has been observed to be a widespread and fundamental problem in psychology, conceptual clarification plays a mostly marginal role in psychological research. In this article, we argue that better conceptualization of psychological phenomena is needed to move psychology forward as a science. We first show how conceptual unclarity seeps through all aspects of psychological research, from everyday concepts to statistical measures. We then turn to recommendations on how to improve conceptual clarity in psychology, emphasizing the importance of seeing research as an iterative process in which it is necessary to revisit the phenomena that are the foundations of theories and models, as well as how they are conceptualized and measured.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“In contrast, the conceptual clarity of constructs commonly used in education and educational psychology has been recently criticized (Bringmann et al., 2022; Flake & Fried, 2020; Marsh et al., 2019).”
From Screening Smarter, Not Harder: A Comparative Analysis of Machine Learning Screening Algorithms and Heuristic Stopping Criteria for Systematic Reviews in Educational Research (2024) · cites this paper as Bringmann et al., 2022
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
null (2016) · Philosophy Study · doi:10.17265/2159-5313/2016.09.003 · Cited by 28,317
Centrality in social networks conceptual clarification
Freeman, L. C. (1978) · Social Networks · doi:10.1016/0378-8733(78)90021-7 · Cited by 17,062
Network analysis: An integrative approach to the structure of psychopathology
Borsboom, D., & Cramer, A. O. J. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185608 · Cited by 4,359 · cited 2×
“…of Mental Disorders (American Psychiatric Association, 2013) to the latest transdiagnostic frameworks, such as the psychological network approach (Borsboom & Cramer, 2013) or dimensional models (e.g., the Hierarchical Taxonomy of Psychopathology, or HiTOP; Kotov et al., 2017)—and thus are…”
BackgroundMethodKotov, R., Krueger, R. F., Watson, D., Achenbach, T. M., Althoff, R. R., Bagby, R. M., Brown, T. A., Carpenter, W. T., Caspi, A., Clark, L. A., et al. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000258 · Cited by 3,335
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2004) · Psychological Review · doi:10.1037/0033-295x.111.4.1061 · Cited by 1,674 · cited 2×
“As Borsboom et al. (2004) pointed out, “no amount of empirical data can fill a theoretical gap” (p. 1068).”
BackgroundIncreasing Transparency Through a Multiverse Analysis
Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616658637 · Cited by 1,372 · cited 1×
“A multiverse analysis examines systematically how research results are influenced by the many choices that researchers need to make (Steegen et al., 2016).”
BackgroundWhat do centrality measures measure in psychological networks?
Bringmann, L. F., Elmer, T., Epskamp, S., Krause, R. W., Schoch, D., Wichers, M., Wigman, J. T. W., & Snippe, E. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000446 · Cited by 1,345 · cited 1×
“In this case, the connections represent how strongly the nodes are associated, not how far or close they are from each other, so adding up the connection values does not result in a measure of distance (Bringmann et al., 2019).”
BackgroundSelf-citationMeasurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them
Flake, J. K., & Fried, E. I. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920952393 · Cited by 969 · cited 3×
“However, what is often overlooked is that in order to get good data, psychological concepts must be clearly defined and measured in a valid way (Flake & Fried, 2020).”
BackgroundMethodBogen, J., & Woodward, J. (1988) · The Philosophical Review · doi:10.2307/2185445 · Cited by 938 · cited 1×
“Thus, when using theoretical or statistical models, one should revisit the phenomena that are the foundations of the models (see also Bogen & Woodward, 1988; Haig, 2013), as well as how they are conceptualized and measured.”
MethodInventing Temperature: Measurement and Scientific Progress
Chang, H. (2004) · doi:10.1093/0195171276.001.0001 · Cited by 883
Robinaugh, D. J., Hoekstra, R. H. A., Toner, E. R., & Borsboom, D. (2020) · Psychological Medicine · doi:10.1017/s0033291719003404 · Cited by 861 · cited 1×
“Such distance-based centrality measures have been widely applied in psychological networks to estimate a symptom’s influence on the system (between 2008 and 2018, at least 145 articles reported results using these measures; Robinaugh et al., 2020).”
BackgroundPodsakoff, P. M., MacKenzie, S. B., & Podsakoff, N. P. (2016) · Organizational Research Methods · doi:10.1177/1094428115624965 · Cited by 712 · cited 4×
“Although we find existing discussions of conceptualization insightful, and largely build on them in this article, they often have focused too much on providing long lists of rather abstract criteria for conceptual clarity, which can set the bar very high for starting conceptualclarification research or clarifying a co…”
BackgroundInfluentialGerring, J. (1999) · Polity · doi:10.2307/3235246 · Cited by 622 · cited 3×
“Concepts are often referred to as ideas or terms that are the “building blocks” of thoughts and theories (Gerring, 1999; Podsakoff et al., 2016), and thus play a key role in all aspects of psychological research.”
BackgroundInfluentialOn doing better science: From thrill of discovery to policy implications
Antonakis, J. (2017) · The Leadership Quarterly · doi:10.1016/j.leaqua.2017.01.006 · Cited by 475 · cited 2×
“Although the lack of conceptual clarity has been observed to be a widespread and fundamental problem in psychology (Antonakis, 2017; Eronen & Bringmann, 2021; Flake, 2021; MacKenzie, 2003; Podsakoff et al., 2016; Scheel et al., 2021), conceptual clarification plays a mostly marginal role in…”
BackgroundThe Theory Crisis in Psychology: How to Move Forward
Eronen, M. I., & Bringmann, L. F. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620970586 · Cited by 454 · cited 1×
“Although the lack of conceptual clarity has been observed to be a widespread and fundamental problem in psychology (Antonakis, 2017; Eronen & Bringmann, 2021; Flake, 2021; MacKenzie, 2003; Podsakoff et al., 2016; Scheel et al., 2021), conceptual clarification plays a mostly marginal role in…”
BackgroundSelf-citationThe dangers of poor construct conceptualization
MacKenzie, S. B. (2003) · Journal of the Academy of Marketing Science · doi:10.1177/0092070303031003011 · Cited by 426 · cited 1×
“…clarity has been observed to be a widespread and fundamental problem in psychology (Antonakis, 2017; Eronen & Bringmann, 2021; Flake, 2021; MacKenzie, 2003; Podsakoff et al., 2016; Scheel et al., 2021), conceptual clarification plays a mostly marginal role in psychological research (see,…”
BackgroundWhy Hypothesis Testers Should Spend Less Time Testing Hypotheses
Scheel, A. M., Tiokhin, L., Isager, P. M., & Lakens, D. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620966795 · Cited by 382 · cited 2×
“Although the lack of conceptual clarity has been observed to be a widespread and fundamental problem in psychology (Antonakis, 2017; Eronen & Bringmann, 2021; Flake, 2021; MacKenzie, 2003; Podsakoff et al., 2016; Scheel et al., 2021), conceptual clarification plays a mostly marginal role in psychological research (see…”
BackgroundSocial Psychology and Science: Some Lessons From Solomon Asch
Rozin, P. (2001) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0501_1 · Cited by 349 · cited 1×
“(Rozin, 2001, p. 5) No psychological researcher would deny that “good models are hard to build on the basis of bad data” (Freedman, 1985, p. 345).”
BackgroundWhat do we mean by ‘friend’? an inductive study
Fischer, C. S. (1982) · Social Networks · doi:10.1016/0378-8733(82)90004-1 · Cited by 339 · cited 3×
“However, when one tries to define a concept such as “friendship,” it becomes clear that people understand it in widely different ways, and studies show that whom people call a friend is often even inconsistent, because of differences in how “friendship” is interpreted in different contexts (Fischer, 1982).”
BackgroundInfluentialDraheim, C., Mashburn, C. A., Martin, J. D., & Engle, R. W. (2019) · Psychological Bulletin · doi:10.1037/bul0000192 · Cited by 322
An Ounce of Prevention Is Worth a Pound of Cure: Improving Research Quality Before Data Collection
Aguinis, H., & Vandenberg, R. J. (2014) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-031413-091231 · Cited by 304 · cited 2×
“…funding would be important because conceptual research does not necessarily lead directly to new empirical findings and is therefore difficult to “sell” to journals and funding agencies, but is nevertheless the very basis for fruitful empirical research (Aguinis & Vandenberg, 2014; Freedman, 1985).”
BackgroundBeyond Subjective and Objective in Statistics
Gelman, A., & Hennig, C. (2017) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/rssa.12276 · Cited by 250 · cited 1×
“Moreover, conceptual unclarity easily seeps through statistical analyses as well, as statistical measures are often intertwined with conceptualizations (see also Gelman & Hennig, 2017).”
BackgroundAssessing Temporal Emotion Dynamics Using Networks
Bringmann, L. F., Pe, M. L., Vissers, N., Ceulemans, E., Borsboom, D., Vanpaemel, W., Tuerlinckx, F., & Kuppens, P. (2016) · Assessment · doi:10.1177/1073191116645909 · Cited by 236
Self-citationThe concept of recovery in major depression
FAVA, G. A., RUINI, C., & BELAISE, C. (2007) · Psychological Medicine · doi:10.1017/s0033291706008981 · Cited by 230 · cited 1×
“What it means for treatment of depression to be successful has been hotly debated, and successful treatment has been conceptualized in many alternative ways (Fava et al., 2007).”
BackgroundAn historical framework for psychiatric nosology
Kendler, K. S. (2009) · Psychological Medicine · doi:10.1017/s0033291709005753 · Cited by 191 · cited 1×
“…cycles in which description of phenomena, concept definition and refinement, measurement, statistics and theorizing are intertwined (see also Kendler, 2009, and the cycle proposed by Valsiner, 2014).1 We suggest that psychological research too often gets stuck in one part of this cycle, and…”
BackgroundPopularity, Similarity, and the Network Extraversion Bias
Feiler, D. C., & Kleinbaum, A. M. (2015) · Psychological Science · doi:10.1177/0956797615569580 · Cited by 167 · cited 1×
“The need for conceptual clarity is broadly acknowledged, but nevertheless, concepts are usually not precisely and clearly defined in empirical research, even when they are the main topic of study (for an example of such lack of clarity regarding “friendship,” see, e.g., Feiler & Kleinbaum, 2015).”
BackgroundForgetting of friends and its effects on measuring friendship networks
Brewer, D. D., & Webster, C. M. (2000) · Social Networks · doi:10.1016/s0378-8733(99)00018-0 · Cited by 159 · cited 1×
“One article reporting a study of friendship defined friends as ‘‘those individuals who you feel close to, who you interact with frequently, those who you would seek out to do some type of social activity” (Brewer & Webster, 2000, p. 363).”
BackgroundMachine Learning and Psychological Research: The Unexplored Effect of Measurement
Jacobucci, R., & Grimm, K. J. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620902467 · Cited by 153 · cited 2×
“…of theories and statistical models of mental disorders, or as Wilshire et al. (2021) put it: “There is little point in continuing to develop and refine statistical techniques or classification schemes until we have a better grasp of these key concepts” (p. 336; see also Jacobucci & Grimm, 2020).”
BackgroundRethinking Traditional Methods of Survey Validation
Maul, A. (2017) · Measurement: Interdisciplinary Research and Perspectives · doi:10.1080/15366367.2017.1348108 · Cited by 142 · cited 1×
“However, as Maul (2017) showed, even completely made-up nonsense data can result in a neat one-factor (or two-factor) solution with high loadings and correlations with other variables.”
BackgroundNeeded for cultural psychology: Methodology in a new key
Valsiner, J. (2014) · Culture & Psychology · doi:10.1177/1354067x13515941 · Cited by 139 · cited 1×
“…concept definition and refinement, measurement, statistics and theorizing are intertwined (see also Kendler, 2009, and the cycle proposed by Valsiner, 2014).1 We suggest that psychological research too often gets stuck in one part of this cycle, and that researchers should more frequently…”
BackgroundSearching for the impossible: Parapsychology’s elusive quest.
Reber, A. S., & Alcock, J. E. (2020) · American Psychologist · doi:10.1037/amp0000486 · Cited by 100 · cited 1×
“An example of such a concept is “psi,” a central concept in parapsychology, which has so far not been connected to reasonable observable phenomena (see, e.g., Reber & Alcock, 2020).”
BackgroundWhat is(n’t) a friend? Dimensions of the friendship concept among adolescents
Kitts, J. A., & Leal, D. F. (2021) · Social Networks · doi:10.1016/j.socnet.2021.01.004 · Cited by 100 · cited 2×
“…the concept, whether participants generally have similar semantic boundaries for it (i.e., what phenomena are included and excluded in the concept), or the extent to which the concept differs from closely related concepts (see also Kitts & Leal, 2021; Podsakoff et al., 2016; Tafreshi et al., 2016).”
BackgroundStatistics and the Scientific Method
Freedman, D. A. (1985) · Springer eBooks · doi:10.1007/978-1-4613-8536-3_11 · Cited by 85 · cited 3×
“…funding would be important because conceptual research does not necessarily lead directly to new empirical findings and is therefore difficult to “sell” to journals and funding agencies, but is nevertheless the very basis for fruitful empirical research (Aguinis & Vandenberg, 2014; Freedman, 1985).”
BackgroundQuantification in psychology: Critical analysis of an unreflective practice.
Tafreshi, D., Slaney, K. L., & Neufeld, S. D. (2016) · Journal of Theoretical and Philosophical Psychology · doi:10.1037/teo0000048 · Cited by 72
Heating up the measurement debate: What psychologists can learn from the history of physics
Bringmann, L. F., & Eronen, M. I. (2016) · Theory & Psychology · doi:10.1177/0959354315617253 · Cited by 69
Self-citationConceptual Competence in Psychiatry: Recommendations for Education and Training
Aftab, A., & Waterman, G. S. (2020) · Academic Psychiatry · doi:10.1007/s40596-020-01183-3 · Cited by 65
Symptom Descriptions in Psychopathology: How Well Are They Working for Us?
Wilshire, C. E., Ward, T. J., & Clack, S. (2021) · Clinical Psychological Science · doi:10.1177/2167702620969215 · Cited by 62 · cited 3×
“For instance, as Wilshire et al. (2021) pointed out, studies of patients’ narratives suggest that what is now called impaired concentration may turn out to be several distinct phenomena.”
BackgroundInfluentialFlake, J. K. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1898962 · Cited by 58 · cited 2×
“…lack of conceptual clarity has been observed to be a widespread and fundamental problem in psychology (Antonakis, 2017; Eronen & Bringmann, 2021; Flake, 2021; MacKenzie, 2003; Podsakoff et al., 2016; Scheel et al., 2021), conceptual clarification plays a mostly marginal role in psychological…”
BackgroundDetecting Psychological Phenomena: Taking Bottom-Up Research Seriously
Haig, B. D. (2013) · The American Journal of Psychology · doi:10.5406/amerjpsyc.126.2.0135 · Cited by 57 · cited 1×
“Thus, when using theoretical or statistical models, one should revisit the phenomena that are the foundations of the models (see also Bogen & Woodward, 1988; Haig, 2013), as well as how they are conceptualized and measured.”
MethodWhat Is This Thing Called “Efficacy”?
Cartwright, N. D. (2009) · Cambridge University Press eBooks · doi:10.1017/cbo9780511812880.016 · Cited by 49 · cited 2×
“In contrast, conceptual clarification is about characterizing the concept itself, which can be independent of measurement (see also Cartwright, 2009).”
BackgroundTruijens, F. L., Desmet, M., Coster, E. D., Uyttenhove, H., Deeren, B., & Meganck, R. (2019) · Qualitative Research in Psychology · doi:10.1080/14780887.2019.1579287 · Cited by 40
Limits to inferring status from friendship relations
Vörös, A., Block, P., & Boda, Z. (2019) · Social Networks · doi:10.1016/j.socnet.2019.05.007 · Cited by 27
Modeling the symptoms of psychopathology: A pluralistic approach
Clack, S., & Ward, T. J. (2020) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2020.100799 · Cited by 17 · cited 1×
“Thus, instead of immediately studying relationships between two concepts, it would be essential to conduct research projects focusing solely on one concept at a time (see Clack & Ward, 2020, for an example of a project focusing specifically on anhedonia).”
BackgroundNo robust relation between larger cities and depression
Huth, K. B. S., Finnemann, A., van den Ende, M. W. J., & Sloot, P. M. A. (2022) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2118943118 · Cited by 14 · cited 1×
“(See also Huth et al., 2022, who applied a similar approach to a study on the relationship between large cities and depression and showed that different definitions of “city” lead to different results.)”
ResultRedefining Therapeutic Outcomes of Depression Treatment
Slofstra, C., Booij, S. H., Hoenders, R. H. J., & Castelein, S. (2019) · Journal for Person-Oriented Research · doi:10.17505/jpor.2019.10 · Cited by 10
Research works printed but not linked: 1
- Myin-Germeys I., 2022, The open handbook of experience sampling methodology: A step-by-step guide to designing, conducting, and analyzing ESM studies
Cited by
Derakhshan, A. (2025) · Learning and Motivation · doi:10.1016/j.lmot.2025.102114 · Cited by 151
Cloos, L., Ceulemans, E., & Kuppens, P. (2023) · Psychological Assessment · doi:10.1037/pas0001200 · Cited by 127
Desmedt, O., Luminet, O., Maurage, P., & Corneille, O. (2025) · Perspectives on Psychological Science · doi:10.1177/17456916231191537 · Cited by 80
“To the contrary, it may be seen as its bedrock (see e.g., Bringmann et al., 2022).”
Robinson, K. A. (2023) · Educational Psychologist · doi:10.1080/00461520.2023.2198011 · Cited by 115
“Diverse terminology is not necessarily problematic, but a lack of consensus as to the definitions and conceptual connections among the many terms hampers scientific progress (Bringmann et al., 2022).”
BackgroundCampos, D. G., Fütterer, T., Gfrörer, T., Lavelle-Hill, R., Murayama, K., König, L., Hecht, M., Zitzmann, S., & Scherer, R. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09862-5 · Cited by 75
“In contrast, the conceptual clarity of constructs commonly used in education and educational psychology has been recently criticized (Bringmann et al., 2022; Flake & Fried, 2020; Marsh et al., 2019).”
Metadata
- Authors
- Bringmann, L. F., Elmer, T., & Eronen, M. I.
- Affiliations
- University Medical Center Groningen (NL)
- University of Groningen (NL)
- Corresponding author
- Bringmann, Laura F.
- Venue
- Current Directions in Psychological Science
- Publisher
- SAGE Publications
- Published
- 2022-06-14
- Volume
- 31
- Issue
- 4
- Pages
- 340-346
- ISSN
- 0963-7214 (ISSN-L)
- 1467-8721
- OpenAlex
- W4282915676
- Cited by
- 221
- References
- 46
- Citations by year
- 2026: 38 · 2025: 64 · 2024: 73 · 2023: 37 · 2022: 9
- FWCI
- 133.19
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Current Directions in Psychological Science (publishedVersion, cc-by-nc)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion, cc-by-nc)
- Repository for Publications and Research Data (ETH Zurich) (submittedVersion, cc-by-nc)
- ETH Zürich Research Collection
- Funders
- National Science Foundation
- Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung (188022)
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (191G.037, NWO-Veni 191G.037)
- Topics
- Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- conceptual clarity, conceptualization, psychological concepts, measurement, statistical indicators, iterative research process, theory development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.