The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Invisible Hands and Fine Calipers: A Call to Use Formal Theory as a Toolkit for Theory Construction
Open accessPublished version of a preprint
Abstract
In recent years, a growing chorus of researchers has argued that psychological theory is in a state of crisis: Theories are rarely developed in a way that indicates an accumulation of knowledge. Paul Meehl raised this very concern more than 40 years ago. Yet in the ensuing decades, little has improved. We aim to chart a better path forward for psychological theory by revisiting Meehl’s criticisms, his proposed solution, and the reasons his solution failed to meaningfully change the status of psychological theory. We argue that Meehl identified serious shortcomings in our evaluation of psychological theories and that his proposed solution would substantially strengthen theory testing. However, we also argue that Meehl failed to provide researchers with the tools necessary to construct the kinds of rigorous theories his approach required. To advance psychological theory, we must equip researchers with tools that allow them to better generate, evaluate, and develop their theories. We argue that formal theories provide this much-needed set of tools, equipping researchers with tools for thinking, evaluating explanation, enhancing measurement, informing theory development, and promoting the collaborative construction of psychological theories.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Studies in the Logic of Explanation
Hempel, C. G., & Oppenheim, P. (1948) · Philosophy of Science · doi:10.1086/286983 · Cited by 3,174
Clark, D. M. (1986) · Behaviour Research and Therapy · doi:10.1016/0005-7967(86)90011-2 · Cited by 2,422 · cited 1×
“In a highly influential verbal theory, Clark (1986) posited that if some initial arousal-related bodily sensations (e.g., increased heart rate) are perceived as threatening (e.g., indicating a heart attack), that perceived threat will elicit more arousal, which, in turn, will exacerbate the sense…”
BackgroundComputational psychiatry as a bridge from neuroscience to clinical applications
Huys, Q. J. M., Maia, T. V., & Frank, M. J. (2016) · Nature Neuroscience · doi:10.1038/nn.4238 · Cited by 1,002
Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them
Flake, J. K., & Fried, E. I. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920952393 · Cited by 969
Self-citationKessler, R. C., Chiu, W. T., Jin, R., Ruscio, A. M., Shear, K., & Walters, E. E. (2006) · Archives of General Psychiatry · doi:10.1001/archpsyc.63.4.415 · Cited by 795
Addressing the theory crisis in psychology
Oberauer, K., & Lewandowsky, S. (2019) · Psychonomic Bulletin & Review · doi:10.3758/s13423-019-01645-2 · Cited by 462
The Flynn effect: A meta-analysis.
Trahan, L. H., Stuebing, K. K., Fletcher, J. M., & Hiscock, M. (2014) · Psychological Bulletin · doi:10.1037/a0037173 · Cited by 364 · cited 2×
“Theories explain phenomena: the robust, generalizable features of the world that we as scientists seek to understand (Bogen & Woodward, 1988; Haig, 2014), such as the Flynn Effect (Trahan et al., 2014), the matching phenomenon (Feingold, 1988), or the simple observation that some individuals experience recurrent panic…”
BackgroundGigerenzer, G. (1998) · Theory & Psychology · doi:10.1177/0959354398082006 · Cited by 196 · cited 1×
“Others argued that we frequently mistake statistical hypotheses, data fitting, and other aspects of psychological research for substantive theories (Borsboom, 2013; Gigerenzer, 1998).”
Background
Research works printed but not linked: 64
- 10.1176/appi.books.9780890425596 · DOI · Paper page
- 10.1037/0022-3514.54.3.441 · DOI
- 10.2307/j.ctt5vkdnq · doi:10.2307/j.ctt5vkdnq
- 10.1016/0022-1031(71)90065-5 · DOI · Paper page
- 10.2307/2185445 · DOI · Paper page
- Borsboom D., van der Maas H., Dalege J., Kievit R., Haig B. (2021). Theory construction methodology: A practical framework for theory formation in psychology. Perspectives on Psychological Science, 16(4), 756–766. https://doi.org/10.1177/1745691620969647 · DOI · Paper page
- 10.1037/a0032850 · DOI · Paper page
- 10.1016/0162-3095(83)90009-2 · DOI · Paper page
- Buss D. M., Barnes M. (1986). Preferences in human mate selection. Journal of Personality and Social Psychology, 50(3), 559–570. https://doi.org/10.1037/0022-3514.50.3.559 · doi:10.1037//0022-3514.50.3.559 · Paper page
- Conroy-Beam D., Buss D. M., Asao K., Sorokowska A., Sorokowski P., Aavik T., Akello G., Alhabahba M. M., Alm C., Amjad N., Anjum A., Atama C. S., Duyar D. A., Ayebare R., Batres C., Bendixen M., Bensafia A., Bizumic B., Boussena M. Zupancˇicˇ M. (2019). Contrasting computational models of mate preference integration across 45 countries. Scientific Reports, 9(1), Article 16885. https://doi.org/10.1038/s41598-019-52748-8 · DOI · Paper page
- Denrell J., Le Mens G. (2007). Interdependent sampling and social influence. Psychological Review, 114(2), 398–422. https://doi.org/10.1037/0033-295X.114.2.398 · DOI
- Elliott-Graves A. (2014). The role of target systems in scientific practice [Unpublished doctoral dissertation, University of Pennsylvania].
- Epstein J. M. (2008). Why model? Journal of Artificial Societies and Social Simulation, 11(4), Article 12. http://jasss.soc.surrey.ac.uk/11/4/12.html
- 10.1016/0022-2496(75)90025-5 · DOI
- 10.1017/CBO9781316272503 · DOI · Paper page
- Feingold A. (1988). Matching for attractiveness in romantic partners and same-sex friends: A metaanalysis and theoretical critique. Psychological Bulletin, 104(2), 226–235. https://doi.org/10.1037/0033-2909.104.2.226 · DOI · Paper page
- Fradkin I., Adams R. A., Parr T., Roiser J. P., Huppert J. D. (2020). Searching for an anchor in an unpredictable world: A computational model of obsessive compulsive disorder. Psychological Review, 127(5), 672–699. https://doi.org/10.1037/rev0000188 · DOI · Paper page
- Fried E. I., Flake J. K. (2018). Measurement matters. APS Observer, 31(3), 29–30. https://www.psychologicalscience.org/observer/measurement-matters.
- 10.1177/0959354310378184 · DOI · Paper page
- Guest O., Martin A. E. (2021). How computational modeling can force theory building in psychological science. Perspectives on Psychological Science, 16(4), 789–802. https://doi.org/10.1177/1745691620970585 · DOI · Paper page
- 10.1037/1082-989X.10.4.371 · DOI · Paper page
- 10.7551/mitpress/9780262027366.001.0001 · DOI
- Haslbeck J., Ryan O., Robinaugh D., Waldorp L., Borsboom D. (2019). Modeling psychopathology: From data models to formal theories. PsyArXiv. https://doi.org/10.31234/osf.io/jgm7f · DOI
- 10.1111/j.1467-9280.1997.tb00534.x · DOI · Paper page
- Jaccard J., 2019, Theory construction and model-building skills: A practical guide for social scientists
- Jia T., Spivey R. F., Szymanski B., Korniss G. (2015). An analysis of the matching hypothesis in networks. PLOS ONE, 10(6), Article e0129804. https://doi.org/10.1371/journal.pone.0129804 · DOI
- Kalick S. M., Hamilton T. E. (1986). The matching hypothesis reexamined. Journal of Personality and Social Psychology, 51(4), 673–682. https://doi.org/10.1037/0022-3514.51.4.673 · DOI · Paper page
- Kalick S. M., Hamilton T. E. (1988). Closer look at a matching simulation: Reply to Aron. Journal of Personality and Social Psychology, 54(3), 447–451. https://doi.org/10.1037/0022-3514.54.3.447 · doi:10.1037//0022-3514.54.3.447
- Kellen D., Davis-Stober C., Dunn J. C., Kalish M. (2021). The problem of coordination and the pursuit of structural constraints in psychology. Perspectives on Psychological Science, 16(4), 767–778. https://doi.org/10.1177/1745691620970585 · DOI
- 10.1002/casp.2450010108 · DOI
- Lewandowsky S., 2010, Computational modeling in cognition: Principles and practice
- 10.3758/BF03197461 · DOI · Paper page
- Lykken D. T., 1991, Thinking clearly about psychology: Vol. 1. Matters of public interest, 3
- 10.1037/0022-006X.46.4.806 · DOI · Paper page
- 10.1207/s15327965pli0102_1 · DOI · Paper page
- 10.2466/pr0.1990.66.1.195 · DOI · Paper page
- 10.1038/s41562-018-0522-1 · DOI · Paper page
- Nozick R., 1974, Anarchy, state, and utopia
- Orben A., Lakens D. (2019). Crud (re)defined. Advances in Methods and Practices in Psychological Science, 3(2), 238–247. https://doi.org/10.1177/2515245920917961 · DOI
- Pickering A. D. (2008). Formal and computational models of reinforcement sensitivity theory. In Corr P. J. (Ed.), The reinforcement sensitivity theory of personality (p. 453–481). Cambridge University Press. https://doi.org/10.1017/CBO9780511819384.017 · DOI
- 10.1037/0000135-010 · doi:10.1037/0000135-010
- Ritter F. E., Tehranchi F., Oury J. D. (2019). Act-r: A cognitive architecture for modeling cognition. Wiley Interdisciplinary Reviews: Cognitive Science, 10(3), Article e1488. https://doi.org/10.1002/wcs.1488 · DOI · Paper page
- Rodgers J. L. (2010). The epistemology of mathematical and statistical modeling: A quiet methodological revolution. American Psychologist, 65(1), 1–12. https://doi.org/10.1037/a0018326 · DOI · Paper page
- 10.1086/287823 · DOI
- Rozeboom W. W. (1990). Hypothetico-deductivism is a fraud. American Psychologist, 45(4), 555–556. https://doi.org/10.1037/0003-066X.45.4.555 · doi:10.1037//0003-066x.45.4.555
- Rozeboom W. W., 1997, What if there were no significance tests, 335
- Schiepek G., 2016, Nonlinear Dynamics, Psychology, and Life Sciences, 20, 369
- Schuler K., Ruggero C. J., Mahaffey B., Gonzalez A. L., Callahan J., Boals A., Waszczuk M. A., Luft B. J., Kotov R. (2021). When hindsight is not 20/20: Ecological momentary assessment of PTSD symptoms versus retrospective report. Assessment, 28(1), 238–247. https://doi.org/10.1177/1073191119869826 · DOI
- 10.1146/annurev-psych-122216-011845 · DOI · Paper page
- Smaldino P. E. (2016). Not even wrong: Imprecision perpetuates the illusion of understanding at the cost of actual understanding. Behavioral and Brain Sciences, 39, Article e163. https://doi.org/10.1017/S0140525X1500151X · DOI
- 10.4324/9781315173726-14 · DOI · Paper page
- 10.1038/d41586-019-03350-5 · DOI
- Smaldino P. E. (2020). How to translate a verbal theory into a formal model. Social Psychology, 51, 207–218. https://doi.org/10.1027/1864-9335/a000425. · DOI
- 10.1177/1088868306294789 · DOI · Paper page
- 10.1111/j.1747-9991.2009.00261.x · DOI
- 10.1086/702029 · doi:10.1086/702029
- 10.1007/BF00499820 · DOI · Paper page
- van der Maas H. L., Molenaar D., Maris G., Kievit R. A., Borsboom D. (2011). Cognitive psychology meets psychometric theory: On the relation between process models for decision making and latent variable models for individual differences. Psychological Review, 118(2), 339–356. https://doi.org/10.1037/a0022749 · DOI · Paper page
- 10.1086/422204 · DOI
- van Rooij I., Baggio G. (2020). Theory development requires an epistemological sea change. PsyArXiv. https://doi.org/10.31234/osf.io/rnw9q · doi:10.31234/osf.io/rnw9q
- van Rooij I., Blokpoel M. (2020, July). Formalizing verbal theories: A tutorial by dialogue. PsyArXiv. https://doi.org/10.31234/osf.io/r2zqy · doi:10.31234/osf.io/r2zqy
- 10.3758/s13421-011-0158-0 · DOI · Paper page
- Wilensky U., 2015, An introduction to agent-based modeling: Modeling natural, social, and engineered complex systems with netlogo
- Wimsatt W. C., 1987, Neutral models in biology, 23
Cited by
Lack of theory building and testing impedes progress in the factor and network literature
Fried, E. I. (2020) · Psychological Inquiry · doi:10.1080/1047840x.2020.1853461 · Cited by 317
Self-citationDigital well-being theory and research
Büchi, M. (2024) · New Media & Society · doi:10.1177/14614448211056851 · Cited by 277
Revisiting the theoretical and methodological foundations of depression measurement
Fried, E. I., Flake, J. K., & Robinaugh, D. J. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00050-2 · Cited by 274
Self-citationSibling Constructs: What Are They, Why Do They Matter, and How Should You Handle Them?
Lawson, K. M., & Robins, R. W. (2021) · Personality and Social Psychology Review · doi:10.1177/10888683211047101 · Cited by 144
Advancing the Network Theory of Mental Disorders: A Computational Model of Panic Disorder
Robinaugh, D., Haslbeck, J. M. B., Waldorp, L., Kossakowski, J. J., Fried, E. I., Millner, A., McNally, R. J., Ryan, O., de Ron, J., van der Maas, H., et al. (2019) · doi:10.31234/osf.io/km37w · Cited by 120
Self-citation
Metadata
- Authors
- Robinaugh, D. J., Haslbeck, J. M. B., Ryan, O., Fried, E. I., & Waldorp, L. J.
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2021-02-16
- Volume
- 16
- Issue
- 4
- Pages
- 725-743
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W3129957462
- Cited by
- 209
- References
- 13
- FWCI
- 74.22
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Funders
- H2020 European Research Council (Consolidator Grant / 647209)
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (Onderzoekstalent Grant / 406-15-128)
- National Institute of Mental Health (K23MH113805)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Invisible Hands and Fine Calipers: A Call to Use Formal Theory as a Toolkit for Theory Construction. https://app.cochat.ai/papers/10.1177/1745691620974697
- The paper
- Robinaugh, D. J., Haslbeck, J. M. B., Ryan, O., Fried, E. I., & Waldorp, L. J. (2021). Invisible Hands and Fine Calipers: A Call to Use Formal Theory as a Toolkit for Theory Construction. Perspectives on Psychological Science. https://doi.org/10.1177/1745691620974697
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.