The DOI matches its Crossref record; 113 of the 113 references it cites were found in a registry or an index.
Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning
Open accessAbstract
Psychology has historically been concerned, first and foremost, with explaining the causal mechanisms that give rise to behavior. Randomized, tightly controlled experiments are enshrined as the gold standard of psychological research, and there are endless investigations of the various mediating and moderating variables that govern various behaviors. We argue that psychology’s near-total focus on explaining the causes of behavior has led much of the field to be populated by research programs that provide intricate theories of psychological mechanism but that have little (or unknown) ability to predict future behaviors with any appreciable accuracy. We propose that principles and techniques from the field of machine learning can help psychology become a more predictive science. We review some of the fundamental concepts and tools of machine learning and point out examples where these concepts have been used to conduct interesting and important psychological research that focuses on predictive research questions. We suggest that an increased focus on prediction, rather than explanation, can ultimately lead us to greater understanding of behavior.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
ImageNet: A large-scale hierarchical image database
Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., & Fei-Fei, L. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206848 · Cited by 65,333
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Greedy function approximation: A gradient boosting machine
Friedman, J. H. (2001) · The Annals of Statistics · doi:10.1214/aos/1013203451 · Cited by 30,731
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,737
Deep learning in neural networks: an overview
Schmidhuber, J. (2015) · Neural Networks · doi:10.1016/j.neunet.2014.09.003 · Cited by 18,570
Visualizing and understanding convolutional networks
Zeiler, M. D., & Fergus, R. (2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10590-1_53 · Cited by 15,839
No free lunch theorems for optimization
Wolpert, D. H., & Macready, W. G. (1997) · IEEE Transactions on Evolutionary Computation · doi:10.1109/4235.585893 · Cited by 14,237
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Multimodel Inference: Understanding AIC and BIC in Model Selection
Burnham, K. P., & Anderson, D. R. (2004) · Sociological Methods & Research · doi:10.1177/0049124104268644 · Cited by 11,648
Mixed-Effects Models in Sand S-PLUS
Pinheiro, J. C., & Bates, D. M. (2000) · Statistics and Computing · doi:10.1007/978-1-4419-0318-1 · Cited by 11,187
An argument for basic emotions
Ekman, P. (1992) · Cognition and Emotion · doi:10.1080/02699939208411068 · Cited by 9,646 · cited 1×
“For example, Du, Tao, and Martinez (2014) proposed that, in addition to the six “basic” facial emotional expressions of happiness, surprise, sadness, anger, fear, and disgust (Ekman, 1992), human beings can reliably produce and detect additional compound expressions.”
BackgroundMixed-Effects Models in S and S-PLUS
(2001) · Technometrics · doi:10.1198/tech.2001.s574 · Cited by 9,278
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
The WU-Minn Human Connectome Project: An overview
Van Essen, D. C., Smith, S. M., Barch, D. M., Behrens, T. E. J., Yacoub, E., & Ugurbil, K. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.05.041 · Cited by 5,651
Lesch, K.-P., Bengel, D., Heils, A., Sabol, S. Z., Greenberg, B. D., Petri, S., Benjamin, J., Müller, C. R., Hamer, D. H., & Murphy, D. L. (1996) · Science · doi:10.1126/science.274.5292.1527 · Cited by 5,162
Wood, S. N. (2006) · doi:10.1201/9781420010404 · Cited by 4,953
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340 · cited 2×
“…machines, or random forests outperform standard regression models, then there may be relatively large low-order (e.g., two-way) interactions or other nonlinearities that the machine learning methods implicitly capture but that regression does not (Breiman, 2001a; Friedman, 2001; S. Wood, 2006).”
BackgroundRegression Shrinkage and Selection via The Lasso: A Retrospective
Tibshirani, R. (2011) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.00771.x · Cited by 3,589
A few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326 · cited 4×
“…a full treatment of these issues is beyond the scope of this paper (for excellent full-length introductions, see Browne, 2000; Bunea et al., 2011; Domingos, 2012; McNeish, 2015; an authoritative, freely available textbook is Hastie, Tibshirani, & Friedman, 2009), even a cursory familiarity with…”
BackgroundInfluentialApplied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen (2013) · doi:10.4324/9780203774441 · Cited by 3,228
Toward discovery science of human brain function
Biswal, B. B., Mennes, M., Zuo, X.-N., Gohel, S., Kelly, C., Smith, S. M., Beckmann, C. F., Adelstein, J. S., Buckner, R. L., Colcombe, S., et al. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0911855107 · Cited by 2,970
Private traits and attributes are predictable from digital records of human behavior
Kosinski, M., Stillwell, D., & Graepel, T. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1218772110 · Cited by 2,829
Brysbaert, M., & New, B. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.977 · Cited by 2,821
Balota, D. A., Yap, M. J., Hutchison, K. A., Cortese, M. J., Kessler, B., Loftis, B., Neely, J. H., Nelson, D. L., Simpson, G. B., & Treiman, R. (2007) · Behavior Research Methods · doi:10.3758/bf03193014 · Cited by 2,742
A meta-analysis of the five-factor model of personality and academic performance.
Poropat, A. E. (2009) · Psychological Bulletin · doi:10.1037/a0014996 · Cited by 2,729
A 61-million-person experiment in social influence and political mobilization
Bond, R. M., Fariss, C. J., Jones, J. J., Kramer, A. D. I., Marlow, C., Settle, J. E., & Fowler, J. H. (2012) · Nature · doi:10.1038/nature11421 · Cited by 2,575
Shmueli, G. (2010) · Statistical Science · doi:10.1214/10-sts330 · Cited by 2,517
Bias in error estimation when using cross-validation for model selection
Varma, S., & Simon, R. (2006) · BMC Bioinformatics · doi:10.1186/1471-2105-7-91 · Cited by 2,485 · cited 3×
“…should ideally embed any model selection steps into the cross-validation procedure itself, rather than simply picking the model that gives the best cross-validated result (for further explanation, see Cawley & Talbot, 2010; Krstajic, Buturovic, Leahy, & Thomas, 2014; Varma & Simon, 2006).”
BackgroundMethodMeasuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
The robust beauty of improper linear models in decision making.
Dawes, R. M. (1979) · American Psychologist · doi:10.1037/0003-066x.34.7.571 · Cited by 1,966
Linguistic styles: language use as an individual difference
Pennebaker, J. W., & King, L. A. (1999) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.77.6.1296 · Cited by 1,961
Vrieze, S. I. (2012) · Psychological Methods · doi:10.1037/a0027127 · Cited by 1,948
(2010) · doi:10.5555/1756006.1859921 · Cited by 1,924
The Electronic Medical Records and Genomics (eMERGE) Consortium, Wood, A. R., The MIGen Consortium, The PAGE Consortium, Study, T. L. C., Esko, T., Yang, J., Vedantam, S., Pers, T. H., Gustafsson, S., et al. (2014) · Nature Genetics · doi:10.1038/ng.3097 · Cited by 1,853 · cited 1×
“…few years, such exciting findings had almost entirely disappeared from the literature—to be replaced by much larger studies (with n s routinely > 10,000) that have consistently produced null results or extremely small effects (e.g., Ripke et al., 2013; Smith et al., 2015; A. R. Wood et al., 2014).”
ResultThe statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Linear Model Selection by Cross-validation
Shao, J. (1993) · Journal of the American Statistical Association · doi:10.1080/01621459.1993.10476299 · Cited by 1,790
The do re mi's of everyday life: The structure and personality correlates of music preferences.
Rentfrow, P. J., & Gosling, S. D. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.84.6.1236 · Cited by 1,567
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
Ebstein, R. P., Novick, O., Umansky, R., Priel, B., Osher, Y., Blaine, D., Bennett, E. R., Nemanov, L., Katz, M., & Belmaker, R. H. (1996) · Nature Genetics · doi:10.1038/ng0196-78 · Cited by 1,475
Browne, M. W. (2000) · Journal of Mathematical Psychology · doi:10.1006/jmps.1999.1279 · Cited by 1,348
Statistical modeling: The two cultures
Breiman, L. (2001) · Cited by 1,314
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Investigating Variation in Replicability: A “Many Labs” Replication Project
Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B., Bahník, Š., Bernstein, M. J., Bocian, K., Brandt, M. J., Brooks, B., Brumbaugh, C. C., et al. (2014) · Social Psychology · doi:10.1027/1864-9335/a000178 · Cited by 1,208
Facebook Profiles Reflect Actual Personality, Not Self-Idealization
Back, M. D., Stopfer, J. M., Vazire, S., Gaddis, S., Schmukle, S. C., Egloff, B., & Gosling, S. D. (2010) · Psychological Science · doi:10.1177/0956797609360756 · Cited by 1,169 · cited 3×
“A growing literature in personality has focused on the question of whether it is possible to infer a person’s personality from his or her social media footprint—for example, his or her Facebook profile (Back et al., 2010; Gosling, Augustine, Vazire, Holtzman, & Gaddis, 2011), personal blog or website (Vazire & Gosling…”
BackgroundInfluentialA mega-analysis of genome-wide association studies for major depressive disorder
Major Depressive Disorder Working Group of the Psychiatric GWAS Consortium, Ripke, S., Wray, N. R., Lewis, C. M., Hamilton, S. P., Weissman, M. M., Breen, G., Byrne, E. M., Blackwood, D. H. R., Boomsma, D. I., et al. (2013) · Molecular Psychiatry · doi:10.1038/mp.2012.21 · Cited by 1,120
Making Memories: Brain Activity that Predicts How Well Visual Experience Will Be Remembered
Brewer, J. B., Zhao, Z., Desmond, J. E., Glover, G. H., & Gabrieli, J. D. E. (1998) · Science · doi:10.1126/science.281.5380.1185 · Cited by 1,108
Cross-validation pitfalls when selecting and assessing regression and classification models
Krstajic, D., Buturovic, L. J., Leahy, D. E., & Thomas, S. (2014) · Journal of Cheminformatics · doi:10.1186/1758-2946-6-10 · Cited by 1,090 · cited 1×
“…should ideally embed any model selection steps into the cross-validation procedure itself, rather than simply picking the model that gives the best cross-validated result (for further explanation, see Cawley & Talbot, 2010; Krstajic, Buturovic, Leahy, & Thomas, 2014; Varma & Simon, 2006).”
BackgroundAn Agenda for Purely Confirmatory Research
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463078 · Cited by 1,042 · cited 1×
“…2013; Nosek & Lakens, 2014), where a sharp distinction is to be drawn between the exploratory (where flexibility is encouraged) and confirmatory (where flexibility is denied) components of a research program (Jonas & Cesario, 2015; Wagenmakers, Wetzels, Borsboom, van der Maas, & Kievit, 2012).”
BackgroundLexique 2 : A new French lexical database
New, B., Pallier, C., Brysbaert, M., & Ferrand, L. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195598 · Cited by 1,002
Mixed-Effects Models in S and S-PLUS
(2000) · Statistics and Computing · doi:10.1007/b98882 · Cited by 930
Westfall, J., Kenny, D. A., & Judd, C. M. (2014) · Journal of Experimental Psychology: General · doi:10.1037/xge0000014 · Cited by 928
Self-citationWhy Summaries of Research on Psychological Theories are Often Uninterpretable
Meehl, P. E. (1990) · Psychological Reports · doi:10.2466/pr0.1990.66.1.195 · Cited by 909
Compound facial expressions of emotion
Du, S., Tao, Y., & Martinez, A. M. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1322355111 · Cited by 806
The rules of the game called psychological science
Bakker, M., van Dijk, A., & Wicherts, J. M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459060 · Cited by 800 · cited 1×
“…and journalists alike to favor analysis procedures that produce “good” results—where a good result is one that is deemed more hypothesis-congruent, publication-worthy, soci-etally interesting, etc. (Bakker, van Dijk, & Wicherts, 2012; Dwan et al., 2008; Ferguson & Heene, 2012; Ioannidis, 2012).”
BackgroundDo studies of statistical power have an effect on the power of studies?
Sedlmeier, P., & Gigerenzer, G. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.2.309 · Cited by 748
Registered Reports: A Method to Increase the Credibility of Published Results
Nosek, B. A., & Lakens, D. (2014) · Social Psychology · doi:10.1027/1864-9335/a000192 · Cited by 716 · cited 2×
“This appreciation is most evident in the numerous recent calls for routine preregistration of studies (Chambers & Munafo, 2013; Nosek & Lakens, 2014), where a sharp distinction is to be drawn between the exploratory (where flexibility is encouraged) and confirmatory (where flexibility is denied)…”
BackgroundResultMoving beyond Coltheart’s N: A new measure of orthographic similarity
Yarkoni, T., Balota, D., & Yap, M. (2008) · Psychonomic Bulletin & Review · doi:10.3758/pbr.15.5.971 · Cited by 695
Self-citationEstimating coefficients in linear models: It don't make no nevermind.
Wainer, H. (1976) · Psychological Bulletin · doi:10.1037//0033-2909.83.2.213 · Cited by 656
Personality in 100,000 Words: A large-scale analysis of personality and word use among bloggers
Yarkoni, T. (2010) · Journal of Research in Personality · doi:10.1016/j.jrp.2010.04.001 · Cited by 637 · cited 2×
“For example, suppose one is interested in the relationship between personality and language use (Fast & Funder, 2008; Pennebaker & King, 1999; Yarkoni, 2010).”
BackgroundSelf-citationThe Smartphone Psychology Manifesto
Miller, G. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612441215 · Cited by 624
Gosling, S. D., Augustine, A. A., Vazire, S., Holtzman, N., & Gaddis, S. (2011) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2010.0087 · Cited by 620
Ferguson, C. J., & Heene, M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459059 · Cited by 603 · cited 1×
“…and journalists alike to favor analysis procedures that produce “good” results—where a good result is one that is deemed more hypothesis-congruent, publication-worthy, soci-etally interesting, etc. (Bakker, van Dijk, & Wicherts, 2012; Dwan et al., 2008; Ferguson & Heene, 2012; Ioannidis, 2012).”
BackgroundBaayen, R. H., Milin, P., Đurđević, D. F., Hendrix, P., & Marelli, M. (2011) · Psychological Review · doi:10.1037/a0023851 · Cited by 595 · cited 1×
“…the production of new models that explain ever more variance in behavioral tasks like word naming has been guided by, and reciprocally informs, psycholinguistic theory (e.g., Baayen, Milin, Đurdˉevic´, Hendrix, & Marelli, 2011; Perry, Ziegler, & Zorzi, 2010; Yap, Balota, Sibley, & Ratcliff, 2012).”
BackgroundWhy Science Is Not Necessarily Self-Correcting
Ioannidis, J. P. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612464056 · Cited by 563 · cited 3×
“…and journalists alike to favor analysis procedures that produce “good” results—where a good result is one that is deemed more hypothesis-congruent, publication-worthy, soci-etally interesting, etc. (Bakker, van Dijk, & Wicherts, 2012; Dwan et al., 2008; Ferguson & Heene, 2012; Ioannidis, 2012).”
BackgroundYarkoni, T. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01127.x · Cited by 549
Self-citationStatistically controlling for confounding constructs is harder than you think
Westfall, J., & Yarkoni, T. (2016) · PLOS ONE · doi:10.1371/journal.pone.0152719 · Cited by 547 · cited 1×
“For example, we and others have demonstrated that under typical measurement conditions, statistical significance patterns observed in fitted regression models are often very unstable and can produce highly misleading conclusions (Shear & Zumbo, 2013; Westfall & Yarkoni, 2016).”
BackgroundSelf-citationMany Labs 3: Evaluating participant pool quality across the academic semester via replication
Ebersole, C. R., Atherton, O. E., Belanger, A. L., Skulborstad, H. M., Allen, J. M., Banks, J. B., Baranski, E., Bernstein, M. J., Bonfiglio, D. B. V., Boucher, L., et al. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.10.012 · Cited by 468
Experiments with More Than One Random Factor: Designs, Analytic Models, and Statistical Power
Judd, C. M., Westfall, J., & Kenny, D. A. (2017) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033702 · Cited by 466
Self-citatione-Perceptions: Personality Impressions Based on Personal Websites.
Vazire, S., & Gosling, S. D. (2004) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.87.1.123 · Cited by 458
Neuropsychosocial profiles of current and future adolescent alcohol misusers
the IMAGEN Consortium, Whelan, R., Watts, R., Orr, C. A., Althoff, R. R., Artiges, E., Banaschewski, T., Barker, G. J., Bokde, A. L. W., Büchel, C., et al. (2014) · Nature · doi:10.1038/nature13402 · Cited by 443
McNeish, D. M. (2015) · Multivariate Behavioral Research · doi:10.1080/00273171.2015.1036965 · Cited by 432
Perry, C., Ziegler, J. C., & Zorzi, M. (2010) · Cognitive Psychology · doi:10.1016/j.cogpsych.2010.04.001 · Cited by 413
Early gesture selectively predicts later language learning
Rowe, M. L., & Goldin‐Meadow, S. (2009) · Developmental Science · doi:10.1111/j.1467-7687.2008.00764.x · Cited by 400
Structural Equation Modeling in the Communication Sciences, 1995-2000
Holbert, R. L. (2002) · Human Communication Research · doi:10.1093/hcr/28.4.531 · Cited by 358
(2017) · Annual Review of Psychology · doi:10.1146/psych.716 · Cited by 331
I. Problems and Designs of Cross-Validation 1
Mosier, C. I. (1951) · Educational and Psychological Measurement · doi:10.1177/001316445101100101 · Cited by 319
Data mining with decision trees and decision rules
Apté, C., & Weiss, S. (1997) · Future Generation Computer Systems · doi:10.1016/s0167-739x(97)00021-6 · Cited by 307
Impulsivity predicts problem gambling in low SES adolescent males
Vitaro, F., Arseneault, L., & Tremblay, R. E. (1999) · Addiction · doi:10.1046/j.1360-0443.1999.94456511.x · Cited by 297
Fast, L. A., & Funder, D. C. (2008) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.94.2.334 · Cited by 292
There Is Nothing So Theoretical as a Good Method
Greenwald, A. G. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691611434210 · Cited by 281
When fit indices and residuals are incompatible.
Browne, M. W., MacCallum, R. C., Kim, C., Andersen, B. L., & Glaser, R. (2002) · Psychological Methods · doi:10.1037//1082-989x.7.4.403 · Cited by 268
Genome-wide analysis of over 106 000 individuals identifies 9 neuroticism-associated loci
Smith, D. J., Escott-Price, V, Davies, G., Bailey, M. E. S., Colodro-Conde, L., Ward, J., Vedernikov, A., Marioni, R., Cullen, B., Lyall, D., et al. (2016) · Molecular Psychiatry · doi:10.1038/mp.2016.49 · Cited by 259
Individual differences in visual word recognition: Insights from the English Lexicon Project.
Yap, M. J., Balota, D. A., Sibley, D. E., & Ratcliff, R. (2012) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/a0024177 · Cited by 199
Penalized least squares regression methods and applications to neuroimaging
Bunea, F., She, Y., Ombao, H., Gongvatana, A., Devlin, K., & Cohen, R. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.12.028 · Cited by 184
(2014) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-10578-9 · Cited by 170
Detecting individual memories through the neural decoding of memory states and past experience
Rissman, J., Greely, H. T., & Wagner, A. D. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1001028107 · Cited by 164
Music Preference and the Five-Factor Model of the NEO Personality Inventory
Rawlings, D., & Ciancarelli, V. (1997) · Psychology of Music · doi:10.1177/0305735697252003 · Cited by 160
Human neuroimaging as a “Big Data” science
Horn, J. D. V., & Toga, A. W. (2013) · Brain Imaging and Behavior · doi:10.1007/s11682-013-9255-y · Cited by 154
Dissecting the genetic architecture of human personality
Munafo, M. R., & Flint, J. (2011) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2011.07.007 · Cited by 148
Loftus, E. F., & Palmer, J. C. (1996) · doi:10.1007/978-1-349-24483-6_46 · Cited by 145
Data from the Race Implicit Association Test on the Project Implicit Demo Website
Xu, K., Nosek, B. A., & Greenwald, A. G. (2014) · Journal of Open Psychology Data · doi:10.5334/jopd.ac · Cited by 142
Gelman, A., & Weakliem, D. L. (2009) · American Scientist · doi:10.1511/2009.79.310 · Cited by 137
Psychoinformatics: New Horizons at the Interface of the Psychological and Computing Sciences
Yarkoni, T. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412457362 · Cited by 127
Self-citationMapping collective behavior in the big-data era
Bentley, R. A., O’Brien, M. J., & Brock, W. A. (2014) · Behavioral and Brain Sciences · doi:10.1017/s0140525x13000289 · Cited by 109
Many Labs 3: Evaluating participant pool quality across the academic semester via replicationPreprint
Ebersole, C. R., Atherton, O. E., Belanger, A. L., Skulborstad, H. M., Allen, J., Banks, J., Baranski, E. N., Bernstein, M. J., Bonfiglio, D. B. V., Boucher, L., et al. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/q4emc · Cited by 109
A Research Test of the Rorschach Test
Kurtz, A. K. (1948) · Personnel Psychology · doi:10.1111/j.1744-6570.1948.tb01292.x · Cited by 71
A Monte Carlo evaluation of three formula estimates of cross-validated multiple correlation.
Schmitt, N., Coyle, B. W., & Rauschenberger, J. M. (1977) · Psychological Bulletin · doi:10.1037/0033-2909.84.4.751 · Cited by 69
The Use of Simplified or Misspecified Models: Linear Case
Wu, S.-H., Harris, T. J., & McAuley, K. B. (2007) · The Canadian Journal of Chemical Engineering · doi:10.1002/cjce.5450850401 · Cited by 65
Comparing the Predictive Powers of Alternative Multiple Regression Models
Hagerty, M. R., & Srinivasan, V. (1991) · Psychometrika · doi:10.1007/bf02294587 · Cited by 49
Shear, B. R., & Zumbo, B. D. (2013) · Educational and Psychological Measurement · doi:10.1177/0013164413487738 · Cited by 45
Davis‐Stober, C. P., & Dana, J. D. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0342-1 · Cited by 43
How can preregistration contribute to research in our field?
Jonas, K. J., & Cesario, J. (2015) · Comprehensive Results in Social Psychology · doi:10.1080/23743603.2015.1070611 · Cited by 41
Strube, M. (2006) · Behavior Research Methods · doi:10.3758/bf03192746 · Cited by 41
Erratum: Genome-wide analysis of over 106 000 individuals identifies 9 neuroticism-associated loci
Smıth, D. J., Escott‐Price, V., Davies, G. E., Bailey, M. E. S., Colodro‐Conde, L., Ward, J., Vedernikov, A., Marioni, R. E., Cullen, B., Lyall, D. M., et al. (2016) · Molecular Psychiatry · doi:10.1038/mp.2016.177 · Cited by 33
Wherry, R. J. (1951) · Educational and Psychological Measurement · doi:10.1177/001316445101100104 · Cited by 22
Yarkoni, T., Ashar, Y. K., & Wager, T. D. (2015) · PeerJ · doi:10.7717/peerj.1089 · Cited by 21
Self-citation
Cited by
Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)
Adadi, A., & Berrada, M. (2018) · IEEE Access · doi:10.1109/access.2018.2870052 · Cited by 6,294
Network analysis of multivariate data in psychological science
Borsboom, D., Deserno, M. K., Rhemtulla, M., Epskamp, S., Fried, E. I., McNally, R. J., Robinaugh, D. J., Perugini, M., Dalege, J., Costantini, G., et al. (2021) · Nature Reviews Methods Primers · doi:10.1038/s43586-021-00055-w · Cited by 1,371
Leakage and the reproducibility crisis in machine-learning-based science
Kapoor, S., & Narayanan, A. (2023) · Patterns · doi:10.1016/j.patter.2023.100804 · Cited by 1,387
Grotzinger, A. D., Rhemtulla, M., de Vlaming, R., Ritchie, S. J., Mallard, T. T., Hill, W. D., Ip, H. F., Marioni, R. E., McIntosh, A. M., Deary, I. J., et al. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0566-x · Cited by 958
Moving Forward: Challenges and Directions for Psychopathological Network Theory and Methodology
Fried, E. I., & Cramer, A. O. J. (2017) · Perspectives on Psychological Science · doi:10.1177/1745691617705892 · Cited by 938
Metadata
- Authors
- Yarkoni, T., & Westfall, J.
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2017-08-25
- Volume
- 12
- Issue
- 6
- Pages
- 1100-1122
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2284729062
- Cited by
- 1,916
- References
- 113
- FWCI
- 396.75
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.