Strengthening the foundation of educational psychology by integrating construct validation into open science reform
Open accessPublished version of a preprint
Abstract
An increased focus on transparency and replication in science has stimulated reform in research practices and dissemination. As a result, the research culture is changing: the use of preregistration is on the rise, access to data and materials is increasing, and large-scale replication studies are more common. In this article, I discuss two problems the methodological reform movement is now ready to tackle given the progress thus far and how educational psychology is particularly well suited to contribute. The first problem is that there is a lack of transparency and rigor in measurement development and use. The second problem is caused by the first—replication research is difficult and potentially futile as long as the first problem persists. I describe how to expand transparent practices into measure use and how construct validation can be implemented to bolster the validity of replication studies.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371 · see citing works
Construct validity in psychological tests.
Cronbach, L. J., & Meehl, P. E. (1955) · Psychological Bulletin · doi:10.1037/h0040957 · Cited by 11,195 · see citing works
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515 · see citing works
The standards for educational and psychological testing.
Eignor, D. R. (2013) · American Psychological Association eBooks · doi:10.1037/14047-013 · Cited by 6,975 · see citing works
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567 · see citing works
1,500 scientists lift the lid on reproducibility
Baker, M. (2016) · Nature · doi:10.1038/533452a · Cited by 4,209 · see citing works
Messick, S. (1995) · American Psychologist · doi:10.1037/0003-066x.50.9.741 · Cited by 4,198 · see citing works
Learning from television in young children
Barr, R., & Brito, N. H. (2012) · doi:10.1007/978-1- · Cited by 3,927 · see citing works
Handbook of Research on Student Engagement
(2012) · doi:10.1007/978-1-4614-2018-7 · Cited by 3,050 · see citing works
Promoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708 · see citing works
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239 · see citing works
The preregistration revolution
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708274114 · Cited by 1,998 · see citing works
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Trials · doi:10.1186/1745-6215-11-32 · Cited by 1,871 · see citing works
Much ado about grit: A meta-analytic synthesis of the grit literature
Credé, M., Tynan, M. C., & Harms, P. D. (2017) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000102 · Cited by 1,653 · see citing works
The association between adolescent well-being and digital technology use
Orben, A., & Przybylski, A. K. (2019) · Nature Human Behaviour · doi:10.1038/s41562-018-0506-1 · Cited by 1,500 · see citing works
Increasing Transparency Through a Multiverse Analysis
Steegen, S., Tuerlinckx, F., Gelman, A., & Vanpaemel, W. (2016) · Perspectives on Psychological Science · doi:10.1177/1745691616658637 · Cited by 1,388 · see citing works
Investigating Variation in Replicability: A “Many Labs” Replication Project
Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B., Bahník, Š., Bernstein, M. J., Bocian, K., Brandt, M. J., Brooks, B., Brumbaugh, C. C., et al. (2014) · Social Psychology · doi:10.1027/1864-9335/a000178 · Cited by 1,208 · see citing works
O’Donnell, C. (2008) · Review of Educational Research · doi:10.3102/0034654307313793 · Cited by 1,037 · see citing works
Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them
Flake, J. K., & Fried, E. I. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920952393 · Cited by 969 · see citing works
Self-citationA Motivated Exploration of Motivation Terminology
Murphy, P. K., & Alexander, P. A. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.1999.1019 · Cited by 922 · see citing works
Interpretation of Educational Measurements
Freeman, F. S., & Kelley, T. L. (1928) · The American Journal of Psychology · doi:10.2307/1414476 · Cited by 865 · see citing works
Wicherts, J. M., Veldkamp, C. L. S., Augusteijn, H. E. M., Bakker, M., van Aert, R. C. M., & van Assen, M. A. L. M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.01832 · Cited by 754 · see citing works
Psychology, Science, and Knowledge Construction: Broadening Perspectives from the Replication Crisis
Shrout, P. E., & Rodgers, J. L. (2018) · Annual Review of Psychology · doi:10.1146/annurev-psych-122216-011845 · Cited by 740 · see citing works
Construct Validation in Social and Personality Research
Flake, J. K., Pek, J. C. X., & Hehman, E. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617693063 · Cited by 715 · see citing works
Self-citationKidwell, M. C., Lazarević, L. B., Baranski, E., Hardwicke, T. E., Piechowski, S., Falkenberg, L.-S., Kennett, C., Slowik, A., Sonnleitner, C., Hess-Holden, C., et al. (2016) · PLOS Biology · doi:10.1371/journal.pbio.1002456 · Cited by 700 · see citing works
The Value of Direct Replication
Simons, D. J. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691613514755 · Cited by 630 · see citing works
Measurement error and the replication crisis
Loken, E., & Gelman, A. (2017) · Science · doi:10.1126/science.aal3618 · Cited by 628 · see citing works
Measuring cost: The forgotten component of expectancy-value theory
Flake, J. K., Barron, K. E., Hulleman, C., McCoach, B. D., & Welsh, M. E. (2015) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2015.03.002 · Cited by 554 · see citing works
Self-citationMarsh, H. W., Pekrun, R., Parker, P. D., Murayama, K., Guo, J., Dicke, T., & Arens, A. K. (2019) · Journal of Educational Psychology · doi:10.1037/edu0000281 · Cited by 535 · see citing works
Comment on “Estimating the reproducibility of psychological science.”
Gilbert, D. T., King, G., Pettigrew, S., & Wilson, T. D. (2016) · Science · doi:10.1126/science.aad7243 · Cited by 474 · see citing works
Moshontz, H., Campbell, L., Ebersole, C. R., IJzerman, H., Urry, H. L., Forscher, P. S., Grahe, J. E., McCarthy, R. J., Musser, E. D., Antfolk, J., et al. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918797607 · Cited by 377 · see citing works
Self-citationScientific Utopia: I. Opening Scientific Communication
Nosek, B. A., & Bar‐Anan, Y. (2012) · Psychological Inquiry · doi:10.1080/1047840x.2012.692215 · Cited by 366 · see citing works
Preregistration Is Hard, And Worthwhile
Nosek, B. A., Beck, E. D., Campbell, L., Flake, J. K., Hardwicke, T. E., Mellor, D. T., Veer, A. V. '., & Vazire, S. (2019) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2019.07.009 · Cited by 325 · see citing works
Self-citationMeasure Twice, Cut down Error: A Process for Enhancing the Validity of Survey Scales
Gehlbach, H., & Brinkworth, M. E. (2011) · Review of General Psychology · doi:10.1037/a0025704 · Cited by 298 · see citing works
Messick, S. (1994) · ETS Research Report Series · doi:10.1002/j.2333-8504.1994.tb01618.x · Cited by 287 · see citing works
Theory of mental and social measurements.
Thorndike, E. L. (1904) · doi:10.1037/13283-000 · Cited by 242 · see citing works
Weidman, A. C., Steckler, C. M., & Tracy, J. L. (2016) · Emotion · doi:10.1037/emo0000226 · Cited by 219 · see citing works
D. Chambers, C., 1 Cardiff University Brain Research Imaging Centre, S. O. P., Feredoes, E., D. Muthukumaraswamy, S., & J. Etchells, P. (2014) · AIMS Neuroscience · doi:10.3934/neuroscience.2014.1.4 · Cited by 213 · see citing works
Conceptualizing and evaluating the replication of research results
Fabrigar, L. R., & Wegener, D. T. (2015) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.07.009 · Cited by 168 · see citing works
Validity and Validation in Social, Behavioral, and Health Sciences
Zumbo, B., & Chan, E. K. H. (2014) · Social indicators research series · doi:10.1007/978-3-319-07794-9 · Cited by 165 · see citing works
Construct validity and the validity of replication studies: A systematic review.
Flake, J. K., Davidson, I. J., Wong, O. C. Y., & Pek, J. C. X. (2022) · American Psychologist · doi:10.1037/amp0001006 · Cited by 154 · see citing works
Self-citationAn Introduction to the Theory of Mental and Social Measurements
Thorndike, E. L. (1905) · The American Journal of Psychology · doi:10.2307/1412238 · Cited by 148 · see citing works
Validity and Reliability Reporting Practices in the Field of Health Education and Behavior
Barry, A. E., Chaney, B. H., Piazza-Gardner, A. K., & Chavarria, E. A. (2013) · Health Education & Behavior · doi:10.1177/1090198113483139 · Cited by 139 · see citing works
An Introduction to the Theory of Mental and Social Measurements.
Giddings, F. H., & Thorndike, E. L. (1905) · The Journal of Philosophy Psychology and Scientific Methods · doi:10.2307/2012040 · Cited by 127 · see citing works
Replication is important for educational psychology: Recent developments and key issues
Plucker, J. A., & Makel, M. C. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1895796 · Cited by 122 · see citing works
Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability
Ebersole, C. R., Mathur, M. B., Baranski, E., Bart-Plange, D.-J., Buttrick, N. R., Chartier, C. R., Corker, K. S., Corley, M., Hartshorne, J. K., IJzerman, H., et al. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920958687 · Cited by 105 · see citing works
Validating Psychological Constructs
Slaney, K. L. (2017) · Palgrave Macmillan UK eBooks · doi:10.1057/978-1-137-38523-9 · Cited by 98 · see citing works
Gildersleeve, K. A., Haselton, M. G., & Fales, M. R. (2014) · Psychological Bulletin · doi:10.1037/a0037714 · Cited by 91 · see citing works
The Implications of “Contamination” for Experimental Design in Education
Rhoads, C. H. (2010) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998610379133 · Cited by 71 · see citing works
Fleming, J. I., Wilson, S. E., Hart, S. A., Therrien, W. J., & Cook, B. G. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1897593 · Cited by 60 · see citing works
Measurement practices in large-scale replications: Insights from Many Labs 2.
Shaw, M., Cloos, L., Luong, R., Elbaz, S., & Flake, J. K. (2020) · Canadian Psychology/Psychologie canadienne · doi:10.1037/cap0000220 · Cited by 37 · see citing works
Self-citationImproving norms in research culture to incentivize transparency and rigor
Mellor, D. T. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1902329 · Cited by 36 · see citing works
Measurement MattersPreprint
Fried, E. I., & Flake, J. K. (2018) · doi:10.17605/osf.io/zrkd4 · Cited by 34 · see citing works
Self-citationImplications of the open science era for educational psychology research syntheses
Patall, E. A. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1897009 · Cited by 34 · see citing works
Preregistration and registered reports
Reich, J. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1900851 · Cited by 30 · see citing works
Introducing Advances in Methods and Practices in Psychological Science
Simons, D. J. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918757424 · Cited by 25 · see citing works
The Degree of Congruence between Test Standards and Test Documentation with in Journal Publications
Qualls, A. L., & Moss, A. D. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056002002 · Cited by 23 · see citing works
Reflections on Validation Practices in the Social, Behavioral, and Health Sciences
Zumbo, B., & Chan, E. K. H. (2014) · Social indicators research series · doi:10.1007/978-3-319-07794-9_19 · Cited by 20 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Matthews, R. A., Pineault, L., & Hong, Y.-H. (2022) · Journal of Business and Psychology · doi:10.1007/s10869-022-09813-3 · Cited by 485 · see citing works
Back to Basics: The Importance of Conceptual Clarification in Psychological Science
Bringmann, L. F., Elmer, T., & Eronen, M. I. (2022) · Current Directions in Psychological Science · doi:10.1177/09637214221096485 · Cited by 221 · see citing works
Construct validity and the validity of replication studies: A systematic review.
Flake, J. K., Davidson, I. J., Wong, O. C. Y., & Pek, J. C. X. (2022) · American Psychologist · doi:10.1037/amp0001006 · Cited by 154 · see citing works
Self-citationHodson, G. (2021) · Journal of Theoretical Social Psychology · doi:10.1002/jts5.120 · Cited by 118 · see citing works
Cloos, L., Ceulemans, E., & Kuppens, P. (2022) · Psychological Assessment · doi:10.1037/pas0001200 · Cited by 97 · see citing works
Gehlbach, H., & Robinson, C. D. (2021) · Educational Psychology · doi:10.1080/00461520.2021.1898961 · Cited by 46 · see citing works
What Can Educational Psychology Learn From, and Contribute to, Theory Development Scholarship?
Greene, J. A. (2022) · Educational Psychology Review · doi:10.1007/s10648-022-09682-5 · Cited by 55 · see citing works
Educational reforms and their impact on student performance: A review in African Countries
Adeniyi, I. S., Hamad, N. M. A., Adewusi, O. E., Unachukwu, C. C., Osawaru, B., Onyebuchi, C. N., Omolawal, S. A., Aliu, A. O., & David, I. O. (2024) · World Journal of Advanced Research and Reviews · doi:10.30574/wjarr.2024.21.2.0490 · Cited by 43 · see citing works
Gehlbach, H., Mascio, B., & McIntyre, J. (2022) · Journal of Educational Psychology · doi:10.1037/edu0000762 · Cited by 40 · see citing works
Questioning Psychological Constructs: Current Issues and Proposed Changes
de Boeck, P. A. L., Pek, J. C. X., Walton, K. M., Wegener, D. T., Turner, B. M., Andersen, B. L., Beauchaine, T. P., Lecavalier, L., Myung, J. I., & Petty, R. E. (2023) · Psychological Inquiry · doi:10.1080/1047840x.2023.2274429 · Cited by 38 · see citing works
Implications of the open science era for educational psychology research syntheses
Patall, E. A. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1897009 · Cited by 34 · see citing works
Is it really a neuromyth? A meta-analysis of the learning styles matching hypothesis
Clinton‐Lisell, V., & Litzinger, C. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1428732 · Cited by 48 · see citing works
Limitations of the Sum-and-Alpha Approach to Measurement in Behavioral Research
McNeish, D. (2022) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/23727322221117144 · Cited by 30 · see citing works
Practical Implications of Sum Scores Being Psychometrics’ Greatest Accomplishment
McNeish, D. (2024) · Psychometrika · doi:10.1007/s11336-024-09988-z · Cited by 29 · see citing works
Quinn‐Nilas, C. (2022) · Journal of Social and Personal Relationships · doi:10.1177/02654075221143360 · Cited by 17 · see citing works
Synthesizing Definitions of Digital Literacy for the Web 3.0
Greene, J. A., & Crompton, H. (2024) · TechTrends · doi:10.1007/s11528-024-01015-3 · Cited by 16 · see citing works
Albert, N., & Thomson, M. (2023) · Journal of Consumer Research · doi:10.1093/jcr/ucad064 · Cited by 18 · see citing works
Open science reforms: Strengths, challenges, and future directions
Wentzel, K. R. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1901709 · Cited by 16 · see citing works
The measurement of goal dimensions: A critical review.
Kiendl, K., & Hennecke, M. (2022) · Motivation Science · doi:10.1037/mot0000268 · Cited by 18 · see citing works
Causal complexity and psychological measurement
Eronen, M. I. (2024) · Philosophical Psychology · doi:10.1080/09515089.2023.2300693 · Cited by 15 · see citing works
Dynamic fit index cutoffs for treating likert items as continuous.
McNeish, D. (2024) · Psychological Methods · doi:10.1037/met0000683 · Cited by 16 · see citing works
Estimating adolescent mental health in the general population: current challenges and opportunities
Black, L., Panayiotou, M., & Humphrey, N. (2024) · The Lancet Psychiatry · doi:10.1016/s2215-0366(24)00254-2 · Cited by 15 · see citing works
Measuring CHAOS? Evaluating the Short-form Confusion, Hubbub and Order Scale
Larsen, S. A., Asbury, K., Coventry, W. L., Hart, S. A., Little, C. W., & Petrill, S. A. (2023) · Collabra Psychology · doi:10.1525/collabra.77837 · Cited by 12 · see citing works
Intrinsic and Extrinsic Reading Motivation: Context, Theory, and Measurement
Ives, S. T., Parsons, S. A., Cutter, D., Field, S. A., Wells, M. S., & Lague, M. (2022) · Reading Psychology · doi:10.1080/02702711.2022.2141403 · Cited by 12 · see citing works
Huff, M., & Bongartz, E. C. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231156419 · Cited by 11 · see citing works
Civitillo, S., Mayer, A., & Jugert, P. (2022) · doi:10.31234/osf.io/d4rva · Cited by 9 · see citing works
Robinson, K. A., Zheng, Q., Shankar, S., Lee, S. Y., & Christiaans, E. (2023) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2023.102254 · Cited by 8 · see citing works
A Novel, Network-Based Approach to Assessing Romantic-Relationship Quality
Lab, T. C. (2024) · Perspectives on Psychological Science · doi:10.1177/17456916231215248 · Cited by 12 · see citing works
McNeish, D. (2025) · Annual Review of Psychology · doi:10.1146/annurev-psych-121924-104021 · Cited by 11 · see citing works
Dynamic Fit Index Cutoffs for Factor Analysis with Likert, Ordinal, or Binary ResponsesPreprint
McNeish, D. (2023) · doi:10.31234/osf.io/tp35s · Cited by 7 · see citing works
Carminati, J.-Y. J., Ponsford, J. L., & Gould, K. R. (2024) · Brain Impairment · doi:10.1071/ib23065 · Cited by 6 · see citing works
Addressing the vexing educational challenges of biodiversity loss: A photo-based intervention
Gehlbach, H., Mu, N., Arcot, R. R., Chuter, C., Cornwall, K. J., Nehring, L., Robinson, C. D., & Vriesema, C. C. (2022) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2022.102096 · Cited by 8 · see citing works
A scoping review on what constitutes a good research culture
Blatch-Jones, A., Lakin, K., & Thomas, S. E. (2024) · F1000Research · doi:10.12688/f1000research.147599.1 · Cited by 6 · see citing works
Robinson, K. A., & Johnson, C. D. (2025) · Learning and Individual Differences · doi:10.1016/j.lindif.2025.102732 · Cited by 5 · see citing works
Levy, R., & McNeish, D. (2024) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986241254348 · Cited by 3 · see citing works
Dunne, J. H., Black, L., Nanda, P., Anderton, M., Banwell, E., Butters, L. C., Demkowicz, O., Davies, J., Davidson, B. I., Qualter, P., et al. (2023) · doi:10.31234/osf.io/erjvz · Cited by 3 · see citing works
A scoping review on what constitutes a good research culture
Blatch-Jones, A., Lakin, K., & Thomas, S. E. (2024) · F1000Research · doi:10.12688/f1000research.147599.3 · Cited by 2 · see citing works
Carminati, J.-Y. J., Wiley, J. F., Ponsford, J. L., & Gould, K. R. (2025) · Disability and Rehabilitation · doi:10.1080/09638288.2025.2520994 · Cited by 2 · see citing works
Bijani, H., Hashempour, B., & Orabah, S. S. B. (2022) · International Journal of Research in English Education · doi:10.52547/ijree.7.3.32 · Cited by 2 · see citing works
Construct validity of international literacy measures: implications for dyslexia across cultures
Pamei, G., Cheah, Z. R. E., & McBride, C. A. (2022) · Journal of Cultural Cognitive Science · doi:10.1007/s41809-022-00115-x · Cited by 4 · see citing works
Mind the (Construct-Measurement) Gap
Hodson, G. (2023) · Psychological Inquiry · doi:10.1080/1047840x.2023.2274389 · Cited by 1 · see citing works
Pownall, M., Blundell-Birtill, P., & Harris, R. J. (2025) · Higher Education Research & Development · doi:10.1080/07294360.2025.2470821 · Cited by 3 · see citing works
Dyslexia Research and Replicability: Should We Be Worried?
Leung, A. Y., Logvinenko, T. I., & Schmalz, X. (2025) · Mind Brain and Education · doi:10.1111/mbe.70031 · Cited by 1 · see citing works
Blind Spots in Research Integrity Policy: How to Identify and Resolve Them
Redman, B. K. (2023) · Springer eBooks · doi:10.1007/978-3-031-27111-3_2 · Cited by 1 · see citing works
Reduce, reuse, recycle: Introducing MetaPipeX , a framework for analyses of multi‐lab data
Fuenderich, J., Beinhauer, L. J., & Renkewitz, F. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1733 · Cited by 1 · see citing works
Open Research as an Ally to Teaching and Scholarship-Track Academics
Pownall, M., Soicher, R. N., & Nordmann, E. (2025) · Journal of Perspectives in Applied Academic Practice · doi:10.56433/dxhss233 · Cited by 1 · see citing works
Huff, M., & Bongartz, E. C. (2022) · doi:10.31234/osf.io/9yhcz · Cited by 1 · see citing works
Dyslexia Research and Replicability: Should We Be Worried?Preprint
Logvinenko, T. I., Leung, A. Y., & Schmalz, X. (2025) · doi:10.35542/osf.io/qg9s4_v1 · Cited by 1 · see citing works
Reduce, Reuse, Recycle: Introducing MetaPipeX, a Framework for Analyses of Multi-Lab DataPreprint
Fuenderich, J., Beinhauer, L. J., & Renkewitz, F. (2023) · doi:10.31234/osf.io/bcpkt
Konaszewski, K., Muszyńska, J., Skalski‐Bednarz, S. B., & Surżykiewicz, J. (2023) · Polska Myśl Pedagogiczna · doi:10.4467/24504564pmp.23.016.18245
A scoping review on what constitutes a good research culture
Blatch-Jones, A., Lakin, K., & Thomas, S. E. (2024) · F1000Research · doi:10.12688/f1000research.147599.2
Andon, A., Rew, W. J., & Luschei, T. F. (2025) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2025.103355
Blinde Flecken in der Politik der Forschungsintegrität: Wie man sie identifiziert und löst
Redman, B. K. (2025) · Springer eBooks · doi:10.1007/978-3-031-92469-9_2
Digital Trace Data as Measurement Instruments forVariance-Theoretic Research in Information Systems
Hüllmann, J. A. (2026) · Progress in IS · doi:10.1007/978-3-032-05497-5_10
Alley, L. J., Johnson, C. D., Luong, R., Robinson, K. A., & Flake, J. K. (2026) · The Journal of Experimental Education · doi:10.1080/00220973.2026.2630661
Self-citationAdvantages in Bayesian Approaches to Confirmatory Factor Analysis
Alvarez-Bartolo, D., Cheng, C. H., Levy, R., Berkel, C., & Gewirtz, A. H. (2026) · Prevention Science · doi:10.1007/s11121-026-01934-y
Construct and Inference Alignment in Mathematical Problemsolving ResearchPreprint
Doronila, R. A. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7597139
Construct and inference alignment in mathematical problem-solving researchPreprint
Doronila, R. A. (2026) · Research Square · doi:10.21203/rs.3.rs-11339567/v1
- Authors
- Flake, J. K.
- Affiliations
- McGill University (CA)
- Corresponding author
- Flake, Jessica Kay
- ORCID
- Flake, Jessica Kay
- Venue
- Educational Psychologist
- Publisher
- Informa UK Limited
- Published
- 2021-04-03
- Volume
- 56
- Issue
- 2
- Pages
- 132-141
- ISSN
- 0046-1520 (ISSN-L)
- 1532-6985
- OpenAlex
- W3141288175
- Cited by
- 58
- References
- 58
- Citations by year
- 2026: 5 · 2025: 9 · 2024: 14 · 2023: 11 · 2022: 15 · 2021: 4
- FWCI
- 6.69
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- other-oa
- Locations
- Educational Psychologist (publishedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Education › Educational Research and Methods
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Keywords
- construct validation, open science, replication study, measurement development, research rigor, preregistration
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review