Journal article reporting standards for quantitative research in psychology: The APA Publications and Communications Board task force report.
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Following a review of extant reporting standards for scientific publication, and reviewing 10 years of experience since publication of the first set of reporting standards by the American Psychological Association (APA; APA Publications and Communications Board Working Group on Journal Article Reporting Standards, 2008), the APA Working Group on Quantitative Research Reporting Standards recommended some modifications to the original standards. Examples of modifications include division of hypotheses, analyses, and conclusions into 3 groupings (primary, secondary, and exploratory) and some changes to the section on meta-analysis. Several new modules are included that report standards for observational studies, clinical trials, longitudinal studies, replication studies, and N-of-1 studies. In addition, standards for analytic methods with unique characteristics and output (structural equation modeling and Bayesian analysis) are included. These proposals were accepted by the Publications and Communications Board of APA and supersede the standards included in the 6th edition of the Publication Manual of the American Psychological Association (APA, 2010). (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A systematic search strategy was implemented (Appelbaum et al., 2018).”
From Cognitive and academic benefits of music training with children: A multilevel meta-analysis (2020) · cites this paper as Appelbaum et al., 2018
In the citing paper
“We designed the meta-analyses and report the results in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement (Moher et al., 2009) and the American Psychological Association's Quantitative Meta-Analysis Article Reporting Standards (Appelbaum et al., 2018).”
From Do growth mindset interventions impact students’ academic achievement? A systematic review and meta-analysis with recommendations for best practices. (2023) · cites this paper as Appelbaum et al., 2018
In the citing paper
“However, the relative novelty of conducting Bayesian analyses in applied fields means that there are no detailed reporting standards, and this in turn may frustrate the broader adoption and proper interpretation of the Bayesian framework.”
From The JASP guidelines for conducting and reporting a Bayesian analysis (2021) · cites this paper as Appelbaum et al., 2018
In the citing paper
“These methods are necessary to produce unbiased and more reliable estimates (Appelbaum et al., 2018).”
From The cognitive and academic benefits of Cogmed: A meta-analysis (2019) · cites this paper as Appelbaum et al., 2018
Citations
Cites
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Cook, R. J., Dickens, B. M., & Fathalla, M. F. (2003) · Reproductive Health and Human Rights · doi:10.1093/acprof:oso/9780199241323.003.0025 · Cited by 10,769
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
A Beginner's Guide to Structural Equation Modeling: Fourth Edition
Schumacker, R. E., & Lomax, R. G. (2015) · doi:10.4324/9781315749105 · Cited by 6,604
Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72351 · Cited by 6,277
(2016) · Cited by 3,399
Self-citationStandards for Educational and Psychological Testing
(2007) · Encyclopedia of Measurement and Statistics · doi:10.4135/9781412952644.n432 · Cited by 3,126
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Picton, T. W., Bentin, S., Berg, P., Donchin, E., Hillyard, S. A., Johnson, R., Miller, G. A., Ritter, W., Ruchkin, D. S., Rugg, M. D., et al. (2000) · Psychophysiology · doi:10.1111/1469-8986.3720127 · Cited by 2,157
Cited by
Items 101–200 of 1,002
Measuring fear of crime during the past 25 years: A systematic quantitative literature review
Hart, T. C., Chataway, M., & Mellberg, J. (2022) · Journal of Criminal Justice · doi:10.1016/j.jcrimjus.2022.101988 · Cited by 100
Best practices for researching diverse groups.
Burlew, A. K., Peteet, B. J., McCuistian, C. L., & Miller-Roenigk, B. D. (2019) · American Journal of Orthopsychiatry · doi:10.1037/ort0000350 · Cited by 79
“Even the standards on quantitative research published in a recent issue of the American Psychologist only mention the need to report ethnicity along with other sociodemographic characteristics of the sample (Appelbaum et al., 2018).”
BackgroundHughes, J. L., Camden, A. A., Yangchen, T., Smith, G. P. A., Rodríguez, M. M. D., Rouse, S. V., McDonald, C. P., & Lopez, S. G. (2022) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn27.4.232 · Cited by 112
Higgins, W. C., Kaplan, D. M., Deschrijver, E., & Ross, R. M. (2023) · Clinical Psychology Review · doi:10.1016/j.cpr.2023.102378 · Cited by 91
Emotion-related impulsivity and risky decision-making: A systematic review and meta-regression
Elliott, M., Johnson, S. L., Pearlstein, J. G., Lopez, D. E. M., & Keren, H. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102232 · Cited by 91
“We followed the Journal Article Reporting Standards for Quantitative Meta-Analyses (Appelbaum et al., 2018).”
MethodEffects of emotional skills training to prevent burnout syndrome in schoolteachers
Schoeps, K., Tamarit, A., de la Barrera, U., & González Barrón, R. (2019) · Ansiedad y Estrés · doi:10.1016/j.anyes.2019.01.002 · Cited by 66
Zhang, J., Dong, C., Jiang, Y., Zhang, Q., Li, H., & Li, Y. (2023) · Psychology Research and Behavior Management · doi:10.2147/prbm.s417718 · Cited by 71
“A systematic literature search was performed according to the Journal Article Reporting Standards for Quantitative Research in Psychology 41 and descriptions given by Braune-Krickau et al 27 According to the suggestion of Frandsen et al, 43 outcomes terms related to child social-emotional…”
MethodLanguage and Group Processes: An Integrative, Interdisciplinary Review
Swol, L. M. V., & Kane, A. A. (2018) · Small Group Research · doi:10.1177/1046496418785019 · Cited by 79
González‐Roz, A., Castaño, Y., Krotter, A., Salazar-Cedillo, A., & Gervilla, E. (2024) · International Journal of Clinical and Health Psychology · doi:10.1016/j.ijchp.2024.100502 · Cited by 91
“It also conformed to both the Journal Article Reporting Standards (JARS) and Meta-Analysis Reporting Standards (MARS) (see Appelbaum et al., 2018).”
MethodA Systematic Review of Passing as Non-autistic in Autism Spectrum Disorder
Libsack, E. J., Keenan, E. G., Freden, C. E., Mirmina, J., Iskhakov, N., Krishnathasan, D., & Lerner, M. D. (2021) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-021-00365-1 · Cited by 68
How to use and report Bayesian hypothesis tests.
Dienes, Z. P. (2021) · Psychology of Consciousness Theory Research and Practice · doi:10.1037/cns0000258 · Cited by 91
Baziliansky, S., & Cohen, M. W. (2020) · Stress and Health · doi:10.1002/smi.2972 · Cited by 80
The Cooperation Databank: Machine-Readable Science Accelerates Research Synthesis
Spadaro, G., Tiddi, I., Columbus, S., Jin, S., ten Teije, A., CoDa Team, & Balliet, D. P. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916211053319 · Cited by 86
“However, CoDa does not provide an estimate of the risk of bias that specific study-design features might introduce in the meta-analysis (Appelbaum et al., 2018).”
BackgroundReddit in communication research: current status, future directions and best practices
Hintz, E. A., & Betts, T. (2022) · Annals of the International Communication Association · doi:10.1080/23808985.2022.2064325 · Cited by 85
“Adherence to the American Psychological Association’s JARS for qualitative and mixed method (see Levitt et al., 2018) and quantitative designs (see Appelbaum et al., 2018) would further bolster study credibility and transparency and address many of these inconsistencies.”
MethodDo We Become More Lonely With Age? A Coordinated Data Analysis of Nine Longitudinal Studies
Graham, E. K., Beck, E. D., Jackson, K., Yoneda, T. B., McGhee, C., Pieramici, L., Atherton, O. E., Luo, J., Willroth, E. C., Steptoe, A., et al. (2024) · Psychological Science · doi:10.1177/09567976241242037 · Cited by 86
“We follow Journal Article Reporting Standards (Appelbaum et al., 2018).”
Preregistration in Single-Case Design Research
Johnson, A. H., & Cook, B. G. (2019) · Exceptional Children · doi:10.1177/0014402919868529 · Cited by 68
“Replicable and complete descriptions of research studies are necessary for science to benefit the public (Appelbaum et al., 2018; Council for Exceptional Children [CEC], 2014).”
BackgroundMethodHernández, M. P., Schoeps, K., Maganto, C., & Montoya-Castilla, I. (2021) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106569 · Cited by 66
Zhang, M., Chen, X., Xie, H., Esposito, L., Parziale, A., Taneja, S., & Siraj, A. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e31579 · Cited by 94
“This was considered as the most suitable data analysis technique for this research in view of the objectives and exploratory nature of this study (the conceptualization of digital capability) and the presence of second order formative constructs in the measurement model [88].”
MethodApplied Psychometrics: Writing-Up a Factor Analysis Construct Validation Study with Examples
Kyriazos, T. A. (2018) · Psychology · doi:10.4236/psych.2018.911144 · Cited by 82
“This work is licensed under the Creative Commons Attribution International License (CC BY 4.0). http://creativecommons.org/licenses/by/4.0/ Open Access DOI: 10.4236/psych.2018.911144 2504 Psychology dards, 2018; Levitt et al., 2018; Appelbaum et al., 2018).”
MethodInfluentialKúld, P. B., Frielink, N., Zijlmans, M., Schuengel, C., & Embregts, P. J. C. M. (2023) · Journal of Intellectual Disability Research · doi:10.1111/jir.13036 · Cited by 73
Schoemann, M., O’Hora, D. P., Dale, R. A. C., & Scherbaum, S. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01851-3 · Cited by 76
Reitsma, L., Boelen, P. A., de Keijser, J., & Lenferink, L. I. M. (2023) · Behaviour Research and Therapy · doi:10.1016/j.brat.2023.104286 · Cited by 64
Transformational Leadership and Nursing Retention: An Integrative Review
Goens, B., & Giannotti, N. (2024) · Nursing Research and Practice · doi:10.1155/2024/3179141 · Cited by 94
Statistical assumptions in L2 research: A systematic review
Hu, Y., & Plonsky, L. (2019) · Second language Research · doi:10.1177/0267658319877433 · Cited by 82
Sala, G., Aksayli, N. D., Tatlidil, K. S., Gondo, Y., & Gobet, F. (2019) · Intelligence · doi:10.1016/j.intell.2019.101386 · Cited by 72
From Boulder to Stockholm in 70 Years: Single Case Experimental Designs in Clinical Research
Vlaeyen, J. W. S., Wicksell, R. K., Simons, L. E., Gentili, C., De, T. K., Tate, R. L., Vohra, S., Punja, S., Linton, S. J., Sniehotta, F. F., et al. (2020) · The Psychological Record · doi:10.1007/s40732-020-00402-5 · Cited by 63
Filho, E., Dobersek, U., & Husselman, T.-A. (2021) · Experimental Brain Research · doi:10.1007/s00221-021-06078-9 · Cited by 70
In praise of Table 1: The importance of making better use of descriptive statistics
Murphy, K. R. (2021) · Industrial and Organizational Psychology · doi:10.1017/iop.2021.90 · Cited by 81
How to evaluate local fit (residuals) in large structural equation models
Kline, R. B. (2024) · International Journal of Psychology · doi:10.1002/ijop.13252 · Cited by 78
Self-citationBošnjak, M., Fiebach, C. J., Mellor, D. T., Mueller, S., O'Connor, D. B., Oswald, F. L., & Sokol, R. I. (2022) · American Psychologist · doi:10.1037/amp0000879 · Cited by 77
Development of narcissism across the life span: A meta-analytic review of longitudinal studies.
Orth, U., Krauss, S., & Back, M. D. (2024) · Psychological Bulletin · doi:10.1037/bul0000436 · Cited by 79
Wallrich, L., Opara, V., Wesołowska, M., Barnoth, D., & Yousefi, S. (2024) · Journal of Business and Psychology · doi:10.1007/s10869-024-09977-0 · Cited by 69
Human resource management training of supervisors for improving health and well-being of employees
Kuehnl, A., Seubert, C., Rehfuess, E. A., von Elm, E. B., Nowak, D., & Glaser, J. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd010905.pub2 · Cited by 75
Zinsser, K. M., Gordon, R. A., & Xue, J. (2021) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2021.02.001 · Cited by 76
Incredible Utility: The Lost Causes and Causal Debris of Psychological Science
Richters, J. E. (2021) · Basic and Applied Social Psychology · doi:10.1080/01973533.2021.1979003 · Cited by 69
Phonemic Awareness: A Meta‐Analysis for Planning Effective Instruction
Rice, M., Erbeli, F., Thompson, C. G., Sallese, M. R., & Fogarty, M. (2022) · Reading Research Quarterly · doi:10.1002/rrq.473 · Cited by 79
Self-regulation, stress appraisal, and esport action performance
Trotter, M. G., Obine, E. A. C., & Sharpe, B. T. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1265778 · Cited by 74
Park, H. (., Wiernik, B. M., Oh, I.-S., Gonzalez-Mulé, E., Ones, D. S., & Lee, Y. (2020) · Journal of Applied Psychology · doi:10.1037/apl0000476 · Cited by 57
Reporting Practice in Multilevel Modeling: A Revisit After 10 Years
Luo, W., Li, H., Baek, E., Chen, S., Lam, K. H., & Semma, B. (2021) · Review of Educational Research · doi:10.3102/0034654321991229 · Cited by 76
“Hence, we iterate the reporting guidelines for MLM by Dedrick et al. (2009) and include three additional recommendations in light of the updated journal article reporting standards for quantitative research by the American Psychological Association (Appelbaum et al., 2018) and the findings of this review.”
BackgroundMethodInfluentialBardach, L., Röhl, S., Oczlon, S., Schumacher, A., Lüftenegger, M., Lavelle-Hill, R. E., Schwarzenthal, M., & Zitzmann, S. (2024) · Psychological Bulletin · doi:10.1037/bul0000454 · Cited by 70
Demangeon, A., Claudel-Valentin, S., Aubry, A., & Tazouti, Y. (2023) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2023.102182 · Cited by 55
Suicidality among individuals with gambling problems: A meta-analytic literature review.
Kristensen, J. H., Pallesen, S., Bauer, J., Leino, T. M., Griffiths, M. D., & Erevik, E. K. (2023) · Psychological Bulletin · doi:10.1037/bul0000411 · Cited by 70
Secades‐Villa, R., Diego, G. A., Pérez, Á. G., & González‐Roz, A. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000611 · Cited by 60
Okada, R. (2023) · Japanese Psychological Research · doi:10.1111/jpr.12380 · Cited by 54
Sun, H., Dai, Y.-Y., Jeon, S.-S., Lee, R., Wang, H., Shi, X., Sun, L., & Wang, Y. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e36030 · Cited by 77
“Given that this study does not involve experimental manipulation, we aimed to enhance the reporting of SEM outcomes by JARSQuant standards by the APA, following the approach outlined by Appelbaum et al. [59].”
MethodCheung, S. F., Pesigan, I. J. A., & Vong, W. N. (2022) · Behavior Research Methods · doi:10.3758/s13428-022-01808-5 · Cited by 63
“In addition to using point estimation, which yields a value (the estimate) of this parameter, it is now common to report an interval estimate, which yields an interval enclosed by two values (Appelbaum et al., 2018; Pek & Flora, 2018).”
BackgroundEffective interventions for gaming disorder: A systematic review of randomized control trials
Chen, Y., Lu, J., Wang, L., & Gao, X. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1098922 · Cited by 80
“Authors must also improve the quality of reporting and follow international standards, such as the Consolidated Standards of Reporting Trials (CONSORT) (87) and the Journal Article Reporting Standards (JARS) (88).”
BackgroundJouhki, H., Savolainen, I., Sirola, A., & Oksanen, A. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph191912491 · Cited by 72
A Worthwhile Endeavor? A meta-analysis of research on formalized novice teacher induction programs
Keese, J., Thompson, C., Waxman, H., McIntush, K., & Svajda-Hardy, M. (2022) · Educational Research and Reviews · doi:10.1016/j.edurev.2022.100505 · Cited by 46
Burstein, O., Zevin, Z. T., & Geva, R. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.3687 · Cited by 64
Making the Invisible Visible: Guidelines for the Coding Process in Meta-Analyses
Villiger, J., Schweiger, S. A., & Baldauf, A. (2021) · Organizational Research Methods · doi:10.1177/10944281211046312 · Cited by 61
Islam, M. A., Saidin, Z. H., Ayub, M. A., & Islam, M. S. (2022) · Heliyon · doi:10.1016/j.heliyon.2022.e10519 · Cited by 72
Mesquida, C., Murphy, J., Lakens, D., & Warne, J. P. (2023) · Journal of Sports Sciences · doi:10.1080/02640414.2023.2269357 · Cited by 57
“…reporting practices of statistical results were suboptimal and journals and researchers should adopt the journal article reporting standards recommended by APA (Appelbaum et al., 2018), although there are others such as the Bayesian analysis reporting guidelines also known as BARG (Kruschke, 2021).”
BackgroundInfluentialRahman, S., Adeel, S., Ali, M., Bajaba, S. M., & Latan, H. (2025) · Business Strategy and the Environment · doi:10.1002/bse.70252 · Cited by 69
Does music training improve inhibition control in children? A systematic review and meta-analysis
Jamey, K., Foster, N. E. V., Hyde, K. L., & Bella, S. D. (2024) · Cognition · doi:10.1016/j.cognition.2024.105913 · Cited by 72
Implementation Reporting Recommendations for School-Based Mindfulness Programs
Baelen, R. N., Gould, L. F., Felver, J. C., Schussler, D. L., & Greenberg, M. T. (2022) · Mindfulness · doi:10.1007/s12671-022-01997-2 · Cited by 56
The Use of Online Panel Data in Management Research: A Review and Recommendations
Porter, C. O. L. H., Outlaw, R., Gale, J. P., & Cho, T. S. (2018) · Sage Journals Data · doi:10.25384/sage.c.4310936 · Cited by 50
Hallford, D. J., Rusanov, D., Yeow, J. J. E., Austin, D., D’Argembeau, A., Fuller‐Tyszkiewicz, M., & Raes, F. (2022) · Cognitive Therapy and Research · doi:10.1007/s10608-022-10330-z · Cited by 62
“Journal Article Reporting Standards for Quantitative Research in Psychology were followed (Appelbaum et al., 2018), as were CONSORT guidelines for randomized controlled experiments (Schulz et al., 2010).”
MethodIs it really a neuromyth? A meta-analysis of the learning styles matching hypothesis
Clinton‐Lisell, V., & Litzinger, C. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1428732 · Cited by 72
The Use of Research Methods in Psychological Research: A Systematised Review
Scholtz, S. E., de Klerk, W., & Beer, L. T. D. (2020) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2020.00001 · Cited by 66
“such as sampling and designs, is a requirement according to the APA’s Journal Article Reporting Standards (JARS-Quant) (Appelbaum et al., 2018).”
MethodBloomfield, R. J., Rennekamp, K. M., & Steenhoven, B. A. (2018) · Journal of Accounting Research · doi:10.1111/1475-679x.12208 · Cited by 54
Impact of Emotional Intelligence on Burnout among Spanish Teachers: A Mediation Study
Schoeps, K., Tamarit, A., Peris, M., & Montoya‐Castilla, I. (2021) · Psicología Educativa · doi:10.5093/psed2021a10 · Cited by 73
“All results were reported as recommended by the Reporting Standards for Studies Using Structural equation Modeling (Appelbaum et al., 2018).”
MethodDirect Discrepancy Dynamic Fit Index Cutoffs for Arbitrary Covariance Structure Models
McNeish, D., & Wolf, M. G. (2024) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2024.2308005 · Cited by 56
“Though useful and widely considered part of a comprehensive fit evaluation (Appelbaum et al., 2018; Thoemmes et al., 2018), local fit is not often reported based on findings from recent reviews.”
Saraswati, Y., Indana, S., & Sudibyo, E. (2021) · IJORER International Journal of Recent Educational Research · doi:10.46245/ijorer.v2i3.118 · Cited by 47
Doing a Systematic Review in Health Sciences
Blasco, B. C., Jiménez, R., Gervilla, E., & Moreno, J. J. M. (2020) · Clínica y Salud · doi:10.5093/clysa2020a15 · Cited by 60
Greene, C. M., de Saint Laurent, C., Murphy, G., Prike, T., Hegarty, K., & Ecker, U. K. H. (2023) · European Psychologist · doi:10.1027/1016-9040/a000491 · Cited by 33
Impact of emotional development intervention program on subjective well-being of university students
Schoeps, K., de la Barrera, U., & Montoya‐Castilla, I. (2019) · Higher Education · doi:10.1007/s10734-019-00433-0 · Cited by 63
Smith, K. N., Lamb, K. N., & Henson, R. K. (2019) · Gifted Child Quarterly · doi:10.1177/0016986219890352 · Cited by 55
“%) of the 56 total articles, authors failed to explain why MANOVA was deemed appropriate for answering the stated research question(s), a basic reporting requirement for any study (American Psychological Association [APA], 2010; see also Appelbaum et al., 2018).”
BackgroundBadovinac, S. D., Riddell, R. P., Deneault, A., Martin, J., Bureau, J., & O’Neill, M. C. (2021) · Marriage & Family Review · doi:10.1080/01494929.2021.1879984 · Cited by 54
“The criteria evaluated closely resemble the standards for reporting released by the American Psychological Association (Appelbaum et al., 2018).”
MethodDeveloping an open science ‘mindset’
Hagger, M. S. (2021) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2021.2012474 · Cited by 56
“…and guidelines that aim to improve replicability, reproducibility, credibility, and transparency in research (e.g. Aczel et al., 2020; Appelbaum et al., 2018; Kidwell et al., 2016; Morey et al., 2016; NIH, 2021a; Nosek et al., 2015; NSF, 2021a; Open Science MOOC, 2018; SIPS, 2021;…”
BackgroundAbove averaging in literature reviews
Simonsohn, U., Simmons, J. P., & Nelson, L. D. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00101-8 · Cited by 44
Following Up on Employee Surveys: A Conceptual Framework and Systematic Review
Huebner, L.-A. M., & Zacher, H. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.801073 · Cited by 59
Assessing Publication Bias: a 7-Step User’s Guide with Best-Practice Recommendations
Kepes, S., Wang, W., & Cortina, J. M. (2022) · Journal of Business and Psychology · doi:10.1007/s10869-022-09840-0 · Cited by 49
King, S. A., Boyer, J., Bell, T., & Estapa, A. T. (2022) · JMIR Serious Games · doi:10.2196/41097 · Cited by 57
“The use of a single-case design [34-36] permitted improvements in simulation functionality over the course of the experiment, resulting in automated assessments with a high degree of agreement with direct observation (>96%) and large changes in the percentage of steps in the procedure exhibited by the two participatin…”
MethodJudging the Scientific Quality of Applied Lighting Research
Veitch, J. A., Fotios, S. A., & Houser, K. W. (2019) · LEUKOS The Journal of the Illuminating Engineering Society of North America · doi:10.1080/15502724.2018.1550365 · Cited by 44
“We commend the general guidance recently provided in the psychology community as providing useful information that can be applied to many lighting investigations (Appelbaum et al. 2018; Levitt et al. 2018).”
BackgroundRisk factors for being a victim of online grooming in adolescents
Schoeps, K., Montoya-Castilla, I., Garaigordobil, M., & Peris Hernández, M. (2020) · Psicothema · doi:10.7334/psicothema2019.179 · Cited by 43
“…of the study are presented following the standards proposed by the American Association of Psychology (APA) for quantitative research in psychology (Appelbaum et al., 2018) Results Associations between the variables of interest Descriptive statistics for asymmetry and curtosis (Table 1) were…”
O'Neil, M. E., Harik, J. M., McDonagh, M. S., Cheney, T. P., Hsu, F. C., Cameron, D. C., Carlson, K. F., Norman, S. B., & Hamblen, J. L. (2020) · Journal of Traumatic Stress · doi:10.1002/jts.22520 · Cited by 44
“This will be an important element of future systematic reviews and meta-analyses based on repository data (Appelbaum et al., 2018; Moher, Liberati, Tetzlaff, & Altman, 2009); as such, a risk-of-bias assessment is currently underway as part of the first annual update to the PTSDRepository.”
BackgroundCognitive-behavioral treatment for gambling harm: Umbrella review and meta-analysis
Pfund, R. A., Ginley, M. K., Kim, H. S. A., Boness, C. L., Horn, T. L., & Whelan, J. (2023) · Clinical Psychology Review · doi:10.1016/j.cpr.2023.102336 · Cited by 55
A systematic and meta-analytic review of the impact of sleep restriction on memory formation
Crowley, R., Alderman, E., Javadi, A., & Tamminen, J. (2024) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2024.105929 · Cited by 58
“We adhered to the MARS guidelines for meta-analytic reporting (Appelbaum et al., 2018).”
MethodAl-Jundi, S. A., Ali, M., Latan, H., & الجنابي, ه. ع. ا. (2020) · Sustainable Cities and Society · doi:10.1016/j.scs.2020.102316 · Cited by 41
Impacts to Larval Fathead Minnows Vary between Preconsumer and Environmental Microplastics
Bucci, K., Bikker, J., Stevack, K., Watson-Leung, T., & Rochman, C. (2022) · Environmental Toxicology and Chemistry · doi:10.1002/etc.5036 · Cited by 38
“In fact, reporting effect sizes has become standard practice in some disciplines (Appelbaum et al. 2018) and has been recommended as a best practice in all biological journals (Nakagawa and Cuthill 2007).”
BackgroundFawson, S., Moon, Z., Novogrudsky, K., Moxham, F., Forster, K., Tribe, I., Moss-Morris, R., Johnson, C., & Hughes, L. D. (2024) · Health Psychology Review · doi:10.1080/17437199.2023.2261518 · Cited by 40
“This systematic review and meta-analysis have been conducted in line with PRISMA 2020 (Page et al., 2021b) and JARS-Quant for reporting meta-analysis guidelines (Appelbaum et al., 2018).”
MethodMiller, C. B., Gu, J., Henry, A. L., Davis, M. L., Espie, C. A., Stott, R., Heinz, A. J., Bentley, K. H., Goodwin, G. M., Gorman, B. S., et al. (2021) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2020.101609 · Cited by 40
A reliability generalization meta‐analysis of self‐report measures of muscle dysmorphia.
Rubio‐Aparicio, M., Badenes‐Ribera, L., Sánchez‐Meca, J., Fabris, M. A., & Longobardi, C. (2020) · Clinical Psychology Science and Practice · doi:10.1111/cpsp.12303 · Cited by 45
Kalsoom, Q., & Qureshi, N. (2021) · International Journal of Sustainable Development & World Ecology · doi:10.1080/13504509.2021.1880983 · Cited by 51
“Since effect size is the index of practical significance of an intervention (Plonsky and Oswald 2014), its reporting has been suggested (APA 2010; Appelbaum et al. 2018).”
Backgroundvan den Akker, O. R., van Assen, M. A. L. M., Enting, M., de Jonge, M., Ong, H. H., Rüffer, F. F., Schoenmakers, M., Stoevenbelt, A. H., Wicherts, J. M., & Bakker, M. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231187988 · Cited by 51
“What could help to prevent this is a stricter adherence to existing reporting guidelines like CONSORT for biomedicine studies (Schulz et al., 2010) and JARS for psychology studies (Appelbaum et al., 2018).”
Dunst, C. J. (2023) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph20186723 · Cited by 51
“The American Psychological Association reporting standards were used to describe the results of each meta-analysis [69].”
MethodAn Integrative, Systematic Review of the Situational Judgment Test Literature
Kepes, S., Keener, S. K., Lievens, F., & McDaniel, M. A. (2024) · Journal of Management · doi:10.1177/01492063241288545 · Cited by 49
Effect Size Interpretation in Structural Equation Models
Flora, D. B., Crone, G., & Bell, S. M. (2025) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2025.2459768 · Cited by 45
“Although there are reporting standards listing the information to report from any SEM analysis (e.g., Appelbaum et al., 2018; Boomsma, 2000; McDonald & Ho, 2002), they do not address effect size directly.”
Humans reconfigure target and distractor processing to address distinct task demands.
Ritz, H., & Shenhav, A. (2024) · Psychological Review · doi:10.1037/rev0000442 · Cited by 36
McVey, A. J., Schiltz, H. K., Coffman, M., Antezana, L., & Magnus, B. (2022) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-021-05018-4 · Cited by 37
“Furthermore, studies varied in their collection and reporting of demographic data, limiting our ability to report these details to the recommended degree (Appelbaum et al., 2018).”
BackgroundNiu, L., Gao, Q., Xie, M., Yip, T., Gunnar, M. R., Wang, W., Xu, Q., Zhang, Y., & Lin, D. (2025) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2025.106124 · Cited by 48
Bootstrap Confidence Intervals for Multilevel Standardized Effect Size
Lai, M. H. C. (2020) · Multivariate Behavioral Research · doi:10.1080/00273171.2020.1746902 · Cited by 45
Harrington, N. G., Scott, A. M., & Spencer, E. A. (2020) · Social Science & Medicine · doi:10.1016/j.socscimed.2020.113084 · Cited by 39
Vaughn, S. R., Grills, A. E., Capin, P., Roberts, G., Fall, A., & Daniel, J. (2021) · Journal of Learning Disabilities · doi:10.1177/00222194211053225 · Cited by 48
“Consistent with journal article reporting standards for quantitative research (Appelbaum et al., 2018), Figure 1 depicts the flow of participants from screening through analyses.”
Spitzer, L., & Mueller, S. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281086 · Cited by 47
“For example, it may be advantageous to increase the fit between preregistration and manuscript by aligning the information in the preregistration with established journal article reporting standards like JARS-Quant [77], which is the case for the PRP-QUANT Template (available at https://doi.org/10.23668/ psycharchives…”
InfluentialSnapshots of daily life: Situations investigated through the lens of smartphone sensing.
Schoedel, R., Kunz, F., Bergmann, M., Bemmann, F., Bühner, M., & Sust, L. N. N. (2023) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000469 · Cited by 52
Empirical research methods department: Mission, learnings, and future plans
Shang, G., & Rönkkö, M. (2022) · Journal of Operations Management · doi:10.1002/joom.1171 · Cited by 43
Karin, E., Crane, M. F., Dear, B. F., Nielssen, O., Heller, G. Z., Kayrouz, R., & Titov, N. (2021) · JMIR Mental Health · doi:10.2196/22700 · Cited by 36
Longitudinal Job Crafting Research: A Meta-Analysis
Silapurem, L., Slemp, G. R., & Jarden, A. (2024) · International Journal of Applied Positive Psychology · doi:10.1007/s41042-024-00159-0 · Cited by 45
Metadata
- Authors
- Appelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M.
- Affiliations
- University of California San Diego (US)
- Duke University (US)
- Concordia University (US)
- Drexel University (US)
- Cleveland Clinic (US)
- Venue
- American Psychologist
- Published
- 2018-01
- Volume
- 73
- Issue
- 1
- Pages
- 3-25
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W2784576540
- Cited by
- 1,449
- References
- 35
- Citations by year
- 2026: 258 · 2025: 246 · 2024: 204 · 2023: 172 · 2022: 154 · 2021: 142 · 2020: 133 · 2019: 89 · 2018: 47
- FWCI
- 78.36
- Type
- journal article
- Language
- en
- Update notices
- correction (2018-10-04)
- Open access
- hybrid
- doi.org
- Locations
- American Psychologist (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- reporting guidelines, meta-analysis reporting, observational studies, clinical trials, longitudinal study, replication study, N-of-1 studies, structural equation modeling, Bayesian analysis, scientific publications
- MeSH terms
- Humans, Periodicals as Topic, Psychology, Research Design, Societies, Scientific, Peer Review, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.