Journal article reporting standards for quantitative research in psychology: The APA Publications and Communications Board task force report.
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Following a review of extant reporting standards for scientific publication, and reviewing 10 years of experience since publication of the first set of reporting standards by the American Psychological Association (APA; APA Publications and Communications Board Working Group on Journal Article Reporting Standards, 2008), the APA Working Group on Quantitative Research Reporting Standards recommended some modifications to the original standards. Examples of modifications include division of hypotheses, analyses, and conclusions into 3 groupings (primary, secondary, and exploratory) and some changes to the section on meta-analysis. Several new modules are included that report standards for observational studies, clinical trials, longitudinal studies, replication studies, and N-of-1 studies. In addition, standards for analytic methods with unique characteristics and output (structural equation modeling and Bayesian analysis) are included. These proposals were accepted by the Publications and Communications Board of APA and supersede the standards included in the 6th edition of the Publication Manual of the American Psychological Association (APA, 2010). (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A systematic search strategy was implemented (Appelbaum et al., 2018).”
From Cognitive and academic benefits of music training with children: A multilevel meta-analysis (2020) · cites this paper as Appelbaum et al., 2018
In the citing paper
“We designed the meta-analyses and report the results in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement (Moher et al., 2009) and the American Psychological Association's Quantitative Meta-Analysis Article Reporting Standards (Appelbaum et al., 2018).”
From Do growth mindset interventions impact students’ academic achievement? A systematic review and meta-analysis with recommendations for best practices. (2023) · cites this paper as Appelbaum et al., 2018
In the citing paper
“However, the relative novelty of conducting Bayesian analyses in applied fields means that there are no detailed reporting standards, and this in turn may frustrate the broader adoption and proper interpretation of the Bayesian framework.”
From The JASP guidelines for conducting and reporting a Bayesian analysis (2021) · cites this paper as Appelbaum et al., 2018
In the citing paper
“These methods are necessary to produce unbiased and more reliable estimates (Appelbaum et al., 2018).”
From The cognitive and academic benefits of Cogmed: A meta-analysis (2019) · cites this paper as Appelbaum et al., 2018
Citations
Cites
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Cook, R. J., Dickens, B. M., & Fathalla, M. F. (2003) · Reproductive Health and Human Rights · doi:10.1093/acprof:oso/9780199241323.003.0025 · Cited by 10,769
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
A Beginner's Guide to Structural Equation Modeling: Fourth Edition
Schumacker, R. E., & Lomax, R. G. (2015) · doi:10.4324/9781315749105 · Cited by 6,604
Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72351 · Cited by 6,277
(2016) · Cited by 3,399
Self-citationStandards for Educational and Psychological Testing
(2007) · Encyclopedia of Measurement and Statistics · doi:10.4135/9781412952644.n432 · Cited by 3,126
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Picton, T. W., Bentin, S., Berg, P., Donchin, E., Hillyard, S. A., Johnson, R., Miller, G. A., Ritter, W., Ruchkin, D. S., Rugg, M. D., et al. (2000) · Psychophysiology · doi:10.1111/1469-8986.3720127 · Cited by 2,157
Cited by
Items 401–500 of 1,002
van den Berg, E. M., Schlochtermeier, D., Koenders, J., de Mooij, L. D., de Jonge, M., Goudriaan, A. E., Blankers, M., Peen, J., & Dekker, J. (2022) · Journal of Eating Disorders · doi:10.1186/s40337-021-00526-1 · Cited by 21
“The Journal Article Reporting Standards [32], the Strengthening the Reporting of Observational Studies in Epidemiology statement [33] and the Consolidated Health Economic Evaluation Reporting Standards statement [34] were used for study design and reporting of the results.”
MethodStrengths and Weaknesses of Meta-Analyses
Corker, K. S. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780190938550.003.0006 · Cited by 18
Woods, S. P., Mustafa, A. I., Beltran‐Najera, I., Matchanova, A., Thompson, J. L., & Ridgely, N. C. (2023) · Journal of the International Neuropsychological Society · doi:10.1017/s1355617723000127 · Cited by 15
Getting published: Suggestions and strategies from editors of sport and exercise psychology journals
Schinke, R. J., Mellalieu, S. D., Ntoumanis, N., Kavussanu, M., Standage, M., Strauß, B., & Papaioannou, A. G. (2020) · Journal of Applied Sport Psychology · doi:10.1080/10413200.2020.1741725 · Cited by 19
“…to be addressed in the Introduction; within this section we elaborate on pertinent guidelines from the Journal Article Reporting Standards for studies that report new quantitative (JARS-Quant), qualitative (JARS-Qual), and mixed methods research (cf. Appelbaum et al., 2018; Levitt et al., 2018).”
BackgroundMethodHiggins, W. C., Savalei, V., Polito, V., & Ross, R. M. (2025) · Assessment · doi:10.1177/10731911251328604 · Cited by 17
“More broadly, our findings underscore the importance of routinely reporting sample-specific evidence for the structural properties of test scores (Appelbaum et al., 2018), which provides a key source of information for assessing the credibility of research findings.”
Jańczak, M. O., & Soroko, E. (2025) · Scientific Reports · doi:10.1038/s41598-025-96067-7 · Cited by 15
“Adhering to the Journal Article Reporting Standards 41 , all the data and research materials are available online.”
Sample size practices and guidelines in services marketing survey research
Ali, F. (2026) · Service Industries Journal · doi:10.1080/02642069.2026.2612706 · Cited by 23
Filho, E. (2020) · Journal of Clinical Sport Psychology · doi:10.1123/jcsp.2019-0054 · Cited by 16
Greene, J. A., Chinn, C. A., & Deekens, V. M. (2021) · Journal of the Learning Sciences · doi:10.1080/10508406.2020.1860992 · Cited by 20
“There are some common norms for research methods in psychology (e.g., Appelbaum et al., 2018; Levitt et al., 2018), but the subdisciplines within psychology do vary in terms of specific sociological knowledge of the field and social practices (see Collins, 2014, for a discussion of sociological…”
BackgroundKabir, R., Doku, D., & Wiium, N. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.676376 · Cited by 11
Smith, A. R., Witte, T. K., Troop‐Gordon, W., Grunewald, W., Crosby, E. S., Hill, K., Williams, T., Kinkel‐Ram, S. S., Santivasci, C. A., Chamberlin, J. M., et al. (2023) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12994 · Cited by 17
da Silva, J. L. G., Costa, T. P. D. P., & Castro, F. N. (2023) · Personality and Individual Differences · doi:10.1016/j.paid.2023.112489 · Cited by 18
Fernández‐Castilla, B., Said‐Metwaly, S., Kreitchmann, R. S., & Noortgate, W. V. D. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02373-9 · Cited by 17
“Numerous guidelines for conducting and reporting quantitative research are available and endorsed (e.g., Appelbaum et al., 2018).”
BackgroundHallford, D. J., Austin, D., Takano, K., Yeow, J. J. E., Rusanov, D., Fuller‐Tyszkiewicz, M., & Raes, F. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.04.078 · Cited by 15
Expósito-Álvarez, C., Roldán-Pardo, M., Gilchrist, G., & Lila, M. (2024) · Psychosocial Intervention · doi:10.5093/pi2024a13 · Cited by 15
“The guidelines outlined in the Journal Article Reporting Standards (JARS; Applebaum et al., 2018) were adhered to.”
Adaptiveness of emotion regulation flexibility according to long-term implications
Pruessner, L., & Ortner, C. N. M. (2025) · Journal of Affective Disorders · doi:10.1016/j.jad.2025.02.114 · Cited by 17
Gadaire, D. M., & Kilmer, R. P. (2020) · Journal of Evidence-Based Social Work · doi:10.1080/26408066.2020.1724226 · Cited by 14
Cho, S.-H., & Shin, I. (2021) · Healthcare · doi:10.3390/healthcare9101368 · Cited by 16
“Independent assumptions comprise two issues: first, whether the same sample was used twice or not, and second, how more than one effect size was treated in calculating an effect size for MA [40].”
BackgroundMethodInfluentialMorán, N. A. P., Guevara, R., & Armijos, M. (2022) · International Journal of Economics and Business Administration · doi:10.35808/ijeba/764 · Cited by 24
“Subsequently, the results are reported according to the reporting standards for non-experimental studies (Appelbaum et al., 2018).”
ResultItem-Level Psychometric Analysis of the Psychosocial Processes at Work Scale (PROPSIT) in Workers
Merino‐Soto, C., García, A. J., Escudero, G. S., & Toledano‐Toledano, F. (2022) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19137972 · Cited by 14
“In the creation and/or adaptation phase of the measures, detailed univariate item information is considered good practice for reporting quantitative results and serves to better understand the quantitative functioning of the scales or tests, and for the characterization of the measured construct [1,2].”
MethodSelf-relevant appeals to engage in self-monitoring of alcohol use: A microrandomized trial.
Carpenter, S. M., Yap, J. R. T., Patrick, M. E., Morrell, N., Dziak, J. J., Almirall, D., Yoon, C., & Nahum-Shani, I. B. (2022) · Psychology of Addictive Behaviors · doi:10.1037/adb0000855 · Cited by 17
Low Prevalence of A Priori Power Analyses in Motor Behavior Research
McKay, B., Corson, A. E., Vinh, M.-A., Jeyarajan, G., Tandon, C., Brooks, H., Hubley, J., & Carter, M. J. (2022) · Journal of Motor Learning and Development · doi:10.1123/jmld.2022-0042 · Cited by 16
Martin, M., Steele, B., Spreckelsen, T. F., Lachman, J. M., Gardner, F. E. M., & Shenderovich, Y. (2023) · Prevention Science · doi:10.1007/s11121-023-01515-3 · Cited by 19
“The revised Meta-Analysis Reporting Standards was followed where possible (Appelbaum et al., 2018).”
MethodIs Biological Death Final? Recomputing the Drake-S Equation for Postmortem Survival of Consciousness
Rock, A. J., Houran, J., Tressoldi, P. E., & Laythe, B. R. (2023) · International Journal of Transpersonal Studies · doi:10.24972/ijts.2023.42.1.9 · Cited by 14
“Following the APA guidelines for metaanalysis and systematic reviews (Appelbaum et al., 2018; Page et al., 2021), we searched for pertinent studies with exceptional subjects via the Google Scholar database, which is considered more inclusive than other scientific databases such as PubMed or Scopus,…”
MethodPublishing Open, Reproducible Research With Undergraduates
Strand, J. F., & Brown, V. A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00564 · Cited by 17
Ballester, A. M. J., de la Barrera, U., Schoeps, K., & Montoya‐Castilla, I. (2022) · Behavioral Psychology/Psicología Conductual · doi:10.51668/bp.8322113n · Cited by 20
Akrong, G. B., Shao, Y., & Owusu, E. (2022) · Africa Journal of Management · doi:10.1080/23322373.2022.2155116 · Cited by 13
“…because individuals place varying degrees of emphasis on technology usage, they frequently oppose the implementation of such systems when the expected bene fi ts are not immediately apparent or when the system introduces a large amount of di ffi culty (Appelbaum et al., 2018; Roky & Al Meriouh, 2015).”
BackgroundBias in Student Ratings of Instruction: A Systematic Review of Research from 2012 to 2021
Stoesz, B. M., Jaeger, A. E. D., Quesnel, M. S., Bhojwani, D., & Los, R. (2023) · Canadian Journal of Educational Administration and Policy · doi:10.7202/1095482ar · Cited by 13
“Regardless, to strengthen research reports on SRIs, authors must adhere to reporting standards (Appelbaum et al., 2018).”
BackgroundMethodInfluentialDunst, C. J. (2022) · International Journal of Health and Psychology Research · doi:10.37745/ijhpr.13/vol10n4122 · Cited by 20
Dynamic Fit Index Cutoffs for Hierarchical and Second-Order Factor Models
McNeish, D., & Manapat, P. D. (2023) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705511.2023.2225132 · Cited by 17
“Alternatively, evaluation of local fit by — for instance – inspecting the standardized residual correlation matrix may be useful (Appelbaum et al., 2018; McDonald & Ho, 2002, p. 73).”
BackgroundCategory learning in autistic individuals: A meta-analysis
Wimmer, L., Steininger, T. M., Schmid, A., & Wittwer, J. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-023-02365-4 · Cited by 16
“We adhered to the MARS guidelines for meta-analytic reporting (Appelbaum et al., 2018).”
Gnambs, T., & Schroeders, U. (2023) · Research Synthesis Methods · doi:10.1002/jrsm.1673 · Cited by 15
“Because reporting practices in psychology and other behavioral sciences often do not follow prevalent recommendations, 9 necessary information to adequately aggregate meta-analytic results is often missing.”
BackgroundBustamante, J., Soto, M., Míguez, G., Quezada-Scholz, V. E., Angulo, R., & Laborda, M. A. (2023) · Learning & Behavior · doi:10.3758/s13420-023-00609-w · Cited by 16
“The present research synthesis was performed following PRISMA and APA recommendations for conducting and reporting meta-analytical studies (Appelbaum et al., 2018; Cooper, 2017, 2018; Moher et al., 2009; Page et al., 2021).”
Introducing SoNHR–Reporting guidelines for Social Networks In Health Research
Luke, D. A., Tsai, E., Carothers, B. J., Malone, S. M., Prusaczyk, B., Combs, T., Vogel, M. T., Neal, J. W., & Neal, Z. P. (2023) · PLoS ONE · doi:10.1371/journal.pone.0285236 · Cited by 15
Health-related quality of life in family caregivers of autistic adults
Dückert, S., Bart, S., Gewohn, P., König, H., Schöttle, D., Konnopka, A., Rahlff, P., Erik, F., Vogeley, K. T., Schulz, H., et al. (2023) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2023.1290407 · Cited by 15
Reporting checklists in neuroimaging: promoting transparency, replicability, and reproducibility
Ekhtiari, H., Zare-Bidoky, M., Sangchooli, A., Valyan, A., Abi‐Dargham, A., Cannon, D. M., Carter, C. S., Garavan, H., George, T. P., Ghobadi‐Azbari, P., et al. (2024) · Neuropsychopharmacology · doi:10.1038/s41386-024-01973-5 · Cited by 15
Moldes, O., Zaleśkiewicz, T., & Gąsiorowska, A. (2024) · Journal of Consumer Behaviour · doi:10.1002/cb.2409 · Cited by 14
Reiner, A., Gioannis, E. D., & Steinhoff, P. (2025) · Aging & Mental Health · doi:10.1080/13607863.2025.2468892 · Cited by 20
“Additionally, the reporting of this meta-analysis follows the Journal Article Reporting Standards guidelines (Appelbaum et al., 2018), particularly suited for psychological research.”
Zhou, S., Li, H., Yang, Y., Qi, Y., Liu, W., Mo, L., & Wong, C. L. (2025) · BMC Complementary Medicine and Therapies · doi:10.1186/s12906-025-04866-2 · Cited by 23
“The Cochrane Handbook for Systematic Reviews of Interventions [25], preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines ( http:// www. prisma-state ment. org/ ), and APA’s Meta-Analysis Reporting Methods (MARS) [6] were applied to guide this systematic review.”
Statistical Perspectives on Reproducibility: Definitions and Challenges
Simkus, A., Coolen‐Maturi, T., Coolen, F. P. A., & Bendtsen, C. (2025) · Journal of Statistical Theory and Practice · doi:10.1007/s42519-025-00459-x · Cited by 15
“A detailed manual about journal reporting in quantitative research in psychology can be found in Appelbaum et al. [6].”
Pluess, M., Aron, E. N., Kähkönen, J. E., Lionetti, F., Huang, Y. P., Tillmann, T., Greven, C. U., & Aron, A. (2026) · Personality and Individual Differences · doi:10.1016/j.paid.2026.113782 · Cited by 15
Writing Quantitative Empirical Manuscripts With Rigor and Flair (Yes, It’s Possible)
Fallon, M. (2018) · Psi Chi Journal of Psychological Research · doi:10.24839/2325-7342.jn23.3.184 · Cited by 13
“You will learn a lot about what goes into a good manuscript, informed by the American Psychological Association’s Publication Manual (American Psychological Association, 2010) and the most recent Journal Article Reporting Standards (Appelbaum et al., 2018).”
BackgroundMethodInfluentialCook, G. M., Fletcher, D., & Peyrebrune, M. (2020) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2020.101876 · Cited by 18
Dunst, C. J. (2020) · Journal of Family Research · doi:10.20377/jfr-578 · Cited by 19
“The American Psychological Association Reporting Standards for Quantitative Meta-Analyses were used to structure the conduct of the research synthesis and to report the results from the meta-analysis (Appelbaum et al., 2018).”
MethodTressoldi, P. E., & Storm, L. (2021) · F1000Research · doi:10.12688/f1000research.51746.1 · Cited by 14
“Methods Reporting guidelines This study follows the guidelines of the APA Meta-Analysis Reporting Standard (Appelbaum et al., 2018) and the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P, Moher et al.”
MethodStorm, L., & Tressoldi, P. E. (2023) · Journal of Scientific Exploration · doi:10.31275/20232967 · Cited by 13
“We followed the APA meta-analysis reporting standards guideline (MARS, Appelbaum et al., 2018).”
MethodPromoting Quality of Mixed Methods Consultation Research: A Synergistic Participatory Framework
Nastasi, B. K., Hitchcock, J. H., Gutierrez, R., & Oshrin, S. J. (2021) · Journal of Educational and Psychological Consultation · doi:10.1080/10474412.2021.1887743 · Cited by 13
“Another recommended resource is the APA standards for reporting quality/validity of various quantitative research designs as described in Appelbaum et al. (2018) and in the APA (2020) publication manual (see also JARS webpage, https://apastyle.apa.org/jars).”
BackgroundMethodBošnjak, M., Fiebach, C. J., Mellor, D. T., Mueller, S., O'Connor, D. B., Oswald, F. L., & Sokol, R. I. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/d7m5r · Cited by 14
“Some key elements of the template reinforce recommendations of JARS-Quant (Appelbaum et al., 2018); namely, having clear sampling procedures, providing an analytic strategy for primary, secondary, and exploratory hypotheses, and providing a clear description of statistics and data analysis, including how missing data…”
BackgroundMethodInfluentialOsatuyi, B., & Dennis, A. R. (2025) · Information Systems Frontiers · doi:10.1007/s10796-025-10613-2 · Cited by 14
“We report how we determined our sample size, all data exclusions (if any), all manipulations, and all measures in the study, and we follow JARS (Appelbaum et al., 2018).”
Kim, E. J., Park, S. M., & Kang, H. W. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.733200 · Cited by 12
Dunst, C. J. (2022) · European Journal of Psychology and Educational Research · doi:10.12973/ejper.5.1.11 · Cited by 13
“83 Ardic and Olcay (2021) 1 32 NR Carmo (2004) 1 32 .94 Cate et al. (2002) 1 33 .93 Engstrand et al. (2020) 1 41 .82 Bertule and Vetra (2020) 2 41 .81 Dell’Armi (2017) Family Needs Scale 3 41 .95 Dunst et al. (1987) Family Needs Scale-Adapted Version 1 23 .93 Unger et al. (2001) Family Needs Questionnaire 1 54 .”
BackgroundMethodInfluentialChaniaud, N., Sagnier, C., & Loup‐Escande, É. (2022) · JMIR Formative Research · doi:10.2196/36777 · Cited by 14
“To conduct the translation, adaptation, and validation of eHEALS [7], we followed the American Psychological Association guidelines [52] and the 5 steps recommended by Vallerand [53]: translation, validation with experts, pretest measurement, administration of the tool, and test-retesting.”
MethodLiddelow, C., Mullan, B. A., Boyes, M. E., & Ling, M. (2022) · Health Psychology Review · doi:10.1080/17437199.2022.2127831 · Cited by 15
“The APA Journal Article Reporting Standards Quantitative (JARS-Quant; Appelbaum et al., 2018) which provides guidelines for quantitative articles, including meta-analysis, was also followed.”
MethodBrown, M. P., Ng, R., Lisle, J., Koenig, M. A., Sannes, D., Rogosch, F. A., & Cicchetti, D. (2023) · Developmental Psychology · doi:10.1037/dev0001506 · Cited by 15
Beck, A. K., Baker, A., Britton, B., Lum, A., Pohlman, S., Forbes, E., Moore, L., Barnoth, D., Perkes, S. J., Oldmeadow, C. J., et al. (2023) · British Journal of Health Psychology · doi:10.1111/bjhp.12664 · Cited by 14
“(Appelbaum et al., 2018).”
Badovinac, S. D., Chow, C. H. T., Lorenzo-Klas, M. G. D., Edgell, H., Flora, D. B., & Riddell, R. P. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105229 · Cited by 15
Mack, D. E., Vo, K. T., & Wilson, P. M. (2024) · Journal of Happiness Studies · doi:10.1007/s10902-024-00715-0 · Cited by 15
“Reliability evidence from existing research should be offered to support decision making for instrument selec - tion (Appelbaum et al., 2018).”
Susperreguy, M. I., Burr, S. D. L., Xu, C., Douglas, H. P., Bourque, T., del Río, M. F., Salinas, V., & LeFevre, J. (2024) · Cognitive Development · doi:10.1016/j.cogdev.2024.101441 · Cited by 13
Kane, A. A., & Emich, K. J. (2024) · Group & Organization Management · doi:10.1177/10596011241282703 · Cited by 15
“These recommendations are incorporated into American Psychological Association (APA) reporting standards for quantitative research (Appelbaum et al., 2018) and are featured prominently in the latest APA publication manual (2020, pp. 87 – 89).”
Malipeddi, S., Sasidharan, A., Ravindra, P. N., Mehrotra, S., John, J. P., & Kutty, B. M. (2024) · Mindfulness · doi:10.1007/s12671-024-02466-8 · Cited by 13
“Statistical reporting adhered to the guidelines of the American Psychological Association (Appelbaum et al., 2018), as implemented in the ggstatsplot package (Patil, 2021).”
A Systematic Review on the Evolution of Power Analysis Practices in Psychological Research
Vankelecom, L., Schacht, O., Laroy, N., Loeys, T., & Moerkerke, B. (2025) · Psychologica Belgica · doi:10.5334/pb.1318 · Cited by 19
Nagendra, A., Orleans-Pobee, M., Spahnn, R., Monette, M. A., Sosoo, E. E., Pinkham, A. E., & Penn, D. L. (2020) · Journal of Mental Health · doi:10.1080/09638237.2020.1837356 · Cited by 13
“It is striking that, despite clear standards for reporting race and ethnicity in sample descriptions (American Psychological Association, 2008; Appelbaum et al., 2018) research papers neglect to do this approximately 40% of the time.”
BackgroundReporting Quality in Math Meta-Analyses for Students with or at Risk of Disabilities
Nelson, G., Park, S., Brafford, T. L., Heller, N. A., Crawford, A., & Drake, K. R. (2021) · Exceptional Children · doi:10.1177/00144029211050851 · Cited by 12
Dunst, C. J. (2021) · Journal of Psychology and Behavioral Science · doi:10.15640/jpbs.v9n1a5 · Cited by 15
“The guidelines and reporting standards described by Appelbaum et al. (2018) and Siddaway et al. (2019) were used to conduct the meta-analysis and report the results from the research synthesis.”
MethodImproving the reporting of sport imagery interventions with TIDieR
Cumming, J., & Quinton, M. L. (2022) · Asian Journal of Sport and Exercise Psychology · doi:10.1016/j.ajsep.2022.07.003 · Cited by 13
Lawson, D. O., Wang, M. K., Kim, K. S., Eikelboom, R., Rodrigues, M., Trapsa, D., Thabane, L., & Moher, D. (2022) · Trials · doi:10.1186/s13063-022-06624-y · Cited by 12
“He reflects on how this work has influenced similar movements for transparent reporting in other fields including evolutionary biology and ecology [6] and psychology [7, 8] for example.”
BackgroundProfile of Junior High School Students’ Scientific Literacy
Wahab, M. N. N. D., Wasis, W., & Yuliani, Y. (2023) · IJORER International Journal of Recent Educational Research · doi:10.46245/ijorer.v4i2.292 · Cited by 12
Reducing suicidal ideation in African American adolescents: A randomized controlled clinical trial.
Robinson, W. L., Whipple, C. R., Keenan, K. E., Flack, C. E., Lemke, S., & Jason, L. A. (2023) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000849 · Cited by 16
Day, M. A., Ehde, D. M., Bindicsova, I., & Jensen, M. P. (2023) · Journal of Pain · doi:10.1016/j.jpain.2023.10.007 · Cited by 13
Ferguson, S. L., Kerrigan, M. R., & Hovey, K. A. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1436 · Cited by 17
“Quality standards from quantitative, qualitative, and mixed methods approaches may all apply and should be evaluated as appropriate to the SMSR approach used.(33,34,50) What validity and reliability evidence is appropriate for the quantitative strand of the review, and how is it supported? What elements of trustworthi…”
MethodA Reliability Generalization Meta-analysis of the Dimensional Obsessive-Compulsive Scale
López‐Nicolás, R., Rubio‐Aparicio, M., López‐Ibáñez, C., & Sánchez‐Meca, J. (2021) · Psicothema · doi:10.7334/psicothema2020.455 · Cited by 15
Evans, C., Paz, C., & Mascialino, G. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.695893 · Cited by 13
Towards the enhancement of quality publication practices in clinical psychological science
Waters, A. M., LeBeau, R. T., Young, K. S., Dowell, T. L., & Ryan, K. M. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2019.103499 · Cited by 14
Shared Reality Can Reduce Stressor Reactivity
Goldring, M. R., Pinelli, F., Bolger, N., & Higgins, E. T. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.853750 · Cited by 11
“For both studies, we specify how we determined our sample size, manipulations, measures, and other standards set forth in the Open Science movement (see Appelbaum et al., 2018).”
MethodGibbons, M. B. C., Duong, L. A., Zoupou, E., Kashden, J., Fisher, J., & Crits-Christoph, P. F. (2023) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000807 · Cited by 13
Correcting for outcome reporting bias in a meta-analysis: A meta-regression approach
van Aert, R. C. M., & Wicherts, J. M. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02132-2 · Cited by 20
“The meta-analytic reporting standards (MARS, Appelbaum et al. 2018) of the American Psychological Association and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA, Moher et al., 2009) both advise researchers to address the risk of biases such as ORB in any…”
MethodKeener, S. K., Kepes, S., & Torka, A. (2023) · Acta Psychologica · doi:10.1016/j.actpsy.2023.104005 · Cited by 14
Spence, J. R., & Stanley, D. J. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231217932 · Cited by 14
“Indeed, the APA Journal Article Reporting Standards (Appelbaum et al., 2018) requires the use of bias-detection techniques.”
MethodLegate, A. E., Nimon, K., & Noblin, A. (2024) · F1000Research · doi:10.12688/f1000research.151493.1 · Cited by 15
“In these fields, data elements targeted for extraction would rarely align with the PICO framework, but rather, meta-analytic endeavors would entail extraction of measures such as effect sizes, model fit indices, or instrument psychometric properties (Appelbaum et al., 2018).”
MethodMeine, L. E., Müller-Bardorff, M., Recher, D., Paersch, C., Schulz, A., Spiller, T. R., Galatzer‐Levy, I. R., Kowatsch, T., Fisher, A. J., & Kleim, B. (2024) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2024.102914 · Cited by 17
Using DNA to Predict Education: a Meta-analytic Review
Wilding, K., Wright, M., & von Stumm, S. (2024) · Educational Psychology Review · doi:10.1007/s10648-024-09928-4 · Cited by 15
Monson, A., James, R. J. E., Wootton, R. E., & Newall, P. W. S. (2024) · Psychology of Addictive Behaviors · doi:10.1037/adb0001036 · Cited by 17
Higgins, W. C., Kaplan, D. M., Deschrijver, E., & Ross, R. M. (2024) · Clinical Psychology Review · doi:10.1016/j.cpr.2024.102530 · Cited by 11
Mües, H. M., Markert, C., Feneberg, A. C., & Nater, U. M. (2025) · Annals of Behavioral Medicine · doi:10.1093/abm/kaaf007 · Cited by 13
Moscatelli, S., Mazzuca, S., Menegatti, M., & Rubini, M. (2025) · Sex Roles · doi:10.1007/s11199-025-01573-7 · Cited by 14
“For both studies, we report how we determined all data exclusions, sample size, manipulations, and measures, consistent with reporting standards for quantitative research (Appelbaum et al., 2018).”
Insufficient Effort Responding in Management Research: A Critical Review and Future Directions
Huang, J. L. W., Wang, Z., Huang, R., Wu, D., & Shi, H. (2025) · Journal of Management · doi:10.1177/01492063251330268 · Cited by 16
de Zárate, A. G. O., García, M. A. A., Gómez-Flechoso, M. Á., & Aliagas, I. (2025) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2025.102676 · Cited by 15
McNeish, D. (2025) · Annual Review of Psychology · doi:10.1146/annurev-psych-121924-104021 · Cited by 17
The persuasive effects of narrative entertainment: a meta-analysis of recent experiments
Rahmani, B., Montano, B., Groves, D. W., & GREEN, D. P. (2025) · Behavioural Public Policy · doi:10.1017/bpp.2025.10010 · Cited by 17
Montgomery, P., & Weisman, C. B. (2020) · Children and Youth Services Review · doi:10.1016/j.childyouth.2020.105642 · Cited by 12
Zhu, Z., Tomassetti, A. J., Dalal, R., Schrader, S. W., Loo, K. J., Sabat, I., Alaybek, B., Zhou, Y., Jones, C., & Fyffe, S. (2021) · Organizational Research Methods · doi:10.1177/10944281211011529 · Cited by 9
“The flow diagram summarizing the study identification and evaluation process (Appelbaum et al., 2018; Moher et al., 2009) can be seen in Figure 2.”
BackgroundAccumulating Knowledge in the Organizational Sciences
Bosco, F. A. (2021) · Annual Review of Organizational Psychology and Organizational Behavior · doi:10.1146/annurev-orgpsych-012420-090657 · Cited by 14
A revised and expanded taxonomy for understanding heterogeneity in research and reporting practices.
Manapat, P. D., Anderson, S. F., & Edwards, M. C. (2022) · Psychological Methods · doi:10.1037/met0000488 · Cited by 11
Fang, Z., Lachman, J. M., Qiao, D., & Barlow, J. (2022) · Psychosocial Intervention · doi:10.5093/pi2022a9 · Cited by 13
Meuer, M., Oeberst, A., & Imhoff, R. (2022) · European Journal of Social Psychology · doi:10.1002/ejsp.2903 · Cited by 14
Comprehensive Prevention: An Evaluation of Peripheral Outcomes of a School-based Prevention Program
Seely, H. D., Gaskins, J., Pössel, P., & Hautzinger, M. (2023) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-023-01043-2 · Cited by 12
“We report all data collection procedures, manipulations, and measures used for the purpose of this article, and we follow the Journal Article Reporting Standards (JARS; Appelbaum et al., 2018).”
MethodKaspar, R., Wahl, H., & Diehl, M. K. (2023) · Innovation in Aging · doi:10.1093/geroni/igad044 · Cited by 14
“We report how the sample size was determined, describe all data exclusions, manipulations, and all measures in the study, and follow the Journal Article Reporting Standards (JARS; Appelbaum et al., 2018).”
MethodBurns, E. J. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02459-4 · Cited by 13
“Data was not collected on participants’ other cultural backgrounds (e.g., socioeconomic status; Appelbaum et al., 2018).”
BackgroundHeo, M., Nair, S., Wylie‐Rosett, J., Faith, M. S., Pietrobelli, A., Glassman, N. R., Martin, S. N., Dickinson, S., & Allison, D. B. (2018) · Journal of Obesity · doi:10.1155/2018/8767315 · Cited by 11
“Separate reports were made for quantitative studies [26], as well as qualitative, meta-analytic, and mixed-methods research [27].”
BackgroundSima, A. P., Rodriguez, V. A., Bradbrook, K. E., DiPace, B. S., & Okhomina, V. I. (2020) · Journal of Clinical and Translational Science · doi:10.1017/cts.2020.527 · Cited by 11
“Week 1 Description of productive collaborative relationships [19–21] Strategies to achieve productive collaborative relationships [22–25] Written communication skills [26,27] Ethics [28–30] BCL policies and procedures”
Metadata
- Authors
- Appelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M.
- Affiliations
- University of California San Diego (US)
- Duke University (US)
- Concordia University (US)
- Drexel University (US)
- Cleveland Clinic (US)
- Venue
- American Psychologist
- Published
- 2018-01
- Volume
- 73
- Issue
- 1
- Pages
- 3-25
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W2784576540
- Cited by
- 1,449
- References
- 35
- Citations by year
- 2026: 258 · 2025: 246 · 2024: 204 · 2023: 172 · 2022: 154 · 2021: 142 · 2020: 133 · 2019: 89 · 2018: 47
- FWCI
- 78.36
- Type
- journal article
- Language
- en
- Update notices
- correction (2018-10-04)
- Open access
- hybrid
- doi.org
- Locations
- American Psychologist (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- reporting guidelines, meta-analysis reporting, observational studies, clinical trials, longitudinal study, replication study, N-of-1 studies, structural equation modeling, Bayesian analysis, scientific publications
- MeSH terms
- Humans, Periodicals as Topic, Psychology, Research Design, Societies, Scientific, Peer Review, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.