Journal article reporting standards for quantitative research in psychology: The APA Publications and Communications Board task force report.
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Following a review of extant reporting standards for scientific publication, and reviewing 10 years of experience since publication of the first set of reporting standards by the American Psychological Association (APA; APA Publications and Communications Board Working Group on Journal Article Reporting Standards, 2008), the APA Working Group on Quantitative Research Reporting Standards recommended some modifications to the original standards. Examples of modifications include division of hypotheses, analyses, and conclusions into 3 groupings (primary, secondary, and exploratory) and some changes to the section on meta-analysis. Several new modules are included that report standards for observational studies, clinical trials, longitudinal studies, replication studies, and N-of-1 studies. In addition, standards for analytic methods with unique characteristics and output (structural equation modeling and Bayesian analysis) are included. These proposals were accepted by the Publications and Communications Board of APA and supersede the standards included in the 6th edition of the Publication Manual of the American Psychological Association (APA, 2010). (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A systematic search strategy was implemented (Appelbaum et al., 2018).”
From Cognitive and academic benefits of music training with children: A multilevel meta-analysis (2020) · cites this paper as Appelbaum et al., 2018
In the citing paper
“We designed the meta-analyses and report the results in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement (Moher et al., 2009) and the American Psychological Association's Quantitative Meta-Analysis Article Reporting Standards (Appelbaum et al., 2018).”
From Do growth mindset interventions impact students’ academic achievement? A systematic review and meta-analysis with recommendations for best practices. (2023) · cites this paper as Appelbaum et al., 2018
In the citing paper
“However, the relative novelty of conducting Bayesian analyses in applied fields means that there are no detailed reporting standards, and this in turn may frustrate the broader adoption and proper interpretation of the Bayesian framework.”
From The JASP guidelines for conducting and reporting a Bayesian analysis (2021) · cites this paper as Appelbaum et al., 2018
In the citing paper
“These methods are necessary to produce unbiased and more reliable estimates (Appelbaum et al., 2018).”
From The cognitive and academic benefits of Cogmed: A meta-analysis (2019) · cites this paper as Appelbaum et al., 2018
Citations
Cites
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Cook, R. J., Dickens, B. M., & Fathalla, M. F. (2003) · Reproductive Health and Human Rights · doi:10.1093/acprof:oso/9780199241323.003.0025 · Cited by 10,769
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
A Beginner's Guide to Structural Equation Modeling: Fourth Edition
Schumacker, R. E., & Lomax, R. G. (2015) · doi:10.4324/9781315749105 · Cited by 6,604
Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72351 · Cited by 6,277
(2016) · Cited by 3,399
Self-citationStandards for Educational and Psychological Testing
(2007) · Encyclopedia of Measurement and Statistics · doi:10.4135/9781412952644.n432 · Cited by 3,126
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Picton, T. W., Bentin, S., Berg, P., Donchin, E., Hillyard, S. A., Johnson, R., Miller, G. A., Ritter, W., Ruchkin, D. S., Rugg, M. D., et al. (2000) · Psychophysiology · doi:10.1111/1469-8986.3720127 · Cited by 2,157
Cited by
Items 301–400 of 1,002
Cognitive ability and creativity: Typology contributions and a meta-analytic review
Serban, A., Kepes, S., Wang, W., & Baldwin, R. (2023) · Intelligence · doi:10.1016/j.intell.2023.101757 · Cited by 26
Sherman, A. D. F., Higgins, M. K., Balthazar, M. S., Hill, M., Klepper, M., Schneider, J. S., Adams, D., Radix, A., Mayer, K. H., Cooney, E. E., et al. (2024) · Journal of Nursing Scholarship · doi:10.1111/jnu.12906 · Cited by 21
“To improve transparency and openness, we reported how we arrived at our sample size, all data exclusions, all manipulations, and all measures in the study, and we followed Journal Article Reporting Standards for Quantitative Research in Psychology (Appelbaum et al., 2018; Kazak, 2018).”
MethodHughes, Z. D., Ball, L. J., Richardson, C., & Judge, J. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-023-02327-w · Cited by 26
“We adhered to the Meta-Analytic Reporting Standards (MARS) for meta-analytic reporting (Appelbaum et al., 2018).”
MethodRubio‐Aparicio, M., Núñez, R. M. N., Sánchez‐Meca, J., Pina, J. A. L., Marín‐Martínez, F., & López-López, J. A. (2018) · Journal of Personality Assessment · doi:10.1080/00223891.2018.1483378 · Cited by 24
“…more recently, the reporting standards of the American Psychological Association specifically recommended for quantitative studies: “Estimate and report values of reliability coefficients for the scores analyzed (i.e., the researcher’s sample), if possible” (Appelbaum et al., 2018, Table 1, p. 7).”
BackgroundSchuster, R., Kaiser, T., Terhorst, Y., Meßner, E.-M., Strohmeier, L.-M., & Laireiter, A. (2021) · Psychological Medicine · doi:10.1017/s003329172100129x · Cited by 31
Canivez, G. L., von der Embse, N. P., & McGill, R. J. (2021) · School Psychology · doi:10.1037/spq0000444 · Cited by 25
“While Appelbaum et al. (2018) published important reporting standards necessary for journal publications, these same standards should also apply to test publishers in full disclosure of critical psychometric properties in test manuals.”
BackgroundMethodHarman and Lorandos’ false critique of Meier et al.’s family court study
Meier, J. S., Dickson, S., O’Sullivan, C. S., & Rosen, L. N. (2022) · Journal of Family Trauma Child Custody & Child Development · doi:10.1080/26904586.2022.2086659 · Cited by 21
Muris, P., Otgaar, H., Donkers, F. C. L., Ollendick, T. H., & Deckers, A. (2025) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-025-00524-8 · Cited by 27
“Quality appraisals were made of the studies that were included in the meta-analysis using a combination of Murray et al.’s (2022a) criteria and the Journal Article Reporting Standards for quantitative research (Appelbaum et al., 2018).”
Efendić, E., & van Zyl, L. E. (2019) · SA Journal of Industrial Psychology · doi:10.4102/sajip.v45i0.1607 · Cited by 28
“Furthermore, authors should ensure that their manuscripts are in line with the APA’s new ‘Journal Article Reporting Standards for Quantitative Research in Psychology’ (Appelbaum et al., 2018).”
MethodInfluentialMencke, I., Seibert, C., Brattico, E., & Wald‐Fuhrmann, M. (2022) · Psychology of Music · doi:10.1177/03057356221091312 · Cited by 21
Lui, F., Lewicka, M., Bao, G. C., Moyer, A. E., Boyce, L. M., & Leng, J. C. F. (2023) · Psycho-Oncology · doi:10.1002/pon.6110 · Cited by 24
Isbell, D. R., & Kim, J. (2023) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2023.100060 · Cited by 21
Wulff, J. N., & Taylor, L. (2024) · Strategic Organization · doi:10.1177/14761270231214429 · Cited by 24
“Along with the effect size and its confidence interval, researchers should report the exact p -value as it allows for use in secondary analyses (Appelbaum et al., 2018) and the possibility for readers to compare with their own alpha level (Lehmann and Romano, 2005).”
Perfectionistic Self‐Presentation and Psychopathology: A Systematic Review and Meta‐Analysis
Casale, S., Svicher, A., Fioravanti, G., Hewitt, P. L., Flett, G. L., & Pozza, A. (2024) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2966 · Cited by 24
Articulating scholarship in human resource management: Guidance for researchers
Budhwar, P. S., Wood, G., Chowdhury, S., Aguinis, H., Breslin, D., Collings, D. G., Cooke, F. L., Darabi, F., Eby, L. T. D. T., Martin, U. M., et al. (2024) · Human Resource Management Journal · doi:10.1111/1748-8583.12567 · Cited by 32
Rights, J. D., & Cole, D. A. (2018) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2018.1528550 · Cited by 23
“This state of affairs contrasts with current practices in standard, single-level regression wherein researchers almost always report R(2) and conflicts with current reporting standards in the psychological sciences that emphasize effect size (American Psychological Association, 2008, 2009; Appelbaum et al., 2018).”
BackgroundResultInfluentialRobertson, M. A., Hague, C., Evans, M. B., & Martin, L. J. (2019) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2019.101559 · Cited by 25
Tofighi, D., & Kelley, K. (2020) · Psychological Methods · doi:10.1037/met0000259 · Cited by 22
“These recommendations are consistent with and enhance the APA recommendations (APA Publication Manual, 2010; Appelbaum et al., 2018; Wilkinson & Task Force on Statistical Inference, 1999) for reporting statistical analysis results.”
ResultSousa, C., Tsvetkova, P., Pérez-Fuster, P., Agius, M. M., Kostova, S., Bolesta, K., Garcia, F. M., Nanchen, B., & Tkaczyk, A. H. (2024) · Disability and Rehabilitation Assistive Technology · doi:10.1080/17483107.2024.2414414 · Cited by 24
Domestic Violence in Cross-Border Marriages: A Systematic Review
Said, M. H. M., & Kaka, G. E. (2022) · Trauma Violence & Abuse · doi:10.1177/15248380221074321 · Cited by 22
“…and samples, reliability and validity evidence in quantitative studies or trustworthiness, credibility & dependability in qualitative studies, data analysis, implication for practice and policy with speci fi c topic (Acosta et al., 2020; Appelbaum et al., 2018; Kazak, 2018; Levitt et al., 2018).”
BackgroundMethodConceptualizing and Dismantling White Privilege in School Psychology Research: An Ecological Model
Grapin, S. L., & Fallon, L. M. (2022) · School psychology review · doi:10.1080/2372966x.2021.1963998 · Cited by 17
“…White methods can be seen in color evasive (i.e., avoidance or denial of racial realities) approaches to experimentation, in which White scholars fail to (and generally are not expected to) explicitly account for their racial positionality in evaluating study outcomes (Appelbaum et al., 2018).”
BackgroundCromwell, J. R., Haase, J., & Vladova, G. (2023) · Personality and Individual Differences · doi:10.1016/j.paid.2023.112205 · Cited by 24
Nowak, J., Nikendei, C., Rollmann, I., Orth, M., Friederich, H., & Kindermann, D. (2023) · BMC Psychiatry · doi:10.1186/s12888-023-04988-2 · Cited by 20
“We report how we determined our sample size, all data exclusions, all manipulations, and all measures in the study, and we follow the “Journal Article Reporting Standards” (JARS) [56], the “Strengthening the Reporting of Observational Studies in Epidemiology” (STROBE) guidelines [57], and the “Statistical Analyses and…”
MethodThe future of replication in applied linguistics: Toward a standard for replication studies
McManus, K. (2024) · Annual Review of Applied Linguistics · doi:10.1017/s0267190524000011 · Cited by 19
“…standards for replication studies in applied linguistics were devised following a critical review and synthesis of the following: Abbuhl (2011), Appelbaum et al. (2018), Atkinson (2012), Brandt et al. (2014), Brown (2012), Errington et al. (2021), In’nami et al. (2022), Isager et al. (2023),…”
Dunst, C. J. (2021) · International journal of psychological research · doi:10.21500/20112084.5236 · Cited by 29
“sis described by Appelbaum et al. (2018) and Siddaway et al. (2019) were used to conduct the research synthesis and report the findings of the meta-analysis.”
MethodAnomalous Cognition: An Umbrella Review of the Meta-Analytic Evidence
Tressoldi, P. E., & Storm, L. (2021) · Journal of Anomalous Experience and Cognition · doi:10.31156/jaex.23206 · Cited by 21
“In order to give an overall picture of the quality of all 11 meta-analyses, we checked whether four major meta-analysis reporting standards (MARS): studies selection criteria, effect size formulas, studies quality check, publication bias check, were followed as recommended by the APA (Appelbaum et al., 2018).”
MethodVerkooyen, R., Broers, N. J., & Dandachi-FitzGerald, B. (2024) · Frontiers in Psychology · doi:10.3389/fpsyg.2024.1378456 · Cited by 18
Dudija, N., Naibaho, S., & Wibowo, S. B. (2024) · Jurnal Psikologi · doi:10.22146/jpsi.81915 · Cited by 27
Davenport, M. K., Young, C. K., Kim, M. H., Gilberto, J. M., & Beier, M. E. (2022) · Personnel Psychology · doi:10.1111/peps.12535 · Cited by 21
Rank-order stability of relationship satisfaction: A meta-analysis of longitudinal studies.
Bühler, J. L., & Orth, U. (2022) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000430 · Cited by 27
Aghdaei, Z. A. T., McColl‐Kennedy, J. R., & Coote, L. V. (2022) · Medical Care Research and Review · doi:10.1177/10775587221113228 · Cited by 19
“The data were analyzed based on random-effect models (Appelbaum et al., 2018; Higgins et al., 2011).”
MethodNarrative identity does not predict well-being when controlling for emotional valence
Gehrt, T. B., Nielsen, N. P., Hoyle, R. H., Rubin, D. C., & Berntsen, D. (2023) · Memory · doi:10.1080/09658211.2023.2218632 · Cited by 20
The Use of Trajectories in Management Research: A Review and Insights for Future Research
Swider, B. W., Yang, J., & Wang, M. (2023) · Journal of Management · doi:10.1177/01492063231207341 · Cited by 20
“Of course, the methodological details expected to be reported in all quantitative studies (e.g., report all study variables in correlation matrices, discuss how outliers were identi fi ed, describe missing data; Appelbaum et al., 2018) should be included in all trajectory-based studies as well.”
BackgroundBunker, C. J., Balcerowska, J. M., Precht, L.-M., Margraf, J., & Brailovskaia, J. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.108056 · Cited by 26
Benefits for coteachers of students with disabilities: Do contextual factors matter?
Stefanidis, A., King‐Sears, M. E., & Brawand, A. (2018) · Psychology in the Schools · doi:10.1002/pits.22207 · Cited by 31
Dunst, C. J., Bruther, M. B., Hamby, D. W., Howse, R. B., & Wilkie, H. (2018) · Cited by 30
Long-term effects and impact of a positive psychology intervention for Brazilian retirees
Durgante, H. B., Bedin, L. M., de Lima, M. P., & Dell’Aglio, D. D. (2020) · Current Psychology · doi:10.1007/s12144-020-00683-7 · Cited by 18
Reflections on Preregistration: Core Criteria, Badges, Complementary Workflows
Thibault, R. T., Pennington, C. R., & Munafo, M. R. (2023) · Journal of Trial and Error · doi:10.36850/mr6 · Cited by 26
Factor Analysis and Variance Partitioning in Intelligence Test Research: Clarifying Misconceptions
Dombrowski, S. C., McGill, R. J., Canivez, G. L., Watkins, M. W., & Beaujean, A. A. (2020) · Journal of Psychoeducational Assessment · doi:10.1177/0734282920961952 · Cited by 19
“The specific parameter that was modified and the rationale for its specification were not disclosed, a clear violation of research reporting standards (Appelbaum et al., 2018).”
BackgroundThe New Statistics for Neuroscience Majors: Thinking in Effect SizesPreprint
Calin-Jageman, R. J. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/zvm9a · Cited by 19
“This was reinforced in the APA’s newly updated standards for reporting quantitative research (Appelbaum et al., 2018), which enjoin authors to report “effect size estimates and confidence intervals.””
MethodQuantitative Research Submissions to Project Management Journal®
Klein, G. L., & Müller, R. (2019) · Project Management Journal · doi:10.1177/8756972819840141 · Cited by 25
“Differences in expectations and reporting can be found in the American Psychological Association’s (APA) article reporting standards for quantitative research (Appelbaum et al., 2018).”
BackgroundDiscrimination is associated with poor sleep quality in pregnant Black American women
Cohen, M. F., Corwin, E. J., Johnson, D. A., Amore, A. D., Brown, A. L., Barbee, N. R., Brennan, P. A., & Dunlop, A. L. (2022) · Sleep Medicine · doi:10.1016/j.sleep.2022.07.015 · Cited by 19
Reig-Aleixandre, N., Esparza-Reig, J., Vilar, M. M., Merino‐Soto, C., & Segovia, J. L. (2023) · Healthcare · doi:10.3390/healthcare11040560 · Cited by 19
“Guidelines [53,54] and organizations [55,56] that promote good practices encourage the researchers to achieve transparency in their works, which is also promoted by this study, especially when it comes to the use of an instrument directed to assess variables in the field of health.”
BackgroundRosa, C. D., Chaves, T. S., Collado, S., & Harper, N. J. (2023) · Journal of Adventure Education & Outdoor Learning · doi:10.1080/14729679.2023.2196638 · Cited by 19
Klamert, L., Bedi, G., Craike, M. J., Kidd, S., Pascoe, M. C., & Parker, A. G. (2023) · Mental health and physical activity · doi:10.1016/j.mhpa.2023.100551 · Cited by 23
“Significance sells”: Applied linguists’ views on questionable research practices
Plonsky, L., Brown, D., Chen, M., Ghanem, R., Arvizu, M. N. G., Isbell, D. R., & Zhang, M. (2024) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2024.100099 · Cited by 18
Nicolai, K. D., Morton, T. R., Torre, C. D. L., DeCuir‐Gunby, J. T., & Koenka, A. C. (2024) · Journal of Social Issues · doi:10.1111/josi.12602 · Cited by 23
Alhemimah, A., Ali, M., Badghish, S., Latan, H., & Jabbour, C. J. C. (2025) · Management of Environmental Quality An International Journal · doi:10.1108/meq-10-2024-0433 · Cited by 26
Trait Emotional Intelligence and Its Correlates in Oman Medical Specialty Board Residents
Al‐Huseini, S., Al‐Alawi, M., Sinawi, H. A., Al‐Balushi, N., Jose, S., & Al‐Adawi, S. (2019) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-18-00388 · Cited by 19
“The goodness of fit in the linear regression model was assessed by the coefficient of determination (R(2)) Cox and Snell approach.(15)”
MethodRigor and reproducibility for data analysis and design in the behavioral sciences
Hildebrandt, T., & Prenoveau, J. M. (2020) · Behaviour Research and Therapy · doi:10.1016/j.brat.2020.103552 · Cited by 19
Farewell to Bright-Line: A Guide to Reporting Quantitative Results Without the S-Word
Cummins, K. M., & Marks, C. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00815 · Cited by 17
“It is also consistent with American Psychological Association reporting standards, which promotes the reporting of exact p-values along with point and interval estimates of the effect-size (Appelbaum et al., 2018).”
ResultDunst, C. J. (2021) · Journal of Behavior Health & Social Issues · doi:10.22201/fesi.20070780e.2021.13.2.77837 · Cited by 20
Questionable Research Practices
O’Boyle, E. H., & Götz, M. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780190938550.003.0010 · Cited by 28
Amir, N., Holbrook, A., Kallen, A. M., Santopetro, N. J., Klawohn, J., McGhie, S. F., Bruchnak, A., Lowe, M. E., Taboas, W., Brush, C. J., et al. (2023) · Clinical Psychological Science · doi:10.1177/21677026231170563 · Cited by 20
“We report how we determined our sample size, all data exclusions, all manipulations, and all measures in the study, and we follow JARS (Appelbaum et al., 2018).”
MethodA randomized controlled trial of inhibitory control training for smoking cessation and reduction.
Bos, J., Staiger, P. K., Hayden, M. J., Hughes, L. K., Youssef, G. J., & Lawrence, N. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000424 · Cited by 21
Tasca, G. A. (2020) · Group Dynamics Theory Research and Practice · doi:10.1037/gdn0000115 · Cited by 17
What Psychology Teachers Should Know About Open Science and the New Statistics
Morling, B., & Calin-Jageman, R. J. (2020) · Teaching of Psychology · doi:10.1177/0098628320901372 · Cited by 18
“Specifically, the APA (2020) enjoins authors to “wherever possible, base discussion and interpretation of results on point and interval estimates” (p. 88; see Appelbaum et al., 2018).”
BackgroundRecommendations for Reporting Sample and Measurement Information in Experience Sampling Studies
Heggestad, E. D., Kreamer, L. M., Hausfeld, M. M., Patel, C., & Rogelberg, S. G. (2021) · British Journal of Management · doi:10.1111/1467-8551.12489 · Cited by 17
Döhmen, A., Kock, M., Fischer, F. H., Rose, M., Obbarius, A., & Klapproth, C. P. (2022) · Quality of Life Research · doi:10.1007/s11136-022-03261-5 · Cited by 17
“Guidelines of the American Psychological Associations recommend including key psychometric information for each instrument in publications [15, 16].”
BackgroundPerceived teacher support in secondary education from 1980 to 2019: An integrative review
Botellero, V. L., Ekornes, S. M., Gamlem, S. M., Torrissen, W., & Løvoll, H. S. (2023) · Cogent Education · doi:10.1080/2331186x.2022.2164648 · Cited by 21
“Based on our results and reporting APA guidelines (American Psychological Association, 2020; Appelbaum et al., 2018; Levitt et al., 2018), we recommend that future studies provide more detail and specific information regarding demographic variables.”
BackgroundMethodAydın, O. (2023) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2023.2181191 · Cited by 25
“SCRIBE has also been approved for publication reporting standards by the APA (Appelbaum et al., 2018).”
MethodInfluentialMalik, H. B., & Norman, J. B. (2023) · Journal of Pediatric Neuropsychology · doi:10.1007/s40817-023-00145-5 · Cited by 22
“The Journal Article Reporting Standards recommends reporting demographic groups in both the abstract and methods, selection methods, and whether exclusions may inadvertently restrict demographic characteristics (Appelbaum et al., 2018).”
MethodDorsch, T. E., Blazo, J., Paoli, A. G. D., & Hardiman, A. L. (2023) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2023.102504 · Cited by 18
Bunker, C. J., & Kwan, V. S. Y. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.108025 · Cited by 20
Tan, L., Luningham, J. M., Huh, D., Zhou, Z., Tanner‐Smith, E. E., Baldwin, S. A., & Mun, E. (2023) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.15232 · Cited by 22
Maloney, S., Montero‐Marín, J., & Kuyken, W. (2024) · Behaviour Research and Therapy · doi:10.1016/j.brat.2024.104478 · Cited by 16
“We have also provided details on the measures we have used following Journal Article Reporting Standard (ARS) (Appelbaum et al., 2018).”
MethodThe effectiveness of corpus use in ESL/EFL writing: A meta-analysis
Ngo, T. T.-N., & Chen, H. H.-J. (2024) · Language Teaching Research · doi:10.1177/13621688241260183 · Cited by 20
Reframing Adolescent Identity: A Global Perspective for the Digital Age
Sirin, S. R., Brauer, S. Z., & Tugberk, C. (2024) · Annual Review of Developmental Psychology · doi:10.1146/annurev-devpsych-010923-101059 · Cited by 26
Dynamic fit index cutoffs for treating likert items as continuous.
McNeish, D. (2024) · Psychological Methods · doi:10.1037/met0000683 · Cited by 22
Alcocer‐Bruno, C., Ferrer‐Cascales, R., Rubio‐Aparicio, M., & Ruiz‐Robledillo, N. (2020) · Research in Nursing & Health · doi:10.1002/nur.22070 · Cited by 17
The current phase of social sciences research: A thematic overview of the literature
Babalola, S. S., & Nwanzu, C. L. (2021) · Cogent Social Sciences · doi:10.1080/23311886.2021.1892263 · Cited by 19
“Therefore, SS researchers are encouraged to be acquainted with best practices (e.g., Appelbaum et al., 2018; Levitt et al., 2018) in results and indecisive reporting.”
BackgroundTaylor, J. A., Pigott, T., & Williams, R. T. (2021) · Educational Researcher · doi:10.3102/0013189x211051319 · Cited by 16
“JANUARy/FEbRUARy 2022 73 Article Reporting Standards (Appelbaum et al., 2018), and the WWC Procedures Handbook v.”
BackgroundMethodInfluentialDwanyen, L., Holtrop, K., & Parra‐Cardona, R. (2021) · Journal of Marital and Family Therapy · doi:10.1111/jmft.12573 · Cited by 21
Sharing is caring: Ethical implications of transparent research in psychology.
Bosma, C. M., & Granger, A. M. (2022) · American Psychologist · doi:10.1037/amp0001002 · Cited by 24
Optimizing the scientific study of suicide with open and transparent research practices
Carpenter, T. P., & Law, K. C. (2021) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12665 · Cited by 24
Supporting and enhancing scientific rigor.
Chen, G. (2018) · Journal of Applied Psychology · doi:10.1037/apl0000313 · Cited by 17
Open science reforms: Strengths, challenges, and future directions
Wentzel, K. R. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1901709 · Cited by 20
“…in how to think about the aims and objectives of research would be required, beginning with an understanding of the basic philosophical underpinnings of our science and the established research standards of our community (i.e., APA standards for reporting; Appelbaum et al., 2018; Levitt, 2019).”
BackgroundCognitive and academic benefits of music training with children: A multilevel meta-analysisPreprint
Sala, G., & Gobet, F. R. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7s8wr · Cited by 19
Hung, J. W., Lee, C. K. Y., Kasturiratna, K. T. A. S., & Hartanto, A. (2026) · Computers in Human Behavior: Artificial Humans · doi:10.1016/j.chbah.2026.100323 · Cited by 16
Sicard, V., Stephenson, D. D., Hergert, D. C., Dodd, A. B., Robertson-Benta, C. R., Pabbathi Reddy, S., Yeates, K. O., Cromer, J. A., Meier, T. B., Campbell, R. A., et al. (2022) · Neuropsychology · doi:10.1037/neu0000803 · Cited by 15
Family environment and self-esteem development in adolescence: A replication and extension
Krauss, S., & Orth, U. (2024) · Journal of Research in Personality · doi:10.1016/j.jrp.2024.104511 · Cited by 21
Deconstructing the gender-equality paradox.
Ilmarinen, V., & Lönnqvist, J. (2024) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000508 · Cited by 23
Müller, V. I., Cieslik, E. C., Ficco, L., Tyralla, S., Sepehry, A. A., Aziz-Safaie, T., Feng, C., Eickhoff, S. B., & Langner, R. (2024) · Neuropsychology Review · doi:10.1007/s11065-024-09647-1 · Cited by 18
“We adhered to the Journal Article Reporting Standards for Quantitative Research in Psychology (Table 9 from Appelbaum et al., 2018) and the guidelines for neuroimaging meta-analyses (Müller et al., 2018a).”
Cejalvo, E., Vilar, M. M., Gisbert-Pérez, J., & Badenes‐Ribera, L. (2025) · Journal of Clinical Medicine · doi:10.3390/jcm14061916 · Cited by 17
“%) did not report reliability estimates based on study-specific data, despite APA recommendations [65].”
Binge eating as emotion regulation? A meta-analysis of ecological momentary assessment studies
Borm, I., Hartmann, S., Barnow, S., & Pruessner, L. (2025) · Clinical Psychology Review · doi:10.1016/j.cpr.2025.102625 · Cited by 19
Improving statistical reporting in psychology
Schubert, A., Snijder-Steinhilber, M., Kang, H., & Quintana, D. S. (2025) · Communications Psychology · doi:10.1038/s44271-025-00356-w · Cited by 24
Simplifying Common Method Variance Mitigation: The Role of Additional Variables
Sturman, M. C., Richardson, H. A., Simmering, M. J., & Ukhov, A. D. (2025) · Journal of Business and Psychology · doi:10.1007/s10869-025-10074-z · Cited by 21
Development and validation of a digital burnout scale in artificial intelligence era
Zhao, L., Zhao, J., Cao, E. Y., Li, K., Pan, L., Zou, Y., & Sun, X. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1580422 · Cited by 16
“…guidance for scale development and reporting (DeVellis and Thorpe, 2021; Hinkin, 1998; Worthington and Whittaker, 2006) and aligned our procedures with the COSMIN standards (Prinsen et al., 2018) and APA JARS (JARS-Quant; Appelbaum et al., 2018) to enhance transparency and reproducibility.”
Halfond, R. W., Wright, C. V., & Bufka, L. F. (2020) · Clinical Psychology Science and Practice · doi:10.1111/cpsp.12343 · Cited by 20
Longitudinal relations between physical activity and alcohol consumption among young adults.
Henderson, C. E., Najjar, L. Z., Young, C. M., Leasure, J. L., Neighbors, C., Gasser, M. L., & Lindgren, K. P. (2021) · Psychology of Addictive Behaviors · doi:10.1037/adb0000807 · Cited by 19
Filho, E., Rettig, J., Gaspar, P. D., & Bagni, G. (2022) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2022.102198 · Cited by 18
Bühler, J. L., Mund, M., Neyer, F. J., & Wrzus, C. (2022) · Journal of Personality · doi:10.1111/jopy.12757 · Cited by 22
Visalli, M., & Galmarini, M. V. (2022) · PLoS ONE · doi:10.1371/journal.pone.0270969 · Cited by 17
Cordero, J., Groechel, T. R., & Matarić, M. (2022) · IEEE International Symposium on Robot and Human Interactive Communication · doi:10.1109/ro-man53752.2022.9900744 · Cited by 13
“Describing the recruitment method is also part of the reporting checklist for psychology studies by the American Psychological Association (APA) [17] and Consolidated Standards of Reporting Trials (CONSORT) [14], [18].”
BackgroundMethodInfluentialBoulianne, S., & Hoffmann, C. P. (2024) · Media and Communication · doi:10.17645/mac.8102 · Cited by 21
Belief in conspiracy theories and satisfaction in interpersonal relationships
Toribio‐Flórez, D., Green, R., & Douglas, K. M. (2024) · Journal of Applied Social Psychology · doi:10.1111/jasp.13061 · Cited by 17
Prevalence of Publication Bias Tests in Speech, Language, and Hearing Research
Chow, J. C. (2018) · Journal of Speech Language and Hearing Research · doi:10.1044/2018_jslhr-l-18-0098 · Cited by 15
Fallon, L. M., DeFouw, E. R., Cathcart, S. C., Berkman, T. S., Robinson-Link, P. M., O’Keeffe, B. V., & Sugai, G. M. (2021) · Journal of Behavioral Education · doi:10.1007/s10864-021-09436-3 · Cited by 22
The cagey C-test construct: Some evidence from a meta-analysis of correlation coefficients
McKay, T., Teimouri, Y., Sağdıç, A., Salen, B., Reagan, D., & Malone, M. E. (2021) · System · doi:10.1016/j.system.2021.102526 · Cited by 16
Villavicencio-Ayub, E. (2021) · Psicología Iberoamericana · doi:10.48102/pi.v29i1.176 · Cited by 27
“…tal y como PDF generado a partir de XML-JATS4R por Redalyc Proyecto académico sin fines de lucro, desarrollado bajo la iniciativa de acceso abierto se da en el contexto natural y la recolección de datos se hizo en un solo momento (Appelbaum et al., 2018; Hernández Sampieri et al., 2014).”
Metadata
- Authors
- Appelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M.
- Affiliations
- University of California San Diego (US)
- Duke University (US)
- Concordia University (US)
- Drexel University (US)
- Cleveland Clinic (US)
- Venue
- American Psychologist
- Published
- 2018-01
- Volume
- 73
- Issue
- 1
- Pages
- 3-25
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W2784576540
- Cited by
- 1,449
- References
- 35
- Citations by year
- 2026: 258 · 2025: 246 · 2024: 204 · 2023: 172 · 2022: 154 · 2021: 142 · 2020: 133 · 2019: 89 · 2018: 47
- FWCI
- 78.36
- Type
- journal article
- Language
- en
- Update notices
- correction (2018-10-04)
- Open access
- hybrid
- doi.org
- Locations
- American Psychologist (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- reporting guidelines, meta-analysis reporting, observational studies, clinical trials, longitudinal study, replication study, N-of-1 studies, structural equation modeling, Bayesian analysis, scientific publications
- MeSH terms
- Humans, Periodicals as Topic, Psychology, Research Design, Societies, Scientific, Peer Review, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.