The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Journal article reporting standards for quantitative research in psychology: The APA Publications and Communications Board task force report.
Open accessAbstract
Following a review of extant reporting standards for scientific publication, and reviewing 10 years of experience since publication of the first set of reporting standards by the American Psychological Association (APA; APA Publications and Communications Board Working Group on Journal Article Reporting Standards, 2008), the APA Working Group on Quantitative Research Reporting Standards recommended some modifications to the original standards. Examples of modifications include division of hypotheses, analyses, and conclusions into 3 groupings (primary, secondary, and exploratory) and some changes to the section on meta-analysis. Several new modules are included that report standards for observational studies, clinical trials, longitudinal studies, replication studies, and N-of-1 studies. In addition, standards for analytic methods with unique characteristics and output (structural equation modeling and Bayesian analysis) are included. These proposals were accepted by the Publications and Communications Board of APA and supersede the standards included in the 6th edition of the Publication Manual of the American Psychological Association (APA, 2010). (PsycINFO Database Record
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“A systematic search strategy was implemented (Appelbaum et al., 2018).”
From Cognitive and academic benefits of music training with children: A multilevel meta-analysis (2020) · cites this paper as Appelbaum et al., 2018
In the citing paper
“We designed the meta-analyses and report the results in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement (Moher et al., 2009) and the American Psychological Association's Quantitative Meta-Analysis Article Reporting Standards (Appelbaum et al., 2018).”
From Do growth mindset interventions impact students’ academic achievement? A systematic review and meta-analysis with recommendations for best practices. (2023) · cites this paper as Appelbaum et al., 2018
In the citing paper
“However, the relative novelty of conducting Bayesian analyses in applied fields means that there are no detailed reporting standards, and this in turn may frustrate the broader adoption and proper interpretation of the Bayesian framework.”
From The JASP guidelines for conducting and reporting a Bayesian analysis (2021) · cites this paper as Appelbaum et al., 2018
In the citing paper
“These methods are necessary to produce unbiased and more reliable estimates (Appelbaum et al., 2018).”
From The cognitive and academic benefits of Cogmed: A meta-analysis (2019) · cites this paper as Appelbaum et al., 2018
Citations
Cites
Meta-analysis of Observational Studies in Epidemiology<SUBTITLE>A Proposal for Reporting</SUBTITLE>
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371
Cook, R. J., Dickens, B. M., & Fathalla, M. F. (2003) · Reproductive Health and Human Rights · doi:10.1093/acprof:oso/9780199241323.003.0025 · Cited by 10,769
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
A Beginner's Guide to Structural Equation Modeling: Fourth Edition
Schumacker, R. E., & Lomax, R. G. (2015) · doi:10.4324/9781315749105 · Cited by 6,604
Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72351 · Cited by 6,277
(2016) · Cited by 3,399
Self-citationStandards for Educational and Psychological Testing
(2007) · Encyclopedia of Measurement and Statistics · doi:10.4135/9781412952644.n432 · Cited by 3,126
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Picton, T. W., Bentin, S., Berg, P., Donchin, E., Hillyard, S. A., Johnson, R., Miller, G. A., Ritter, W., Ruchkin, D. S., Rugg, M. D., et al. (2000) · Psychophysiology · doi:10.1111/1469-8986.3720127 · Cited by 2,157
Is psychology suffering from a replication crisis? What does “failure to replicate” really mean?
Maxwell, S. E., Lau, M. Y., & Howard, G. S. (2015) · American Psychologist · doi:10.1037/a0039400 · Cited by 1,005
The assessment, monitoring, and enhancement of treatment fidelity in public health clinical trials
Borrelli, B. (2011) · Journal of Public Health Dentistry · doi:10.1111/j.1752-7325.2011.00233.x · Cited by 970
Best practices in data analysis and sharing in neuroimaging using MRI
Nichols, T. E., Das, S., Eickhoff, S. B., Evans, A. C., Glatard, T., Hanke, M., Kriegeskorte, N., Milham, M. P., Poldrack, R. A., Poline, J.-B., et al. (2017) · Nature Neuroscience · doi:10.1038/nn.4500 · Cited by 714
Single-case experimental designs: a systematic review of published research and current standards
Smith, J. D. (2012) · Psychological Methods · doi:10.1037/a0029312 · Cited by 630
Best Practices in Structural Equation Modeling
Mueller, R. O., & Hancock, G. R. (2008) · Best Practices in Quantitative Methods · doi:10.4135/9781412995627.d38 · Cited by 398
Quality of reporting of observational longitudinal research.
Tooth, L. (2005) · American Journal of Epidemiology · doi:10.1093/aje/kwi042 · Cited by 363
CONSORT extension for reporting N-of-1 trials (CENT) 2015 Statement
Vohra, S., Shamseer, L., Sampson, M., Bukutu, C., Schmid, C. H., Tate, R., Nikles, J., Zucker, D. R., Kravitz, R., Guyatt, G., et al. (2015) · BMJ · doi:10.1136/bmj.h1738 · Cited by 239
Maggin, D. M., Chafouleas, S. M., Goddard, K. M., & Johnson, A. H. (2011) · Journal of School Psychology · doi:10.1016/j.jsp.2011.05.001 · Cited by 222
Tate, R. L., Perdices, M., Rosenkoetter, U., McDonald, S., Togher, L., Shadish, W., Horner, R., Kratochwill, T., Barlow, D. H., Kazdin, A., et al. (2016) · Archives of Scientific Psychology · doi:10.1037/arc0000027 · Cited by 219
Didden, R., Korzilius, H., van Oorsouw, W., & Sturmey, P. (2006) · American Journal on Mental Retardation · doi:10.1352/0895-8017(2006)111[290:btocbi]2.0.co;2 · Cited by 165
Duggan, C., Parry, G., McMurran, M., Davidson, K., & Dennis, J. (2014) · Trials · doi:10.1186/1745-6215-15-335 · Cited by 165
Atkinson, K. M., Koenka, A. C., Sanchez, C. E., Moshontz, H., & Cooper, H. M. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1127 · Cited by 160
Self-citationCONSORT extension for reporting N-of-1 trials (CENT) 2015: explanation and elaboration
Shamseer, L., Sampson, M., Bukutu, C., Schmid, C. H., Nikles, J., Tate, R. L., Johnston, B. C., Zucker, D. R., Shadish, W. R., Kravitz, R. L., et al. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.05.018 · Cited by 145
Protocol for CONSORT-SPI: an extension for social and psychological interventions
Montgomery, P., Grant, S., Hopewell, S., Macdonald, G. M., Moher, D., Michie, S., & Mayo-Wilson, E. (2013) · Implementation Science · doi:10.1186/1748-5908-8-99 · Cited by 123
Self-citationBarker, J. B., Mellalieu, S. D., McCarthy, P. J., Jones, M. V., & Moran, A. P. (2012) · Journal of Applied Sport Psychology · doi:10.1080/10413200.2012.709579 · Cited by 114
Tate, R. L., Perdices, M., McDonald, S., Togher, L., & Rosenkoetter, U. (2014) · Neuropsychological Rehabilitation · doi:10.1080/09602011.2013.875043 · Cited by 111
Cybulski, Ł., Mayo‐Wilson, E., & Grant, S. (2016) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000115 · Cited by 94
Self-citationMontgomery, P., Underhill, K., Gardner, F., Operario, D., & Mayo-Wilson, E. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.03.006 · Cited by 92
Self-citationThe need for expanded monitoring of adverse events in behavioral health clinical trials
Peterson, A. L., Roache, J. D., Raj, J., & Young-McCaughan, S. (2013) · Contemporary Clinical Trials · doi:10.1016/j.cct.2012.10.009 · Cited by 70
Reporting results from structural equation modeling analyses in Archives of Scientific Psychology.
Hoyle, R. H., & Isherwood, J. C. (2013) · Archives of Scientific Psychology · doi:10.1037/arc0000004 · Cited by 56
Why (or why not), when and how to replicate research
Mackey, A. (2012) · Lancaster EPrints (Lancaster University) · Cited by 46
Mastering Modern Psychological Testing : Theory and Methods
Reynolds, C. R., & Livingston, R. B. (2011) · Medical Entomology and Zoology · Cited by 45
Psychometric Assessment and Reporting Practices
Slaney, K. L., Tkatchouk, M., Gabriel, S. M., & Maraun, M. D. (2009) · Journal of Psychoeducational Assessment · doi:10.1177/0734282909335781 · Cited by 21
(2008) · doi:10.1093/med:psych/9780195304633.003.0013 · Cited by 11
Self-citationReplications of Important Results in Social Psychology: Special Issue of Social PsychologyPreprint
Nosek, B. A., & Lakens, D. (2013) · Cited by 8
Cited by
Salk, R. H., Hyde, J. S., & Abramson, L. Y. (2017) · Psychological Bulletin · doi:10.1037/bul0000102 · Cited by 2,622
Cheung, G. W., Cooper-Thomas, H. D., Lau, R. S., & Wang, L. C. (2024) · Asia Pacific Journal of Management · doi:10.1007/s10490-023-09871-y · Cited by 2,262
“The American Psychological Association’s journal article reporting standards (Appelbaum et al., 2018) refer researchers to Kline (2016, Chapter 18), who suggested researchers report chi-square with its degrees of freedom and p -value; RMSEA (Steiger & Lind, 1980) and its 90% confidence interval…”
Latent class analysis: a guide to best practice
Weller, B. E., Bowen, N. K., & Faubert, S. J. (2020) · Journal of Black Psychology · doi:10.1177/0095798420930932 · Cited by 2,223
“To present clear results and justified conclusions, LCA reports need to detail study procedures and results with clarity and coherence (Appelbaum et al., 2018).”
BackgroundExploratory Factor Analysis: A Guide to Best Practice
Watkins, M. W. (2018) · Journal of Black Psychology · doi:10.1177/0095798418771807 · Cited by 2,218
The JASP guidelines for conducting and reporting a Bayesian analysis
van Doorn, J., van den Bergh, D., Böhm, U., Dablander, F., Derks, K., Draws, T., Etz, A., Evans, N. J., Gronau, Q. F., Haaf, J. M., et al. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01798-5 · Cited by 1,114
Metadata
- Authors
- Appelbaum, M., Cooper, H., Kline, R. B., Mayo-Wilson, E., Nezu, A. M., & Rao, S. M.
- Affiliations
- University of California San Diego (US)
- Duke University (US)
- Concordia University (US)
- Drexel University (US)
- Cleveland Clinic (US)
- Venue
- American Psychologist
- Published
- 2018-01
- Volume
- 73
- Issue
- 1
- Pages
- 3-25
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W2784576540
- Cited by
- 1,449
- References
- 35
- Citations by year
- 2026: 258 · 2025: 246 · 2024: 204 · 2023: 172 · 2022: 154 · 2021: 142 · 2020: 133 · 2019: 89 · 2018: 47
- FWCI
- 78.36
- Type
- journal article
- Language
- en
- Update notices
- correction (2018-10-04)
- Open access
- hybrid
- doi.org
- Locations
- American Psychologist (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Library and Information Sciences › Academic Writing and Publishing
- Keywords
- reporting guidelines, meta-analysis reporting, observational studies, clinical trials, longitudinal study, replication study, N-of-1 studies, structural equation modeling, Bayesian analysis, scientific publications
- MeSH terms
- Humans, Periodicals as Topic, Psychology, Research Design, Societies, Scientific, Peer Review, Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.