Reporting standards for research in psychology: why do we need them? What might they be?
Open accessAbstract
In anticipation of the impending revision of the Publication Manual of the American Psychological Association, APA's Publications and Communications Board formed the Working Group on Journal Article Reporting Standards (JARS) and charged it to provide the board with background and recommendations on information that should be included in manuscripts submitted to APA journals that report (a) new data collections and (b) meta-analyses. The JARS Group reviewed efforts in related fields to develop standards and sought input from other knowledgeable groups. The resulting recommendations contain (a) standards for all journal articles, (b) more specific standards for reports of studies with experimental manipulations or evaluations of interventions using research designs involving random or nonrandom assignment, and (c) standards for articles reporting meta-analyses. The JARS Group anticipated that standards for reporting other research designs (e.g., observational studies, longitudinal studies) would emerge over time. This report also (a) examines societal developments that have encouraged researchers to provide more details when reporting their studies, (b) notes important differences between requirements, standards, and recommendations for reporting, and (c) examines benefits and obstacles to the development and implementation of reporting standards.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The CONSORT checklist and JARS guidelines were applied in reporting the findings.
“The CONSORT checklist (Schulz et al., 2010) (Appendix A) and JARS guidelines (American Psychological Association, 2008) were applied in reporting the findings.”
From An online acceptance, commitment, and self-compassion based treatment to decrease psychological distress in people with type 2 diabetes: A feasibility randomised-controlled trial (2023) · cites this paper as American Psychological Association, 2008
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823 · see citing works
Dermyshi, E., Wang, Y., Yan, C., Hong, W., Qiu, G., Gong, X., & Zhang, T. (2017) · Neonatology · doi:10.1159/000454668 · Cited by 24,577 · see citing works
Stroup, D. F. (2000) · JAMA · doi:10.1001/jama.283.15.2008 · Cited by 20,623 · see citing works
Evidence based medicine: what it is and what it isn't
Sackett, D. L., Rosenberg, W. M. C., Gray, J. A. M., Haynes, R. B., & Richardson, W. S. (1996) · BMJ · doi:10.1136/bmj.312.7023.71 · Cited by 15,769 · see citing works
Moher, D., Cook, D. J., Eastwood, S., Olkin, I., Rennie, D., & Stroup, D. F. (1999) · The Lancet · doi:10.1016/s0140-6736(99)04149-5 · Cited by 4,826 · see citing works
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553 · see citing works
The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835 · see citing works
Des Jarlais, D. C., Lyles, C., Crepaz, N., & the TREND Group (2004) · American Journal of Public Health · doi:10.2105/ajph.94.3.361 · Cited by 2,817 · see citing works
Evidence-based practice in psychology.
American Psychological Association (2006) · American Psychologist · doi:10.1037/0003-066x.61.4.271 · Cited by 2,478 · see citing works
Research Synthesis and Meta-Analysis: A Step-by-Step Approach
Cooper, H. (2017) · doi:10.4135/9781071878644 · Cited by 1,716 · see citing works
Coming to terms with the terms of risk
Kraemer, H. C. (1997) · Archives of General Psychiatry · doi:10.1001/archpsyc.1997.01830160065009 · Cited by 1,432 · see citing works
Moher, D., Schulz, K. F., Altman, D. G., & for the CONSORT Group* (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00011 · Cited by 1,426 · see citing works
Capturing momentary, self-report data: A proposal for reporting guidelines
Stone, A. A., & Shiffman, S. (2002) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2403_09 · Cited by 807 · see citing works
Cook, D. J., Sackett, D. L., & Spitzer, W. O. (1995) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)00172-m · Cited by 573 · see citing works
Meta-analysis of Observational Studies in Epidemiology
Stroup, D. F., Berlin, J. A., Morton, S. C., Olkin, I., Williamson, G. D., Rennie, D., Moher, D., Becker, B. J., Sipe, T. A., & Thacker, S. B. (2000) · Cited by 460 · see citing works
Evidence-based behavioral medicine: What is it and how do we achieve it?
Davidson, K. W., Goldstein, M. G., Kaplan, R. M., Kaufmann, P. G., Knatterud, G. L., Orleans, C. T., Spring, B. J., Trudeau, K. J., & Whitlock, E. P. (2003) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2603_01 · Cited by 407 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- American Psychological Association, Council of Editors 1952 Publication manual of the American Psychological Association Psychological Bulletin 49 Suppl, Pt 2
Cited by
Sorted by citations
Salk, R. H., Hyde, J. S., & Abramson, L. Y. (2017) · Psychological Bulletin · doi:10.1037/bul0000102 · Cited by 2,622 · see citing works
Journal of Consulting and Clinical Psychology
Nezu, A. M., & Greenberg, L. M. (2015) · The Encyclopedia of Clinical Psychology · doi:10.1002/9781118625392.wbecp389 · Cited by 2,468 · see citing works
Perceived organizational support: a meta-analytic evaluation of organizational support theory.
Kurtessis, J. N., Eisenberger, R., Ford, M. T., Buffardi, L. C., Stewart, K. A., & Adis, C. S. (2017) · Journal of Management · doi:10.1177/0149206315575554 · Cited by 2,354 · see citing works
A Meta-Analysis of Interventions to Reduce Loneliness
Masi, C. M., Chen, H.-Y., Hawkley, L. C., & Cacioppo, J. T. (2011) · Personality and Social Psychology Review · doi:10.1177/1088868310377394 · Cited by 1,995 · see citing works
How Big Is “Big”? Interpreting Effect Sizes in L2 Research
Plonsky, L., & Oswald, F. L. (2014) · Language Learning · doi:10.1111/lang.12079 · Cited by 1,960 · see citing works
Aguinis, H., Gottfredson, R. K., & Culpepper, S. A. (2013) · Journal of Management · doi:10.1177/0149206313478188 · Cited by 1,099 · see citing works
Premature discontinuation in adult psychotherapy: A meta-analysis
Swift, J. K., & Greenberg, R. P. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028226 · Cited by 978 · see citing works
A Meta-Analysis of Compassion-Based Interventions: Current State of Knowledge and Future Directions
Kirby, J. N., Tellegen, C. L., & Steindl, S. R. (2017) · Behavior Therapy · doi:10.1016/j.beth.2017.06.003 · Cited by 827 · see citing works
Page, M. J., & Moher, D. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0663-8 · Cited by 769 · see citing works
Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods
Carter, E. C., Schönbrodt, F. D., Gervais, W. M., & Hilgard, J. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847196 · Cited by 588 · see citing works
Ingoldsby, E. M. (2010) · Journal of Child and Family Studies · doi:10.1007/s10826-009-9350-2 · Cited by 522 · see citing works
King, D. L., Haagsma, M. C., Delfabbro, P., Gradisar, M., & Griffiths, M. D. (2013) · Clinical Psychology Review · doi:10.1016/j.cpr.2013.01.002 · Cited by 459 · see citing works
Pre-registration in social psychology—A discussion and suggested template
Veer, A. V. '., & Giner‐Sorolla, R. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2016.03.004 · Cited by 436 · see citing works
Social media and citizen engagement: A meta-analytic review
Škorić, M. M., Zhu, Q., Goh, D., & Pang, N. L.-S. (2015) · New Media & Society · doi:10.1177/1461444815616221 · Cited by 448 · see citing works
Compassion interventions: The programmes, the evidence, and implications for research and practice
Kirby, J. N. (2017) · Psychology and Psychotherapy: Theory, Research and Practice · doi:10.1111/papt.12104 · Cited by 427 · see citing works
Sex differences in visual-spatial working memory: A meta-analysis
Voyer, D., Voyer, S. D., & Saint-Aubin, J. (2017) · Psychonomic Bulletin & Review · doi:10.3758/s13423-016-1085-7 · Cited by 400 · see citing works
Video Improves Learning in Higher Education: A Systematic Review
Noetel, M., Griffith, S., Delaney, O., Sanders, T., Parker, P. D., Cruz, B. D. P., & Lonsdale, C. (2021) · Review of Educational Research · doi:10.3102/0034654321990713 · Cited by 518 · see citing works
Frazier, T. W., Strauss, M., Klingemier, E. W., Zetzer, E. E., Hardan, A. Y., Eng, C., & Youngstrom, E. A. (2017) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2017.05.005 · Cited by 374 · see citing works
Screening and assessment tools for gaming disorder: A comprehensive systematic review
King, D. L., Chamberlain, S. R., Carragher, N., Billieux, J., Stein, D., Mueller, K., Potenza, M. N., Rumpf, H. J., Saunders, J., Starcevic, V., et al. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101831 · Cited by 369 · see citing works
Text Preprocessing for Text Mining in Organizational Research: Review and Recommendations
Hickman, L., Thapa, S., Tay, L., Cao, M., & Srinivasan, P. (2020) · Organizational Research Methods · doi:10.1177/1094428120971683 · Cited by 400 · see citing works
Plonsky (2013) · doi:10.1017/s0272263113000399 · Cited by 347 · see citing works
A Meta-Analytic Review of Social Identification and Health in Organizational Contexts
Steffens, N. K., Haslam, S. A., Schuh, S. C., Jetten, J., & van Dick, R. (2017) · Personality and Social Psychology Review · doi:10.1177/1088868316656701 · Cited by 311 · see citing works
Macnamara, B. N., & Burgoyne, A. P. (2022) · Psychological Bulletin · doi:10.1037/bul0000352 · Cited by 358 · see citing works
How Effective are Pedagogical Agents for Learning? A Meta-Analytic Review
Schroeder, N. L., Adesope, O., & Gilbert, R. B. (2013) · Journal of Educational Computing Research · doi:10.2190/ec.49.1.a · Cited by 299 · see citing works
School connectedness and suicidal thoughts and behaviors: A systematic meta-analysis.
Marraccini, M. E., & Brier, Z. M. F. (2017) · School Psychology Quarterly · doi:10.1037/spq0000192 · Cited by 295 · see citing works
Early versus late onset obsessive–compulsive disorder: Evidence for distinct subtypes
Taylor, S. J. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.06.007 · Cited by 291 · see citing works
Kuester, A., Niemeyer, H., & Knaevelsrud, C. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2015.11.004 · Cited by 261 · see citing works
Gorman, C. A., Meriac, J. P., Overstreet, B. L., Apodaca, S. P., McIntyre, A. L., Park, P., & Godbey, J. (2011) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2011.07.005 · Cited by 277 · see citing works
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.010 · Cited by 279 · see citing works
Francis, H. M., Stevenson, R. J., Chambers, J. R., Gupta, D., Newey, B., & Lim, C. K. (2019) · PLOS ONE · doi:10.1371/journal.pone.0222768 · Cited by 277 · see citing works
Meta-Analysis With Complex Research Designs
Scammacca, N. K., Roberts, G. J., & Stuebing, K. K. (2013) · Review of Educational Research · doi:10.3102/0034654313500826 · Cited by 269 · see citing works
Quantitative Research Methods, Study Quality, and Outcomes: The Case of Interaction Research
Plonsky, L., & Gass, S. (2011) · Language Learning · doi:10.1111/j.1467-9922.2011.00640.x · Cited by 267 · see citing works
Quintana, D. S. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.01549 · Cited by 261 · see citing works
Debunking Myths and Urban Legends About Meta-Analysis
Aguinis, H., Pierce, C. A., Bosco, F. A., Dalton, D. R., & Dalton, C. M. (2010) · Organizational Research Methods · doi:10.1177/1094428110375720 · Cited by 261 · see citing works
Stevens, A., Shamseer, L., Weinstein, E., Yazdi, F., Turner, L., Thielman, J., Altman, D. G., Hirst, A., Hoey, J., Palepu, A., et al. (2014) · BMJ · doi:10.1136/bmj.g3804 · Cited by 242 · see citing works
A Guide to Conducting a Meta-Analysis
Cheung, M. W.-L., & Vijayakumar, R. (2016) · Neuropsychology Review · doi:10.1007/s11065-016-9319-z · Cited by 239 · see citing works
Are Computers Effective Lie Detectors? A Meta-Analysis of Linguistic Cues to Deception
Hauch, V., Blandón‐Gitlin, I., Masip, J., & Sporer, S. L. (2014) · Personality and Social Psychology Review · doi:10.1177/1088868314556539 · Cited by 234 · see citing works
On the reproducibility of meta-analyses: six practical recommendations
Lakens, D., Hilgard, J., & Staaks, J. P. C. (2016) · BMC Psychology · doi:10.1186/s40359-016-0126-3 · Cited by 231 · see citing works
Dignath, C., Rimm‐Kaufman, S. E., van Ewijk, R. J. G., & Kunter, M. (2022) · Educational Psychology Review · doi:10.1007/s10648-022-09695-0 · Cited by 324 · see citing works
Kepes, S., McDaniel, M. A., Brannick, M. Τ., & Banks, G. C. (2013) · Journal of Business and Psychology · doi:10.1007/s10869-013-9300-2 · Cited by 221 · see citing works
Goodman, S. H., Simon, H. F. M., Shamblaw, A. L., & Kim, C. Y. (2020) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-020-00322-4 · Cited by 251 · see citing works
Larson‐Hall, J., & Plonsky, L. (2015) · Language Learning · doi:10.1111/lang.12115 · Cited by 207 · see citing works
Salgado, J. F., & Táuriz, G. (2014) · European Journal of Work and Organizational Psychology · doi:10.1080/1359432x.2012.716198 · Cited by 205 · see citing works
Peng, J., Li, M., Wang, Z., & Lin, Y. (2020) · The Journal of Applied Behavioral Science · doi:10.1177/0021886320920366 · Cited by 234 · see citing works
White, C. A., Uttl, B., & Holder, M. D. (2019) · PLoS ONE · doi:10.1371/journal.pone.0216588 · Cited by 203 · see citing works
The Effects of Family Therapies for Adolescent Delinquency and Substance Abuse: A Meta‐analysis
Baldwin, S. A., Christian, S., Berkeljon, A., & Shadish, W. R. (2012) · Journal of Marital and Family Therapy · doi:10.1111/j.1752-0606.2011.00248.x · Cited by 244 · see citing works
A Regression Framework for Effect Size Assessments in Longitudinal Modeling of Group Differences
Feingold, A. (2012) · Review of General Psychology · doi:10.1037/a0030048 · Cited by 199 · see citing works
Best‐practice recommendations for estimating interaction effects using meta‐analysis
Aguinis, H., Gottfredson, R. K., & Wright, T. A. (2010) · Journal of Organizational Behavior · doi:10.1002/job.719 · Cited by 200 · see citing works
Psychology's Replication Crisis and Clinical Psychological Science
Tackett, J. L., Brandes, C. M., King, K. M., & Markon, K. E. (2019) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050718-095710 · Cited by 196 · see citing works
Berrone, P., Durán, P., Gómez‐Mejía, L. R., Heugens, P. P. M. A. R., Kostova, T., & van Essen, M. (2020) · Journal of International Business Studies · doi:10.1057/s41267-020-00362-6 · Cited by 188 · see citing works
Nguyen, L., Murphy, K. A., & Andrews, G. (2019) · Psychological Bulletin · doi:10.1037/bul0000196 · Cited by 189 · see citing works
A Meta-Analysis of Interpersonal and Organizational Workplace Deviance Research
Mackey, J. D., McAllister, C. P., Ellen, B. P., & Carson, J. E. (2019) · Journal of Management · doi:10.1177/0149206319862612 · Cited by 183 · see citing works
Weisz, J. R., Kuppens, S., Ng, M. Y., Vaughn-Coaxum, R. A., Ugueto, A. M., Eckshtain, D., & Corteselli, K. A. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691618805436 · Cited by 180 · see citing works
Plonsky, L. (2014) · Modern Language Journal · doi:10.1111/j.1540-4781.2014.12058.x · Cited by 187 · see citing works
Youngstrom, E. A., Meter, A. V., Frazier, T. W., Hunsley, J. D., Prinstein, M. J., Ong, M., & Youngstrom, J. K. (2017) · Clinical Psychology Science and Practice · doi:10.1111/cpsp.12207 · Cited by 184 · see citing works
A Review of Meta-Analyses in Education
Ahn, S., Ames, A. J., & Myers, N. D. (2012) · Review of Educational Research · doi:10.3102/0034654312458162 · Cited by 165 · see citing works
Van Meter, A. R., Burke, C., Youngstrom, E. A., Faedda, G. L., & Correll, C. U. (2016) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2016.04.017 · Cited by 174 · see citing works
Jonsson, U., Alaie, I., Parling, T., & Arnberg, F. K. (2014) · Contemporary Clinical Trials · doi:10.1016/j.cct.2014.02.005 · Cited by 175 · see citing works
The CALL-SLA interface: Insights from a second-order synthesis
Plonsky, L., & Ziegler, N. (2016) · Language learning & technology · doi:10.64152/10125/44459 · Cited by 178 · see citing works
Polanin, J. R., Espelage, D. L., Grotpeter, J. K., Ingram, K., Michaelson, L., Spinney, E., Valido, A., Sheikh, A. E., Torgal, C., & Robinson, L. (2022) · Prevention Science · doi:10.1007/s11121-021-01259-y · Cited by 171 · see citing works
Sample size in psychological research over the past 30 years
Marszalek, J. M., Barber, C., Kohlhart, J., & Cooper, B. H. (2011) · Perceptual and Motor Skills · doi:10.2466/03.11.pms.112.2.331-348 · Cited by 167 · see citing works
Lee, G., Benoit-Bryan, J. M., & Johnson, T. P. (2011) · Public Administration Review · doi:10.1111/j.1540-6210.2011.02482.x · Cited by 161 · see citing works
Plonsky, L., & Gönülal, T. (2015) · Language Learning · doi:10.1111/lang.12111 · Cited by 158 · see citing works
Etiology of obsessions and compulsions: A meta-analysis and narrative review of twin studies
Taylor, S. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2011.09.008 · Cited by 156 · see citing works
Attrition in developmental psychology
Nicholson, J. S., Deboeck, P. R., & Howard, W. (2015) · International Journal of Behavioral Development · doi:10.1177/0165025415618275 · Cited by 158 · see citing works
Gonzalez-Mule, E. N., & Aguinis, H. (2017) · Journal of Management · doi:10.1177/0149206317710723 · Cited by 157 · see citing works
An A–Z of Applied Linguistics Research Methods
Loewen, S., & Plonsky, L. (2016) · doi:10.1007/978-1-137-40322-3 · Cited by 156 · see citing works
Is the Dodo bird endangered in the 21st century? A meta-analysis of treatment comparison studies
Marcus, D. K., O'Connell, D., Norris, A. L., & Sawaqdeh, A. (2014) · Clinical Psychology Review · doi:10.1016/j.cpr.2014.08.001 · Cited by 148 · see citing works
Describing reporting guidelines for health research: a systematic review
Moher, D., Weeks, L., Ocampo, M., Seely, D., Sampson, M., Altman, D. G., Schulz, K. F., Miller, D., Simera, I., Grimshaw, J., et al. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.09.013 · Cited by 151 · see citing works
Predictive Physiological Anticipation Preceding Seemingly Unpredictable Stimuli: A Meta-Analysis
Mossbridge, J., Tressoldi, P. E., & Utts, J. M. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00390 · Cited by 148 · see citing works
Revealed or Concealed? Transparency of Procedures, Decisions, and Judgment Calls in Meta-Analyses
Aytug, Z. G., Rothstein, H. R., Zhou, W., & Kern, M. C. (2011) · Organizational Research Methods · doi:10.1177/1094428111403495 · Cited by 145 · see citing works
Multimedia Design for Learning: An Overview of Reviews With Meta-Meta-Analysis
Noetel, M., Griffith, S., Delaney, O., Harris, N. R., Sanders, T., Parker, P., del Pozo Cruz, B., & Lonsdale, C. (2022) · Review of Educational Research · doi:10.3102/00346543211052329 · Cited by 148 · see citing works
Sloan, D. M., Marx, B. P., Bovin, M. J., Feinstein, B. A., & Gallagher, M. W. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.07.001 · Cited by 140 · see citing works
Boehnlein, P., & Baum, M. (2020) · The International Journal of Human Resource Management · doi:10.1080/09585192.2020.1737177 · Cited by 140 · see citing works
How diverse are the samples used to study intimate relationships? A systematic review
Williamson, H. C., Bornstein, J. X., Cantu, V., Ciftci, O., Farnish, K. A., & Schouweiler, M. T. (2021) · Journal of Social and Personal Relationships · doi:10.1177/02654075211053849 · Cited by 143 · see citing works
Baumel, A., Pawar, A. K. S., Kane, J. M., & Correll, C. U. (2016) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/cap.2016.0048 · Cited by 141 · see citing works
Benefits of Physical Activity for Adolescents with Autism Spectrum Disorders: A Comprehensive Review
Sorensen, C., & Zarrett, N. R. (2014) · Review Journal of Autism and Developmental Disorders · doi:10.1007/s40489-014-0027-4 · Cited by 137 · see citing works
Drug Treatment of Primary Insomnia: A Meta-Analysis of Polysomnographic Randomized Controlled Trials
Winkler, A., Auer, C. J., Doering, B. K., & Rief, W. (2014) · CNS Drugs · doi:10.1007/s40263-014-0198-7 · Cited by 139 · see citing works
A checklist to improve reporting of group-based behaviour-change interventions
Borek, A., Abraham, C., Smith, J. R., Greaves, C. J., & Tarrant, M. (2015) · BMC Public Health · doi:10.1186/s12889-015-2300-6 · Cited by 139 · see citing works
Efficacy of group treatment for posttraumatic stress disorder symptoms: A meta-analysis.
Sloan, D. M., Feinstein, B. A., Gallagher, M. W., Beck, J. G., & Keane, T. M. (2011) · Psychological Trauma Theory Research Practice and Policy · doi:10.1037/a0026291 · Cited by 132 · see citing works
Outcome-Reporting Bias in Education Research
Pigott, T. D., Valentine, J. C., Polanin, J. R., Williams, R. T., & Canada, D. D. (2013) · Educational Researcher · doi:10.3102/0013189x13507104 · Cited by 127 · see citing works
Feingold, A. (2014) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0037721 · Cited by 126 · see citing works
Dissociation and emotion regulation strategies: A meta-analytic review
Cavicchioli, M., Scalabrini, A., Northoff, G., Mucci, C., Ogliari, A., & Maffei, C. (2021) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2021.09.011 · Cited by 130 · see citing works
Diversity in randomized clinical trials of depression: A 36-year review
Polo, A. J., Makol, B. A., Castro, A. S., Colón-Quintana, N., Wagstaff, A. E., & Guo, S. (2019) · Clinical Psychology Review · doi:10.1016/j.cpr.2018.09.004 · Cited by 114 · see citing works
Meta-analyzing SECOND LANGUAGE Research*
Plonsky, L., & Oswald, F. L. (2015) · Routledge eBooks · doi:10.4324/9781315870908-6 · Cited by 127 · see citing works
Improving the reporting quality of reliability generalization meta‐analyses: The REGEMA checklist
Sánchez‐Meca, J., Marín‐Martínez, F., López-López, J. A., Núñez, R. M. N., Rubio‐Aparicio, M., García, J. J. L., Pina, J. A. L., Blázquez-Rincón, D., López‐Ibáñez, C., & López‐Nicolás, R. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1487 · Cited by 127 · see citing works
Atkinson, K. M., Koenka, A. C., Sanchez, C. E., Moshontz, H., & Cooper, H. M. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1127 · Cited by 126 · see citing works
Smith, T. E., & Sheridan, S. M. (2018) · Journal of Educational and Psychological Consultation · doi:10.1080/10474412.2018.1460725 · Cited by 134 · see citing works
How Trustworthy Is the Scientific Literature in Industrial and Organizational Psychology?
Kepes, S., & McDaniel, M. A. (2013) · Industrial and Organizational Psychology · doi:10.1111/iops.12045 · Cited by 125 · see citing works
Reporting of demographic variables in the <i>Journal of Applied Behavior Analysis</i>
Jones, S. H., St. Peter, C. C., & Ruckle, M. M. (2020) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.722 · Cited by 129 · see citing works
Guidelines for Reporting Quantitative Methods and Results in Primary Research
Norris, J. M., Plonsky, L., Ross, S. J., & Schoonen, R. (2015) · Language Learning · doi:10.1111/lang.12104 · Cited by 121 · see citing works
A meta-analysis of the effect of virtual reality technology use in education
Yu, Z. (2021) · Interactive Learning Environments · doi:10.1080/10494820.2021.1989466 · Cited by 128 · see citing works
Fabiano, G. A., Schatz, N. K., Aloe, A. M., Chacko, A., & Chronis-Tuscano, A. M. (2015) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-015-0178-6 · Cited by 118 · see citing works
Grant, S. P., Mayo-Wilson, E., Melendez-Torres, G. J., & Montgomery, P. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065442 · Cited by 111 · see citing works
Implementing Effective Educational Practices at Scales of Social Importance
Horner, R. H., Sugai, G., & Fixsen, D. L. (2017) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-017-0224-7 · Cited by 114 · see citing works
Spatial Abilities and Aging: A Meta-Analysis
Techentin, C., Voyer, D., & Voyer, S. D. (2014) · Experimental Aging Research · doi:10.1080/0361073x.2014.926773 · Cited by 112 · see citing works
Effect sizes and the interpretation of research results in international business
Ellis, P. (2010) · Journal of International Business Studies · doi:10.1057/jibs.2010.39 · Cited by 113 · see citing works
Quantitative research methods and study quality in learner corpus research
Paquot, M., & Plonsky, L. (2017) · International Journal of Learner Corpus Research · doi:10.1075/ijlcr.3.1.03paq · Cited by 111 · see citing works
Sommers‐Spijkerman, M., Trompetter, H. R., Schreurs, K. M. G., & Bohlmeijer, E. T. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000268 · Cited by 110 · see citing works
Locklear, L. R., Sheridan, S. B., & Kong, D. T. (2022) · Journal of Organizational Behavior · doi:10.1002/job.2624 · Cited by 108 · see citing works
- Authors
- APA Publications and Communications Board Working Group on Journal Article Reporting Standards
- Corresponding author
- APA Publications and Communications Board Working Group on Journal Article Reporting Standards
- Venue
- American Psychologist
- Published
- 2008-12
- Volume
- 63
- Issue
- 9
- Pages
- 839-851
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- PMC
- PMC2957094
- OpenAlex
- W2444484626
- Cited by
- 571
- References
- 17
- Citations by year
- 2026: 18 · 2025: 18 · 2024: 21 · 2023: 25 · 2022: 34 · 2021: 60 · 2020: 38 · 2019: 34 · 2018: 43 · 2017: 37 · 2016: 44 · 2015: 46 · 2014: 47 · 2013: 40 · 2012: 24
- FWCI
- 15.50
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- American Psychologist (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (R01HD048962)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Academic Writing and Publishing
- Keywords
- reporting guidelines, research reporting, APA Publication Manual, meta-analysis reporting, intervention evaluation, random assignment, research transparency
- MeSH terms
- Humans, Periodicals as Topic, Psychology, Publishing, Research Design, Societies, Scientific, Meta-Analysis as Topic, Guidelines as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
