The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Finding the missing science: The fate of studies submitted for review by a human subjects committee.
Open accessAbstract
Publication bias, including prejudice against the null hypothesis, and other biasing filters may operate on researchers as well as journal editors and reviewers. A survey asked 33 psychology researchers to describe the fate of 159 studies approved by their departmental human subjects review committee. About two thirds of completed studies did not result in published summaries. About half of the unpublished studies fell out of the process for reasons other than methodological quality. Among these, lack of interest and aims that did not include publication were cited more often than nonsignificant results as the reasons why publication was not pursued. However, significant findings were more likely than nonsignificant findings to be submitted for meeting presentation or publication. These results indicate attention needs to be paid to improving how psychological scientists communicate, especially to the creation of prospective research registers.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Publication bias may be the result of journals choosing not to publish papers with non-significant primary outcomes (Hopewell et al. 2009) or study authors choosing not to submit the study for publication (Cooper et al. 1997).”
From Effects of after-school programs with at-risk youth on attendance and externalizing behaviors: A systematic review and meta-analysis (2015) · cites this paper as Cooper et al. 1997
Citations
Cites
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022 · cited 1×
“Greenwald (1975) demonstrated that prejudice against the null hypothesis is not restricted to journal reviewers and editors only.”
BackgroundPublication bias: the case for an international registry of clinical trials.
Simes, R. J. (1986) · Journal of Clinical Oncology · doi:10.1200/jco.1986.4.10.1529 · Cited by 747
Minimizing the Three Stages of Publication Bias
Chalmers, T. C. (1990) · JAMA · doi:10.1001/jama.1990.03440100104016 · Cited by 226
Cooper, H. M., & Hedges, L. V. (1994) · Journal of International Crisis and Risk Communication Research · Cited by 170
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Items 101–145 of 145
van Aert, R. C. M., & Niemeyer, H. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_10 · Cited by 10
Lilienfeld, S. O., & Jones, M. K. (2008) · Clinical Psychology Science and Practice · doi:10.1111/j.1468-2850.2008.00148.x · Cited by 9
Critical Values Robust to P-Hacking
McCloskey, A., & Michaillat, P. (2024) · The Review of Economics and Statistics · doi:10.1162/rest_a_01456 · Cited by 11
Us versus Them in Context: Meta-Analysis as a Tool for Geotemporal Trends in Intergroup Relations
Tan, J. Y., Huedo-Medina, T. B., Lennon, C. A., White, A. C., & Johnson, B. T. (2010) · PubMed · doi:10.4119/ijcv-2832 · Cited by 7
Meta-analysis: A 12-step program
David, L. S. (2003) · Journal of Gambling Issues · doi:10.4309/jgi.2003.9.1 · Cited by 7
Make abandoned research publicly available
Lakens, D., & Ensinck, E. N. F. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01829-4 · Cited by 5
Problematic Online Dating: Systematic Review of Definitions, Correlates, and Study Designs
Thomas, M. F., Dörfler, S., Mittmann, G., & Steiner‐Hofbauer, V. (2025) · Journal of Medical Internet Research · doi:10.2196/72850 · Cited by 6
The perceived role of null results in school psychology research and publication
Iwachiw, J. S., Button, A. L., & Atlas, J. G. (2019) · School Psychology International · doi:10.1177/0143034319851230 · Cited by 6
Villers, M. J. D., & Cohn, T. M. (2017) · Nursing Management · doi:10.1097/01.numa.0000522183.31780.76 · Cited by 6
Hilk, C. L. (2013) · University of Minnesota Digital Conservancy (University of Minnesota) · Cited by 6
Veldkamp, C. L. S. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/g8cjq · Cited by 6
A Prospective Study of Coping and Adjustment in Adolescents With Craniofacial Conditions
Roberts, R., & Shute, R. H. (2012) · Children s Health Care · doi:10.1080/02739615.2012.657031 · Cited by 5
Meta-analysis in Prevention Science
Wilson, S. J., & Tanner‐Smith, E. E. (2014) · Springer eBooks · doi:10.1007/978-1-4899-7424-2_19 · Cited by 5
Marks‐Anglin, A., Luo, C., Piao, J., Gibbons, M. B. C., Schmid, C. H., Ning, J., & Chen, Y. (2021) · Biometrics · doi:10.1111/biom.13441 · Cited by 5
To Be or Not to Be: The Entrepreneur in Endogenous Growth TheoryPreprint
Henrekson, M., Johansson, D., & Karlsson, J. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3822341 · Cited by 5
Correcting for publication bias in a meta-analysis with the p-uniform* method
van Aert, R. C. M., & van Assen, M. A. L. M. (2026) · Psychonomic Bulletin & Review · doi:10.3758/s13423-025-02812-4 · Cited by 118
An Inception-Cohort Study Quantifying How Many Registered Studies Are Publicly Shared
Ensinck, E. N. F., & Lakens, D. (2025) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459241296031 · Cited by 9
Riniolo, T. C., & Schmidt, L. A. (2000) · The Journal of Psychology · doi:10.1080/00223980009600857 · Cited by 4
Pratt, T. C. (2011) · doi:10.1093/obo/9780195396607-0101 · Cited by 4
Muradchanian, J., Hoekstra, R., Kiers, H. A. L., & van Ravenzwaaij, D. (2020) · doi:10.31222/osf.io/wvdjf · Cited by 4
Quality assessment of scientific manuscripts in peer review and educationPreprint
Augusteijn, H. E. M., Wicherts, J. M., Sijtsma, K., & van Assen, M. A. L. M. (2023) · doi:10.31219/osf.io/7dc6a · Cited by 4
Streiner, D. L. (2016) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0000000000000625 · Cited by 3
Accelerating addiction research via Open Science and Team Science
Dora, J., Piccirillo, M. L., Foster, K. T., & King, K. M. (2023) · The Psychology of learning and motivation/The psychology of learning and motivation · doi:10.1016/bs.plm.2023.06.004 · Cited by 3
Les pratiques de recherche ouvertes en psychologie
Lantian, A. (2020) · Psychologie Française · doi:10.1016/j.psfr.2020.09.001 · Cited by 6
Dissertation R.C.M. van AertPreprint
van Aert, R. C. M. (2018) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/eqhjd · Cited by 3
Publication Bias in Meta-Analyses from Psychology and Medicine: A Meta-Meta-AnalysisPreprint
van Aert, R. C. M., Wicherts, J. M., & van Assen, M. A. L. M. (2017) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/czdp3 · Cited by 4
The role of results in deciding to publishPreprint
Muradchanian, J., Hoekstra, R., Kiers, H. A. L., & van Ravenzwaaij, D. (2023) · doi:10.31222/osf.io/dgshk · Cited by 2
Bausell, R. B. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197536537.003.0002 · Cited by 1
Döring, N. M. (2023) · Springer eBooks · doi:10.1007/978-3-662-64762-2_16 · Cited by 1
Good science, bad science: Questioning research practices in psychological research
Bakker, M. (2014) · UvA-DARE (University of Amsterdam) · Cited by 1
Research on Research: A Meta-Scientific Study of Problems and Solutions in Psychological SciencePreprint
Nuijten, M. B. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/qtk7e · Cited by 1
Wicherts, J. M. (2020) · Springer eBooks · doi:10.1007/978-3-319-24612-3_1307 · Cited by 1
Correcting for outcome reporting bias in a meta-analysis: A meta-regression approachPreprint
van Aert, R. C. M., & Wicherts, J. M. (2021) · doi:10.31222/osf.io/bn8vd · Cited by 1
Incentivizing Transparency in Psychological Science: Enter ScienpostingPreprint
Gullo, M., & O'Gorman, J. G. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2258209
The Effects of Induced Depressed Mood on Recall of Experiences with Racial Discrimination
Williams, T. Y. (2002) · Digital Commons - University of South Florida (University of South Florida)
Incomplete Reporting: Addressing the Prevalence of Outcome-Reporting Bias in Educational Research.
Trainor, B. C., Polanin, J. R., Williams, R. T., & Pigott, T. (2015) · Society for Research on Educational Effectiveness
Publication Bias: Assessment and Impact
Canestaro, W. J. (2017) · ResearchWorks at the University of Washington (University of Washington)
Augusteijn, H. E. M., van Aert, R. C. M., & van Assen, M. A. L. M. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/avkgj
Döring, N. M., & Bortz, J. (2015) · Springer-Lehrbuch · doi:10.1007/978-3-642-41089-5_16 · Cited by 3
vanAert_Niemeyer21Preprint
van Aert, R. C. M., & Niemeyer, H. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/3rdys
Wicherts, J. M. (2017) · Springer eBooks · doi:10.1007/978-3-319-28099-8_1307-1
Mellenbergh, G. J. (2019) · Springer eBooks · doi:10.1007/978-3-030-12272-0_19
Littell, J. H. (2024) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/8yz9a
Opening Up? Adoption of Open Science Practices in Democratic Innovation Research
Muradova, L. H., Ryan, M., Mestre, R., Gheasi, M., & Bolton, G. (2025) · PS: Political Science and Politics · doi:10.1017/s1049096525101297
Augusteijn, H. E. M., Wicherts, J. M., Sijtsma, K., & van Assen, M. A. L. M. (2026) · PLoS ONE · doi:10.1371/journal.pone.0355938 · Cited by 4
Metadata
- Authors
- Cooper, H., DeNeve, K., & Charlton, K.
- Affiliations
- University of Missouri (US)
- ORCID
- Cooper, Harris
- Venue
- Psychological Methods
- Published
- 1997-12
- Volume
- 2
- Issue
- 4
- Pages
- 447-452
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2120579488
- Cited by
- 144
- References
- 4
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 3 · 2023: 10 · 2022: 4 · 2021: 16 · 2020: 10 · 2019: 3 · 2018: 11 · 2017: 10 · 2016: 7 · 2015: 9 · 2014: 12 · 2013: 8 · 2012: 3
- FWCI
- 3.13
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-nd
- Locations
- Psychological Methods (publishedVersion)
- DukeSpace (Duke University) (submittedVersion, cc-by-nc-nd)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- publication bias, missing studies, unpublished research, null hypothesis significance testing, non-significant results, research register, scholarly communication, psychology research practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review