Cited by 115Psychology Research and BibliometricsDecision-Making and Behavioral EconomicsPsychometric Methodologies and Testing

The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.

How often are our numbers wrong?

Rosenthal, Robert·1978·American Psychologist

DOI 10.1037/0003-066x.33.11.1005

Open this paper in CoChat — free account

Integrity signals

Registry

Crossref · 10.1037/0003-066x.33.11.1005

Cites

14 of 14 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Exploratory Data Analysis
David, F. N., & Tukey, J. W. (1977) · Biometrics · doi:10.2307/2529486 · Cited by 12,707
Statistical Methods -6th ed.-
Snedecor, G. W., & Cochran, W. G. (1967) · Cited by 6,573
Artifact in behavioral research
Rosenthal, R., & Rosnow, R. L. (1969) · Medical Entomology and Zoology · Cited by 1,186
Self-citation
A history of experimental psychology, 2nd ed.
Boring, E. G. (1950) · Cited by 488
The Volunteer Subject
Wortman, C. B., Rosenthal, R., & Rosnow, R. L. (1976) · The American Journal of Psychology · doi:10.2307/1421418 · Cited by 428
Self-citation
The Interpretation of Levels of Significance by Psychological Researchers
Rosenthal, R., & Gaito, J. M. (1963) · The Journal of Psychology · doi:10.1080/00223980.1963.9916596 · Cited by 183
Self-citation
Experimenter effects in behavioral research, Enlarged ed.
Rosenthal, R. (1976) · Cited by 67
Self-citation
Teacher Expectancy as Related to the Academic and Personal Growth of Primary-Age Children
Fleming, E. S., & Anttonen, R. G. (1971) · Monographs of the Society for Research in Child Development · doi:10.2307/1165748 · Cited by 18
VARIABLES AFFECTING EXPERIMENTER BIAS IN A GROUP SITUATION.
Rosenthal, R. H., Friedman, C. J., Ca, J., Fode, K. L., Schill, T. R., Rc, W., & Vikan-Kline, L. (1964) · PubMed · Cited by 11
Self-citation
Bias Effects and Awareness in Studies of Verbal Conditioning.
Doctor, R. M. (1968) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 10

Show all 14 references

Sorted by citations

Meta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews
Rosenthal, R., & DiMatteo, M. R. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.59 · Cited by 1,780
Self-citation
Interpersonal expectancy effects: the first 345 studies
Rosenthal, R., & Rubin, D. B. (1978) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00075506 · Cited by 1,158
Self-citation
Spatial data analysis: theory and practice
(2004) · Choice Reviews Online · doi:10.5860/choice.41-3486 · Cited by 965
Observer bias in randomised clinical trials with binary outcomes: systematic review of trials with both blinded and non-blinded outcome assessors
Hróbjartsson, A., Thomsen, A. S. S., Emanuelsson, F., Tendal, B., Hilden, J., Boutron, I., Ravaud, P., & Brorson, S. (2012) · BMJ · doi:10.1136/bmj.e1119 · Cited by 505
Scientific Utopia: I. Opening Scientific Communication
Nosek, B. A., & Bar‐Anan, Y. (2012) · Psychological Inquiry · doi:10.1080/1047840x.2012.692215 · Cited by 387
The (mis)reporting of statistical results in psychology journals
Bakker, M., & Wicherts, J. M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0089-5 · Cited by 356
Data availability, reusability, and analytic reproducibility: evaluating the impact of a mandatory open data policy at the journal Cognition
Hardwicke, T. E., Mathur, M. B., MacDonald, K., Nilsonne, G., Banks, G. C., Kidwell, M. C., Hofelich Mohr, A., Clayton, E., Yoon, E. J., Henry Tessler, M., et al. (2018) · Royal Society Open Science · doi:10.1098/rsos.180448 · Cited by 336
Spatial Data Analysis
Haining, R. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754944 · Cited by 1,050
Rater (dis)agreement on risk assessment measures in sexually violent predator proceedings: Evidence of adversarial allegiance in forensic evaluation?
Murrie, D. C., Boccaccini, M. T., Turner, D. B., Meeks, M., Woods, C. L., & Tussey, C. M. (2009) · Psychology Public Policy and Law · doi:10.1037/a0014897 · Cited by 203
Science and Ethics in Conducting, Analyzing, and Reporting Psychological Research
Rosenthal, R. (1994) · Psychological Science · doi:10.1111/j.1467-9280.1994.tb00646.x · Cited by 208
Self-citation
Context effects in forensic science: A review and application of the science of science to crime laboratory practice in the United States
Saks, M. J., Risinger, D. M., Rosenthal, R., & Thompson, W. C. (2003) · Science & Justice · doi:10.1016/s1355-0306(03)71747-x · Cited by 150
Self-citation
Cognitive issues in fingerprint analysis: Inter- and intra-expert consistency and the effect of a ‘target’ comparison
Dror, I. E., Champod, C., Langenburg, G., Charlton, D., Hunt, H., & Rosenthal, R. (2010) · Forensic Science International · doi:10.1016/j.forsciint.2010.10.013 · Cited by 135
Self-citation
Précis ofBias in Mental Testing
Jensen, A. R. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005161 · Cited by 105
"Pygmalion" Effects: Existence, Magnitude, and Social Importance
Rosenthal, R. (1987) · Educational Researcher · doi:10.3102/0013189x016009037 · Cited by 86
Self-citation
A Meta-analysis of Loss Aversion in Product Choice
Neumann, N., & Böckenholt, U. (2014) · Journal of Retailing · doi:10.1016/j.jretai.2014.02.002 · Cited by 83
The management of domain irrelevant context information in forensic handwriting examination casework
Found, B. J., & Ganas, J. (2012) · Science & Justice · doi:10.1016/j.scijus.2012.10.004 · Cited by 81
Expanding forensic science through forensic intelligence
Olivier Ribaux, A., & Talbot-Wright, B. (2014) · Science & Justice · doi:10.1016/j.scijus.2014.05.001 · Cited by 58
A selected history of expectation bias in physics
Jeng, M. (2006) · American Journal of Physics · doi:10.1119/1.2186333 · Cited by 53
Data availability, reusability, and analytic reproducibility: Evaluating the impact of a mandatory open data policy at the journal CognitionPreprint
Hardwicke, T. E., Mathur, M. B., MacDonald, K. E., Nilsonne, G., Banks, G. C., Kidwell, M. C., Mohr, A. H., Clayton, E., Yoon, E. J., Tessler, M. H., et al. (2018) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/39cfb · Cited by 63
Affiliation Bias in Arbitration: An Experimental Approach
Puig, S., & Strezhnev, A. (2016) · The Journal of Legal Studies · doi:10.1086/694416 · Cited by 51
Just how objective is science?
Hetherington, N. S. (1983) · Nature · doi:10.1038/306727a0 · Cited by 51
On Trees and Triviality Traps: Locating the Debate on the Contribution of Cognitive Mapping to Organizational Research
Daniels, K., & Johnson, G. (2002) · Organization Studies · doi:10.1177/017084060202300104 · Cited by 50
Forensic intelligence: deregulation or return to the roots of forensic science?
Olivier Ribaux, A., Crispino, F., & Roux, C. P. (2014) · Australian Journal of Forensic Sciences · doi:10.1080/00450618.2014.906656 · Cited by 42
A selected history of expectation bias in physics
Jeng, M. (2005) · CERN Document Server (European Organization for Nuclear Research) · Cited by 40
Going beyond the narrative summarization of research findings: The meta‐analysis approach
Curlette, W. L., & Cannella, K. S. (1985) · Research in Nursing & Health · doi:10.1002/nur.4770080312 · Cited by 37
Unbiased tests and biased people
Clarke, A. M. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005215 · Cited by 28
Qualitative plus/versus quantitative: The last word
Smith, M. L. (1994) · New Directions for Program Evaluation · doi:10.1002/ev.1666 · Cited by 26
Correcting the bias against mental testing: A preponderance of peer agreement
Jensen, A. R. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005458 · Cited by 25
The Robustness of Validity and Efficiency of the Related Samples t-Test in the Presence of Outliers
Joula, J. F., Zumbo, B. D., & Jennings, M. (2002) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 24
The Effect of Blinded Experts on Juror Verdicts
Robertson, C. T., & Yokum, D. V. (2012) · Journal of Empirical Legal Studies · doi:10.1111/j.1740-1461.2012.01273.x · Cited by 18
The Role of Human Fallibility in Psychological Research: A Survey of Mistakes in Data Management
Kovács, M., Hoekstra, R., & Aczél, B. (2021) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459211045930 · Cited by 19
In support of Bias in Mental Testing and scientific inquiry
Reynolds, C. R. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005367 · Cited by 19
The NAS Report on Forensic Science: A Glass Nine-Tenths Full (This is About the Other Tenth)Preprint
Risinger, D. M. (2009) · SSRN Electronic Journal · doi:10.2139/ssrn.1437276 · Cited by 19
Experimenter and clinician effects in scientific inquiry and clinical practice.
Rosenthal, R. (2002) · Prevention & Treatment · doi:10.1037/1522-3736.5.1.538c · Cited by 22
Self-citation
Intelligence and test bias: Art and science
Sternberg, R. J. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005380 · Cited by 17
How Often are Our Statistics Wrong? a Statistics Class Exercise
Rossi, J. S. (1987) · Teaching of Psychology · doi:10.1207/s15328023top1402_8 · Cited by 15
Blinding prosecutors to defendants’ race: A policy proposal to reduce unconscious bias in the criminal justice system
Sah, S., Robertson, C. T., & Baughman, S. B. (2015) · Behavioral Science & Policy · doi:10.1353/bsp.2015.0013 · Cited by 16
Some Thoughts about Classification
Hampel, F. R. (2002) · Studies in classification, data analysis, and knowledge organization · doi:10.1007/978-3-642-56181-8_1 · Cited by 16
Blinding prosecutors to defendants’ race: A policy proposal to reduce unconscious bias in the criminal justice system
Sah, S., Robertson, C. T., & Baughman, S. B. (2015) · Behavioral Science & Policy · doi:10.1177/237946151500100208 · Cited by 15
Towards a forensic semiotics
Crispino, F. (2024) · Forensic Science International · doi:10.1016/j.forsciint.2024.111968 · Cited by 15
When ab ≠ c – c′: Published errors in the reports of single-mediator models
Petrocelli, J. V., Clarkson, J. J., Whitmire, M. B., & Moon, P. E. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0262-5 · Cited by 12
Implications of valid (and stubborn) IQ differences: An unstatesmanlike view
Gordon, R. A. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005264 · Cited by 13
Against representative agent methodology
Koppl, R. G. (2010) · The Review of Austrian Economics · doi:10.1007/s11138-010-0119-z · Cited by 10
Allegiance Effects in Clinical Psychology Research and Practice
Boccaccini, M. T., Marcus, D. K., & Murrie, D. C. (2017) · Wiley eBooks · doi:10.1002/9781119095910.ch16 · Cited by 9
Inaccuracy in the Scientific Record and Open Postpublication Critique
Brewin, C. R. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916221141357 · Cited by 10
The Money Blind: How to Stop Industry Bias in Biomedical Science, without Violating the First Amendment
Robertson, C. T. (2011) · American Journal of Law & Medicine · doi:10.1177/009885881103700207 · Cited by 9
Designing the Study
Steenbarger, B. N., & Manchester, R. A. (1996) · Journal of American College Health · doi:10.1080/07448481.1996.9937532 · Cited by 9
The Spearman-Jensen hypothesis
Osborne, R. T. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005355 · Cited by 9
Experiments Testing Models of Mind-Matter Interaction
Radin, D. I. (2006) · Cited by 8
“They talk of some strict testing of us – Pish”
Cattell, R. B. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005203 · Cited by 8
Correlation, regression and biased science
Vetta, A. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005422 · Cited by 8
Devising Relevant and Topical Undergraduate Laboratory Projects: The Core Article Approach
Chamberlain, K. (1988) · Teaching of Psychology · doi:10.1207/s15328023top1504_10 · Cited by 8
Estimating the Errors Remaining in a Data Set: Techniques for Quality Control
Strayhorn, J. M. (1990) · The American Statistician · doi:10.1080/00031305.1990.10475684 · Cited by 8
Assent, Dissent, and Rhetoric in Science
Harris, R. A. (1990) · Rhetoric Society Quarterly · doi:10.1080/02773949009390867 · Cited by 7
Controversies surrounding mental testing
Kempthorne, O., & Wolins, L. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0000532x · Cited by 7
The definitive work on mental test bias
Longstreth, L. E. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005343 · Cited by 6
Race, the heritability of IQ, and the intellectual scale of nature
Wahłsten, D. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005446 · Cited by 6
An existence proof for intelligence?
Vandenberg, S. G. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005409 · Cited by 6
Test bias: What did Yale, Harvard, Rolls-Royce, and a black have in common in 1917?
Dorfman, D. D. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005227 · Cited by 6
Compensatory education has succeeded
Hirsch, J., Beeman, M. J., & Tully, T. P. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005306 · Cited by 6
Sequential Unmasking: Minimizing Observer Effects in Forensic Science
Inman, K., & Rudin, N. (2013) · Encyclopedia of Forensic Sciences · doi:10.1016/b978-0-12-382165-2.00286-5 · Cited by 5
Error and bias in the selection of data
Rosenthal, R. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005379 · Cited by 5
Self-citation
Research in College Health 2: Designing the Study
Steenbarger, B. N., & Manchester, R. A. (1993) · Journal of American College Health · doi:10.1080/07448481.1993.9940451 · Cited by 5
Teaching Students the Importance of Accuracy in Research
Cronan-Hillix, T. (1988) · Teaching of Psychology · doi:10.1207/s15328023top1504_9 · Cited by 5
Differential construct validity
Brody, N., & Brody, E. B. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005197 · Cited by 5
The insights from the crowd: Drawing inferences from many approaches to key empirical questions in international business
Delios, A., Hu, T., Yu, S., Zhou, N., Ahsan, F. M., Bahl, M., Bai, T., Basu, M., Bathula, H., Batsakis, G. K., et al. (2025) · Journal of International Business Studies · doi:10.1057/s41267-025-00808-9 · Cited by 3
Hypothesis testing in the presence of spatial dependence
Haining, R. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754944.010 · Cited by 3
Observation Error and Bias in Accounting Research
Copeland, R. M., Taylor, R. L., & Brown, S. H. (1981) · Journal of Accounting Research · doi:10.2307/2490969 · Cited by 3
The stress response, psychoeducational interventions and assisted reproduction technology treatment outcomes : a meta-analytic review
Mumford, K. (2004) · Digital Commons - University of South Florida (University of South Florida) · Cited by 3
An Investigation of Factors that Create and Mitigate Confirmation Bias in Judgments of Handwriting Evidence
Kukucka, J. (2014) · CUNY Academic Works (City University of New York) · Cited by 2
Using Procedural Justice to Understand, Explain, and Prevent Decision-Making Errors in Forensic Sciences
Behson, S. J., & Koppl, R. G. (2013) · Organization Management Journal · doi:10.1080/15416518.2013.801743 · Cited by 2
Systematic review on trace processing and forensic science contributions. Part I: Decision-making steps
Divoy, J., Lemans, I., & Bitzer, S. (2026) · Forensic Science International · doi:10.1016/j.forsciint.2026.112843 · Cited by 2
What Steps can be Taken to Reduce Unconscious Bias in the Workplace?
Zhu, B. (2023) · Academic Journal of Management and Social Sciences · doi:10.54097/ajmss.v5i1.14088 · Cited by 1
THE EFFECT OF SOME ESTIMATORS OF BETWEEN-STUDY VARIANCE ON RANDOM-EFFECTS META-ANALYSIS
Dogo, S. H. (2017) · Science World Journal · Cited by 2
Empirically Based Myths: Astrology, Biorhythms, and ATIs
Ragsdale, R. G. (1980) · Canadian Journal of Education / Revue canadienne de l éducation · doi:10.2307/1494637 · Cited by 2
Confirmation Bias in Forensic Science
(2018) · Elsevier eBooks · doi:10.1016/b978-0-12-802655-7.00007-1 · Cited by 2
Test bias and problems in cross-cultural testing
Kline, P. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005331 · Cited by 2
The problem of hierarchial thought in the work of Arthur Jensen
Eckberg, D. L. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005239 · Cited by 2
Intelligence testing: the importance of a difference should be evaluated independently of its causes
Humphreys, L. G. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005318 · Cited by 2
Competent teachers and competent students
Eckland, B. K. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005240 · Cited by 2
Individual versus collective social justice
Havender, W. R. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0000529x · Cited by 2
Bias cuts deeper than scores
Economos, J. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005252 · Cited by 2
Exploratory spatial data analysis: numerical methods
Haining, R. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754944.009 · Cited by 2
The nature of spatial data
Haining, R. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754944.004 · Cited by 1
Spatial data analysis: scientific and policy context
Haining, R. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754944.003 · Cited by 1
Data quality: implications for spatial data analysis
Haining, R. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754944.006 · Cited by 2
Genetic influences on IQ
Vogel, F. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005434 · Cited by 1
Population validity and admissions decisions
Breland, H. M. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005185 · Cited by 1
Antitest views are refuted
Vernon, P. E. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005410 · Cited by 1
Criteria of test bias: do the statistical models fit reality?
Harrington, G. M. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005288 · Cited by 1
Social bias in mental testing
Brace, C. L. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005173 · Cited by 1
Tests are not to blame
Tyler, L. E. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005392 · Cited by 1
Achievement test bias
Green, D. R. (1980) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00005276 · Cited by 1
Good science, bad science: Questioning research practices in psychological research
Bakker, M. (2014) · UvA-DARE (University of Amsterdam) · Cited by 1
Exploratory spatial data analysis: conceptual models
Haining, R. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754944.007 · Cited by 1
Statistical modelling of spatial variation: explanatory modelling
Haining, R. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754944.013 · Cited by 1
Obtaining spatial data through sampling
Haining, R. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754944.005
Data Cleaning in Occupational Therapy Research
Dijkers, M. P. J. M., & Creighton, C. L. (1994) · The Occupational Therapy Journal of Research · doi:10.1177/153944929401400302
Studies of knowledge synthesis
Ward, S. A. (1980) · Evaluation in Education · doi:10.1016/0191-765x(80)90044-0
Cambridgeshire lung cancer data
Haining, R. (2003) · Cambridge University Press eBooks · doi:10.1017/cbo9780511754944.015

Authors: Rosenthal, R.
Affiliations: Harvard University (US)
Corresponding author: Rosenthal, Robert
Venue: American Psychologist
Publisher: American Psychological Association (APA)
Published: 1978-11
Volume: 33
Issue: 11
Pages: 1005-1008
ISSN: 0003-066X (ISSN-L)
1935-990X
DOI: 10.1037/0003-066x.33.11.1005
OpenAlex: W2031227039
Cited by: 115
References: 14
Citations by year: 2026: 1 · 2025: 1 · 2024: 1 · 2023: 2 · 2021: 1 · 2018: 4 · 2017: 2 · 2016: 3 · 2015: 3 · 2014: 5 · 2013: 2 · 2012: 5
FWCI: 19.83
Type: journal article
Language: en
Open access: closed
Locations: American Psychologist (publishedVersion)
Topics: Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Keywords: measurement error, reliability statistics, measurement accuracy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How often are our numbers wrong?

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks