Rater bias in psychological research: When is it a problem and what can we do about it?

Hoyt, William T.·2000·Psychological Methods

Cites (36)

  1. Statistical power analysis for the behavioral sciences
    1990 · Computers, Environment and Urban Systems
  2. Untitled work
    1998
  3. Intraclass correlations: Uses in assessing rater reliability.
    Shrout, Patrick E., Fleiss, Joseph L. · 1979 · Psychological Bulletin
  4. Structural Equations with Latent Variables.
    Clogg, Clifford C., Bollen, Kenneth A. · 1991 · Contemporary Sociology
  5. Convergent and discriminant validation by the multitrait-multimethod matrix.
    Campbell, Donald T., Fiske, Donald W. · 1959 · Psychological Bulletin
  6. A power primer.
    Cohen, Jacob · 1992 · Psychological Bulletin
  7. Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
    Schmidt, Frank L., Hunter, John E. · 2015
  8. The Handbook of Research Synthesis.
    Howel, D., Cooper, H., Hedges, L. V. · 1995 · Biometrics
  9. A constant error in psychological ratings.
    Thorndike, E.L. · 1920 · Journal of Applied Psychology
  10. The Dependability of Behavioral Measurements: Theory of Generalizability for Scores and Profiles
    Merrifield, Philip R., Cronbach, Lee J., Gleser, Goldine C., Nanda, Harinder, Rajaratnam, Nageswari · 1974 · American Educational Research Journal
  11. Interpersonal Perception: A Social Relations Analysis
    Kenny, David A. · 1988 · Journal of Social and Personal Relationships
  12. Correlation and causality
    David A. Kenny · 1979 · Medical Entomology and Zoology
  13. Generalizability theory: a primer
    1992 · Choice Reviews Online
  14. CORRELATION CALCULATED FROM FAULTY DATA
    SPEARMAN, C. · 1910 · British Journal of Psychology, 1904-1920
  15. The Social Relations Model
    Kenny, David A., La Voie, Lawrence · 1984 · Advances in Experimental Social Psychology
  16. Elements of Generalizability Theory
    Robert L. Brennan · 1992 · Medical Entomology and Zoology
  17. Measurement error in psychological research: Lessons from 26 research scenarios.
    Schmidt, Frank L., Hunter, John E. · 1996 · Psychological Methods
  18. Rating the ratings: Assessing the psychometric quality of rating data.
    Saal, Frank E., Downey, Ronald G., Lahey, Mary A. · 1980 · Psychological Bulletin
  19. What do data really mean? Research findings, meta-analysis, and cumulative knowledge in psychology.
    Schmidt, Frank L. · 1992 · American Psychologist
  20. Test “Reliability”: Its Meaning and Determination
    Cronbach, Lee J. · 1947 · Psychometrika
  21. A general model of consensus and accuracy in interpersonal perception.
    Kenny, David A. · 1991 · Psychological Review
  22. Balanced Incomplete Block Designs for Inter-Rater Reliability Studies
    Fleiss, Joseph L. · 1981 · Applied Psychological Measurement
  23. Nature and consequences of halo error: A critical analysis.
    Murphy, Kevin R., Jako, Robert A., Anhalt, Rebecca L. · 1993 · Journal of Applied Psychology
  24. A cautionary note on measurement error corrections in structural equation models.
    DeShon, Richard P. · 1998 · Psychological Methods
  25. Interrater reliability of job performance ratings: Growth to asymptote level with increasing opportunity to observe.
    Rothstein, Hannah R. · 1990 · Journal of Applied Psychology
  26. Magnitude and moderators of bias in observer ratings: A meta-analysis.
    Hoyt, William T., Kerns, Michael-David · 1999 · Psychological Methods
  27. STABILITY OF RATER LENIENCY: THREE STUDIES.
    Joanne Kane, H. John Bernardin, Peter D. Villanova, Joseph Peyrefitte · 1995 · Academy of Management Journal
  28. STUDENT EVALUATIONS OF TEACHING: THE GENERALIZABILITY OF CLASS MEANS
    Michael T. Kane, Gerald M. Gillmore, Terence J. Crooks · 1976 · Journal of Educational Measurement
  29. ERROR OF MEASUREMENT AND THE POWER OF A STATISTICAL TEST
    T. Anne Cleary, Robert L. Linn · 1969 · British Journal of Mathematical and Statistical Psychology
  30. Tests of Three Causal Models of Halo Rater Error
    Charles E. Lance, Julie A. LaPointe, Sebastiano A. Fisicaro · 1994 · Organizational Behavior and Human Decision Processes
  31. Dependability of Measurement in Counseling Psychology: An Introduction to Generalizability Theory
    William T. Hoyt, Janet Nieuwsma Melby · 1999 · The Counseling Psychologist
  32. On the relationship of reliability to statistical power.
    J. P. Sutcliffe · 1980 · Psychological Bulletin
  33. Least Squares Models to Correct for Rater Effects in Performance Assessment
    Mark R. Raymond, Chockalingam Viswesvaran · 1993 · Journal of Educational Measurement
  34. A method for investigating sources of rater bias.
    Clara E. Hill, Kevin E. O’Grady, Pauline B. Price · 1988 · Journal of Counseling Psychology
  35. Hunter, John E., and Frank L. Schmidt, Methods of Meta-Analysis: Correcting Error and Bias in Research Findings . Newbury Park, CA: Sage, 1990.
    John E. Hunter, Frank L. Schmidt · 1990 · Journal of International Crisis and Risk Communication Research
  36. Giving Method Variance Its Due
    Lee J. Cronbach · 2014 · Psychology Press eBooks

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.