A meta-analysis of interrater and internal consistency reliability of selection interviews.

Conway, James M., Jako, Robert A., Goodman, Deborah F.·1995·Journal of Applied Psychology
DOI 10.1037//0021-9010.80.5.565

Abstract

A meta-analysis of 111 interrater reliability coefficients and 49 coefficient alphas from selection interviews was conducted. Moderators of interrater reliability included study design, interviewer training, and 3 dimensions of interview structure ( standardization of questions, of response evaluation, and of combining multiple ratings). Interactions showed that standardizing questions had a stronger moderating effect on reliability when coefficients were from separate ( rather than panel) interviews, and multiple ratings were useful when combined mechanically (there was no evidence of usefulness when combined subjectively). Average correlations (derived from alphas) between ratings were moderated by standardization of questions and number of ratings made. Upper limits of validity were estimated to be.67 for highly structured interviews and.34 for unstructured interviews.

Cites (2)

  1. What is coefficient alpha? An examination of theory and applications
    Cortina, Jose M. · 1993 · Journal of Applied Psychology
  2. Methods of Meta-Analysis: Correcting Error and Bias in Research Findings
    Schmidt, Frank L., Hunter, John E. · 2015

Show all 2 references

Cited by (9)

  1. Information sharing and team performance: A meta-analysis
    Mesmer-Magnus, Jessica R., DeChurch, Leslie A. · 2009 · Journal of Applied Psychology
  2. An other perspective on personality: Meta-analytic integration of observers' accuracy and predictive validity.
    Connelly, Brian S., Ones, Deniz S. · 2010 · Psychological Bulletin
  3. Influence tactics and work outcomes: a meta analysis
    Higgins, Chad A., Judge, Timothy A., Ferris, Gerald R. · 2003 · Journal of Organizational Behavior
  4. Stubborn Reliance on Intuition and Subjectivity in Employee Selection
    Highhouse, Scott · 2008 · Industrial and Organizational Psychology
  5. What Drives Key Informant Accuracy?
    Homburg, Christian, Klarmann, Martin, Reimann, Martin, Schilke, Oliver · 2012 · Journal of Marketing Research

See all 318

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: A meta-analysis of interrater and internal consistency reliability of selection interviews. https://app.cochat.ai/papers/10.1037//0021-9010.80.5.565
The paper
Conway, J. M., Jako, R. A., & Goodman, D. F. (1995). A meta-analysis of interrater and internal consistency reliability of selection interviews. Journal of Applied Psychology. https://doi.org/10.1037//0021-9010.80.5.565

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.