Quality of group judgment.

Einhorn, Hillel J., Hogarth, Robin M., Klempner, Eric·1977·Psychological Bulletin

Abstract

The quality of group judgment is examined in situations in which groups have to express an opinion in quantitative form. To provide a yardstick for evaluating the quality of group performance (which is itself defined as the absolute value of the discrepancy between the judgment and the true value), four baseline models are considered. These models provide a standard for evaluating how well groups perform. The four models are: (a) randomly picking a single individual; (b) weighting the judgments of the individual group members equally (the group mean); (c) weighting the "best " group member (i.e., the one closest to the true value) totally where the best is known, a priori, with certainty; (d) weighting the best member totally where there is a given probability of misidentifying the best and getting the second, third, etc., best member. These four models are examined under varying conditions of group size and "bias. " Bias is denned as the degree to which the expectation of the population of individual judgments does not equal the true value (i.e., there is systematic bias in individual judgments). A method is then developed to evaluate

Cites (21)

  1. Judgment under Uncertainty: Heuristics and Biases
    Tversky, Amos, Kahneman, Daniel · 1975 · Utility, Probability, and Human Decision Making
  2. An Experimental Application of the DELPHI Method to the Use of Experts
    Dalkey, Norman, Helmer, Olaf · 1963 · Management Science
  3. A study of normative and informational social influences upon individual judgment.
    Deutsch, Morton, Gerard, Harold B. · 1955 · The Journal of Abnormal and Social Psychology
  4. Group process and productivity
    Ivan D. Steiner · 1972 · Medical Entomology and Zoology
  5. Linear models in decision making.
    Dawes, Robyn M., Corrigan, Bernard · 1974 · Psychological Bulletin
  6. The Delphi Method: An Experimental Study of Group Opinion
    1969 · RAND Corporation eBooks
  7. An experimental study of group opinion
    Dalkey, N. · 1969 · Futures
  8. Unit weighting schemes for decision making
    Einhorn, Hillel J., Hogarth, Robin M. · 1975 · Organizational Behavior and Human Performance
  9. PSYCHOLOGICAL STUDY OF HUMAN JUDGMENT: IMPLICATIONS FOR INVESTMENT DECISION MAKING
    Slovic, Paul · 1972 · The Journal of Finance
  10. Expert judgment: Some necessary conditions and an example.
    Einhorn, Hillel J. · 1974 · Journal of Applied Psychology

Show all 21 references

Cited by (27)

  1. The Delphi technique as a forecasting tool: issues and analysis
    Rowe, Gene, Wright, George · 1999 · International Journal of Forecasting
  2. Combining forecasts: A review and annotated bibliography
    1990 · Long Range Planning
  3. The emerging conceptualization of groups as information processors.
    Hinsz, Verlin B., Tindale, R. Scott, Vollrath, David A. · 1997 · Psychological Bulletin
  4. Group versus individual performance: Are N?+?1 heads better than one?
    Hill, Gayle W. · 1982 · Psychological Bulletin
  5. Combining Probability Distributions From Experts in Risk Analysis
    Clemen, Robert T., Winkler, Robert L. · 1999 · Risk Analysis

See all 283

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Quality of group judgment. https://app.cochat.ai/papers/10.1037//0033-2909.84.1.158
The paper
Einhorn, H. J., Hogarth, R. M., & Klempner, E. (1977). Quality of group judgment. Psychological Bulletin. https://doi.org/10.1037//0033-2909.84.1.158

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.