Proper analysis of the accuracy of group judgments.
Abstract
Modern societies rely heavily on groups to make important economic and political decisions. However, a review of research on group processes shows that progress has been slow in the delineation of the conditions that promote or impede efficient, accurate group judgments. One reason for the slow progress is that research methods and data analysis in this area are varied, difficult to compare, and often substandard. In this review, the authors summarize alternate methods of analysis and provide detailed illustrations of the best methods for assessing and analyzing group judgment accuracy Increased accuracy is a common justification for using groups, rather than individuals, to make judgments. However, the empirical literature shows that groups excel as judges only under limited conditions. Hill's (1982) review found that groups tend to perform around the level of the second best member in most tasks, including group judgment. Hastie (1986) identified several task differences that moderate the relative accuracy of group and individual judges, but he also concluded that there were few, if any, task conditions under which groups consistently
Cites (5)
- Intraclass correlations: Uses in assessing rater reliability.Shrout, Patrick E., Fleiss, Joseph L. · 1979 · Psychological Bulletin
- On the psychology of prediction.Kahneman, Daniel, Tversky, Amos · 1973 · Psychological Review
- The earth is round (p < .05).Cohen, Jacob · 1994 · American Psychologist
- The group polarization phenomenon.Myers, David G., Lamm, Helmut · 1976 · Psychological Bulletin
- The dilution effect: Nondiagnostic information weakens the implications of diagnostic informationNisbett, Richard E., Zukier, Henry, Lemley, Ronald E. · 1981 · Cognitive Psychology
Cited by (19)
- Combining Probability Distributions From Experts in Risk AnalysisClemen, Robert T., Winkler, Robert L. · 1999 · Risk Analysis
- ADAPTABILITY TO CHANGING TASK CONTEXTS: EFFECTS OF GENERAL COGNITIVE ABILITY, CONSCIENTIOUSNESS, AND OPENNESS TO EXPERIENCELEPINE, JEFFREY A., COLQUITT, JASON A., EREZ, AMIR · 2000 · Personnel Psychology
- Risks and decisions for conservation and environmental management2005 · Choice Reviews Online
- Risks and Decisions for Conservation and Environmental ManagementBurgman, Mark · 2005 · Cambridge University Press eBooks
- The Robust Beauty of Majority Rules in Group Decisions.Hastie, Reid, Kameda, Tatsuya · 2005 · Psychological Review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Proper analysis of the accuracy of group judgments. https://app.cochat.ai/papers/10.1037//0033-2909.121.1.149
- The paper
- Gigone, D., & Hastie, R. (1997). Proper analysis of the accuracy of group judgments. Psychological Bulletin. https://doi.org/10.1037//0033-2909.121.1.149
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.