Fairness as Appropriateness: Negotiating Epistemological Differences in Peer Review
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Epistemological differences fuel continuous and frequently divisive debates in the social sciences and the humanities. Sociologists have yet to consider how such differences affect peer evaluation. The empirical literature has studied distributive fairness, but neglected how epistemological differences affect perception of fairness in decision making. The normative literature suggests that evaluators should overcome their epistemological differences by ‘‘translating’’ their preferred standards into general criteria of evaluation. However, little is known about how procedural fairness actually operates. Drawing on eighty-one interviews with panelists serving on five multidisciplinary fellowship competitions in the social sciences and the humanities, we show that (1) Evaluators generally draw on four epistemological styles to make arguments in favor of and against proposals. These are the constructivist, comprehensive, positivist, and utilitarian styles; and (2) Peer reviewers define a fair decision-making process as one in which panelists engage in ‘‘cognitive contextualization,’’ that is, use epistemological styles most appropriate to the field or discipline of the proposal under review.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Culture in Action: Symbols and Strategies
Swidler, A. (1986) · American Sociological Review · doi:10.2307/2095521 · Cited by 8,661
Emotion Work, Feeling Rules, and Social Structure
Hochschild, A. R. (1979) · American Journal of Sociology · doi:10.1086/227049 · Cited by 5,962
Collins, R. (2004) · doi:10.1515/9781400851744 · Cited by 4,726
DiMaggio, P. (1997) · Annual Review of Sociology · doi:10.1146/annurev.soc.23.1.263 · Cited by 3,161
Masterman, M. (1970) · Criticism and the Growth of Knowledge · doi:10.1017/cbo9781139171434.008 · Cited by 1,015
Chance and Consensus in Peer Review
Cole, S., Cole, J. R., & Simon, G. A. (1981) · Science · doi:10.1126/science.7302566 · Cited by 623
Cited by
Toward a Comparative Sociology of Valuation and Evaluation
Lamont, M. (2012) · Annual Review of Sociology · doi:10.1146/annurev-soc-070308-120022 · Cited by 1,492
“…practices, including the prevalence of horse trading among evaluators and how pluralistic evaluators are likely to be in their choice of standards, including their epistemological preferences, and appreciation for a range of methodological approaches (Mallard et al. 2009; Lamont & Huutoniemi 2011).”
BackgroundSelf-citationLee, C. J., Sugimoto, C. R., Zhang, G., & Cronin, B. (2013) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.22784 · Cited by 1,000
Interdisciplinarity: A Critical Assessment
Jacobs, J. A., & Frickel, S. (2009) · Annual Review of Sociology · doi:10.1146/annurev-soc-070308-115954 · Cited by 596
Rafols, I., Leydesdorff, L., O’Hare, A., Nightingale, P., & Stirling, A. (2012) · Research Policy · doi:10.1016/j.respol.2012.03.015 · Cited by 575
Bornmann, L. (2011) · Annual Review of Information Science and Technology · doi:10.1002/aris.2011.1440450112 · Cited by 567
Metadata
- Authors
- Mallard, G., Lamont, M., & Guetzkow, J.
- Venue
- Science, Technology, & Human Values
- Publisher
- SAGE Publications
- Published
- 2009-02-10
- Volume
- 34
- Issue
- 5
- Pages
- 573-606
- ISSN
- 0162-2439 (ISSN-L)
- 1552-8251
- OpenAlex
- W2113026508
- Cited by
- 124
- References
- 6
- FWCI
- 14.43
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Fairness as Appropriateness: Negotiating Epistemological Differences in Peer Review. https://app.cochat.ai/papers/10.1177/0162243908329381
- The paper
- Mallard, G., Lamont, M., & Guetzkow, J. (2009). Fairness as Appropriateness: Negotiating Epistemological Differences in Peer Review. Science, Technology, & Human Values. https://doi.org/10.1177/0162243908329381
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.