The DOI matches its Crossref record; 61 of the 61 references it cites were found in a registry or an index.
Rankings and Reactivity: How Public Measures Recreate Social Worlds
Open accessAbstract
Recently, there has been a proliferation of measures responding to demands for accountability and transparency. Using the example of media rankings of law schools, this article argues that the methodological concept of reactivity - the idea that people change their behavior in reaction to being evaluated, observed, or measured- offers a useful lens for disclosing how these measures effect change. A framework is proposed for investigating the consequences, both intended and unintended, of public measures. The article first identifies two mechanisms, self-fulfilling prophecy and commensuration, that induce reactivity and then distinguishes patterns of effects produced by reactivity. This approach demonstrates how these increasingly fateful public measures change expectations and permeate institutions, suggesting why it is important for scholars to investigate the impact of these measures more systematically.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Discipline and Punish: The Birth of the Prison.
Tarbet, D. W., Foucault, M., & Sheridan, A. (1978) · Eighteenth-Century Studies · doi:10.2307/2737970 · Cited by 19,200
Discipline and Punish: The Birth of the Prison.
Zukin, S., Foucault, M., & Sheridan, A. (1996) · Contemporary Sociology · doi:10.2307/2077073 · Cited by 15,361
(1963) · Medical Entomology and Zoology · Cited by 15,085
(1994) · Choice Reviews Online · doi:10.5860/choice.31-4888 · Cited by 9,294
The Study of Boundaries in the Social Sciences
Lamont, M., & Molnár, V. (2002) · Annual Review of Sociology · doi:10.1146/annurev.soc.28.110601.141107 · Cited by 5,059
Latour, B. (1987) · Cited by 4,106
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
The Audit Society: Rituals of VerificationPreprint
Power, M. (1999) · RePEc: Research Papers in Economics · Cited by 3,647
Hacking, I. (1990) · Cambridge University Press eBooks · doi:10.1017/cbo9780511819766 · Cited by 3,586
The Audit Society: Rituals of Verification
Quam, L. (1998) · BMJ · doi:10.1136/bmj.316.7133.787a · Cited by 3,575
Cited by
What drives corporate social performance? The role of nation-level institutions
Ioannou, I., & Serafeim, G. (2012) · Journal of International Business Studies · doi:10.1057/jibs.2012.26 · Cited by 1,701
From smoke and mirrors to walking the talk: Decoupling in the contemporary world
Bromley, P., & Powell, W. W. (2012) · Academy of Management Annals · doi:10.5465/19416520.2012.684462 · Cited by 1,656
Fairness and Abstraction in Sociotechnical Systems
Selbst, A. D., Boyd, D., Friedler, S. A., Venkatasubramanian, S., & Vertesi, J. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287598 · Cited by 1,631
Toward a Comparative Sociology of Valuation and Evaluation
Lamont, M. (2012) · Annual Review of Sociology · doi:10.1146/annurev-soc-070308-120022 · Cited by 1,492
Espeland, W. N., & Stevens, M. L. (2008) · European Journal of Sociology · doi:10.1017/s0003975609000150 · Cited by 1,265
Self-citationDo ratings of firms converge? Implications for managers, investors and strategy researchers
Chatterji, A. K., Durand, R., Levine, D. I., & Touboul, S. (2016) · Strategic Management Journal · doi:10.1002/smj.2407 · Cited by 1,264
If...Then: Algorithmic Power and Politics
Bucher, T. (2018) · doi:10.1093/oso/9780190493028.001.0001 · Cited by 1,223
The Discipline of Rankings: Tight Coupling and Organizational Change
Sauder, M., & Espeland, W. N. (2009) · American Sociological Review · doi:10.1177/000312240907400104 · Cited by 1,059
Self-citationHallett, T. (2010) · American Sociological Review · doi:10.1177/0003122409357044 · Cited by 903
The Rationalization of Charity: The Influences of Professionalism in the Nonprofit Sector
Hwang, H., & Powell, W. W. (2009) · Administrative Science Quarterly · doi:10.2189/asqu.2009.54.2.268 · Cited by 876
Keeping up Appearances: Reputational Threat and Impression Management after Social Movement Boycotts
McDonnell, M.-H., & King, B. (2013) · Administrative Science Quarterly · doi:10.1177/0001839213500032 · Cited by 618
Cents and Sensibility: Economic Valuation and the Nature of “Nature”
Fourcade, M. (2011) · American Journal of Sociology · doi:10.1086/659640 · Cited by 601
Accounting, organizing, and economizing: connecting accounting research and organization theory
Miller, P., & Power, M. (2013) · Academy of Management Annals · doi:10.5465/19416520.2013.783668 · Cited by 588
Lorenz, C. (2012) · Critical Inquiry · doi:10.1086/664553 · Cited by 583
Rawhouser, H., Cummings, M., & Newbert, S. L. (2019) · Entrepreneurship Theory and Practice · doi:10.1177/1042258717727718 · Cited by 555
How firms respond to being rated
Chatterji, A. K., & Toffel, M. W. (2010) · Strategic Management Journal · doi:10.1002/smj.840 · Cited by 547
Classification Situations: Life- chances in the neoliberal era
Fourcade, M., & Healy, K. (2013) · Accounting, Organizations and Society · doi:10.1016/j.aos.2013.11.002 · Cited by 544
In TripAdvisor we trust: Rankings, calculative regimes and abstract systems
Jeacle, I., & Carter, C. (2011) · Accounting, Organizations and Society · doi:10.1016/j.aos.2011.04.002 · Cited by 516
What is missing? Cultural processes and causal pathways to inequality
Lamont, M., Beljean, S., & Clair, M. (2014) · Socio-Economic Review · doi:10.1093/ser/mwu011 · Cited by 504
Indicators as a Technology of Global Governance
Davis, K. E., Kingsbury, B., & Merry, S. E. (2012) · Law & Society Review · doi:10.1111/j.1540-5893.2012.00473.x · Cited by 501
How Do Companies Respond to Environmental, Social and Governance (ESG) ratings? Evidence from Italy
Clementino, E., & Perkins, R. (2021) · Journal of Business Ethics · doi:10.1007/s10551-020-04441-4 · Cited by 486
Fourcade, M., & Healy, K. (2016) · Socio-Economic Review · doi:10.1093/ser/mww033 · Cited by 474
Evaluation Practices and Effects of Indicator Use—A Literature Review
Rijcke, S. D., Wouters, P. F., Rushforth, A. D., Franssen, T. P., & Hammarfelt, B. (2016) · Research Evaluation · doi:10.1093/reseval/rvv038 · Cited by 467
Status: Insights from Organizational Sociology
Sauder, M., Lynn, F., & Podolny, J. M. (2012) · Annual Review of Sociology · doi:10.1146/annurev-soc-071811-145503 · Cited by 470
Self-citationJournal list fetishism and the perversion of scholarship: reactivity and the ABS list
Willmott, H. (2011) · Organization · doi:10.1177/1350508411403532 · Cited by 453
What Happens When Evaluation Goes Online? Exploring Apparatuses of Valuation in the Travel Sector
Orlikowski, W. J., & Scott, S. V. (2014) · Organization Science · doi:10.1287/orsc.2013.0877 · Cited by 439
What's New with Numbers? Sociological Approaches to the Study of Quantification
Mennicken, A., & Espeland, W. N. (2019) · Annual Review of Sociology · doi:10.1146/annurev-soc-073117-041343 · Cited by 439
Self-citationThe Credit Crisis as a Problem in the Sociology of Knowledge
MacKenzie, D. (2011) · American Journal of Sociology · doi:10.1086/659639 · Cited by 417
Stevens, M. L., Armstrong, E. A., & Arum, R. (2008) · Annual Review of Sociology · doi:10.1146/annurev.soc.34.040507.134737 · Cited by 415
Politics by Number: Indicators as Social Pressure in International Relations
Kelley, J. G., & Simmons, B. A. (2015) · American Journal of Political Science · doi:10.1111/ajps.12119 · Cited by 415
Mishina, Y., Block, E. S., & Mannor, M. J. (2012) · Strategic Management Journal · doi:10.1002/smj.958 · Cited by 406
Reconfiguring relations of accountability: Materialization of social media in the travel sector
Scott, S. V., & Orlikowski, W. J. (2012) · Accounting, Organizations and Society · doi:10.1016/j.aos.2011.11.005 · Cited by 400
The Social Origins of ESG: An Analysis of Innovest and KLD
Eccles, R. G., Lee, L.-E., & Stroehle, J. C. (2020) · Organization & Environment · doi:10.1177/1086026619888994 · Cited by 380
Algorithms in practice: Comparing web journalism and criminal justice
Christin, A. (2017) · Big Data & Society · doi:10.1177/2053951717718855 · Cited by 379
The Invisible Cage: Workers’ Reactivity to Opaque Algorithmic Evaluations
Rahman, H. A. (2021) · Administrative Science Quarterly · doi:10.1177/00018392211010118 · Cited by 375
Working for an Algorithm: Power Asymmetries and Agency in Online Work Settings
Curchod, C., Patriotta, G., Cohen, L., & Neysen, N. (2020) · Administrative Science Quarterly · doi:10.1177/0001839219867024 · Cited by 364
Augmenting the algorithm: Emerging human-in-the-loop work configurations
Grønsund, T., & Aanestad, M. (2020) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2020.101614 · Cited by 364
Evaluative infrastructures: Accounting for platform organization
Kornberger, M., Pflueger, D., & Mouritsen, J. (2017) · Accounting Organizations and Society · doi:10.1016/j.aos.2017.05.002 · Cited by 349
Entanglements in Practice: Performing Anonymity Through Social Media1
Scott, S. V., & Orlikowski, W. J. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.3.11 · Cited by 337
Shaming the Corporation: The Social Production of Targets and the Anti-Sweatshop Movement
Bartley, T., & Child, C. (2014) · American Sociological Review · doi:10.1177/0003122414540653 · Cited by 328
Ksiazek, T. B., Peer, L., & Lessard, K. (2016) · New Media & Society · doi:10.1177/1461444814545073 · Cited by 321
Mejias, U. A., & Couldry, N. (2019) · Internet Policy Review · doi:10.14763/2019.4.1428 · Cited by 316
Accounting information and managerial work
Hall, M. (2010) · Accounting, Organizations and Society · doi:10.1016/j.aos.2009.09.003 · Cited by 291
Bowman, N. A., & Bastedo, M. N. (2009) · Research in Higher Education · doi:10.1007/s11162-009-9129-8 · Cited by 291
Reputational Risk as a Logic of Organizing in Late Modernity
Power, M., Scheytt, T., Soin, K., & Sahlin, K. (2009) · Organization Studies · doi:10.1177/0170840608101482 · Cited by 290
Control by numbers: new managerialism and ranking in higher education
Lynch, K. (2015) · Critical Studies in Education · doi:10.1080/17508487.2014.949811 · Cited by 289
A world of indicators: The making of governmental knowledge through quantification
Rottenburg, R., & Merry, S. E. (2015) · The World of Indicators · doi:10.1017/cbo9781316091265.001 · Cited by 289
Disclosure: Psychology Changes Everything
Loewenstein, G., Sunstein, C. R., & Golman, R. (2014) · Annual Review of Economics · doi:10.1146/annurev-economics-080213-041341 · Cited by 280
Heintz, B. (2010) · Zeitschrift für Soziologie · doi:10.1515/zfsoz-2010-0301 · Cited by 279
Altruism and Indirect Reciprocity: The Interaction of Person and Situation in Prosocial Behavior
Simpson, B., & Willer, R. (2008) · Social Psychology Quarterly · doi:10.1177/019027250807100106 · Cited by 277
Gray, J., Gerlitz, C., & Bounegru, L. (2018) · Big Data & Society · doi:10.1177/2053951718786316 · Cited by 277
The politics of transparency and the calibration of knowledge in the digital age
Hansen, H. K., & Flyverbom, M. (2015) · Organization · doi:10.1177/1350508414522315 · Cited by 273
Global geographies of higher education: The perspective of world university rankings
Jöns, H., & Hoyler, M. (2013) · Geoforum · doi:10.1016/j.geoforum.2012.12.014 · Cited by 272
Standardization as Institutional Work: The Regulatory Power of a Responsible Investment Standard
Slager, R., Gond, J.-P., & Moon, J. (2012) · Organization Studies · doi:10.1177/0170840612443628 · Cited by 271
Academic Institutions in Search of Quality: Local Orders and Global Standards
Paradeise, C., & Thoenig, J.-C. (2013) · Organization Studies · doi:10.1177/0170840612473550 · Cited by 270
Mingers, J., & Willmott, H. (2013) · Human Relations · doi:10.1177/0018726712467048 · Cited by 268
Counting Clicks: Quantification and Variation in Web Journalism in the United States and France
Christin, A. (2018) · American Journal of Sociology · doi:10.1086/696137 · Cited by 266
The Power of Market Intermediaries: From Information to Valuation Processes
Bessy, C., & Chauvin, P.-M. (2013) · Valuation Studies · doi:10.3384/vs.2001-5992.131183 · Cited by 255
Enchanted Determinism: Power without Responsibility in Artificial Intelligence
Campolo, A., & Crawford, K. (2020) · Engaging Science, Technology, and Society · doi:10.17351/ests2020.277 · Cited by 254
The Practice of Data Use: An Introduction
Coburn, C. E., & Turner, E. O. (2012) · American Journal of Education · doi:10.1086/663272 · Cited by 254
“Gaming the System”: Platform Paternalism and the Politics of Algorithmic Visibility
Petre, C., Duffy, B. E., & Hund, E. (2019) · Social Media + Society · doi:10.1177/2056305119879995 · Cited by 225
How Rankings Produce Competition: The Case of Global University Rankings
Brankovic, J., Ringel, L., & Werron, T. (2018) · Zeitschrift für Soziologie · doi:10.1515/zfsoz-2018-0118 · Cited by 223
A Sociological (De)Construction of the Relationship between Status and Quality
Lynn, F. B., Podolny, J. M., & Tao, L. (2009) · American Journal of Sociology · doi:10.1086/603537 · Cited by 210
Pollock, N., & D’Adderio, L. (2012) · Accounting, Organizations and Society · doi:10.1016/j.aos.2012.06.004 · Cited by 206
How accounting begins: Object formation and the accretion of infrastructure
Power, M. (2015) · Accounting, Organizations and Society · doi:10.1016/j.aos.2015.10.005 · Cited by 200
Bastedo, M. N., & Bowman, N. A. (2010) · American Journal of Education · doi:10.1086/649437 · Cited by 198
Waters, F., Chiu, V., Atkinson, A., & Blom, J. D. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00303 · Cited by 165
(2011) · Social Problems · doi:10.1525/sp.2011.58.4.491 · Cited by 129
Deconstructing datafication’s brave new world
Couldry, N., & Yu, J. (2018) · New Media & Society · doi:10.1177/1461444818775968 · Cited by 116
The Making of Data Commodities: Data Analytics as an Embedded Process
Aaltonen, A., Alaimo, C., & Kallinikos, J. (2021) · Journal of Management Information Systems · doi:10.1080/07421222.2021.1912928 · Cited by 95
Dougherty, K. J., & Natow, R. S. (2020) · Higher Education · doi:10.1007/s10734-019-00491-4 · Cited by 92
The Future of Research in an Artificial Intelligence-Driven World
Kulkarni, M., Mantere, S., Vaara, E., van den Broek, E., Pachidi, S., Glaser, V. L., Gehman, J., Petriglieri, G., Lindebaum, D., Cameron, L. D., et al. (2024) · Journal of Management Inquiry · doi:10.1177/10564926231219622 · Cited by 80
Who games metrics and rankings? Institutional niches and journal impact factor inflation
Siler, K., & Larivière, V. (2022) · Research Policy · doi:10.1016/j.respol.2022.104608 · Cited by 70
The Pricing of Open Access Journals: Diverse Niches and Sources of Value in Academic Publishing
Siler, K., & Frenken, K. (2020) · Quantitative Science Studies · doi:10.1162/qss_a_00016 · Cited by 64
Cuckston, T. (2018) · Accounting, Auditing & Accountability Journal · doi:10.1108/aaaj-10-2015-2264 · Cited by 65
Varieties of entrepreneurial ecosystems: a comparative study of Tokyo and Bangalore
Kapturkiewicz, A. (2022) · Research Policy · doi:10.1016/j.respol.2021.104377 · Cited by 65
The state of affairs: Critical performativity and the online dating industry
Roscoe, P., & Chillas, S. (2014) · Organization · doi:10.1177/1350508413485497 · Cited by 57
Chan, N. K. (2022) · Big Data & Society · doi:10.1177/20539517221133779 · Cited by 48
Schneiberg, M., & Berk, G. (2010) · Research in the Sociology of Organizations · doi:10.1108/s0733-558x(2010)0000031011 · Cited by 46
Quantifying human resource management: a literature review
Coron, C. (2022) · Personnel Review · doi:10.1108/pr-05-2020-0322 · Cited by 40
Pflueger, D., Kornberger, M., & Mouritsen, J. (2022) · European Accounting Review · doi:10.1080/09638180.2022.2147973 · Cited by 26
“The Narrative of the Number: Quantification in Criminal Court
Lynch, M. (2019) · Law & Social Inquiry · doi:10.1111/lsi.12334 · Cited by 22
van Doorn, N. (2020) · Working in the Context of Austerity · doi:10.46692/9781529208689.003 · Cited by 16
Stevens, M. L., & Shibanova, E. (2021) · European Journal of Higher Education · doi:10.1080/21568235.2021.1944252 · Cited by 14
Valuing soccer players: on the valuation dynamics of an online user community
Detzen, D., & Löhlein, L. (2024) · Accounting, Auditing & Accountability Journal · doi:10.1108/aaaj-05-2022-5824 · Cited by 8
Copp, D. T. (2017) · Education Policy Analysis Archives · doi:10.14507/epaa.25.3299 · Cited by 8
McDonnell, M.-H., & King, B. (2014) · doi:10.2139/ssrn.2373974 · Cited by 5
Metadata
- Authors
- Espeland, W. N., & Sauder, M.
- Venue
- American Journal of Sociology
- Publisher
- University of Chicago Press
- Published
- 2007-07
- Volume
- 113
- Issue
- 1
- Pages
- 1-40
- ISSN
- 0002-9602 (ISSN-L)
- 1537-5390
- OpenAlex
- W1945197361
- Cited by
- 2,416
- References
- 61
- FWCI
- 90.12
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.