The Making of Performative Accuracy in AI Training: Precision Labor and Its Consequences
Open accessThe claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Across platforms and BPOs, there is a convergence in labor arrangements toward hybrid management practices.
“Across both settings, we observe a convergence in labor arrangements that echoes Zhang et al.’s [148] observation of hybrid management practices.”
From 'The plan is just survival': Data Work in Kenya and the Regime of Entrapment (2026) · cites this paper as [148]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Ethnography in/of the World System: The Emergence of Multi-Sited Ethnography
Marcus, G. E. (1995) · Annual Review of Anthropology · doi:10.1146/annurev.an.24.100195.000523 · Cited by 8,885 · see citing works
Pinch, T. J., & Bijker, W. E. (1984) · Social Studies of Science · doi:10.1177/030631284014003004 · Cited by 3,890 · see citing works
The Essential Tension: Selected Studies in Scientific Tradition and Change
Kuhn, T. S. (1977) · doi:10.7208/chicago/9780226217239.001.0001 · Cited by 3,861 · see citing works
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., Daumé, H., & Crawford, K. (2018) · arXiv · doi:10.48550/arxiv.1803.09010 · Cited by 2,474
Gebru, T., Morgenstern, J., Vecchione, B., Vaughan, J. W., Wallach, H., III, H. D., & Crawford, K. (2021) · Communications of the ACM · doi:10.1145/3458723 · Cited by 2,469 · cited 1× · see citing works
“Previous work has underscored the importance of systematically documenting not only datasets but also data production contexts [4, 17, 24, 32, 34].”
`How many cases do I need?': On science and the logic of case selection in field-based research
Small, M. L. (2009) · Ethnography · doi:10.1177/1466138108099586 · Cited by 2,023 · see citing works
D'Ignazio, C., & Klein, L. F. (2020) · doi:10.7551/mitpress/11805.001.0001 · Cited by 1,738 · see citing works
Anchoring Data Quality Dimensions in Ontological Foundations
Wand, Y., & Wang, R. Y. (1996) · Communications of the ACM · doi:10.1145/240455.240479 · Cited by 1,479 · see citing works
Methodologies for data quality assessment and improvement
Batini, C., Cappiello, C., Francalanci, C., & Maurino, A. (2009) · ACM Computing Surveys · doi:10.1145/1541880.1541883 · Cited by 1,351 · see citing works
In Search of Subjectivity—One's Own
Peshkin, A. (1988) · Educational Researcher · doi:10.3102/0013189x017007017 · Cited by 1,196 · see citing works
The Challenges of Data Quality and Data Quality Assessment in the Big Data Era
Cai, L., & Zhu, Y. (2015) · Data Science Journal · doi:10.5334/dsj-2015-002 · Cited by 1,044 · see citing works
Bender, E. M., & Friedman, B. (2018) · Transactions of the Association for Computational Linguistics · doi:10.1162/tacl_a_00041 · Cited by 854 · cited 1× · see citing works
“Previous work has underscored the importance of systematically documenting not only datasets but also data production contexts [4, 17, 24, 32, 34].”
Tsing, A. (2012) · Common Knowledge · doi:10.1215/0961754x-1630424 · Cited by 802 · see citing works
Turkopticon: interrupting worker invisibility in amazon mechanical turk
Irani, L. C., & Silberman, M. S. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2470742 · Cited by 798 · see citing works
The Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence
CRAWFORD, K. (2021) · doi:10.2307/j.ctv1ghv45t · Cited by 742 · see citing works
A framework for analysis of data quality research
Wang, R., Storey, V. C., & Firth, C. (1995) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/69.404034 · Cited by 686 · see citing works
Data and its (dis)contents: A survey of dataset development and use in machine learning research
Paullada, A., Raji, I. D., Bender, E. M., Denton, E., & Hanna, A. (2021) · Patterns · doi:10.1016/j.patter.2021.100336 · Cited by 548 · cited 2× · see citing works
“In line with previous literature that examines and questions the values in ML studies [5, 28, 45, 70], we examine how accuracy and precision shape data production and AI training practices.”
A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk
Hara, K., Adams, A., Milland, K., Savage, S., Callison-Burch, C., & Bigham, J. P. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3174023 · Cited by 497 · see citing works
The relationship of action research to human-computer interaction
Hayes, G. R. (2011) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1993060.1993065 · Cited by 452 · see citing works
Cognitive and Non-Cognitive Values in Science: Rethinking the Dichotomy
Longino, H. E. (1996) · Springer eBooks · doi:10.1007/978-94-009-1742-2_3 · Cited by 354 · see citing works
Human-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI
Wang, D., Weisz, J. D., Muller, M., Ram, P., Geyer, W., Dugan, C., Tausczik, Y., Samulowitz, H., & Gray, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359313 · Cited by 342 · see citing works
Connect With Your Audience! The Relational Labor of Connection
Baym, N. K. (2015) · The Communication Review · doi:10.1080/10714421.2015.996401 · Cited by 321 · see citing works
The Values Encoded in Machine Learning Research
Birhane, A., Kalluri, P., Card, D., Agnew, W., Dotan, R., & Bao, M. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533083 · Cited by 317 · see citing works
Madianou, M. (2014) · Journal of Computer-Mediated Communication · doi:10.1111/jcc4.12069 · Cited by 295 · see citing works
Heteromation, and Other Stories of Computing and Capitalism
Ekbia, H. R., & Nardi, B. A. (2017) · doi:10.7551/mitpress/10767.001.0001 · Cited by 285 · see citing works
Hutchinson, B., Smart, A., Hanna, A., Denton, R., Greer, C., Kjartansson, O., Barnes, P., & Mitchell, M. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445918 · Cited by 279 · see citing works
Martin, D., Hanrahan, B. V., O’Neill, J., & Gupta, N. (2014) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2531602.2531663 · Cited by 279 · see citing works
Tubaro, P., Casilli, A. A., & Coville, M. (2020) · Big Data & Society · doi:10.1177/2053951720919776 · Cited by 262 · see citing works
How Data Science Workers Work with Data
Muller, M. J., Lange, I., Wang, D., Piorkowski, D., Tsay, J., Liao, Q. V., Dugan, C., & Erickson, T. D. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300356 · Cited by 262 · see citing works
Le Dantec, C. A., & Fox, S. (2015) · Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing · doi:10.1145/2675133.2675147 · Cited by 255 · see citing works
The Crowd is a Collaborative Network
Gray, M. L., Suri, S., Ali, S. S., & Kulkarni, D. (2016) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2818048.2819942 · Cited by 239 · see citing works
Passi, S., & Jackson, S. J. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274405 · Cited by 225 · see citing works
Gender, politics, and the theoretical virtues
Longino, H. E. (1995) · Synthese · doi:10.1007/bf01064506 · Cited by 220 · see citing works
Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Development
Scheuerman, M. K., Hanna, A., & Denton, R. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476058 · Cited by 216 · see citing works
The Ethics of Emotion in Artificial Intelligence Systems
Stark, L., & Hoey, J. (2021) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3442188.3445939 · Cited by 187 · see citing works
The Dataset Nutrition Label: A Framework To Drive Higher Data Quality Standards
Holland, S., Hosny, A., Newman, S., Joseph, J., & Chmielinski, K. (2018) · arXiv · doi:10.48550/arxiv.1805.03677 · Cited by 175 · see citing works
Between Subjectivity and Imposition: Power Dynamics in Data Annotation for Computer Vision
Miceli, M., Schuessler, M., & Yang, T. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415186 · Cited by 149 · see citing works
Self-citationAlgorithmic warfare and the reinvention of accuracy
Suchman, L. A. (2020) · Critical Studies on Security · doi:10.1080/21624887.2020.1760587 · Cited by 147 · see citing works
Micro-work, artificial intelligence and the automotive industry
Tubaro, P., & Casilli, A. A. (2019) · Journal of Industrial and Business Economics · doi:10.1007/s40812-019-00121-1 · Cited by 122 · see citing works
The Data-Production Dispositif
Miceli, M., & Posada, J. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555561 · Cited by 121 · see citing works
Self-citationFeinberg, M. (2017) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025837 · Cited by 115 · see citing works
Heteromation and its (dis)contents: The invisible division of labor between humans and machines
Ekbia, H., & Nardi, B. (2014) · First Monday · doi:10.5210/fm.v19i6.5331 · Cited by 113 · see citing works
Passi, S., & Jackson, S. (2017) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2998181.2998331 · Cited by 113 · see citing works
Quantifying the Invisible Labor in Crowd Work
Toxtli, C., Suri, S., & Savage, S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476060 · Cited by 103 · see citing works
Embedded reproduction in platform data work
Posada, J. (2022) · Information, Communication & Society · doi:10.1080/1369118x.2022.2049849 · Cited by 89 · see citing works
The problem with annotation. Human labour and outsourcing between France and Madagascar
Ludec, C. L., Cornet, M., & Casilli, A. A. (2023) · Big Data & Society · doi:10.1177/20539517231188723 · Cited by 88 · see citing works
Wang, J. J. (2020) · Accounting and Finance · doi:10.1111/acfi.12682 · Cited by 86 · see citing works
Designing Ground Truth and the Social Life of Labels
Muller, M., Wolf, C. T., Andres, J., Desmond, M., Joshi, N. N., Ashktorab, Z., Sharma, A., Brimijoin, K., Pan, Q., Duesterwald, E., et al. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445402 · Cited by 83 · see citing works
Making data science systems work
Passi, S., & Sengers, P. (2020) · Big Data & Society · doi:10.1177/2053951720939605 · Cited by 81 · see citing works
The false promise of risk assessments: epistemic reform and the limits of fairness
Green, B. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372869 · Cited by 80 · see citing works
AutoDS: Towards Human-Centered Automation of Data Science
Wang, D., Andrés, J., Weisz, J. D., Oduor, E., & Dugan, C. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445526 · Cited by 79 · see citing works
Díaz, M., Kivlichan, I., Rosen, R., Baker, D., Amironesei, R., Prabhakaran, V., & Denton, R. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3534647 · Cited by 72 · see citing works
The poverty of ethical AI: impact sourcing and AI supply chains
Muldoon, J., Cant, C., Graham, M., & Ustek Spilda, F. (2025) · AI & SOCIETY · doi:10.1007/s00146-023-01824-9 · Cited by 70 · cited 1× · see citing works
“This research extended the conversation beyond the harms associated with technology implementation to locate and take seriously ethical considerations within the technology production phase [9, 59].”
Whose AI Dream? In search of the aspiration in data annotation.
Wang, D., Prabhat, S., & Sambasivan, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502121 · Cited by 70 · see citing works
Lifting the curtain: Strategic visibility of human labour in AI-as-a-Service
Newlands, G. (2021) · Big Data & Society · doi:10.1177/20539517211016026 · Cited by 66 · see citing works
Whiting, M. E., Gamage, D., Gaikwad, S. S., Gilbee, A., Goyal, S., Ballav, A., Majeti, D., Chhibber, N., Richmond-Fuller, A., Vargus, F., et al. (2017) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2998181.2998234 · Cited by 66 · see citing works
Privacy, Power, and Invisible Labor on Amazon Mechanical Turk
Sannon, S., & Cosley, D. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300512 · Cited by 63 · see citing works
Lin, C., & Lindtner, S. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445237 · Cited by 50 · see citing works
A typology of artificial intelligence data work
Muldoon, J., Cant, C., Wu, B., & Graham, M. (2024) · Big Data & Society · doi:10.1177/20539517241232632 · Cited by 50 · see citing works
Model Positionality and Computational Reflexivity: Promoting Reflexivity in Data Science
Cambo, S. A., & Gergle, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501998 · Cited by 49 · see citing works
Overwork, job embeddedness and turnover intention among Chinese knowledge workers
Huang, H., Xia, X., Zhao, W., Pan, X., & Zhou, X. (2020) · Asia Pacific Journal of Human Resources · doi:10.1111/1744-7941.12272 · Cited by 49 · see citing works
AI-Assisted Human Labeling: Batching for Efficiency without Overreliance
Ashktorab, Z., Desmond, M., Andres, J., Muller, M., Joshi, N. N., Brachman, M., Sharma, A., Brimijoin, K., Pan, Q., Wolf, C. T., et al. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449163 · Cited by 45 · see citing works
Gautam, A., Tatar, D. G., & Harrison, S. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376647 · Cited by 44 · see citing works
Robust semi-automatic head pose labeling for real-world face video sequences
Demirkus, M., Clark, J. J., & Arbel, T. (2013) · Multimedia tools and applications · doi:10.1007/s11042-012-1352-1 · Cited by 38 · see citing works
Kross, S., & Guo, P. J. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476052 · Cited by 38 · see citing works
The Craft and Coordination of Data Curation: Complicating Workflow Views of Data Science
Thomer, A. K., Akmon, D., York, J., Tyler, A. R. B., Polasek, F., Lafia, S., Hemphill, L., & Yakel, E. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555139 · Cited by 35 · see citing works
Hochschild, A. R. (2022) · Routledge eBooks · doi:10.4324/9781003199588-7 · Cited by 34 · see citing works
Interrupting invisibility in a global world
Raval, N. (2021) · Interactions · doi:10.1145/3469257 · Cited by 34 · see citing works
Interrogating Data Work as a Community of Practice
Rothschild, A., Meng, A., DiSalvo, C. F., Johnson, B., Shapiro, B. R., & DiSalvo, B. J. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3555198 · Cited by 29 · see citing works
Chandhiramowuli, S., Taylor, A. S., Heitlinger, S., & Wang, D. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637367 · Cited by 27 · see citing works
A Survey of Data Quality Measurement and Monitoring Tools
Ehrlinger, L., & Wöß, W. (2022) · Frontiers in Big Data · doi:10.3389/fdata.2022.850611 · Cited by 25 · see citing works
The labor of search engine evaluation: Making algorithms more human or humans more algorithmic?
Meisner, C., Duffy, B. E., & Ziewitz, M. (2022) · New Media & Society · doi:10.1177/14614448211063860 · Cited by 25 · see citing works
How Domain Experts Work with Data: Situating Data Science in the Practices and Settings of Craftwork
Jung, J. Y., Steinberger, T., King, J. L., & Ackerman, M. S. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3512905 · Cited by 24 · see citing works
From Bias to Repair: Error as a Site of Collaboration and Negotiation in Applied Data Science Work
Lin, C. K., & Jackson, S. J. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579607 · Cited by 22 · see citing works
Muller, M. J., Aragon, C., Guha, S., Kogan, M., Neff, G., Seidelin, C., Shilton, K., & Tanweer, A. (2020) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/3406865.3418584 · Cited by 20 · see citing works
Seidelin, C., Dittrich, Y., & Grönvall, E. (2018) · Electronic workshops in computing · doi:10.14236/ewic/hci2018.14 · Cited by 20 · see citing works
Grill, G. (2022) · doi:10.31219/osf.io/zekqv · Cited by 15 · see citing works
Good for tech: Disability expertise and labor in China's artificial intelligence sector
Wu, D. (2023) · First Monday · doi:10.5210/fm.v28i1.12887 · Cited by 12 · see citing works
"Guilds" as Worker Empowerment and Control in a Chinese Data Work Platform
Yang, T., & Miceli, M. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3686904 · Cited by 7 · see citing works
Self-citationAgentic Loafing: An AI Decision Delegation Risk
Issa, H., Petani, F. J., & Glavas, D. (2026) · Risk Analysis · doi:10.1111/risa.70306 · Cited by 1 · see citing works
Inventing Accuracy: A Historical Sociology of Nuclear Missile Guidance
MacKenzie, D., & Zimmerman, P. D. (1992) · Physics Today · doi:10.1063/1.2809544
Strauss, J. C. (2013) · African Studies Review · doi:10.1353/arw.2013.0025
Ethnography and Virtual Worlds: A Handbook of Method
Taylor, T. L., Boellstorff, T., Nardi, B., & Pearce, C. (2013) · doi:10.1515/9781400845286
Flagged first, then by citations
Research works printed but not linked: 11
- [6][6] Judith Butler. 1993. Bodies that matter: on the discursive limits of "sex". Routledge, New York, NY. Go to Citation Google Scholar
- [10][10] Antonio A Casilli, Paola Tubaro, Clément Le Ludec, and Elinor Wahal. 2019. En la trastienda de la inteligencia artificial. Una investigación sobre las plataformas de micro-trabajo en Francia. Arxius de Ciències Socials 41 (2019), 85–108. https://hal-lirmm.ccsd.cnrs.fr/LRI-AO/hal-02554213v1 Go to Citation Google Scholar
- [12][12] Kathy Charmaz. 2006. Constructing Grounded Theory: A Practical Guide through Qualitative Analysis. SAGE. Google-Books-ID: 2ThdBAAAQBAJ. Google Scholar a [...] on grounded theory to guide their research b [...] a grounded theory approach to analyze data c [...] organized around points of intersection
- [16][16] Catherine D’Ignazio and Lauren F. Klein. 2020. Data Feminism. MIT Press, S.l. Go to Citation Crossref Google Scholar
- [21][21] Robert M Emerson, Rachel I Fretz, and Linda L Shaw. 2011. Writing ethnographic fieldnotes. University of Chicago press. Go to Citation Crossref Google Scholar
- [40][40] Maurizio Lazzarato. 1996. Immaterial labor. Radical thought in Italy: A potential politics 1996 (1996), 133–47. Go to Citation Google Scholar
- [44][44] Xiaotian Li. 2023. Managerial technique and worker subjectivity in dialogue: Understanding overwork in China’s internet industry. Work, Employment and Society 37, 6 (2023), 1699–1716. Go to Citation Google Scholar
- [50][50] Renkai Ma, Zinan Zhang, Xinning Gui, and Yubo Kou. 2024. Labeling in the Dark: Exploring Content Creators’ and Consumers’ Experiences with Content Classification for Child Safety on YouTube. In Proceedings of the 2024 ACM Designing Interactive Systems Conference. 1518–1532. Go to Citation Digital Library Google Scholar
- [66][66] Jack E. Olson. 2003. Data quality: the accuracy dimension. Morgan Kaufmann, San Francisco. Google Scholar a [...] to contexts and application scenarios b [...] the arbitrariness of their construction
- [74][74] Julian Posada. 2023. Platform Authority and Data Quality: Who Decides What Counts in Data Production for Artificial Intelligence? In Decoding Digital Authoritarianism, Ziyaad Bhorat and Martin Rauchbauer (Eds.). Berggreun Institute, Los Angeles, CA, 81–85. https://berggruen.org/news/decoding-digital-authoritarianism Go to Citation Google Scholar
- [98][98] M. Norton Wise (Ed.). 1995. The values of precision. Princeton Univ. Press, Princeton, NJ. Crossref Google Scholar a [...] with ambiguity, uncertainty, and messiness b [...] definitions. Drawing on prior works c [...] to truth or rational belief”. As Wise d [...] has been recognized and well established e [...] and political shaping of technologies f [...] 98]. Wise g [...] Despite the aura of accuracy h [...] an “extended network of people”
Cited by
Sorted by citations
Tang, X., Li, J., & Wu, S. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3790405 · Cited by 4 · see citing works
“For example, studies of industry-scale data collection revealed that the pursuit of label precision is often driven by market-oriented values such as objectivity, standardization, and corporate interests [49, 51, 71, 112, 113].”
'The plan is just survival': Data Work in Kenya and the Regime of Entrapment
Kapania, S., Yang, T., Abdelkadir, N. A., Scheuerman, M. K., Miceli, M., Taylor, A. S., & Fox, S. E. (2026) · Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3772318.3791097 · Cited by 2 · see citing works
“Across both settings, we observe a convergence in labor arrangements that echoes Zhang et al.’s [148] observation of hybrid management practices.”
Self-citationCripping AI: Reimagining AI Through Lived Disability Experiences
Tang, X., Lin, T.-A., Li, J., & Wu, S. (2026) · Proceedings of the 2026 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3805689.3806744 · Cited by 2 · see citing works
- Authors
- Zhang, B. Z., Yang, T., Miceli, M., Haimson, O. L., & Thomas, M.
- Affiliations
- University of Michigan, Ann Arbor, Michigan, USA
- Weizenbaum Institute (DE)
- University of Michigan (US)
- Venue
- Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2025-04-25
- Pages
- 1-19
- OpenAlex
- W4409735453
- Cited by
- 7
- References
- 84
- Citations by year
- 2026: 5 · 2025: 2
- FWCI
- 7.20
- Type
- conference paper
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion, cc-by-nc-nd)
- Deep Blue (University of Michigan) (acceptedVersion)
- Funders
- the International Institute, the Lieberthal-Rogel Center for Chinese Studies, and Rackham Graduate School at the University of Michigan
- Topics
- Social Sciences › Safety Research › Ethics and Social Impacts of AI
- Social Sciences › Sociology and Political Science › Digital Economy and Work Transformation
- Social Sciences › Business, Management and Accounting › Industrial relations › Legal and Labor Studies
- Keywords
- AI training, data annotation, algorithmic bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
