The Profiling Potential of Computer Vision and the Challenge of Computational Empiricism
Open accessThe DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
Abstract
Computer vision and other biometrics data science applications have commenced a new project of profiling people. Rather than using 'transaction generated information', these systems measure the 'real world' and produce an assessment of the 'world state' - in this case an assessment of some individual trait. Instead of using proxies or scores to evaluate people, they increasingly deploy a logic of revealing the truth about reality and the people within it. While these profiling knowledge claims are sometimes tentative, they increasingly suggest that only through computation can these excesses of reality be captured and understood. This article explores the bases of those claims in the systems of measurement, representation, and classification deployed in computer vision. It asks if there is something new in this type of knowledge claim, sketches an account of a new form of computational empiricism being operationalised, and questions what kind of human subject is being constructed by these technological systems and practices. Finally, the article explores legal mechanisms for contesting the emergence of computational empiricism as the dominant knowledge platform for understanding the world and the people within it.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We emphasize that even with careful consideration of different theoretical understandings and careful assessment of both construct reliability and construct validity, this approach is fraught and likely to cause a variety of fairness-related and other harms [e.g., 8, 22, 33, 35, 44], despite good intentions.”
From Measurement and Fairness (2021) · cites this paper as [22]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Hacking, I. (1990) · Cambridge University Press eBooks · doi:10.1017/cbo9780511819766 · Cited by 3,586
Big Data, new epistemologies and paradigm shifts
Kitchin, R. (2014) · Big Data & Society · doi:10.1177/2053951714528481 · Cited by 2,355
First Impressions: Making Up Your Mind After a 100-Ms Exposure to a Face
Willis, J., & Todorov, A. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01750.x · Cited by 2,300
The Closed World: Computers and the Politics of Discourse in Cold War America
Edwards, P. N. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/1871.001.0001 · Cited by 999 · cited 1×
“an historical trajectory of understanding human subjectivity as an information pattern [22, 34], bound within the material container of the body that becomes its expression.”
BackgroundCode/Space: Software and Everyday Life
Kitchin, R., & Dodge, M. (2011) · doi:10.7551/mitpress/9780262042482.001.0001 · Cited by 964
Wang, Y., & Kosinski, M. (2018) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000098 · Cited by 766
(2014) · Digital Commons at University of Maryland Carey Law (University of Maryland Francis King Carey School of Law) · Cited by 524
Can an Algorithm be Agonistic? Ten Scenes from Life in Calculated Publics
Crawford, K. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915589635 · Cited by 314 · cited 1×
“’ [17] Connecting computer vision projects to”
Galton, F. (1879) · The Journal of the Anthropological Institute of Great Britain and Ireland · doi:10.2307/2841021 · Cited by 293
Research works printed but not linked: 36
- Alley Thomas, Social and Applied Aspects of Perceiving Faces
- Ambady Nalini, 2008, d.}. First Impressions, year =
- Andrejevic Mark, 2012, Brain Whisperers: Cutting Through the Clutter with Neuromarketing. Somatechnics 2(2)
- Apter Emily, 2016, Shibboleth: Policing by Ear and Forensic Listening in Projects by Lawrence Abu Hamdan. October 156
- Benjamin Walter, 1934, A Short History of Photography
- Borocas Solon, 2016, Big Data's Disparate Impact. California Law Review 104(3)
- Bygrave Lee, 2010, Privacy and Data Protection in an international perspective. Scandinavian Studies in Law 56(8)
- Escalera Sergio, 2017, Hugo Jair Escalante, and Isabelle Guyon
- Graham John, 1961, A Checklist. The Papers of the Bibliographical Society of America 55(4)
- 10.5555/2911282 · doi:10.5555/2911282
- Hartshorne Charles, Collected Papers of Charles Sanders Peirce
- Hayles N Katherine, How We Became Post-Human: Virtual Bodies in Cybernetics, Literature and Infomatics
- Mireille Hildebrandt. {n. d.}. Privacy as Protection of the Incomputable Self: From Agnostic to Agonistic Machine Learning. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3081776 Mireille Hildebrandt. {n. d.}. Privacy as Protection of the Incomputable Self: From Agnostic to Agonistic Machine Learning. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3081776
- Humphries Paul, Topics in the Foundation of Statistics, Bas C
- Gandy Oscar H, 2012, Statistical Surveillance: Remote Sensing in the Digital Age
- Jacques Júnior Júlio C. S., 2018, Isabelle Guyon, Marcel A. J. van Gerven, Rob van Lier, and Sergio Escalera.
- Jäger Jens, 2001, Photography: a means of surveillance, Judicial Photography, 1850
- Yarden Katz. {n. d.}. Manufacturing an Artificial Intelligence Revolution. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3078224 Yarden Katz. {n. d.}. Manufacturing an Artificial Intelligence Revolution. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3078224
- Kozeny E, 1962, Experimentelle Untersuchungen zur Ausdruckskunde mittel photographisch-statisticher Methode. Archive für die gesamte psychologic 114
- Krizhevsky Alex, Advances in Neural Information Processing Systems 25
- Kuhn Thomas, 1961, The Function of Measurement in Modern Physical Science. Isis 52(2)
- LeCun Yann, 2015, Hinton
- Marien Mary Warner, 2015, Photography: A Cultural History
- McGrath Roberta, Seeing her sex: Medical archives and the female body
- McQuillan Dan, 2017, Data Science as Machinic Neoplatanism. Philosophy & Technology 31(2)
- Mendoza Isak, 1934, A Short History of Photography
- Miller Jacques-Alain, 1987, Jeremy Bentham's Panoptic Device. October 41
- Narasimha Roddam, 2001, Axiomatism and Computational Positivism: Two Mathematical Cultures in Pursuit of Exact Sciences. Journal of Medical Humanities 22(2)
- O'Neil Cathy, Weapons of Math Destruction
- 10.5555/2344089 · doi:10.5555/2344089
- Qi Hairong, 2004, Snyder
- Selinger Evan, 2015, Opinion: It's time for an about-face on facial recognition. https:/www.csmonitor.com/World/Passcode/Passcode-Voices/2015/0622/Opinion-It-s-time-for-an-about-face-on-facial-recognition
- Todorov Alexander, 2017, Face Value: The Irresistable Influence of First Impressions
- Valla Jeffrey M, 2011, The Accuracy of Inferences about Criminality Based on Facial Appearance. Journal of Social, Evolutionary, and Cultural Psychology 5(2)
- Vanian Jonathan, 2018, Microsoft President: Facial Recognition Technology Needs Government Regulation
- Weatherby Leif, 2018, Digital Metaphysics: The Cybernetic Idealism of Warren McCulloch. https://iasc-culture.org/THR/THR_article_2018_Spring_Weatherby.php
Cited by
Jacobs, A. Z., & Wallach, H. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445901 · Cited by 362
“ity [27, 53, 59].”
BackgroundInfluentialA survey on bias in visual datasets
Fabbrizzi, S., Papadopoulos, S., Ntoutsi, E., & Kompatsiaris, I. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103552 · Cited by 137
“[9], these applications rely on a precise ideology that Jake Goldenfein called computational empiricism [28]: an epistemological paradigm that claims, in spite of any scientific evidence, that the true nature of humans can be measured and unveiled by algorithms.”
BackgroundPhysiognomic Artificial Intelligence
Stark, L., & Hutson, J. (2021) · doi:10.2139/ssrn.3927300 · Cited by 139
Wang, A., Ramaswamy, V., & Russakovsky, O. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533101 · Cited by 171
AI-assisted facial analysis in healthcare: From disease detection to comprehensive management
Lei, C., Dang, K., Song, S., Wang, Z., Chew, S. P., Bian, R., Yang, X., Guan, Z., Lopes, C. I. M. D. A., Wang, M. H., et al. (2025) · Patterns · doi:10.1016/j.patter.2025.101175 · Cited by 48
“14,15 There is also a need for transparency, regulation, and alignment with societal expectations.”
Metadata
- Authors
- Goldenfein, J.
- Affiliations
- Cornell University (US)
- Corresponding author
- Goldenfein, Jake
- ORCID
- Goldenfein, Jake
- Venue
- Proceedings of the Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2019-01-29
- Pages
- 110-119
- OpenAlex
- W2909848256
- Cited by
- 21
- References
- 22
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 1 · 2023: 3 · 2022: 5 · 2021: 4 · 2020: 1
- FWCI
- 2.53
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- SSRN Electronic Journal (submittedVersion)
- Swinburne figshare (Swinburne University of Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1650589)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Cybernetics and Technology in Society
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Keywords
- computer vision, biometrics, profiling, measurement, classification, representation, knowledge claims, human subjectivity, legal contestation, surveillance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Profiling Potential of Computer Vision and the Challenge of Computational Empiricism. https://app.cochat.ai/papers/10.1145/3287560.3287568
- The paper
- Goldenfein, J. (2019). The Profiling Potential of Computer Vision and the Challenge of Computational Empiricism. Proceedings of the Conference on Fairness, Accountability, and Transparency. https://doi.org/10.1145/3287560.3287568
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.