The DOI matches its Crossref record; 29 of the 31 references it cites were found in a registry or an index.
The Profiling Potential of Computer Vision and the Challenge of Computational Empiricism
Open accessAbstract
Computer vision and other biometrics data science applications have commenced a new project of profiling people. Rather than using 'transaction generated information', these systems measure the 'real world' and produce an assessment of the 'world state' - in this case an assessment of some individual trait. Instead of using proxies or scores to evaluate people, they increasingly deploy a logic of revealing the truth about reality and the people within it. While these profiling knowledge claims are sometimes tentative, they increasingly suggest that only through computation can these excesses of reality be captured and understood. This article explores the bases of those claims in the systems of measurement, representation, and classification deployed in computer vision. It asks if there is something new in this type of knowledge claim, sketches an account of a new form of computational empiricism being operationalised, and questions what kind of human subject is being constructed by these technological systems and practices. Finally, the article explores legal mechanisms for contesting the emergence of computational empiricism as the dominant knowledge platform for understanding the world and the people within it.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“We emphasize that even with careful consideration of different theoretical understandings and careful assessment of both construct reliability and construct validity, this approach is fraught and likely to cause a variety of fairness-related and other harms [e.g., 8, 22, 33, 35, 44], despite good intentions.”
From Measurement and Fairness (2021) · cites this paper as [22]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Hacking, I. (1990) · Cambridge University Press eBooks · doi:10.1017/cbo9780511819766 · Cited by 3,586
Big Data, new epistemologies and paradigm shifts
Kitchin, R. (2014) · Big Data & Society · doi:10.1177/2053951714528481 · Cited by 2,355
First Impressions: Making Up Your Mind After a 100-Ms Exposure to a Face
Willis, J., & Todorov, A. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01750.x · Cited by 2,300
The Closed World: Computers and the Politics of Discourse in Cold War America
Edwards, P. N. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/1871.001.0001 · Cited by 999 · cited 1×
“an historical trajectory of understanding human subjectivity as an information pattern [22, 34], bound within the material container of the body that becomes its expression.”
BackgroundCode/Space: Software and Everyday Life
Kitchin, R., & Dodge, M. (2011) · doi:10.7551/mitpress/9780262042482.001.0001 · Cited by 964
Wang, Y., & Kosinski, M. (2018) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000098 · Cited by 766
(2014) · Digital Commons at University of Maryland Carey Law (University of Maryland Francis King Carey School of Law) · Cited by 524
Can an Algorithm be Agonistic? Ten Scenes from Life in Calculated Publics
Crawford, K. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915589635 · Cited by 314 · cited 1×
“’ [17] Connecting computer vision projects to”
Galton, F. (1879) · The Journal of the Anthropological Institute of Great Britain and Ireland · doi:10.2307/2841021 · Cited by 293
Representation Learning: A Review and New PerspectivesPreprint
Bengio, Y., Courville, A. C., & Vincent, P. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.5538 · Cited by 235
Automatic detection of social rhythms in bipolar disorder
Abdullah, S., Matthews, M., Frank, E., Doherty, G., Gay, G., & Choudhury, T. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv200 · Cited by 224 · cited 1×
“The updating of remote sensing in medical applications with new sensors and data science is similarly oriented towards constructing epistemologies of pathological behaviours [3, 78].”
MethodHildebrandt, M. (2017) · University of Toronto Law Journal · doi:10.3138/utlj.2017-0044 · Cited by 208
Virtual, visible, and actionable: Data assemblages and the sightlines of justice
Jasanoff, S. (2017) · Big Data & Society · doi:10.1177/2053951717724477 · Cited by 177
Why Heideggerian AI failed and how fixing it would require making it more Heideggerian
Dreyfus, H. L. (2007) · Artificial Intelligence · doi:10.1016/j.artint.2007.10.012 · Cited by 163
Responses to Critiques on Machine Learning of Criminality Perceptions (Addendum of arXiv:1611.04135)Preprint
Wu, X., & Zhang, X. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1611.04135 · Cited by 155 · cited 4×
“Most telling is the authors’ acknowledgment that the variance between criminal and non-criminal populations is not evident from visual assessments or simple Euclidean measurements [82].”
BackgroundMethodInfluentialPredicting Symptom Trajectories of Schizophrenia using Mobile Sensing
Wang, R., Wang, W., Aung, M. H., Ben‐Zeev, D., Brian, R., Campbell, A. T., Choudhury, T., Hauser, M., Kane, J. M., Scherer, E. A., et al. (2017) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3130976 · Cited by 125 · cited 1×
“The updating of remote sensing in medical applications with new sensors and data science is similarly oriented towards constructing epistemologies of pathological behaviours [3, 78].”
MethodAutomated Facial Recognition Technology: Recent Developments and Approaches to Oversight
Mann, M., & Smith, M. (2017) · University of New South Wales law journal · doi:10.53637/kavv4291 · Cited by 112
Eubanks, V. (2018) · Scientific American · doi:10.1038/scientificamerican1118-68 · Cited by 92
Rafter, N. (2004) · Theoretical Criminology · doi:10.1177/1362480605048943 · Cited by 91 · cited 2×
“’ [68] It was radical for its providing a measurable explanation of criminal behaviour and other social phenomena on the basis of positivist reasoning with empirical methods, and it transformed criminology, penology, and jurisprudence by changing how we generate knowledge about”
BackgroundMediate Auscultation, the Stethoscope, and the “Autopsy of the Living”: Medicine's Acoustic Culture
Sterne, J. (2001) · Journal of Medical Humanities · doi:10.1023/a:1009067628620 · Cited by 84 · cited 1×
“Histories of diagnostic practices with stethoscopes have been invoked to demonstrate the movement from theoretical to perceptual ways of knowing the body, achieved through the combination of rationality and empiricism [72].”
BackgroundIndependently Controllable FactorsPreprint
Thomas, V., Pondard, J., Bengio, E., Sarfati, M., Beaudoin, P., Meurs, M., Pineau, J., Precup, D., & Bengio, Y. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1708.01289 · Cited by 77 · cited 1×
“to produce ‘disentangled representations’ [74].”
In Situ Design for Mental Illness: Considering the Pathology of Bipolar Disorder in mHealth Design
Matthews, M. L., Voida, S., Abdullah, S., Doherty, G. J., Choudhury, T., Im, S., & Gay, G. K. (2015) · International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI) · doi:10.1145/2785830.2785866 · Cited by 71
Valentin, D., Abdi, H., & Edelman, B. G. (1997) · Perception · doi:10.1068/p261271 · Cited by 63
First Impressions: A Survey on Vision-Based Apparent Personality Trait AnalysisPreprint
Jacques, J. C. S., Güçlütürk, Y., Pérez, M., Güçlü, U., Andújar, C., Baró, X., Escalante, H. J., Guyon, I., van Gerven, M. A. J., van Lier, R., et al. (2018) · RECERCAT (Consorci de Serveis Universitaris de Catalunya) · doi:10.48550/arxiv.1804.08046 · Cited by 49
Computer Vision and Natural Constraints
Brown, C. M. (1984) · Science · doi:10.1126/science.224.4655.1299 · Cited by 47
Physiognomy: Personality traits prediction by learning
Zhang, T., Qin, R., Dong, Q., Gao, W., Xu, H., & Hu, Z. (2017) · Machine Intelligence Research · doi:10.1007/s11633-017-1085-8 · Cited by 42 · cited 1×
“7 It was not long until convolutional neural networks were predicting intelligence and other personality characteristics based on images [84].”
BackgroundWhen machine learning is facially invalid
Pasquale, F. (2018) · Communications of the ACM · doi:10.1145/3241367 · Cited by 18
Automatic Physiognomic Analysis by Classifying Facial Component Feature
Yang, H.-D., & Lee, S. (2006) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2006.1196 · Cited by 7 · cited 1×
“division of the face into 32 classes [25, 30, 83].”
BackgroundBeing and media: digital ontology after the event of the end of media
Clemens, J. C., & Nash, A. (2015) · Minerva Access (University of Melbourne) · Cited by 7
ChaLearn Looking at People: A Review of Events and ResourcesPreprint
Escalera, S., Baró, X., Escalante, H. J., et al. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.02664 · Cited by 2
Research works printed but not linked: 36
- Alley Thomas, Social and Applied Aspects of Perceiving Faces
- Ambady Nalini, 2008, d.}. First Impressions, year =
- Andrejevic Mark, 2012, Brain Whisperers: Cutting Through the Clutter with Neuromarketing. Somatechnics 2(2)
- Apter Emily, 2016, Shibboleth: Policing by Ear and Forensic Listening in Projects by Lawrence Abu Hamdan. October 156
- Benjamin Walter, 1934, A Short History of Photography
- Borocas Solon, 2016, Big Data's Disparate Impact. California Law Review 104(3)
- Bygrave Lee, 2010, Privacy and Data Protection in an international perspective. Scandinavian Studies in Law 56(8)
- Escalera Sergio, 2017, Hugo Jair Escalante, and Isabelle Guyon
- Graham John, 1961, A Checklist. The Papers of the Bibliographical Society of America 55(4)
- 10.5555/2911282 · doi:10.5555/2911282
- Hartshorne Charles, Collected Papers of Charles Sanders Peirce
- Hayles N Katherine, How We Became Post-Human: Virtual Bodies in Cybernetics, Literature and Infomatics
- Mireille Hildebrandt. {n. d.}. Privacy as Protection of the Incomputable Self: From Agnostic to Agonistic Machine Learning. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3081776 Mireille Hildebrandt. {n. d.}. Privacy as Protection of the Incomputable Self: From Agnostic to Agonistic Machine Learning. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3081776
- Humphries Paul, Topics in the Foundation of Statistics, Bas C
- Gandy Oscar H, 2012, Statistical Surveillance: Remote Sensing in the Digital Age
- Jacques Júnior Júlio C. S., 2018, Isabelle Guyon, Marcel A. J. van Gerven, Rob van Lier, and Sergio Escalera.
- Jäger Jens, 2001, Photography: a means of surveillance, Judicial Photography, 1850
- Yarden Katz. {n. d.}. Manufacturing an Artificial Intelligence Revolution. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3078224 Yarden Katz. {n. d.}. Manufacturing an Artificial Intelligence Revolution. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3078224
- Kozeny E, 1962, Experimentelle Untersuchungen zur Ausdruckskunde mittel photographisch-statisticher Methode. Archive für die gesamte psychologic 114
- Krizhevsky Alex, Advances in Neural Information Processing Systems 25
- Kuhn Thomas, 1961, The Function of Measurement in Modern Physical Science. Isis 52(2)
- LeCun Yann, 2015, Hinton
- Marien Mary Warner, 2015, Photography: A Cultural History
- McGrath Roberta, Seeing her sex: Medical archives and the female body
- McQuillan Dan, 2017, Data Science as Machinic Neoplatanism. Philosophy & Technology 31(2)
- Mendoza Isak, 1934, A Short History of Photography
- Miller Jacques-Alain, 1987, Jeremy Bentham's Panoptic Device. October 41
- Narasimha Roddam, 2001, Axiomatism and Computational Positivism: Two Mathematical Cultures in Pursuit of Exact Sciences. Journal of Medical Humanities 22(2)
- O'Neil Cathy, Weapons of Math Destruction
- 10.5555/2344089 · doi:10.5555/2344089
- Qi Hairong, 2004, Snyder
- Selinger Evan, 2015, Opinion: It's time for an about-face on facial recognition. https:/www.csmonitor.com/World/Passcode/Passcode-Voices/2015/0622/Opinion-It-s-time-for-an-about-face-on-facial-recognition
- Todorov Alexander, 2017, Face Value: The Irresistable Influence of First Impressions
- Valla Jeffrey M, 2011, The Accuracy of Inferences about Criminality Based on Facial Appearance. Journal of Social, Evolutionary, and Cultural Psychology 5(2)
- Vanian Jonathan, 2018, Microsoft President: Facial Recognition Technology Needs Government Regulation
- Weatherby Leif, 2018, Digital Metaphysics: The Cybernetic Idealism of Warren McCulloch. https://iasc-culture.org/THR/THR_article_2018_Spring_Weatherby.php
Cited by
Jacobs, A. Z., & Wallach, H. (2021) · Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3442188.3445901 · Cited by 362
“ity [27, 53, 59].”
BackgroundInfluentialA survey on bias in visual datasets
Fabbrizzi, S., Papadopoulos, S., Ntoutsi, E., & Kompatsiaris, I. Y. (2022) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2022.103552 · Cited by 221
“[9], these applications rely on a precise ideology that Jake Goldenfein called computational empiricism [28]: an epistemological paradigm that claims, in spite of any scientific evidence, that the true nature of humans can be measured and unveiled by algorithms.”
BackgroundPhysiognomic Artificial Intelligence
Stark, L., & Hutson, J. (2021) · doi:10.2139/ssrn.3927300 · Cited by 139
Wang, A., Ramaswamy, V., & Russakovsky, O. (2022) · ACM Conference on Fairness, Accountability, and Transparency (FAccT) · doi:10.1145/3531146.3533101 · Cited by 171
AI-assisted facial analysis in healthcare: From disease detection to comprehensive management
Lei, C., Dang, K., Song, S., Wang, Z., Chew, S. P., Bian, R., Yang, X., Guan, Z., Lopes, C. I. M. D. A., Wang, M. H., et al. (2025) · Patterns · doi:10.1016/j.patter.2025.101175 · Cited by 46
“14,15 There is also a need for transparency, regulation, and alignment with societal expectations.”
Metadata
- Authors
- Goldenfein, J.
- Affiliations
- Cornell University (US)
- Corresponding author
- Goldenfein, Jake
- ORCID
- Goldenfein, Jake
- Venue
- Proceedings of the Conference on Fairness, Accountability, and Transparency
- Publisher
- ACM
- Published
- 2019-01-29
- Pages
- 110-119
- OpenAlex
- W2909848256
- Cited by
- 21
- References
- 22
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 1 · 2023: 3 · 2022: 5 · 2021: 4 · 2020: 1
- FWCI
- 2.53
- Type
- conference paper
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- ACM Conference on Fairness, Accountability, and Transparency (FAccT) (publishedVersion)
- arXiv (Cornell University) (submittedVersion)
- SSRN Electronic Journal (submittedVersion)
- Swinburne figshare (Swinburne University of Technology) (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (1650589)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Cybernetics and Technology in Society
- Physical Sciences › Computer Science › Signal Processing › Biometric Identification and Security
- Keywords
- computer vision, biometrics, profiling, measurement, classification, representation, knowledge claims, human subjectivity, legal contestation, surveillance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.