The right to a human in the loop: Political constructions of computer automation and personhood
The DOI matches its Crossref record; 49 of the 50 references it cites were found in a registry or an index.
Abstract
Contributing to recent scholarship on the governance of algorithms, this article explores the role of dignity in data protection law addressing automated decision-making. Delving into the historical roots of contemporary disputes between information societies, notably European Union and Council of Europe countries and the United States, reveals that the regulation of algorithms has a rich, culturally entrenched, politically relevant backstory. The article compares the making of law concerning data protection and privacy, focusing on the role automation has played in the two regimes. By situating diverse policy treatments within the cultural contexts from which they emerged, the article uncovers and examines two different legal constructions of automated data processing, one that has furnished a right to a human in the loop that is intended to protect the dignity of the data subject and the other that promotes and fosters full automation to establish and celebrate the fairness and objectivity of computers. The existence of a subtle right across European countries and its absence in the US will no doubt continue to be relevant to international technology policy as smart technologies are introduced in more and more areas of society.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
The Black Box Society: The Secret Algorithms That Control Money and Information
Pasquale, F. (2015) · doi:10.4159/harvard.9780674736061 · Cited by 3,796
Gillespie, T. (2010) · New Media & Society · doi:10.1177/1461444809342738 · Cited by 2,522 · cited 1×
“A range of scholars have detailed the relevance (Gillespie, 2010), drama (Ziewitz, 2016), politics (Beniger, 1989; Zarsky, 2016) and impact of algorithms and computer automation on everyday information practices (Sweeney, 2013) as well as the limits of current legal regimes to address an…”
BackgroundDesigns on Nature: Science and Democracy in Europe and the United States
Jasanoff, S. (2005) · Princeton University Press eBooks · doi:10.1515/9781400837311 · Cited by 2,338
Turner, F. (2006) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226817439.001.0001 · Cited by 1,818
Sayre, P. L. (1927) · Indiana Magazine of History (Indiana University) · Cited by 1,759
Trust in Numbers: The Pursuit of Objectivity in Science and Public Life
Porter, T. M. (1995) · doi:10.1515/9781400821617 · Cited by 1,431
The Fourth Revolution: How the infosphere is reshaping human reality
Floridi, L. (2014) · International Linear Collider · Cited by 1,200
Gillespie, T. (2014) · Media Technologies · doi:10.7551/mitpress/9042.003.0013 · Cited by 1,016
The Closed World: Computers and the Politics of Discourse in Cold War America
Edwards, P. N. (1996) · The MIT Press eBooks · doi:10.7551/mitpress/1871.001.0001 · Cited by 999
Trust in numbers: The pursuit of objectivity in science and public life
Matthews, J. R. (1996) · Journal of the History of the Behavioral Sciences · doi:10.1002/(sici)1520-6696(199607)32:3<241::aid-jhbs6>3.0.co;2-x · Cited by 989
The Politics of Large Numbers: A History of Statistical Reasoning
Houser, J. A., Desrosieres, A., & Naish, C. (1999) · Contemporary Sociology · doi:10.2307/2654208 · Cited by 911
(2008) · Choice Reviews Online · doi:10.5860/choice.46-1562 · Cited by 820
Robot ethics: the ethical and social implications of robotics
(2012) · Choice Reviews Online · doi:10.5860/choice.50-0844 · Cited by 785
Declaration of Independence for Cyberspace
Barlow, J. P. (1996) · RhetNet: A Dialogic Publishing (Ad)Venture · doi:10.37514/rnt-j.1996.3.6.21 · Cited by 778
Social and political dimensions of privacy
Westin, A. F. (2003) · Journal of Social Issues · doi:10.1111/1540-4560.00072 · Cited by 721
The digital person: technology and privacy in the information age
(2005) · Choice Reviews Online · doi:10.5860/choice.42-5512 · Cited by 601
The Two Western Cultures of Privacy: Dignity versus Liberty
Whitman, J. Q. (2004) · The Yale Law Journal · doi:10.2307/4135723 · Cited by 601
Sweeney, L. (2013) · Queue · doi:10.1145/2460276.2460278 · Cited by 477
Zarsky, T. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915605575 · Cited by 422
Neue juristische Wochenschrift
Ch., M. (1963) · The Military Law and the Law of War Review · doi:10.4337/mllwr.1963.01.19 · Cited by 403
Governing Algorithms: Myth, Mess, and Methods
Ziewitz, M. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915608948 · Cited by 389
Legal Personhood for Artificial Intelligences
Solum, L. B. (2020) · Machine Ethics and Robot Ethics · doi:10.4324/9781003074991-37 · Cited by 296
The Emergence of Personal Data Protection as a Fundamental Right of the EU
González Fuster, G. (2014) · Law, Governance and Technology Series · doi:10.1007/978-3-319-05023-2 · Cited by 291
Regulating Privacy: Data Protection and Public Policy in Europe and the United States
Bennett, C. J. (1992) · Project Muse (Johns Hopkins University) · doi:10.7591/9781501722134 · Cited by 282
The assault on privacy : computers, data banks, and dossiers
Miller, A. R. (1972) · eYLS (Yale Law School) · Cited by 153
The Rise of the Right to Know: Politics and the Culture of Transparency, 1945-1975
Schudson, M. (2015) · Harvard University Press eBooks · doi:10.4159/9780674915787 · Cited by 129
On Record: Files and Dossiers in American Life.
Blumberg, A. S., & Wheeler, S. (1971) · American Sociological Review · doi:10.2307/2093619 · Cited by 126
Punched-Card Systems and the Early Information Explosion, 1880–1945
Heide, L. (2009) · Johns Hopkins University Press eBooks · doi:10.1353/book.3454 · Cited by 116
Morton, B. (1990) · Government Publications Review · doi:10.1016/0277-9390(90)90026-a · Cited by 114
Emerging Data Protection in Europe
Hondius, F. W. (1975) · CERN Document Server (European Organization for Nuclear Research) · Cited by 103
Law, Human Agency and Autonomic Computing
(2011) · Routledge eBooks · doi:10.4324/9780203828342 · Cited by 81
Hart, D. M. (1998) · Princeton University Press eBooks · doi:10.1515/9781400832422 · Cited by 79
Jones, M. L. (2016) · New York University Press eBooks · doi:10.18574/nyu/9781479898718.001.0001 · Cited by 70
Self-citationAFTERWORD: CRITICAL INFORMATION STUDIES
Vaidhyanathan, S. (2006) · Cultural Studies · doi:10.1080/09502380500521091 · Cited by 65
Erickson, C. J., & Glass, D. V. (1974) · The Economic History Review · doi:10.2307/2593395 · Cited by 58
(2002) · BRILL eBooks · doi:10.1163/9789047401704 · Cited by 54
The Control Revolution: Technological and Economic Origins of the Information Society
Costello, C. B., & Beniger, J. R. (1988) · Technology and Culture · doi:10.2307/3105557 · Cited by 47
The Evolving Privacy Landscape: 30 Years After the OECD Privacy Guidelines
OECD (2011) · OECD digital economy papers · doi:10.1787/5kgf09z90c31-en · Cited by 40
“Do Not Fold, Spindle or Mutilate”: A Cultural History of the Punch Card
Lubar, S. D. (1992) · The Journal of American Culture · doi:10.1111/j.1542-734x.1992.1504_43.x · Cited by 39
Friedman, L. M. (2007) · Stanford University Press eBooks · doi:10.1515/9780804763219 · Cited by 39
Alberts, G., & Oldenziel, R. (2014) · History of computing · doi:10.1007/978-1-4471-5493-8 · Cited by 25
Schwartz, P. M. (2010) · bepress Legal Repository · doi:10.15779/z381d7t · Cited by 19
The German Federal Data Protection Act of 1977: Protecting the Right to Privacy?
Riccardi, J. L. (1983) · bepress Legal Repository · Cited by 14
Eko, L. S. (2012) · Lexington Books · doi:10.5771/9780739167908 · Cited by 14
Shattuck, J. (1984) · bepress Legal Repository · Cited by 6
Barbas, S. (2020) · Stanford University Press eBooks · doi:10.1515/9780804796712 · Cited by 6
Ordemann, H.-J., & Schomerus, R. (1978) · Beck eBooks · Cited by 4
Neue Juristische Wochenschrift
Maes, J. (1970) · The Military Law and the Law of War Review · doi:10.4337/mllwr.1970.02.53 · Cited by 4
(2013) · bepress Legal Repository
Research works printed but not linked: 29
- Baker MA, 1972, Columbia Human Rights Law Review, 4, 89
- Black E, 2012, IBM and the Holocaust: The Strategic Alliance between Nazi German and America’s Most Powerful Corporations
- Boucher P, 1980, Informatique et Vie Privée, 45
- Brenton M, 1964, The Privacy Invaders
- Burkert H, 1999, Governance of Global Networks in the Light of Differing Local Values, 43
- Cadoux L, 1998, Privacy: Semaire Egmontpaleis, 26, 215
- Citron DK, 2014, Washington Law Review, 89, 1
- Corell H, 1984, Beyond 1984: The Law and Information Technology in Tomorrow’s Society, Council of Europe Proceedings of the Fourteenth Colloquy on European Law (Lisbon, 26–28 Sept 1984), 42
- Crawford K, 2014, Boston College Law Review, 55, 93
- Dwork C, 2013, Stanford Law Review Online, 66, 35
- Frohman L, 2013, Im Sog des Internets: Öffentlichkeit und Privatheit im digitalen Zeitalter, 71
- Gartner L, 1965, The Daily Californian, 9
- Glensy RD, 2011, Columbia Human Rights Law Review, 43, 65
- Igo SE (2015) The beginnings of the end of privacy. The Hedgehog Review 17(1). Available at: http://www.iasc-culture.org/THR/THR_article_2015_Spring_Igo.php
- Kirby MD, 1980, Stanford Journal of International Law, 16, 27
- OECD, 1968, New OECD publications
- OECD, 1971, Computer utilisation in OECD countries
- Papapavlou G, 1992, Recent Developments in Data Privacy Law: Belgium’s Data Protection Bill and the European Draft Directive, 29
- Riccardi JL, 1983, Boston College International & Comparative Law Review, 6, 243
- Rid T, 2016, The Rise of the Machines: A Cybernetic History
- Rosenberg JM, 1969, The Death of Privacy
- Schwartz PM, 2010, California Law Review, 98, 1925
- Shattuck J, 1983, Hastings Law Journal, 35, 991
- Siepel P, 2001, Nordic Data Protection Law, 115
- Simitis S, 1984, Council of Europe Proceedings of the Fourteenth Colloquy on European Law, 109
- Simitis S, 1995, Iowa Law Journal, 80, 445
- Steinmüller W, 1971, Grundfragen des datenschutzes
- Verhulst SG, 2008, International Journal of Communication, 2, 406
- Westin AF, 1967, Privacy and Freedom
Cited by
Ethical Implications and Accountability of Algorithms
Martin, K. (2019) · Journal of Business Ethics · doi:10.1007/s10551-018-3921-3 · Cited by 757
“Previous arguments against algorithmic transparency have centered on pitting fairness against accuracy or as being inefficient or just difficult to accomplish (Ananny and Crawford 2016; Jones 2017; Kroll et al. 2017).”
BackgroundBurrell, J., & Fourcade, M. (2021) · Annual Review of Sociology · doi:10.1146/annurev-soc-090820-020800 · Cited by 430
“Echoing these sentiments, the European Union’s General Data Protection Regulation instituted a right to an explanation that requires a human review of algorithmic decisions (Jones 2017).”
BackgroundAdministration by Algorithm? Public Management meets Public Sector Machine Learning
Veale, M., & Brass, I. (2019) · doi:10.31235/osf.io/mwhnb · Cited by 316
“11 Intrinsic concerns around automation of decisions have been of particular concern in European law for decades, as some have argued that in contrast to the US, Europe has treated automated decisions of many flavours as an inherent threat to human dignity (Jones 2017).”
The Flaws of Policies Requiring Human Oversight of Government Algorithms
Green, B. (2021) · doi:10.2139/ssrn.3921216 · Cited by 259
The flaws of policies requiring human oversight of government algorithms
Green, B. (2022) · Computer Law & Security Review · doi:10.1016/j.clsr.2022.105681 · Cited by 263
“These policies im to protect human rights and dignity by keeping a “huan in the loop” of automated decision-making ( Jones, 2017 ; agner, 2019 ).”
Background
Metadata
- Authors
- Jones, M. L.
- Affiliations
- Georgetown University (US)
- Corresponding author
- Jones, Meg Leta
- Venue
- Social Studies of Science
- Publisher
- SAGE Publications
- Published
- 2017-04
- Volume
- 47
- Issue
- 2
- Pages
- 216-239
- ISSN
- 0036-8539 (ISSN-L)
- 0306-3127
- 1460-3659
- OpenAlex
- W2606960880
- Cited by
- 75
- References
- 50
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 18 · 2023: 11 · 2022: 15 · 2021: 2 · 2020: 10 · 2019: 9 · 2018: 3
- FWCI
- 61.64
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Social Studies of Science (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Law › Digitalization, Law, and Regulation
- Physical Sciences › Computer Science › Artificial Intelligence › Ethics and Social Impacts of AI
- Social Sciences › Business, Management and Accounting › Industrial relations › Legal and Labor Studies
- Keywords
- automated decision-making, algorithmic governance, data protection law, privacy, personhood, human dignity, computer automation, European Union law, Council of Europe, United States law, information society, smart technologies
- MeSH terms
- Algorithms, Automation, Computers, European Union, Humans, Human Rights, Public Policy, United States, Personhood, History, 20th Century
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.