Making sense of algorithms: Relational perception of contact tracing and risk assessment during COVID-19
Open accessPublished version of a preprint
The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Governments and citizens of nearly every nation have been compelled to respond to COVID-19. Many measures have been adopted, including contact tracing and risk assessment algorithms, whereby citizen whereabouts are monitored to trace contact with other infectious individuals in order to generate a risk status via algorithmic evaluation. Based on 38 in-depth interviews, we investigate how people make sense of Health Code ( jiankangma), the Chinese contact tracing and risk assessment algorithmic sociotechnical assemblage. We probe how people accept or resist Health Code by examining their ongoing, dynamic, and relational interactions with it. Participants display a rich variety of attitudes toward privacy and surveillance, ranging from fatalism to the possibility of privacy to trade-offs for surveillance in exchange for public health, which is mediated by the perceived effectiveness of Health Code and changing views on the intentions of institutions who deploy it. We show how perceived competency varies not just on how well the technology works, but on the social and cultural enforcement of various non-technical aspects like quarantine, citizen data inputs, and cell reception. Furthermore, we illustrate how perceptions of Health Code are nested in people’s broader interpretations of disease control at the national and global level, and unexpectedly strengthen the Chinese authority’s legitimacy. None of the Chinese public, Health Code, or people’s perceptions toward Health Code are predetermined, fixed, or categorically consistent, but are co-constitutive and dynamic over time. We conclude with a theorization of a relational perception and methodological reflections to study algorithmic sociotechnical assemblages beyond COVID-19.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The ethics of algorithms: Mapping the debate
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., & Floridi, L. (2016) · Big Data & Society · doi:10.1177/2053951716679679 · Cited by 4,567 · cited 1×
“Examples include the fairest ownership models for data on individuals, effective trade-offs between privacy and safety, and the appropriateness of deploying algorithms with inscrutable, or black-boxed, statistical reasoning (Eubanks, 2018; Mittelstadt et al., 2016; Pasquale, 2015; Zuboff, 2019).”
BackgroundTheory Construction in Qualitative Research: From Grounded Theory to Abductive Analysis
Timmermans, S., & Tavory, I. (2012) · Sociological Theory · doi:10.1177/0735275112457914 · Cited by 4,349
The Black Box Society: The Secret Algorithms That Control Money and Information
Pasquale, F. (2015) · doi:10.4159/harvard.9780674736061 · Cited by 3,796
The rise of surveillance medicine
Armstrong, D. (1995) · Sociology of Health & Illness · doi:10.1111/1467-9566.ep10933329 · Cited by 1,083 · cited 1×
“Public health systems rely on surveillance infrastructure and risk assessment for disease detection and intervention (Armstrong, 1995; Foucault, 1990).”
BackgroundAlgorithms as culture: Some tactics for the ethnography of algorithmic systems
Seaver, N. (2017) · Big Data & Society · doi:10.1177/2053951717738104 · Cited by 1,010
The Black Box Society: The Secret Algorithms That Control Money and Information
(2015) · Choice Reviews Online · doi:10.5860/choice.190706 · Cited by 533
Fourcade, M., & Healy, K. (2016) · Socio-Economic Review · doi:10.1093/ser/mww033 · Cited by 474 · cited 1×
“Accordingly, an enormous commercial market has emerged for data about individuals (Fourcade and Healy, 2017; Zuboff, 2019).”
BackgroundAlgorithms in practice: Comparing web journalism and criminal justice
Christin, A. (2017) · Big Data & Society · doi:10.1177/2053951717718855 · Cited by 379 · cited 4×
“Echoing a growing scholarly focus on people’s perception of algorithms in practice (Amelang and Bauer, 2019; Brayne and Christin, 2020; Bucher, 2017; Christin, 2017), we demonstrate how people perceive Health Code along three axes: privacy issues, technology use, and implementation.”
BackgroundInfluentialAlgorithms, Governance, and Governmentality: On Governing Academic Writing
Introna, L. D. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915587360 · Cited by 339 · cited 3×
“…talk about an “algorithm,” they are often talking about an algorithmic sociotechnical assemblage, engaged and entangled with diverse sociomate-rial actors that contribute to its ontological status through their performances, beliefs, and interpretations (Introna, 2016; Kitchin, 2017; Seaver, 2017).”
BackgroundChina’s social credit systems and public opinion: Explaining high levels of approval
Kostka, G. (2019) · New Media & Society · doi:10.1177/1461444819826402 · Cited by 316
Research works printed but not linked: 36
- 10.3386/w27972 · DOI
- Amelang K, Bauer S (2019) Following the algorithm: How epidemiological risk-scores do accountability. Social Studies of Science 49(4): 476–502. · DOI
- Au L, Fu Z, Liu C (2020) It is (not) like the flu: Expertise and temporality in United States, China, and Hong Kong. In: Covid-19 conference , 10-11 July, 2020.
- 10.1016/S2589-7500(20)30133-3 · DOI
- Bourdieu P, 1998, Practical Reason: On the Theory of Action (Trans. R Johnson)
- 10.1080/1369118X.2016.1154086 · DOI · Paper page
- 10.1080/0163660X.2020.1770959 · DOI
- 10.1108/9781787430914 · DOI · Paper page
- Collado-Borrell R, Escudero-Vilaplana V, Villanueva-Bueno C, et al. (2020) Features and functionalities of smartphone apps related to COVID-19. Journal of Medical Internet Research 22(8): e20334. · DOI
- 10.1111/j.1467-9558.2008.00318.x · DOI · Paper page
- Edwards L, Veale M, Lynskey O, et al. (2020) The coronavirus (safeguards) bill 2020: Proposed protections for digital interventions and in relation to immunity certificates. Preprint, 13 April. LawArXiv . DOI: 10.31228/osf.io/yc6xu · doi:10.31228/osf.io/yc6xu
- 10.1086/231209 · DOI · Paper page
- Eubanks V, 2018, Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor
- 10.1177/0306422020935796 · doi:10.1177/0306422020935796
- Foucault M, 1990, The History of Sexuality, Vol. 1: An Introduction
- 10.5070/LP61150258 · DOI · Paper page
- Fourcade M, 2017, Socio-Economic Review, 15, 9
- 10.24908/ss.v18i1.13985 · DOI · Paper page
- 10.1177/0163443719831184 · DOI
- 10.24908/ss.v15i3/4.6610 · DOI
- 10.1080/1369118X.2016.1154087 · DOI · Paper page
- 10.1080/13562576.2020.1770587 · DOI · Paper page
- 10.4159/9780674039681 · DOI · Paper page
- Liu C, 2019, Economic Sociology: The European Electronic Newsletter, 21, 22
- Liu C (2020) Algorithms in action: Reassembling contact tracing and risk assessment during the covid-19 pandemic in China. SocArXiv . DOI: 10/ghcwnx. · doi:10.2139/ssrn.3702715
- 10.1136/bmj.m2637 · DOI
- 10.1007/s10676-005-0456-y · DOI
- 10.24908/ss.v15i2.6332 · DOI
- Lyon D, 2018, The Culture of Surveillance: Watching as a Way of Life
- 10.1093/ser/mwaa040 · DOI
- Shao C, 2020, The Surveillance Experience of Chinese University Students and the Value of Privacy in the Surveillance Society
- Tang Q (2020) Privacy-preserving contact tracing: Current solutions and open questions. arXiv:2004.06818 [cs] . Available at: http://arxiv.org/abs/2004.06818 (accessed 10 August 2020). · arXiv
- 10.1080/13569317.2020.1750759 · doi:10.1080/13569317.2020.1750759
- 10.3390/su11061595 · DOI
- 10.1080/1369118X.2018.1543442 · DOI
- Zuboff S, 2019, The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power
Cited by
Roehl, U. B. U. (2022) · Progress in IS · doi:10.1007/978-3-030-92644-1_3 · Cited by 26
Inside algorithmic bureaucracy: Disentangling automated decision-making and good administration
Roehl, U., & Crompvoets, J. (2025) · Public Policy and Administration · doi:10.1177/09520767231197801 · Cited by 21
Seberger, J. S., & Patil, S. (2021) · JMIR mHealth and uHealth · doi:10.2196/30871 · Cited by 20
Ethical Issues Raised by Artificial Intelligence and Big Data in Population Health: A Scoping Review
Couture, V., Roy, M.-C., Dez, E., Tremblay, F., & Bélisle-Pipon, J.-C. (2025) · Frontiers in Sociology · doi:10.3389/fsoc.2025.1536389 · Cited by 3
Metadata
- Authors
- Liu, C., & Graham, R.
- Venue
- Big Data & Society
- Publisher
- SAGE Publications
- Published
- 2021-01
- Volume
- 8
- Issue
- 1
- ISSN
- 2053-9517 (ISSN-L)
- OpenAlex
- W3118801830
- Cited by
- 68
- References
- 11
- FWCI
- 10.46
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Making sense of algorithms: Relational perception of contact tracing and risk assessment during COVID-19. https://app.cochat.ai/papers/10.1177/2053951721995218
- The paper
- Liu, C., & Graham, R. (2021). Making sense of algorithms: Relational perception of contact tracing and risk assessment during COVID-19. Big Data & Society. https://doi.org/10.1177/2053951721995218
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.