Data Vision: Learning to See Through Algorithmic Abstraction
Open accessThe DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Learning to see through data is central to contemporary forms of algorithmic knowledge production. While often represented as a mechanical application of rules, making algorithms work with data requires a great deal of situated work. This paper examines how the often-divergent demands of mechanization and discretion manifest in data analytic learning environments. Drawing on research in CSCW and the social sciences, and ethnographic fieldwork in two data learning environments, we show how an algorithm's application is seen sometimes as a mechanical sequence of rules and at other times as an array of situated decisions. Casting data analytics as a rule-based (rather than rule-bound) practice, we show that effective data vision requires would-be analysts to straddle the competing demands of formal abstraction and empirical contingency. We conclude by discussing how the notion of data vision can help better leverage the role of human work in data analytic learning, research, and practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reconceptualizing Organizational Routines as a Source of Flexibility and Change
Feldman, M. S., & Pentland, B. T. (2003) · Administrative Science Quarterly · doi:10.2307/3556620 · Cited by 4,020
A few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326 · cited 1×
“This helps to not only reduce the “opacity” [8] of data analytic practices, but also better teach and communicate, what some call, the “black art” or “folk knowledge” [13] of data analysis, contributing to the development of a complete and “reflective practitioner” [31].”
BackgroundBig Data, new epistemologies and paradigm shifts
Kitchin, R. (2014) · Big Data & Society · doi:10.1177/2053951714528481 · Cited by 2,355
Gillespie, T. (2014) · Media Technologies · doi:10.7551/mitpress/9042.003.0013 · Cited by 1,016
Artificial intelligence as craftwork
Suchman, L. A., & Trigg, R. H. (1993) · Understanding Practice · doi:10.1017/cbo9780511625510.007 · Cited by 137
Cited by
“Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI
Sambasivan, N., Kapania, S., Highfill, H., Akrong, D., Paritosh, P., & Aroyo, L. M. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445518 · Cited by 781
“[94] Samir Passi and Steven J Jackson.”
BackgroundInfluentialHuman-AI Collaboration in Data Science: Exploring Data Scientists' Perceptions of Automated AI
Wang, D., Weisz, J. D., Muller, M., Ram, P., Geyer, W., Dugan, C., Tausczik, Y., Samulowitz, H., & Gray, A. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359313 · Cited by 342
How do Data Science Workers Collaborate? Roles, Workflows, and Tools
Zhang, A. X., Muller, M., & Wang, D. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3392826 · Cited by 268
How Data Science Workers Work with Data: Discovery, Capture, Curation, Design, Creation
Muller, M., Lange, I., Wang, D., Piorkowski, D., Tsay, J., Liao, Q. V., Dugan, C., & Erickson, T. (2019) · Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300356 · Cited by 261
Problem Formulation and Fairness
Passi, S., & Barocas, S. (2019) · Proceedings of the Conference on Fairness, Accountability, and Transparency · doi:10.1145/3287560.3287567 · Cited by 283
Self-citationPassi, S., & Jackson, S. J. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274405 · Cited by 225
“Contemporary understanding of data science in research is largely based on the analysis of data science work in academic and research sites [26,66,71,75,76,83,98]; shaped by limits of access, confidentiality, and non-disclosure, the large body of applied data science work in corporate settings has received much less a…”
BackgroundSelf-citationAlgorithmic realism: expanding the boundaries of algorithmic thought
Green, B., & Viljoen, S. (2020) · Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency · doi:10.1145/3351095.3372840 · Cited by 161
Between Subjectivity and Imposition: Power Dynamics in Data Annotation for Computer Vision
Miceli, M., Schuessler, M., & Yang, T. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415186 · Cited by 149
Saxena, D., Badillo-Urquiola, K., Wisniewski, P. J., & Guha, S. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3476089 · Cited by 134
Studying Up Machine Learning Data: Why Talk About Bias When We Mean Power?
Miceli, M., Posada, J., & Yang, T. (2022) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3492853 · Cited by 125
The Who in XAI: How AI Background Shapes Perceptions of AI Explanations
Ehsan, U., Passi, S., Liao, Q. V., Chan, L., Lee, I.-H., Muller, M., & Riedl, M. O. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642474 · Cited by 123
“This high-contrast approach provides a baseline understanding and creates the foundation for future granular operationalizations (e.g., years of AI experience).”
BackgroundMethodInfluentialSelf-citationThis Thing Called Fairness: Disciplinary Confusion Realizing a Value in Technology
Mulligan, D. K., Kroll, J. A., Kohli, N., & Wong, R. Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359221 · Cited by 111
Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits
Deng, W. H., Nagireddy, M., Lee, M. S. A., Singh, J., Wu, Z. S., Holstein, K., & Zhu, H. (2022) · 2022 ACM Conference on Fairness Accountability and Transparency · doi:10.1145/3531146.3533113 · Cited by 99
Shifting Concepts of Value: Designing Algorithmic Decision-Support Systems for Public Services
Holten Møller, N., Shklovski, I., & Hildebrandt, T. T. (2020) · Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society · doi:10.1145/3419249.3420149 · Cited by 97
Designing Ground Truth and the Social Life of Labels
Muller, M., Wolf, C. T., Andres, J., Desmond, M., Joshi, N. N., Ashktorab, Z., Sharma, A., Brimijoin, K., Pan, Q., Duesterwald, E., et al. (2021) · Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445402 · Cited by 83
Algorithms as fetish: Faith and possibility in algorithmic work
Thomas, S. L., Nafus, D., & Sherman, J. (2018) · Big Data & Society · doi:10.1177/2053951717751552 · Cited by 72
Whose AI Dream? In search of the aspiration in data annotation.
Wang, D., Prabhat, S., & Sambasivan, N. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3502121 · Cited by 70
“Without the work humans pour into making sense and labeling the data to train and refine it, even the most advanced systems could not make a prediction [40, 41, 44].”
BackgroundA hunt for the Snark: Annotator Diversity in Data Practices
Kapania, S., Taylor, A. S., & Wang, D. (2023) · Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3544548.3580645 · Cited by 50
“Passi and Jackson [73] proposed the concept of data vision as the interplay between formal abstraction and discretion, which is central to making datasets work with the chosen algorithms.”
BackgroundMethodModel Positionality and Computational Reflexivity: Promoting Reflexivity in Data Science
Cambo, S. A., & Gergle, D. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3501998 · Cited by 49
Evaluating the Promise of Human-Algorithm Collaborations in Everyday Work Practices
Wolf, C., & Blomberg, J. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359245 · Cited by 48
(2022) · doi:10.1145/3491102.3501868 · Cited by 36
“HCI researchers have examined the role of collaboration between data science workers for data work [6, 51, 62, 64, 73, 74, 78, 103].”
BackgroundFrom Bias to Repair: Error as a Site of Collaboration and Negotiation in Applied Data Science Work
Lin, C. K., & Jackson, S. J. (2023) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3579607 · Cited by 22
Self-citationWho Cares About Data? Ambivalence, Translation, and Attentiveness in Asylum Casework
Nielsen, T. R., Menendez-Blanco, M., & Møller, N. H. (2023) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-023-09474-7 · Cited by 22
Haque, M. R., Weathington, K., & Guha, S. (2019) · Companion Publication of the 2019 Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/3311957.3359500 · Cited by 7
“Recognizing the growing importance of algorithmic transparency debate, HCI/CSCW researchers have slowly started crafting a broad research agenda in this area including thinking about how data analysts engage in the act of analyzing data[13] and how experts, non-experts and subjects perceive data[1] to support such goa…”
BackgroundThe Making of Performative Accuracy in AI Training: Precision Labor and Its Consequences
Zhang, B. Z., Yang, T., Miceli, M., Haimson, O. L., & Thomas, M. (2025) · Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3706598.3713112 · Cited by 7
“With a specific focus on the human labor required to produce ML datasets, existing work has investigated work practices, workflows, and social and organizational contexts [56, 57, 63, 67, 93, 101].”
Metadata
- Authors
- Passi, S., & Jackson, S.
- Venue
- Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing
- Publisher
- ACM
- Published
- 2017-02-25
- Pages
- 2436-2447
- OpenAlex
- W2588064451
- Cited by
- 100
- References
- 5
- FWCI
- 2.10
- Type
- conference paper
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.