When Knowledge Work and Analytical Technologies Collide: The Practices and Consequences of Black Boxing Algorithmic Technologies
The DOI matches its Crossref record; 100 of the 100 references it cites were found in a registry or an index.
Abstract
Analytical technologies that structure and process data hold great promise for organizations but also may pose fundamental challenges for how knowledge workers accomplish tasks. Knowledge workers are generally considered experts who develop deep understanding of their tools, but recent observations suggest that in some situations, they may black box their analytical technologies, meaning they trust their tools without understanding how they work. I conducted a two-year inductive ethnographic study of the use of analytical technologies across four groups in an investment bank and found two distinct paths that these groups used to validate financial analyses through what I call “validating practices”: actions that confirm whether a produced analysis is trustworthy. Surprisingly, engaging in these practices does not necessarily equate to understanding the calculations performed by the technologies. In one path, validating practices are partitioned across junior and senior roles: junior bankers engage in assembling tasks and use the analytical tools to perform analysis, while only senior bankers interpret the analysis. In the other path, junior and senior members engage in co-construction: junior bankers do both assembling and interpreting tasks, and senior bankers engage in interpreting and provide feedback on junior bankers’ reasoning and choices. Both junior and senior bankers in the partitioning groups routinely black boxed the algorithms embedded in their technologies, taking them for granted without understanding them. By contrast, bankers in the co-construction groups were conscious of the algorithms and understood their potential impact. I found that black boxing influenced the knowledge outputs of these bankers and constrained the development of junior members’ expertise, with consequences for their career trajectories.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Moreover, the technical complexity and opacity of algorithmic systems187–189 deprives workers of the ability to understand and master the system that governs their work, which limits their voice and enpowerment172,185,190.”
From Understanding and shaping the future of work with self-determination theory (2022) · cites this paper as [187]
Citations
Cites
Qualitative Data Analysis: An Expanded Sourcebook
(1994) · Journal of Environmental Psychology · doi:10.1016/s0272-4944(05)80231-2 · Cited by 48,420 · cited 1×
“Next, I began to systematically compare groups’ processes and used charts and tables to facilitate that comparison (Miles and Huberman, 1994).”
Situated Learning: Legitimate Peripheral Participation
Lave, J., & Wenger, E. (1991) · Cambridge University Press eBooks · doi:10.1017/cbo9780511815355 · Cited by 35,324
Communities of Practice: Learning, Meaning, and Identity
Wenger, E. (1998) · doi:10.1017/cbo9780511803932 · Cited by 23,500 · cited 5×
“While prior research has noted that senior members’ expectations may shape forms of participation (Wenger, 1998; Gomes, 2019), this research has largely assumed that such differences coincide with occupational and environmental factors (Bailey and Barley, 2011), including technological barriers and…”
BackgroundResultInfluentialBasics of Qualitative Research: Grounded Theory Procedures and Techniques
Long, D. R., Strauss, A., & Corbin, J. (1993) · The Modern Language Journal · doi:10.2307/328955 · Cited by 17,576
Teece, D. J. (2007) · Strategic Management Journal · doi:10.1002/smj.640 · Cited by 16,825
Psychological Safety and Learning Behavior in Work Teams
Edmondson, A. (1999) · Administrative Science Quarterly · doi:10.2307/2666999 · Cited by 12,026 · cited 1×
“Speaking up in this case was not indicative of psychological safety that mitigates hierarchical differences (Edmondson, 1999).”
BackgroundResearch in Organizational Behavior.
Grimes, A. J., Cummings, L. L., & Staw, B. M. (1986) · Administrative Science Quarterly · doi:10.2307/2392975 · Cited by 10,899
Hutchins, E. (1995) · doi:10.7551/mitpress/1881.001.0001 · Cited by 10,801 · cited 4×
“For example, arbitrage trading is performed with Bloomberg terminals (Beunza and Stark, 2004), ship navigation with nautical charts (Hutchins, 1995), and experimental physics with detection devices (Galison, 1997).”
BackgroundMethodInfluentialScience in Action: How to Follow Scientists and Engineers through Society
Bijker, W. E., & Latour, B. (1988) · Technology and Culture · doi:10.2307/3105094 · Cited by 10,767
Brown, J. S., & Duguid, P. (1991) · Organization Science · doi:10.1287/orsc.2.1.40 · Cited by 8,390 · cited 2×
“…yet developed expertise are more likely to trust analytical technologies as accurate without examination (e.g., Turkle, 2009), though they ultimately develop expertise by participating in knowledge work with more experienced colleagues (Brown and Duguid, 1991; Lave and Wenger, 1991; Wenger, 1998).”
Background
Research works printed but not linked: 5
- Bechky B. A., 2016, Handbook of Qualitative Organizational Research: Innovative Pathways and Methods, 168
- Blasi G., 1995, Journal of Legal Education, 45, 313
- Kluttz D., 2019, Berkeley Technology Law Journal, 34, 853
- 10.1177/000312240106600306 · doi:10.1177/000312240106600306
- Scarselletta M., 1997, Between Craft and Science: Technical Work in the United States, 187
Cited by
Lebovitz, S., Lifshitz-Assaf, H., & Levina, N. (2022) · Organization Science · doi:10.1287/orsc.2021.1549 · Cited by 632
“, cars or computers) is ubiquitous (Anthony 2021), problems arise when there is a need to integrate diverse knowledge claims into a single decision that a human expert can stand behind.”
Understanding and shaping the future of work with self-determination theory
Gagné, M., Parker, S. K., Griffin, M. A., Dunlop, P. D., Knight, C., Klonek, F. E., & Parent-Rocheleau, X. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00056-w · Cited by 434
“Collaborating” with AI: Taking a System View to Explore the Future of Work
Anthony, C., Bechky, B. A., & Fayard, A.-L. (2023) · Organization Science · doi:10.1287/orsc.2022.1651 · Cited by 370
Self-citationCombining Human and Artificial Intelligence: Hybrid Problem-Solving in Organizations
Raisch, S., & Fomina, K. (2025) · Academy of Management Review · doi:10.5465/amr.2021.0421 · Cited by 280
“Accordingly, Anthony (2021) found that inexperienced humans generally accept AI outputs without questioning them.”
BackgroundCan HR adapt to the paradoxes of artificial intelligence?
Charlwood, A., & Guenole, N. (2022) · Human Resource Management Journal · doi:10.1111/1748-8583.12433 · Cited by 271
“It is also important for senior and experienced professionals to work closely with those who develop and operate automating technologies to ensure that their knowledge and expertise is used to inform use and understanding of the automating algorithms (Callen, 2021).”
Background
Metadata
- Authors
- Anthony, C.
- Affiliations
- New York University (US)
- Corresponding author
- Anthony, Callen
- ORCID
- Anthony, Callen
- Venue
- Administrative Science Quarterly
- Publisher
- SAGE Publications
- Published
- 2021-06-04
- Volume
- 66
- Issue
- 4
- Pages
- 1173-1212
- ISSN
- 0001-8392 (ISSN-L)
- 1930-3815
- OpenAlex
- W3169518303
- Cited by
- 191
- References
- 100
- Citations by year
- 2026: 64 · 2025: 56 · 2024: 31 · 2023: 23 · 2022: 15 · 2021: 2
- FWCI
- 24.60
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Administrative Science Quarterly (publishedVersion)
- Funders
- Social Science Research Council (Doctoral Fellowship)
- Strategic Management Society (SRF Dissertation Research Grant)
- Topics
- Social Sciences › Business, Management and Accounting › Management Information Systems › Information Systems Theories and Implementation
- Physical Sciences › Computer Science › Artificial Intelligence › Explainable Artificial Intelligence (XAI)
- Social Sciences › Business, Management and Accounting › Organizational Behavior and Human Resource Management › Management and Organizational Studies
- Keywords
- knowledge work, analytical technologies, black-boxing, algorithmic technologies, validation practices, trust in technology, financial analysis, investment banks, co-construction, expertise development, career paths
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: When Knowledge Work and Analytical Technologies Collide: The Practices and Consequences of Black Boxing Algorithmic Technologies. https://app.cochat.ai/papers/10.1177/00018392211016755
- The paper
- Anthony, C. (2021). When Knowledge Work and Analytical Technologies Collide: The Practices and Consequences of Black Boxing Algorithmic Technologies. Administrative Science Quarterly. https://doi.org/10.1177/00018392211016755
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.