Metahuman systems = humans + machines that learn
The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Abstract
Metahuman systems are new, emergent, sociotechnical systems where machines that learn join human learning and create original systemic capabilities. Metahuman systems will change many facets of the way we think about organizations and work. They will push information systems research in new directions that may involve a revision of the field’s research goals, methods and theorizing. Information systems researchers can look beyond the capabilities and constraints of human learning toward hybrid human/machine learning systems that exhibit major differences in scale, scope and speed. We review how these changes influence organization design and goals. We identify four organizational level generic functions critical to organize metahuman systems properly: delegating, monitoring, cultivating, and reflecting. We show how each function raises new research questions for the field. We conclude by noting that improved understanding of metahuman systems will primarily come from learning-by-doing as information systems scholars try out new forms of hybrid learning in multiple settings to generate novel, generalizable, impactful designs. Such trials will result in improved understanding of metahuman systems. This need for large-scale experimentation will push many scholars out from their comfort zone, because it calls for the revitalization of action research programs that informed the first wave of socio-technical research at the dawn of automating work systems.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Reassembling the Social: An Introduction to Actor-Network-Theory
Latour, B. (2005) · doi:10.1093/oso/9780199256044.001.0001 · Cited by 16,778
The role of deliberate practice in the acquisition of expert performance
Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993) · Psychological Review · doi:10.1037/0033-295x.100.3.363 · Cited by 9,564 · cited 1×
“A human takes perhaps 10,000 h of learning to become an expert due to the biological foundation of human learning (Ericsson et al., 1993).”
BackgroundThe spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 1×
“There are also disciplinary differences: sociology focuses on collective action (Coleman, 2017), while IS researchers concentrate on false news in social media (Aral and Eckles, 2019; Vosoughi et al., 2018).”
BackgroundMultitask principal – agent analyses: Incentive contracts, asset ownership, and job design
Holmstrom, B., & Milgrom, P. (1991) · The Journal of Law, Economics, and Organization · doi:10.1093/jleo/7.special_issue.24 · Cited by 6,046
A model for types and levels of human interaction with automation
Parasuraman, R., Sheridan, T. B., & Wickens, C. D. (2000) · IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans · doi:10.1109/3468.844354 · Cited by 4,195 · cited 2×
“Now machines can act autonomously (Parasuraman et al., 2000) as parts of “networks of humans and machines,” and ANT provides a “. . . powerful tool to regain the sense of heterogeneity, but is a ‘. . . bad tool for differentiating associations’ (Latour, 1996: 380).”
BackgroundLazer, D. M. J., Baum, M. A., Benkler, Y., Berinsky, A. J., Greenhill, K. M., Menczer, F., Metzger, M. J., Nyhan, B., Pennycook, G., Rothschild, D., et al. (2018) · Science · doi:10.1126/science.aao2998 · Cited by 4,160
A few useful things to know about machine learning
Domingos, P. (2012) · Communications of the ACM · doi:10.1145/2347736.2347755 · Cited by 3,326 · cited 1×
“Machine learning is a specialized kind of computational process (Domingos, 2012), whereas machines that learn abstract from the details of the computation and focus on the process features, outcomes and emergent features of systems like their scale, scope, speed and architecture.”
BackgroundA survey of robot learning from demonstration
Argall, B. D., Chernova, S., Veloso, M., & Browning, B. (2009) · Robotics and Autonomous Systems · doi:10.1016/j.robot.2008.10.024 · Cited by 3,227
Big other: Surveillance Capitalism and the Prospects of an Information Civilization
Zuboff, S. (2015) · Journal of Information Technology · doi:10.1057/jit.2015.5 · Cited by 3,205 · cited 3×
“They can also be oppressive (Zuboff, 2015, 2019).”
BackgroundA Survey on Deep Transfer Learning
Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., & Liu, C. (2018) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-01424-7_27 · Cited by 3,165
Yoo, Y., Henfridsson, O., & Lyytinen, K. (2010) · Information Systems Research · doi:10.1287/isre.1100.0322 · Cited by 2,964
Self-citationHuman-level concept learning through probabilistic program induction
Lake, B. M., Salakhutdinov, R., & Tenenbaum, J. B. (2015) · Science · doi:10.1126/science.aab3050 · Cited by 2,817 · cited 1×
“Nevertheless, much of the research, including ours, in the context of metahuman systems proceeds on assuming the presence of mechanisms for learning in both humans and machines (Lake et al., 2015).”
BackgroundBuilding machines that learn and think like people
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2017) · Behavioral and Brain Sciences · doi:10.1017/s0140525x16001837 · Cited by 2,550
Building Machines That Learn and Think Like People
Lake, B. M., Ullman, T. D., Tenenbaum, J. B., & Gershman, S. J. (2016) · arXiv · doi:10.48550/arxiv.1604.00289 · Cited by 2,550
Buciluǎ, C., Caruana, R., & Niculescu-Mizil, A. (2006) · Proceedings of the 12th ACM SIGKDD international conference on Knowledge discovery and data mining · doi:10.1145/1150402.1150464 · Cited by 2,068 · cited 1×
“Machines that can rapidly edit and copy knowledge (Yoo et al., 2010) make it possible for machine trainers to quickly pass new skills to machine trainees (Buciluǎ et al., 2006; Hinton et al., 2015; Rusu et al., 2016).”
BackgroundLeonardi, P. M. (2011) · MIS Quarterly · doi:10.2307/23043493 · Cited by 1,889 · cited 2×
“As a result, humans and machines ‘imbricate’ one another (Leonardi, 2011).”
BackgroundPrinciples of mixed-initiative user interfaces
Horvitz, E. (1999) · Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99 · doi:10.1145/302979.303030 · Cited by 1,490
List, C., & Pettit, P. (2011) · doi:10.1093/acprof:oso/9780199591565.001.0001 · Cited by 1,344
Cooperative Multi-Agent Learning: The State of the Art
Panait, L., & Luke, S. (2005) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-005-2631-2 · Cited by 1,237 · cited 1×
“More generally, new models of agent behavior and learning patterns will be necessary to build machines that learn for tasks where learning takes place in a context of many human and machine agents interacting, cooperating, and competing, as with driving (Lowe et al., 2017; Panait and Luke, 2005).”
BackgroundMechanisms of Social Cognition
Frith, C. D., & Frith, U. (2012) · Annual Review of Psychology · doi:10.1146/annurev-psych-120710-100449 · Cited by 973 · cited 1×
“By watching others do something successfully or engaging in such activity with others, allows one to infer and repeat expected patterns of behavior (Frith and Frith, 2012).”
BackgroundWorking and organizing in the age of the learning algorithm
Faraj, S., Pachidi, S., & Sayegh, K. (2018) · Information and Organization · doi:10.1016/j.infoandorg.2018.02.005 · Cited by 929 · cited 1×
“The machines in these systems incorporate various algorithms (Faraj et al., 2018), and are not constrained to the classical organizational containers of earlier sociotechnical systems theory (Winter et al., 2014).”
BackgroundSchneider, G. (2018) · Nature Reviews Drug Discovery · doi:10.1038/nrd.2017.232 · Cited by 910 · cited 1×
“Now such systems are used in automated drug discovery (Schneider, 2018) and other fields.”
BackgroundLambrecht, A., & Tucker, C. (2019) · Management Science · doi:10.1287/mnsc.2018.3093 · Cited by 854 · cited 1×
“Organizations might not be ready now to cultivate their metahuman systems as suggested by multiple failures, examples of inherent bias, and systems running amok (Kulshrestha et al., 2017; Lambrecht and Tucker, 2019).”
BackgroundWorking with Machines: The Impact of Algorithmic and Data-Driven Management on Human Workers
Lee, M. K., Kusbit, D., Metsky, E., & Dabbish, L. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702548 · Cited by 823
Digital Product Innovation Within Four Classes of Innovation Networks
Lyytinen, K., Yoo, Y., & Boland Jr., R. J. (2016) · Information Systems Journal · doi:10.1111/isj.12093 · Cited by 806 · cited 2×
“…as conducting tax planning or trading equities with even 95% effectiveness), the machine’s ultimate advantage is in the fast transfer and replication of such capability which would have revolutionary consequences of related organizational tasks (Kallinikos et al., 2013; Lyytinen et al., 2016).”
BackgroundSelf-citationThe Flash Crash: High‐Frequency Trading in an Electronic Market
KIRILENKO, A., KYLE, A. S., SAMADI, M., & TUZUN, T. (2017) · The Journal of Finance · doi:10.1111/jofi.12498 · Cited by 795
The Ambivalent Ontology of Digital Artifacts1
Kallinikos, J., Aaltonen, A., & Marton, A. (2013) · MIS Quarterly · doi:10.25300/misq/2013/37.2.02 · Cited by 780
Autonomous Vehicle Safety: An Interdisciplinary Challenge
Koopman, P., & Wagner, M. (2017) · IEEE Intelligent Transportation Systems Magazine · doi:10.1109/mits.2016.2583491 · Cited by 688 · cited 1×
“Monitoring autonomous driving systems is currently a complex topic and requires interdisciplinary research (Koopman and Wagner, 2017).”
BackgroundHuman-level performance in 3D multiplayer games with population-based reinforcement learning
Jaderberg, M., Czarnecki, W. M., Dunning, I., Marris, L., Lever, G., Castañeda, A. G., Beattie, C., Rabinowitz, N. C., Morcos, A. S., Ruderman, A., et al. (2019) · Science · doi:10.1126/science.aau6249 · Cited by 662
Cai, C. J., Winter, S., Steiner, D., Wilcox, L., & Terry, M. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359206 · Cited by 594 · cited 3×
“Two recent studies are signposts in this regard: Zuboff’s (2019) look at Google and Microsoft and Google’s look at its own AI systems as used by doctors (Cai et al., 2019).”
BackgroundKreiss, D., & MCGREGOR, S. C. (2018) · Political Communication · doi:10.1080/10584609.2017.1364814 · Cited by 398
Toward an Ethics of Algorithms: Convening, Observation, Probability, and Timeliness
Ananny, M. (2016) · Science, Technology, & Human Values · doi:10.1177/0162243915606523 · Cited by 395 · cited 1×
“Disclosive archeology help show what to look for—this is where humans run experiments on machines to determine how they work (Ananny, 2016; Barocas et al., 2013).”
BackgroundThe Principles and Limits of Algorithm-in-the-Loop Decision Making
Green, B., & Chen, Y. (2019) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3359152 · Cited by 392 · cited 1×
“Using a machine in a cognitive loop will, for example, causes humans also to anthropomorphize the machine expert (Cai et al., 2019), or only selectively follow machine advice when it reinforces human’s own biases (Green and Chen, 2019).”
BackgroundWhy deep-learning AIs are so easy to fool
Heaven, D. (2019) · Nature · doi:10.1038/d41586-019-03013-5 · Cited by 342 · cited 1×
“Innocuous rectangles on traffic signs can fool autonomous vehicles leveraging the way machines are trained to cause accidents (Heaven, 2019).”
BackgroundMetaFraud: A Meta-Learning Framework for Detecting Financial Fraud1
Abbasi, A., Albrecht, C., Vance, A., & Hansen, J. (2012) · MIS Quarterly · doi:10.2307/41703508 · Cited by 298
The Promise of Artificial Intelligence: Reckoning and Judgment
Smith, B. C. (2019) · doi:10.7551/mitpress/12385.001.0001 · Cited by 271
Legal personality of robots, corporations, idols and chimpanzees: a quest for legitimacy
Solaiman, S. M. (2017) · Artificial Intelligence and Law · doi:10.1007/s10506-016-9192-3 · Cited by 221 · cited 1×
“Legal constraints may prevent some forms of delegation, demanding responsibility from humans (Solaiman, 2017).”
BackgroundProtecting elections from social media manipulation
Aral, S., & Eckles, D. (2019) · Science · doi:10.1126/science.aaw8243 · Cited by 209 · cited 1×
“There are also disciplinary differences: sociology focuses on collective action (Coleman, 2017), while IS researchers concentrate on false news in social media (Aral and Eckles, 2019; Vosoughi et al., 2018).”
BackgroundBeyond the organizational ‘container’: Conceptualizing 21st century sociotechnical work
Winter, S., Berente, N., Howison, J., & Butler, B. (2014) · Information and Organization · doi:10.1016/j.infoandorg.2014.10.003 · Cited by 178 · cited 1×
“The machines in these systems incorporate various algorithms (Faraj et al., 2018), and are not constrained to the classical organizational containers of earlier sociotechnical systems theory (Winter et al., 2014).”
BackgroundQuantifying Search Bias: Investigating Sources of Bias for Political Searches in Social Media
Kulshrestha, J., Eslami, M., Messias, J., Zafar, M. B., Ghosh, S., Gummadi, K. P., & Karahalios, K. (2017) · Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing · doi:10.1145/2998181.2998321 · Cited by 148 · cited 1×
“Organizations might not be ready now to cultivate their metahuman systems as suggested by multiple failures, examples of inherent bias, and systems running amok (Kulshrestha et al., 2017; Lambrecht and Tucker, 2019).”
BackgroundIntrona, L. D. (2007) · Ethics and Information Technology · doi:10.1007/s10676-006-9133-z · Cited by 133 · cited 1×
“Transparent design involves stakeholders and users, and shows them explicitly what is driving the system (Introna, 2007; Lyons et al., 2017).”
BackgroundHeteromation and its (dis)contents: The invisible division of labor between humans and machines
Ekbia, H., & Nardi, B. (2014) · First Monday · doi:10.5210/fm.v19i6.5331 · Cited by 113
Etzioni, A., & Etzioni, O. (2016) · Ethics and Information Technology · doi:10.1007/s10676-016-9400-6 · Cited by 84 · cited 1×
“We arguably don’t know how to build machines that understand and conform to human values (Etzioni and Etzioni, 2016).”
BackgroundSibi, S., Ayaz, H., Kuhns, D. P., Sirkin, D. M., & Ju, W. (2016) · 2016 IEEE Intelligent Vehicles Symposium (IV) · doi:10.1109/ivs.2016.7535420 · Cited by 56
Cited by
Managing artificial intelligence
Berente, N., Gu, B., Recker, J., & Santhanam, R. (2021) · MIS Quarterly · doi:10.25300/misq/2021/16274 · Cited by 898
Artificial intelligence in E-Commerce: a bibliometric study and literature review
Bawack, R. E., Wamba, S. F., Carillo, K. D. A., & Akter, S. (2022) · Electronic Markets · doi:10.1007/s12525-022-00537-z · Cited by 372
Baptista, J., Stein, M.-K., Klein, S., Watson-Manheim, M. B., & Lee, J. (2020) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2020.101618 · Cited by 303
Lifting the curtain: Strategic visibility of human labour in AI-as-a-Service
Newlands, G. (2021) · Big Data & Society · doi:10.1177/20539517211016026 · Cited by 66
Hybrid intelligence in procurement: Disillusionment with AI’s superiority?
Burger, M., Nitsche, A.-M., & Arlinghaus, J. (2023) · Computers in Industry · doi:10.1016/j.compind.2023.103946 · Cited by 40
Metadata
- Authors
- Lyytinen, K., Nickerson, J. V., & King, J. L.
- Venue
- Journal of Information Technology
- Publisher
- SAGE Publications
- Published
- 2020-05-25
- Volume
- 36
- Issue
- 4
- Pages
- 427-445
- ISSN
- 0268-3962 (ISSN-L)
- 1466-4437
- OpenAlex
- W3026058619
- Cited by
- 122
- References
- 44
- FWCI
- 19.17
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.