Shifting ML value creation mechanisms: A process model of ML value creation
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Advancements in artificial intelligence (AI) technologies are rapidly changing the competitive landscape. In the search for an appropriate strategic response, firms are currently engaging in a large variety of AI projects. However, recent studies suggest that many companies are falling short in creating tangible business value through AI. As the current scientific body of knowledge lacks empirically-grounded research studies for explaining this phenomenon, we conducted an exploratory interview study focusing on 56 applications of machine learning (ML) in 29 different companies. Through an inductive qualitative analysis, we uncover three broad types and five subtypes of ML value creation mechanisms, identify necessary but not sufficient conditions for successfully leveraging them, and observe that organizations, in their efforts to create value, dynamically shift from one ML value creation mechanism to another by reconfiguring their ML applications (i.e., the shifting practice). We synthesize these findings into a process model of ML value creation, which illustrates how organizations engage in (resource) orchestration by shifting between ML value creation mechanisms as their capabilities evolve and business conditions change. Our model provides an alternative explanation for the current high failure rate of ML projects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Seeking Qualitative Rigor in Inductive Research: Notes on the Gioia Methodology
Gioia, D. A., Corley, K. G., & Hamilton, A. L. (2013) · Organizational Research Methods · doi:10.1177/1094428112452151 · Cited by 13,227
Business intelligence and analytics: from big data to big impact
Chen, H., Chiang, R. H. L., & Storey, V. C. (2012) · MIS Quarterly · doi:10.2307/41703503 · Cited by 6,250
Some Studies in Machine Learning Using the Game of Checkers
Samuel, A. L. (1959) · IBM Journal of Research and Development · doi:10.1147/rd.33.0210 · Cited by 4,443
But is it rigorous? Trustworthiness and authenticity in naturalistic evaluation
Lincoln, Y. S., & Guba, E. G. (1986) · New Directions for Program Evaluation · doi:10.1002/ev.1427 · Cited by 3,668
Haenlein, M., & Kaplan, A. (2019) · California Management Review · doi:10.1177/0008125619864925 · Cited by 2,655
The KDD process for extracting useful knowledge from volumes of data
Fayyad, U., Piatetsky-Shapiro, G., & Smyth, P. (1996) · Communications of the ACM · doi:10.1145/240455.240464 · Cited by 1,934
The forthcoming artificial intelligence (AI) revolution: Its impact on society and firms
Makridakis, S. (2017) · Futures · doi:10.1016/j.futures.2017.03.006 · Cited by 1,866
Mikalef, P., & Gupta, M. (2021) · Information & Management · doi:10.1016/j.im.2021.103434 · Cited by 1,700
Understanding the elusive black Box of dynamic capabilities
Pavlou, P. A., & El Sawy, O. A. (2011) · Decision Sciences · doi:10.1111/j.1540-5915.2010.00287.x · Cited by 1,329
Pavlou, P. A., & El Sawy, O. A. (2006) · Information Systems Research · doi:10.1287/isre.1060.0094 · Cited by 1,311
Organizational Decision-Making Structures in the Age of Artificial Intelligence
Shrestha, Y. R., Ben-Menahem, S. M., & von Krogh, G. (2019) · California Management Review · doi:10.1177/0008125619862257 · Cited by 1,108
Creating Strategic Business Value from Big Data Analytics: A Research Framework
Grover, V., Chiang, R. H. L., Liang, T.-P., & Zhang, D. (2018) · Journal of Management Information Systems · doi:10.1080/07421222.2018.1451951 · Cited by 961
Managing artificial intelligence
Berente, N., Gu, B., Recker, J., & Santhanam, R. (2021) · MIS Quarterly · doi:10.25300/misq/2021/16274 · Cited by 898
Debating big data: a literature review on realizing value from big data
Günther, W. A., Rezazade Mehrizi, M. H., Huysman, M., & Feldberg, F. (2017) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2017.07.003 · Cited by 880
Universal intelligence: a definition of machine intelligence
Legg, S., & Hutter, M. (2007) · Minds and Machines · doi:10.1007/s11023-007-9079-x · Cited by 803
Toward understanding the impact of artificial intelligence on labor
Frank, M. R., Autor, D., Bessen, J. E., Brynjolfsson, E., Cebrian, M., Deming, D. J., Feldman, M., Groh, M., Lobo, J., Moro, E., et al. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1900949116 · Cited by 713
Big Data Research in Information Systems: Toward an Inclusive Research Agenda
University of Virginia, Abbasi, A., Sarker, S., University of Virginia, Aalto University, Chiang, R., & University of Cincinnati (2016) · Journal of the Association for Information Systems · doi:10.17705/1jais.00423 · Cited by 688
Artificial intelligence in organizations: New opportunities for phenomenon-based theorizing
von Krogh, G. (2018) · Academy of Management Discoveries · doi:10.5465/amd.2018.0084 · Cited by 641
Ready or not, AI comes—an interview study of organizational AI readiness factors
Jöhnk, J., Weißert, M., & Wyrtki, K. (2021) · Business & Information Systems Engineering · doi:10.1007/s12599-020-00676-7 · Cited by 637
What makes Big Data, Big Data? Exploring the ontological characteristics of 26 datasets
Kitchin, R., & McArdle, G. (2016) · Big Data & Society · doi:10.1177/2053951716631130 · Cited by 606
Designing interviews to generate rich data for information systems research
Schultze, U., & Avital, M. (2011) · Information and Organization · doi:10.1016/j.infoandorg.2010.11.001 · Cited by 522
Sharma, R., Mithas, S., & Kankanhalli, A. (2014) · European Journal of Information Systems · doi:10.1057/ejis.2014.17 · Cited by 516
Baird, A., & Maruping, L. M. (2021) · MIS Quarterly · doi:10.25300/misq/2021/15882 · Cited by 512
Resource management in dyadic competitive rivalry: The effects of resource bundling and deployment
Sirmon, D. G., Gove, S., & Hitt, M. A. (2008) · Academy of Management Journal · doi:10.5465/amj.2008.34789656 · Cited by 502
Newell, S., & Marabelli, M. (2015) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2015.02.001 · Cited by 494
Schryen, G. (2013) · European Journal of Information Systems · doi:10.1057/ejis.2012.45 · Cited by 420
Data Analytics, Innovation, and Firm Productivity
Wu, L., Hitt, L., & Lou, B. (2020) · Management Science · doi:10.1287/mnsc.2018.3281 · Cited by 368
Augmenting the algorithm: Emerging human-in-the-loop work configurations
Grønsund, T., & Aanestad, M. (2020) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2020.101614 · Cited by 364
Coombs, C., Hislop, D., Taneva, S. K., & Barnard, S. (2020) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2020.101600 · Cited by 301
Zhang, D., Pee, L. G., & Cui, L. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102304 · Cited by 228
Artificial intelligence as digital agency
Ågerfalk, P. J. (2020) · European Journal of Information Systems · doi:10.1080/0960085x.2020.1721947 · Cited by 217
A New Golden Age in Computer Architecture: Empowering the Machine-Learning Revolution
Dean, J., Patterson, D., & Young, C. (2018) · IEEE Micro · doi:10.1109/mm.2018.112130030 · Cited by 168
ModelOps: Cloud-Based Lifecycle Management for Reliable and Trusted AI
Hummer, W., Muthusamy, V., Rausch, T., Dube, P., El Maghraoui, K., Murthi, A., & Oum, P. (2019) · 2019 IEEE International Conference on Cloud Engineering (IC2E) · doi:10.1109/ic2e.2019.00025 · Cited by 105
Galliers, R. D., Newell, S., Shanks, G., & Topi, H. (2017) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2017.08.002 · Cited by 70
Characterizing Machine Learning Processes: A Maturity Framework
Akkiraju, R., Sinha, V., Xu, A., Mahmud, J., Gundecha, P., Liu, Z., Liu, X., & Schumacher, J. (2020) · Lecture Notes in Computer Science · doi:10.1007/978-3-030-58666-9_2 · Cited by 64
Lebovitz, S., Levina, N., & Lifshitz-Assaf, H. (2021) · MIS Quarterly · doi:10.25300/misq/2021/16564 · Cited by 49
Cited by
Feuerriegel, S., Hartmann, J., Janiesch, C., & Zschech, P. (2024) · Business & Information Systems Engineering · doi:10.1007/s12599-023-00834-7 · Cited by 2,267
“ingredients more closely for the context of generative AI to steer the technological possibilities in a successful direction (Shollo et al., 2022).”
Ofosu-Ampong, K. (2024) · Telematics and Informatics Reports · doi:10.1016/j.teler.2024.100127 · Cited by 81
Kumar, A., Bhattacharyya, S. S., & Krishnamoorthy, B. (2023) · Journal of Enterprise Information Management · doi:10.1108/jeim-09-2022-0307 · Cited by 34
Metadata
- Authors
- Shollo, A., Hopf, K., Thiess, T., & Müller, O.
- Venue
- The Journal of Strategic Information Systems
- Publisher
- Elsevier BV
- Published
- 2022-09
- Volume
- 31
- Issue
- 3
- Pages
- 101734
- ISSN
- 0963-8687 (ISSN-L)
- OpenAlex
- W4286110517
- Cited by
- 90
- References
- 36
- FWCI
- 5.09
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.