Data Science Project Barriers—A Systematic Review
Open accessThe DOI matches its Crossref record; 54 of the 56 references it cites were found in a registry or an index.
Abstract
This study aims to identify and categorize barriers to the success of Data Science (DS) projects through a systematic literature review combined with quantitative methods of analysis. PRISMA is used to conduct a literature review to identify the barriers in the existing literature. With techniques from bibliometrics and network science, the barriers are hierarchically clustered using the Jaccard distance as a measure of dissimilarity. The review identified 27 barriers to the success of DS projects from 26 studies. These barriers were grouped into six thematic clusters: people, data and technology, management, economic, project, and external barriers. The barrier “insufficient skills” is the most frequently cited in the literature and the most frequently considered critical. From the quantitative analysis, the barriers “insufficient skills”, “poor data quality”, “data privacy and security”, “lack of support from top management”, “insufficient funding”, “insufficient ROI or justification”, “government policies and regulation”, and “inadequate, immature or inconsistent methodology” were identified as the most central in their cluster.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Silhouettes: A graphical aid to the interpretation and validation of cluster analysis
Rousseeuw, P. J. (1987) · Journal of Computational and Applied Mathematics · doi:10.1016/0377-0427(87)90125-7 · Cited by 21,392
Beyond Accuracy: What Data Quality Means to Data Consumers
Wang, R. Y., & Strong, D. M. (1996) · Journal of Management Information Systems · doi:10.1080/07421222.1996.11518099 · Cited by 4,672
THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE. 1
Jaccard, P. (1912) · New Phytologist · doi:10.1111/j.1469-8137.1912.tb05611.x · Cited by 4,561
Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340
Haddaway, N. R., Page, M. J., Pritchard, C. C., & McGuinness, L. A. (2022) · Campbell Systematic Reviews · doi:10.1002/cl2.1230 · Cited by 3,486
Guidance on Conducting a Systematic Literature Review
Xiao, Y., & Watson, M. (2019) · Journal of Planning Education and Research · doi:10.1177/0739456x17723971 · Cited by 3,467
Thorndike, R. L. (1953) · Psychometrika · doi:10.1007/bf02289263 · Cited by 2,051
Meta-Analysis: Recent Developments in Quantitative Methods for Literature Reviews
Rosenthal, R., & DiMatteo, M. R. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.59 · Cited by 1,780
Machine learning with big data: challenges and approaches.
L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M. (2017) · IEEE Access · doi:10.1109/access.2017.2696365 · Cited by 1,023
Communities, modules and large-scale structure in networks
Newman, M. E. J. (2012) · Nature Physics · doi:10.1038/nphys2162 · Cited by 787
Börner, K., Sanyal, S., & Vespignani, A. (2007) · Annual Review of Information Science and Technology · doi:10.1002/aris.2007.1440410119 · Cited by 279
Real-time Credit Card Fraud Detection Using Machine Learning
Thennakoon, A., Bhagyani, C., Premadasa, S., Mihiranga, S., & Kuruwitaarachchi, N. (2019) · 2019 9th International Conference on Cloud Computing, Data Science & Engineering (Confluence) · doi:10.1109/confluence.2019.8776942 · Cited by 240
A note on the triangle inequality for the Jaccard distance
Kosub, S. (2019) · Pattern Recognition Letters · doi:10.1016/j.patrec.2018.12.007 · Cited by 238
Kelleher, J. D., & Tierney, B. (2018) · The MIT Press eBooks · doi:10.7551/mitpress/11140.001.0001 · Cited by 221
Big Data Reduction Methods: A Survey
ur Rehman, M. H., Liew, C. S., Abbas, A., Jayaraman, P. P., Wah, T. Y., & Khan, S. U. (2016) · Data Science and Engineering · doi:10.1007/s41019-016-0022-0 · Cited by 207
Data scientists in software teams: State of the art and challenges
Kim, M., Zimmermann, T., DeLine, R., & Begel, A. (2018) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2017.2754374 · Cited by 199
Barriers to big data analytics in manufacturing supply chains: A case study from Bangladesh
Moktadir, M. A., Ali, S. M., Paul, S. K., & Shukla, N. (2019) · Computers & Industrial Engineering · doi:10.1016/j.cie.2018.04.013 · Cited by 198
Quality 4.0: a review of big data challenges in manufacturing
Escobar, C. A., McGovern, M. E., & Morales-Menendez, R. (2021) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-021-01765-4 · Cited by 191
Data Science Methodologies: Current Challenges and Future Approaches
Martínez, I., Viles, E., & Olaizola, I. G. (2021) · Big Data Research · doi:10.1016/j.bdr.2020.100183 · Cited by 172
Sharma, M., Luthra, S., Joshi, S., & Kumar, A. (2022) · Government Information Quarterly · doi:10.1016/j.giq.2021.101624 · Cited by 162
A Big Data Clustering Algorithm for Mitigating the Risk of Customer Churn
Bi, W., Cai, M., Liu, M., & Li, G. (2016) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2016.2547584 · Cited by 133
Big data analytics in sustainable humanitarian supply chain: barriers and their interactions
Bag, S., Gupta, S., & Wood, L. C. (2020) · Annals of Operations Research · doi:10.1007/s10479-020-03790-7 · Cited by 115
Performance Evaluation of Machine Learning Algorithms for Credit Card Fraud Detection
Mittal, S., & Tyagi, S. (2019) · International Conference on Cloud Computing, Data Science & Engineering (Confluence) · doi:10.1109/confluence.2019.8776925 · Cited by 114
Big data for small and medium-sized enterprises (SME): a knowledge management model
Wang, S., & Wang, H. (2020) · Journal of Knowledge Management · doi:10.1108/jkm-02-2020-0081 · Cited by 107
Factors Activating Big Data Adoption by Korean Firms
Park, J.-H., & Kim, Y. B. (2021) · Journal of Computer Information Systems · doi:10.1080/08874417.2019.1631133 · Cited by 106
Big data analytics: Implementation challenges in Indian manufacturing supply chains
Raut, R. D., Yadav, V. S., Cheikhrouhou, N., Narwane, V. S., & Narkhede, B. E. (2021) · Computers in Industry · doi:10.1016/j.compind.2020.103368 · Cited by 96
150 Successful Machine Learning Models: 6 Lessons Learned at Booking.com
Bernardi, L., Mavridis, T., & Estevez, P. (2019) · Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining · doi:10.1145/3292500.3330744 · Cited by 95
Nayal, K., Raut, R. D., Queiroz, M. M., Yadav, V. S., & Narkhede, B. E. (2023) · The International Journal of Logistics Management · doi:10.1108/ijlm-01-2021-0002 · Cited by 91
Rameezdeen, R., Chileshe, N., Hosseini, M. R., & Lehmann, S. (2016) · International Journal of Construction Management · doi:10.1080/15623599.2015.1110275 · Cited by 86
Big data analytics in telecommunications: Governance, architecture and use cases
Kastouni, M. Z., & Lahcen, A. A. (2020) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2020.11.024 · Cited by 85
Zhang, X., & Lam, J. S. L. (2019) · Maritime Policy & Management · doi:10.1080/03088839.2019.1628318 · Cited by 81
Mining Suspicious Tax Evasion Groups in Big Data
Tian, F., Lan, T., Chao, K., Godwin, N., Zheng, Q., Shah, N., & Fan, Z. (2016) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2016.2571686 · Cited by 70
Unlocking causal relations of barriers to big data analytics in manufacturing firms
Raut, R. D., Narwane, V. S., Mangla, S. K., Yadav, V. S., Narkhede, B. E., & Luthra, S. (2021) · Industrial Management & Data Systems · doi:10.1108/imds-02-2020-0066 · Cited by 63
The barriers to big data adoption in developing economies
Alalawneh, A. A. F., & Alkhatib, S. F. (2020) · The Electronic Journal of Information Systems in Developing Countries · doi:10.1002/isd2.12151 · Cited by 60
Predicting data science sociotechnical execution challenges by categorizing data science projects
Saltz, J., Shamshurin, I., & Connors, C. (2017) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23873 · Cited by 58
Gupta, A. K., & Goyal, H. (2021) · Information Technology and Management · doi:10.1007/s10799-021-00333-9 · Cited by 52
Are enterprises ready for big data analytics? A survey-based approach
Brock, V. F., & Khan, H. U. (2017) · International Journal of Business Information Systems · doi:10.1504/ijbis.2017.10004408 · Cited by 44
Achieving Competitive Advantage Through Big Data: A Literature Review
Barham, H. (2017) · Portland International Conference on Management of Engineering and Technology (PICMET) · doi:10.23919/picmet.2017.8125459 · Cited by 40
Predicting business failure under the existence of fraudulent financial reporting
Liou, F., & Yang, C. (2008) · International Journal of Accounting and Information Management · doi:10.1108/18347640810887771 · Cited by 38
Shukla, M., & Mattar, L. (2019) · Computers & Industrial Engineering · doi:10.1016/j.cie.2018.04.055 · Cited by 38
A Model-Based Embedding Technique for Segmenting Customers
Jagabathula, S., Subramanian, L., & Venkataraman, A. (2018) · Operations Research · doi:10.1287/opre.2018.1739 · Cited by 31
MANAGING BIG DATA ANALYTICS PROJECTS: THE CHALLENGES OF REALIZING VALUE
Jensen, M. H., Nielsen, P. A., & Persson, J. S. (2019) · VBN Forskningsportal (Aalborg Universitet) · Cited by 25
Achieving Agile Big Data Science: The Evolution of a Team’s Agile Process Methodology
Saltz, J., & Shamshurin, I. (2019) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata47090.2019.9005493 · Cited by 24
Predicting outcomes for big data projects: Big Data Project Dynamics (BDPD): Research in progress
Becker, D. K. (2017) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2017.8258186 · Cited by 21
Kavre, M. S., Gardas, B. B., Narwane, V. S., Navimipour, N. J., & Yalçın, Ş. (2022) · IT Professional · doi:10.1109/mitp.2022.3156956 · Cited by 20
Transforming Unstructured Data into Useful Information
Brown, M. S. (2014) · Auerbach Publications eBooks · doi:10.1201/b16666-14 · Cited by 16
Identifying Critical Issues in Smart City Big Data Project Implementation
Barham, H., & Daim, T. U. (2018) · Proceedings of the 1st ACM/EIGSCC Symposium on Smart Cities and Communities · doi:10.1145/3236461.3241967 · Cited by 15
Krasteva, I., & Ilieva, S. (2020) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata50022.2020.9378118 · Cited by 12
Gangadhari, R. K., Khanzode, V., Murthy, S., & Dennehy, D. (2022) · Benchmarking An International Journal · doi:10.1108/bij-03-2022-0161 · Cited by 8
Morlock, F., & Boßlau, M. (2021) · Procedia CIRP · doi:10.1016/j.procir.2021.11.091 · Cited by 6
Managing and Composing Teams in Data Science: An Empirical Study
Aho, T., Kilamo, T., Lwakatare, L. E., Mikkonen, T., Sievi-Korte, O., & Yaman, S. G. (2021) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata52589.2021.9671737 · Cited by 6
Chartering Predictive Analytics: A Case Study
Chipidza, W., George, J. J., & Koch, H. (2016) · Americas Conference on Information Systems · Cited by 1
How do centrality measures choose the root of trees?
Riveros, C., Salas, J., & Skibski, O. (2021) · arXiv · doi:10.48550/arxiv.2112.13736
Research works printed but not linked: 3
- Davenport, T.H., and Patil, D.J. (Harvard Business Review, 2012). Data Scientist: The Sexiest Job of the 21st Century, Harvard Business Review.
- Riveros, C., Salas, J., and Skibski, O. (2021). How to Choose the Root: Centrality Measures over Tree Structures. arXiv.
- Bahrami, 2021, Key Challenges in Big Data Startups: An Exploratory Study in Iran, Iran. J. Manag. Stud., 14, 273
Cited by
Data Quality in the Age of AI: A Review of Governance, Ethics, and the FAIR Principles
Guillen-Aguinaga, M., Aguinaga-Ontoso, E., Guillen-Aguinaga, L., Guillen-Grima, F., & Aguinaga-Ontoso, I. (2025) · Data · doi:10.3390/data10120201 · Cited by 37
“A systematic review of data science projects identified 27 barriers grouped into six clusters: people, data and technology, management, economic, project, and external factors [212].”
Inclusive data science adoption in an emerging digital economy: Governance and strategic imperatives
Shaengchart, Y., Pornsuppayakul, J., & Boonrawd, P. (2026) · Journal of Governance and Regulation · doi:10.22495/jgrv15i2siart2
Metadata
- Authors
- Labarrère, N., Costa, L., & Lima, R. M.
- Affiliations
- University of Minho (PT)
- Corresponding author
- Lima, Rui M.
- Venue
- Data
- Publisher
- MDPI AG
- Published
- 2025-08-20
- Volume
- 10
- Issue
- 8
- Pages
- 132
- ISSN
- 2306-5729 (ISSN-L)
- OpenAlex
- W4413342585
- Cited by
- 2
- References
- 56
- Citations by year
- 2026: 1 · 2025: 1
- FWCI
- 0.87
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Data (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, cc-by-nc-nd)
- Funders
- FCT—Fundação para a Ciência e Tecnologia (UID/00319/Centro)
- Topics
- Social Sciences › Business, Management and Accounting › Management Information Systems › Big Data and Business Intelligence
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Information Systems › Software Engineering Techniques and Practices
- Keywords
- data science projects, data quality, data privacy and security, top management support, project funding, return on investment, government regulation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.