Big Data Life Cycle in Shop-Floor–Trends and Challenges
Open accessThe DOI matches its Crossref record; 82 of the 83 references it cites were found in a registry or an index, and 1 are not checked yet.
Abstract
Big data is defined as a large set of data that could be structured or unstructured. In manufacturing shop-floor, big data incorporates data collected at every stage of the production process. This includes data from machines, connecting devices, and even manufacturing operators. The large size of the data available on the manufacturing shop-floor presents a need for the establishment of tools and techniques along with associated best practices to leverage the advantage of data-driven performance improvement and optimization. There also exists a need for a better understanding of the approaches and techniques at various stages of the data life cycle. In the work carried out, the data life-cycle in shop-floor is studied with a focus on each of the components - Data sources, collection, transmission, storage, processing, and visualization. A narrative literature review driven by two research questions is provided to study trends and challenges in the field. The selection of papers is supported by an analysis of n-grams. Those are used to comprehensively characterize the main technological and methodological aspects and as starting point to discuss potential future research directions. A detailed review of the current trends in different data life cycle stages is provided. In the end, the discussion of the existing challenges is also presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
















Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“SCPs are equipped with sensors, embedded systems, and communication capabilities that enable them to gather various types of data, such as sensor readings, usage patterns, and environmental information.”
From AdaptUI: A Framework for the development of Adaptive User Interfaces in Smart Product-Service Systems (2024) · cites this paper as Pulikottil et al. 2023
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Beyond the hype: Big data concepts, methods, and analytics
Gandomi, A., & Haider, M. (2015) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2014.10.007 · Cited by 4,226 · cited 1×
“tured, semi-structured, and unstructured [25].”
Data-driven smart manufacturing
Tao, F., Qi, Q., Liu, A., & Kusiak, A. (2018) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2018.01.006 · Cited by 1,806 · cited 6×
“Big data may be processed efficiently by means of data cleaning, data reduction, data analysis, and data mining techniques, owing to advances in artificial intelligence, cloud computing and IoT [1].”
BackgroundMethodInfluentialSmart manufacturing: Past research, present findings, and future directions
Kang, H. S., Lee, J. Y., Choi, S., Kim, H., Park, J. H., Son, J. Y., Kim, B. H., & Noh, S. D. (2016) · International Journal of Precision Engineering and Manufacturing-Green Technology · doi:10.1007/s40684-016-0015-5 · Cited by 1,362 · cited 1×
“Three key SM technologies include: (i) CPS (physical assets integrated with computational capabilities), (ii) IoT (highly connected devices with embedded sensors), and big data [3].”
BackgroundRecent advances and trends in predictive manufacturing systems in big data environment
Lee, J., Lapira, E., Bagheri, B., & Kao, H.-A. (2013) · Manufacturing Letters · doi:10.1016/j.mfglet.2013.09.005 · Cited by 1,090 · cited 1×
“Big data, and data in general, requires to be structured into specific content formats and context to be useful for users [16].”
BackgroundBig Data technologies: A survey
Oussous, A., Benjelloun, F.-Z., Ait Lahcen, A., & Belfkih, S. (2018) · Journal of King Saud University - Computer and Information Sciences · doi:10.1016/j.jksuci.2017.06.001 · Cited by 980 · cited 1×
“The big data age has arisen with the massive use of mobile and smart devices, the great availability of IoT devices, and cloud computing, when traditional methods were not sufficient for adequate information processing [4].”
BackgroundMachine learning and data mining in manufacturing
Dogan, A., & Birant, D. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.114060 · Cited by 677 · cited 1×
“On a high level, manufacturing data may be categorized into management, equipment, user, product, operational, and process data [6] and [1].”
BackgroundBig data analytics for intelligent manufacturing systems: A review
Wang, J., Xu, C., Zhang, J., & Zhong, R. (2022) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2021.03.005 · Cited by 603 · cited 2×
“Thereafter, during production, data analytics monitor the production process and lead to informed decision making regarding the manufacturing process, improving product quality and reducing production costs [10].”
BackgroundBig Data for Remote Sensing: Challenges and Opportunities
Chi, M., Plaza, A., Benediktsson, J. A., Sun, Z., Shen, J., & Zhu, Y. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2016.2598228 · Cited by 599
Smart manufacturing: Characteristics, technologies and enabling factors
Mittal, S., Khan, M. A., Romero, D., & Wuest, T. (2019) · Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture · doi:10.1177/0954405417736547 · Cited by 560 · cited 1×
“Data may be visualized in dashboards, including statements, charts, graphs and augmented reality [27], and data may be queried in real time or on demand, based on the users needs, enabling decision making based on historical or real-time data.”
BackgroundBig Data: Survey, Technologies, Opportunities, and Challenges
Khan, N., Yaqoob, I., Hashem, I. A. T., Inayat, Z., Mahmoud Ali, W. K., Alam, M., Shiraz, M., & Gani, A. (2014) · The Scientific World Journal · doi:10.1155/2014/712826 · Cited by 547
Research works printed but not linked: 4
- G. Demiris, D. P. Oliver, and K. T. Washington, Behavioral Intervention Research in Hospice and Palliative Care: Building an Evidence Base. New York, NY, USA: Academic, 2018.
- M. Milivojević, I. Antolović, and D. Rančić, ''Using COLLADA and X3D for WebGL based 3D data visualization,'' in Proc. 46th Int. Sci. Conf. Inf., Commun. Energy Syst. Technol. (ICEST), Niš, Serbia, 2011.
- R. Bonnard, K. M. M. Vieira, M. D. S. Arantes, R. Lorbieski, M. C. Nunes, and A. P. Mattei, ''A big data/analytics platform for indus- try 4.0 implementation in SMEs,'' in Proc. CIGI QUALITA, 2019, pp. 1-10.
- M. Gadaleta, G. Berselli, M. Pellicciari, and F. Grassia, ''Extensive exper- imental investigation for the optimization of the energy consumption of a high payload industrial robot with open research dataset,'' Robot. Comput.- Integr. Manuf., vol. 68, Apr. 2021, Art. no. 102046. · DOI
Cited by
15 years of Big Data: a systematic literature review
Tosi, D., Kokaj, R., & Roccetti, M. (2024) · Journal Of Big Data · doi:10.1186/s40537-024-00914-9 · Cited by 110
Agent-based manufacturing — review and expert evaluation
Pulikottil, T. B., Estrada-Jimenez, L. A., Rehman, H. U., Mo, F., Nikghadam-Hojjati, S., & Barata, J. (2023) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-023-11517-8 · Cited by 68
“the load-unbalance help of big data feedback [66], smart assessment and control techniques are suggested.”
BackgroundSelf-citationCarrera-Rivera, A., Larrinaga, F., Lasa, G., Martinez-Arellano, G., & Unamuno, G. (2024) · User Modeling and User-Adapted Interaction · doi:10.1007/s11257-024-09414-0 · Cited by 30
Self-citationIntegrated Low-Cost Water Quality Monitoring System Based on LoRa Network
Georgantas, I., Mitropoulos, S., Katsoulis, S., Chronis, I., & Christakis, I. (2025) · Electronics · doi:10.3390/electronics14050857 · Cited by 24
Rehman, H. U., Mo, F., Chaplin, J. C., Zarzycki, L., Jones, M., & Ratchev, S. M. (2023) · Journal of Manufacturing Systems · doi:10.1016/j.jmsy.2023.12.004 · Cited by 22
Self-citationReal-Time Monitoring and Dynamic Interaction Methods Based on Digital Twin Workshop Theory
Yu, J., Chen, C., Zhang, C., & Ji, W. (2025) · Processes · doi:10.3390/pr13030685 · Cited by 13
Integration Approaches for Heterogeneous Big Data: A Survey
Alma’aitah, W. Z., Quraan, A., AL-Aswadi, F. N., Alkhawaldeh, R. S., Alazab, M., & Awajan, A. W. (2024) · Cybernetics and Information Technologies · doi:10.2478/cait-2024-0001 · Cited by 16
THE ROLE OF DATA ANALYTICS IN MAKING MANAGEMENT DECISIONS BY THE LOGISTICS INTERMEDIARIES
Воробець, Є., Khmelyuk, A., Moshkovskа, O., Valiyev, V. I., & Марухленко, О. В. (2024) · Financial and credit activity problems of theory and practice · doi:10.55643/fcaptp.4.57.2024.4422 · Cited by 11
Blockchain-Based Privacy-Preserving Shop Floor Auditing Architecture
Stodt, F., Alshawki, M. B., Reich, C., Théoleyre, F., & Ligeti, P. (2024) · IEEE Access · doi:10.1109/access.2024.3366492 · Cited by 14
“Any lapse in data management or tracking can lead to significant operational disruptions, ultimately impacting the competitiveness of industrial entities [5].”
BackgroundDevelopment of cloud visualization a machining manufacturing system shop floor
Sulistyo, J., Setiawan, A. T., & Toha, I. S. (2024) · Indonesian Journal of Electrical Engineering and Computer Science · doi:10.11591/ijeecs.v33.i2.pp1005-1015 · Cited by 3
“By utilizing big data, a factory can create a data representation, while analytics allows for advanced predictions and the identification of events that may impact production [19] [21].”
BackgroundOptiTwin: Data-Driven Machining Process Optimization Platform for SMEs
Abadía, J. J. P., Larrinaga, F., Cuesta, M., Badiola, X., Duo, A., Mendia, G. O., & Lázare, T. P. (2024) · IEEE International Conference on Emerging Technologies and Factory Automation (ETFA) · doi:10.1109/etfa61755.2024.10711032 · Cited by 2
Self-citationReisig, M., & Lenz, J. (2026) · Procedia CIRP · doi:10.1016/j.procir.2025.09.049 · Cited by 1
Advances in AI-Driven Big Data Technologies: A Five-Year Review
Chen, C., Luo, Q., & Yang, L. (2025) · International Conference on Big Data and Information Analytics (BigDIA) · doi:10.1109/bigdia68682.2025.11382836
“On the modeling side, manufacturing shop-floor analyses recommend adaptive sampling rates aligned to process phases; this reduces storage costs and improves signal-to-noise ratio without sacrificing analytical value [17].”
Chu, Y. A., Lyu, Y., Zhang, J., & Zuo, L. (2026) · Journal of Intelligent Manufacturing · doi:10.1007/s10845-026-02850-2
Alzuru, S. A. R. (2024) · Repositorio Digital Institucional de la Universidad de Buenos Aires (Universidad de Buenos Aires)
Metadata
- Authors
- Pulikottil, T., Estrada-Jimenez, L. A., Abadía, J. J. P., Carrera-Rivera, A., Torayev, A., Rehman, H. U., Mo, F., Nikghadam-Hojjati, S., & Barata, J.
- Affiliations
- Uninova (PT)
- Mondragon Unibertsitatea (ES)
- University of Nottingham (GB)
- ORCID
- Venue
- IEEE Access
- Published
- 2023
- Volume
- 11
- Pages
- 30008-30026
- ISSN
- 2169-3536 (ISSN-L)
- OpenAlex
- W4323338602
- Cited by
- 14
- References
- 83
- Citations by year
- 2026: 2 · 2025: 3 · 2024: 7 · 2023: 2
- FWCI
- 1.86
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- IEEE Access (publishedVersion, cc-by)
- Repository@Nottingham (University of Nottingham) (publishedVersion, other-oa)
- Lirias (submittedVersion, cc-by)
- eRepository Mondragon University (Mondragon University) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
- Funders
- Digital Manufacturing and Design Training Network (814078)
- Topics
- Physical Sciences › Engineering › Industrial and Manufacturing Engineering › Digital Transformation in Industry
- Social Sciences › Decision Sciences › Management Science and Operations Research › Impact of AI and Big Data on Business and Society
- Physical Sciences › Computer Science › Information Systems › Technology and Data Analysis
- Keywords
- big data, data lifecycle, data collection, data storage, data processing, data visualization, machine data, data transmission, n-gram analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.