The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Manufacturing process data analysis pipelines: a requirements analysis and survey
Open accessAbstract
Smart manufacturing is strongly correlated with the digitization of all manufacturing activities. This increases the amount of data available to drive productivity and profit through data-driven decision making programs. The goal of this article is to assist data engineers in designing big data analysis pipelines for manufacturing process data. Thus, this paper characterizes the requirements for process data analysis pipelines and surveys existing platforms from academic literature. The results demonstrate a stronger focus on the storage and analysis phases of pipelines than on the ingestion, communication, and visualization stages. Results also show a tendency towards custom tools for ingestion and visualization, and relational data tools for storage and analysis. Tools for handling heterogeneous data are generally well-represented throughout the pipeline. Finally, batch processing tools are more widely adopted than real-time stream processing frameworks, and most pipelines opt for a common script-based data processing approach. Based on these results, recommendations are offered for each phase of the pipeline.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Data mining: concepts and techniques
(2012) · Choice Reviews Online · doi:10.5860/choice.49-3305 · Cited by 28,531
Discovery of Frequent Episodes in Event Sequences
Mannila, H., Toivonen, H., & Inkeri Verkamo, A. (1997) · Data Mining and Knowledge Discovery · doi:10.1023/a:1009748302351 · Cited by 1,463
Guide to Industrial Control Systems (ICS) Security
Stouffer, K., Pillitteri, V., Lightman, S., Abrams, M., & Hahn, A. (2015) · doi:10.6028/nist.sp.800-82r2 · Cited by 1,377
Data Mining: Concepts and Techniques (2nd edition)
Han, J., & Kamber, M. (2006) · Cited by 964
Hazen, B. T., Boone, C. A., Ezell, J. D., & Jones-Farmer, L. A. (2014) · International Journal of Production Economics · doi:10.1016/j.ijpe.2014.04.018 · Cited by 863
Software-Defined Industrial Internet of Things in the Context of Industry 4.0
Wan, J., Tang, S., Shu, Z., Li, D., Wang, S., Imran, M., & Vasilakos, A. (2016) · IEEE Sensors Journal · doi:10.1109/jsen.2016.2565621 · Cited by 691
Big Data in product lifecycle management
Li, J., Tao, F., Cheng, Y., & Zhao, L. (2015) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-015-7151-x · Cited by 480
Software Metrics: Establishing a Company-Wide Program
Grady, R. B., & Caswell, D. L. (1987) · Medical Entomology and Zoology · Cited by 412
Process data analytics in the era of big data
Qin, S. J. (2014) · AIChE Journal · doi:10.1002/aic.14523 · Cited by 383
Current Standards Landscape for Smart Manufacturing Systems
Lu, Y., Morris, K., & Frechette, S. (2016) · doi:10.6028/nist.ir.8107 · Cited by 360
Research works printed but not linked: 34
- Choudri A. The Agile enterprise. In: ReVelle J, editor. Manufacturing handbook of best practices: an innovation, productivity, and quality focus. New York: CRC Press; 2001. p. 3–23.
- Corrêa H. Agile manufacturing as the 21st century strategy for improving manufacturing competitiveness. In: Gunasekaran A, editor. Agile manufacturing: the 21st century competitive strategy. Oxford: Elsevier Science Ltd; 2001. p. 3–23. · doi:10.1016/b978-008043567-1/50001-2
- Jirkovsky V, Obitko M, et al. Big Data analysis for sensor time-series in automation. In: International conference on emerging technology and factory automation (ETFA). IEEE; 2014. p. 1–8. · doi:10.1109/etfa.2014.7005183
- Puig Ramírez J. Asset optimization and predictive maintenance in discrete manufacturing industry. MA thesis. Universitat Politècnica de Catalunya; 2010.
- Ismail A, Kastner W. Vertical integration in industrial enterprises and distributed middleware. Int J Internet Protocol Technol. 2016;9(2/3):79–89. https://doi.org/10.1504/IJIPT.2016.079547 . · doi:10.1504/ijipt.2016.079547
- Ismail A, Kastner W. Discovery in SOA-Governed Industrial Middleware with mDNS and DNS-SD. In: International conference on emerging technology and factory automation (ETFA). IEEE. 2016. · doi:10.1109/etfa.2016.7733529
- Ismail A. Service oriented manufacturing infrastructure. Dissertation. Vienna: TU Wien; 2018.
- Zerbst J, Schaefer M, et al. Zone principles as cyber security architecture element for smart grids. In: 2010 IEEE PES innovative smart grid technologies conference Europe (ISGT Europe). 2010. https://doi.org/10.1109/ISGTEUROPE.2010.5638900 . · doi:10.1109/isgteurope.2010.5638900
- Bowonder B. An analysis of the Bhopal accident. Project Appraisal. 1987;2(3):157–68. · doi:10.1080/02688867.1987.9726622
- Liptak BG, Venczel K, et al. Instrument and Automation Engineers’ Handbook. Process measurement and analysis. 5th ed. Boston: CRC Press; 2016.
- Raul AC. The privacy, data protection and cybersecurity law review. English. 2014. ISBN: 978-1-909830-28-8.
- Bernard R. Information lifecycle security risk assessment: a tool for closing security gaps. Comput Secur. 2007;26:26–30. · doi:10.1016/j.cose.2006.12.005
- Appt S, Fietz E, et al. Smart manufacturing. The legal and regulatory challenges. Pinsent: Pinsent Masons LLP; 2015.
- Didier P, Macias F, et al. Converged plantwide ethernet (CPwE) design and implementation guide. Milwaukee: Cisco Systems, San Jose, Californiaand Rockwell Automation; 2011.
- Sawant N, Shah H. Big Data application architecture Q & A: a problem-solution approach. Expert’s voice in big data. New York: Apress. 2013. ISBN: 978-1-4302-6292-3. · doi:10.1007/978-1-4302-6293-0_1
- Sauter T, Soucek S, et al. Vertical integration. In: Wilamowski B, Irwin J, editors. Industrial communication systems. 2nd ed. London: CRC Press; 2011. p. 1–12.
- Wilschut T, Adan I.J, et al. Big Data in daily manufacturing operations. In: IEEE simulation conference (WSC). 2014. p. 2364–75. · doi:10.1109/wsc.2014.7020080
- Staff NRC. Massive data sets: proceedings of a workshop. Washington: National Academies Press; 1900.
- Lee F, Smith S. Yield Analysis and Data Management Using Yield ManagerTM. In: IEEE/SEMI 1998 IEEE/SEMI Advanced semiconductor manufacturing conference and workshop (Cat. No.98CH36168). 1998. pp. 19–30. https://doi.org/10.1109/ASMC.1998.731377 . · doi:10.1109/asmc.1998.731377
- Wang C, Zhao C, et al. A framework for management of massive knowledge in cloud environment. In: International conference on BioMedical engineering and informatics (BMEI). 2014. p. 843–7. https://doi.org/10.1109/BMEI.2014.7002889 . · doi:10.1109/bmei.2014.7002889
- Qanbari S, Zadeh S, et al. CloudMan: a platform for portable cloud manufacturing services. In: International conference on Big Data (Big Data). IEEE; 2015. p. 1006–14. https://doi.org/10.1109/BigData.2014.7004334 . · doi:10.1109/bigdata.2014.7004334
- Moyne J, Samantaray J, et al. Big data emergence in semiconductor manufacturing advanced process control. In: Annual SEMI advanced semiconductor manufacturing conference (ASMC). IEEE. 2015. p. 130–5. https://doi.org/10.1109/ASMC.2015.7164483 . · doi:10.1109/asmc.2015.7164483
- Gerrikagoitia J, Unamuno G, et al. Making sense of manufacturing data. In: International conference on informatics in control, automation and robotics, vol. 2. SciTePress. 2016. p. 590–4. · doi:10.5220/0005999005900594
- Chen C-C, Hung M-H, et al. Development of a cyber-physical-style continuous yield improvement system for manufacturing industry. In: International conference on automation science and engineering. IEEE. 2016. p. 1307–12. https://doi.org/10.1109/COASE.2016.7743559 . · doi:10.1109/coase.2016.7743559
- De Silva PP, De Silva PA. Ipanera: an industry 4.0 based architecture for distributed soil-less food production systems. In: Manufacturing & industrial engineering symposium (MIES). IEEE. 2016. p. 1–5. · doi:10.1109/mies.2016.7780266
- Huber M, Voigt M, et al. Big data architecture for the semantic analysis of complex events in manufacturing. In: Lecture Notes in Informatics (LNI), Proceedings—series of the Gesellschaft fur Informatik (GI). p. 353–60.
- Shi Y, Chen Y, et al. A data services-based quality analysis system for the life cycle of tire production”. In: Lecture notes in computer science 9936 2016. p. 715–29. https://doi.org/10.1007/978-3-319-46295-0_51 . · doi:10.1007/978-3-319-46295-0_51
- Fan X, Zhu X, et al. Big data analytics to improve photomask manufacturing productivity. In: International conference on industrial engineering and engineering management, Vol. 2017. IEEE, 2018. p. 2341–5. https://doi.org/10.1109/IEEM.2017.8290310 . · doi:10.1109/ieem.2017.8290310
- Jirkovský V, Obitko M. Enabling Semantics within Industry 4.0. In: Mařík V, Wahlster W, editors. Industrial applications of holonic and multi-agent systems, vol. 10444. Cham: Springer; 2017. p. 39–52. https://doi.org/10.1007/978-3-319-64635-0_4 . · doi:10.1007/978-3-319-64635-0_4
- Li X, Tu Z, et al. Deep-level quality management based on big data analytics with case study. In: 2017 Chinese Automation Congress (CAC). 2017. p. 4921–6. · doi:10.1109/cac.2017.8243651
- Xu W, Liu Q, et al. Energy condition perception and Big Data analysis for industrial cloud robotics. In: Procedia CIRP 61 2017. p. 370–5. https://doi.org/10.1016/j.procir.2016.11.164 . · doi:10.1016/j.procir.2016.11.164
- Noh K-S. Model of knowledge-based process management system using big data in the wireless communication environment. Wireless Personal Commun. 2018;98:3147–62. https://doi.org/10.1007/s11277-017-4769-z . · doi:10.1007/s11277-017-4769-z
- Arantes M, Bonnard R, et al. General architecture for data analysis in industry 4.0 using SysML and model based system engineering. In: International systems conference (SysCon). IEEE. 2018. p. 1–6. · doi:10.1109/syscon.2018.8369574
- Kirmse A, Kraus V, et al. An architecture for efficient integration and harmonization of heterogeneous, distributed data sources enabling big data analytics. In: International conference on enterprise information systems. INSTICC. SciTePress. 2018. p. 175–82. ISBN: 978-989-758-298-1. https://doi.org/10.5220/0006776701750182 . · doi:10.5220/0006776701750182
Cited by
Machine learning: Algorithms, real-world applications and research directions
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00592-x · Cited by 5,583
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00815-1 · Cited by 2,678
Cybersecurity data science: an overview from machine learning perspective
Sarker, I. H., Kayes, A. S. M., Badsha, S., Alqahtani, H., Watters, P., & Ng, A. (2020) · Journal of Big Data · doi:10.1186/s40537-020-00318-5 · Cited by 766
Sarker, I. H. (2021) · SN Computer Science · doi:10.1007/s42979-021-00765-8 · Cited by 570
AI-Driven Cybersecurity: An Overview, Security Intelligence Modeling and Research Directions
Sarker, I. H., Furhad, M. H., & Nowrozy, R. (2021) · SN Computer Science · doi:10.1007/s42979-021-00557-0 · Cited by 543
Metadata
- Authors
- Ismail, A., Truong, H.-L., & Kastner, W.
- Venue
- Journal of Big Data
- Published
- 2019-01-07
- Volume
- 6
- Issue
- 1
- ISSN
- 2196-1115 (ISSN-L)
- OpenAlex
- W2909445826
- Cited by
- 304
- References
- 47
- FWCI
- 25.46
- Type
- journal article
- Language
- en
- Open access
- gold
- Licence
- creativecommons.org/licenses/by/4.0 (tdm)
- Funders
- H2020 Marie Skłodowska-Curie Actions (764785)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Manufacturing process data analysis pipelines: a requirements analysis and survey. https://app.cochat.ai/papers/10.1186/s40537-018-0162-3
- The paper
- Ismail, A., Truong, H.-L., & Kastner, W. (2019). Manufacturing process data analysis pipelines: a requirements analysis and survey. Journal of Big Data. https://doi.org/10.1186/s40537-018-0162-3
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.