Student or educator? Sign up with your school email and get 6 months of Pro free.

The DOI matches its Crossref record; 108 of the 109 references it cites were found in a registry or an index.

Machine learning with big data: challenges and approaches.

Open access
L'Heureux, Alexandra, Grolinger, Katarina, Elyamany, Hany F., Capretz, Miriam A. M.·2017·IEEE Access

Abstract

The Big Data revolution promises to transform how we live, work, and think by enabling process optimization, empowering insight discovery and improving decision making. The realization of this grand potential relies on the ability to extract value from such massive data through data analytics; machine learning is at its core because of its ability to learn from data and provide data driven insights, decisions, and predictions. However, traditional machine learning approaches were developed in a different era, and thus are based upon multiple assumptions, such as the data set fitting entirely into memory, what unfortunately no longer holds true in this new context. These broken assumptions, together with the Big Data characteristics, are creating obstacles for the traditional techniques. Consequently, this paper compiles, summarizes, and organizes machine learning challenges with Big Data. In contrast to other research that discusses challenges, this work highlights the cause–effect relationship by organizing challenges according to Big Data Vs or dimensions that instigated the issue: volume, velocity, variety, or veracity. Moreover, emerging machine learning approaches and techniques are discussed in terms of how they are capable of handling the various challenges with the ultimate objective of helping practitioners select appropriate solutions for their use cases. Finally, a matrix relating the challenges and approaches is presented. Through this process, this paper provides a perspective on the domain, identifies research gaps and opportunities, and provides a strong foundation and encouragement for further research in the field of machine learning with Big Data.

Overview

Integrity signals

Registry

Crossref · 10.1109/access.2017.2696365

Cites

108 of 108 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 109 references

Research works printed but not linked: 20

  1. goodfellow, 2016, Deep Learning
  2. marz, 2014, Apache Storm
  3. rouse, 2011, Machine Learning Definition
  4. 2015, R A Language and Environment for Statistical Computing, 1
  5. 2014, IBM Watson Ecosystem Program
  6. wu, 2016, Google’s neural machine translation system Bridging the gap between human and machine translation
  7. 2016, Machine Learning American
  8. 2016, Google Cloud Machine Learning
  9. 2016, Matlab
  10. 2013, Billion Devices Will Wirelessly Connect to the Internet of Everything in 2020
  11. krikorian, 2010, Twitter by the Numbers Twitter
  12. 2016, H20
  13. 2016, Apache Mahout
  14. abadi, 2016, TensorFlow Large-Scale Machine Learning on Heterogeneous Systems
  15. langford, 2007, Vowpal wabbit online learning project
  16. rouse, 2009, Predictive Analytics Definition
  17. sukumar, 2014, Machine learning in the big data era: Are we there yet?, Proc 20th ACM SIGKDD Conf Knowl Discovery Data Mining Workshop Data Sci Social Good (KDD), 1
  18. 2016, GPU Applications Transforming Computational Research and Engineering
  19. torrey, 2010, Handbook of Research on Machine Learning Applications and Trends
  20. 2016, Apache Giraph

Cited by

See all 1,023

Metadata

Authors
L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M.
Affiliations
  • Western University (CA)
  • Suez Canal University (EG)
Venue
IEEE Access
Published
2017
Volume
5
Pages
7776-7797
ISSN
2169-3536 (ISSN-L)
OpenAlex
W2609731728
Cited by
1,023
References
109
Citations by year
2026: 50 · 2025: 175 · 2024: 128 · 2023: 145 · 2022: 130 · 2021: 138 · 2020: 105 · 2019: 88 · 2018: 53 · 2017: 11
FWCI
112.99
Type
journal article
Language
en
Open access
Locations
  • IEEE Access (publishedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
NSERC CRD at Western University (477530-14)
Topics
  • Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
  • Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
  • Physical Sciences › Computer Science › Artificial Intelligence › Stochastic Gradient Optimization Techniques
Keywords
big data challenges, volume, velocity, varieties, honesty, scalable learning, data-driven decision making, research gaps

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Machine learning with big data: challenges and approaches. https://app.cochat.ai/papers/10.1109/access.2017.2696365
The paper
L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M. (2017). Machine learning with big data: challenges and approaches. IEEE Access. https://doi.org/10.1109/access.2017.2696365

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.