Big data and its technical challenges.
The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Exploring the inherent technical challenges in realizing the potential of Big Data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Extraction of actionable knowledge and viable patterns from data are often viewed as the core benefits of the big data revolution”
From Challenges and Future Directions of Big Data and Artificial Intelligence in Education (2020) · cites this paper as Jagadish et al., 2014
Citations
Cites
Understanding individual human mobility patterns
González, M. C., Hidalgo, C. A., & Barabási, A.-L. (2008) · Nature · doi:10.1038/nature06958 · Cited by 6,059
(2011) · Cited by 5,203
(2011) · Cited by 4,430
Lazer, D., Pentland, A., Adamic, L., Aral, S., Barabási, A.-L., Brewer, D., Christakis, N., Contractor, N., Fowler, J., Gutmann, M., et al. (2009) · Science · doi:10.1126/science.1167742 · Cited by 3,365
Eisenstein, D. J., Weinberg, D. H., Agol, E., Aihara, H., Allende Prieto, C., Anderson, S. F., Arns, J. A., Aubourg, É., Bailey, S., Balbinot, E., et al. (2011) · The Astronomical Journal · doi:10.1088/0004-6256/142/3/72 · Cited by 2,179
Materials Genome Initiative for Global Competitiveness
Ward, C. (2012) · Advanced Aerospace Materials and Processes Conference and Exposition (AeroMat) · Cited by 407
Getting Beneath the Veil of Effective Schools: Evidence From New York City
Dobbie, W., & Fryer, R. G. (2013) · American Economic Journal: Applied Economics · doi:10.1257/app.5.4.28 · Cited by 352
Cheng, R. C. K. (2015) · Cited by 314
Kahn, S. D. (2011) · Science · doi:10.1126/science.1197891 · Cited by 253
Getting Beneath the Veil of Effective Schools: Evidence from New York City
Dobbie, W., & Fryer, R. (2011) · National Bureau of Economic Research · doi:10.3386/w17632 · Cited by 149
Kearns, M. J. (2010) · Cited by 53
Pots, M. (2014) · Utrecht University Repository (Utrecht University) · Cited by 27
Using Data for Systemic Financial Risk Management
Flood, M. D., Jagadish, H. V., Kyle, A., Olken, F., & Raschid, L. (2012) · Cited by 18
Self-citationVarshney, U., & Chang, C. K. (2016) · Computer · doi:10.1109/mc.2016.351 · Cited by 14
Research works printed but not linked: 6
- Computing Community Consortium . Advancing Discovery in Science and Engineering . Spring 2011 . Computing Community Consortium. Advancing Discovery in Science and Engineering. Spring 2011.
- Computing Community Consortium . Advancing Personalized Education . Spring 2011 . Computing Community Consortium. Advancing Personalized Education. Spring 2011.
- Computing Community Consortium . Smart Health and Wellbeing . Spring 2011 . Computing Community Consortium. Smart Health and Wellbeing. Spring 2011.
- Computing Community Consortium . A Sustainable Future . Summer 2011 . Computing Community Consortium. A Sustainable Future. Summer 2011.
- Gartner Group . Pattern-Based Strategy: Getting Value from Big Data. (July 2011 press release) ; http://www.gartner.com/it/page.jsp?id=173 1916 Gartner Group. Pattern-Based Strategy: Getting Value from Big Data. (July 2011 press release); http://www.gartner.com/it/page.jsp?id=1731916
- Hey , T. , Tansley , S. and Tolle , K ., eds . The Fourth Paradigm: Data-Intensive Scientific Discovery. Microsoft Research , 2009 . Hey, T., Tansley, S. and Tolle, K., eds. The Fourth Paradigm: Data-Intensive Scientific Discovery. Microsoft Research, 2009.
Cited by
A Comprehensive Survey on Graph Neural Networks
Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., & Yu, P. S. (2021) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2020.2978386 · Cited by 11,000
Wang, Y., Kung, L., & Byrd, T. A. (2018) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2015.12.019 · Cited by 1,571
Machine learning with big data: challenges and approaches.
L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M. (2017) · IEEE Access · doi:10.1109/access.2017.2696365 · Cited by 1,023
“[7] consider analytics to be the core of the Big Data revolution.”
BackgroundResultInfluentialExplainable artificial intelligence: a comprehensive review
Minh, D., Wang, H. X., Li, Y. F., & Nguyen, T. N. (2022) · Artificial Intelligence Review · doi:10.1007/s10462-021-10088-y · Cited by 983
Debating big data: a literature review on realizing value from big data
Günther, W. A., Rezazade Mehrizi, M. H., Huysman, M., & Feldberg, F. (2017) · The Journal of Strategic Information Systems · doi:10.1016/j.jsis.2017.07.003 · Cited by 880
“, 2015), or when data analytics is considered a source of competition and sharing endangers the organization’s unique strategic position (Jagadish et al., 2014; Greenaway et al., 2015; Van den Broek and Van Veenstra, 2015).”
BackgroundInfluential
Metadata
- Authors
- Jagadish, H. V., Gehrke, J., Labrinidis, A., Papakonstantinou, Y., Patel, J. M., Ramakrishnan, R., & Shahabi, C.
- Affiliations
- University of Michigan (US)
- Cornell University (US)
- University of Pittsburgh (US)
- University of California, San Diego
- University of Wisconsin–Madison (US)
- Microsoft (United States) (US)
- University of Southern California (US)
- ORCID
- Venue
- Communications of the ACM
- Published
- 2014-07
- Volume
- 57
- Issue
- 7
- Pages
- 86-94
- ISSN
- 0001-0782 (ISSN-L)
- 1557-7317
- OpenAlex
- W2080731889
- Cited by
- 1,048
- References
- 14
- Citations by year
- 2026: 34 · 2025: 62 · 2024: 62 · 2023: 68 · 2022: 85 · 2021: 95 · 2020: 132 · 2019: 96 · 2018: 123 · 2017: 107 · 2016: 96 · 2015: 71 · 2014: 16
- FWCI
- 180.54
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Communications of the ACM (publishedVersion)
- Funders
- Microsoft
- Symantec Corporation
- LA Metro
- Division of Computer and Network Systems (IIS 1017296, IIS 1017149, IIS 1250880, IIS-0746696, OIA-1028162, CBET-1250171, IIS-1117527, SHB-1237174, DC-0910820, III-0963993, IIS-1250886, IIS-1110948, CNS-1218432, IIS-1115153)
- Johnson Controls
- Division of Chemical, Bioengineering, Environmental, and Transport Systems (IIS 1017296, IIS 1017149, IIS 1250880, IIS-0746696, OIA-1028162, CBET-1250171, IIS-1117527, SHB-1237174, DC-0910820, III-0963993, IIS-1250886, IIS-1110948, CNS-1218432, IIS-1115153)
- Division of Information and Intelligent Systems (IIS 1017296, IIS 1017149, IIS 1250880, IIS-0746696, OIA-1028162, CBET-1250171, IIS-1117527, SHB-1237174, DC-0910820, III-0963993, IIS-1250886, IIS-1110948, CNS-1218432, IIS-1115153)
- Informatica research award
- Oracle
- Office of Integrative Activities (IIS 1017296, IIS 1017149, IIS 1250880, IIS-0746696, OIA-1028162, CBET-1250171, IIS-1117527, SHB-1237174, DC-0910820, III-0963993, IIS-1250886, IIS-1110948, CNS-1218432, IIS-1115153)
- National Science Foundation (IIS 1017296, IIS 1017149, IIS 1250880, IIS-0746696, OIA-1028162, CBET-1250171, IIS-1117527, SHB-1237174, DC-0910820, III-0963993, IIS-1250886, IIS-1110948, CNS-1218432, IIS-1115153)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Computer Science › Information Systems › Cloud Computing and Resource Management
- Physical Sciences › Computer Science › Information Systems › Advanced Database Systems and Queries
- Keywords
- big data, technical challenges, data management, scalability, data processing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.