The DOI matches its Crossref record; 144 of the 144 references it cites were found in a registry or an index.
Challenges of Big Data analysis
Open accessAbstract
Big Data bring new opportunities to modern society and challenges to data scientists. On the one hand, Big Data hold great promises for discovering subtle population patterns and heterogeneities that are not possible with small-scale data. On the other hand, the massive sample size and high dimensionality of Big Data introduce unique computational and statistical challenges, including scalability and storage bottleneck, noise accumulation, spurious correlation, incidental endogeneity and measurement errors. These challenges are distinguished and require new computational and statistical paradigm. This paper gives overviews on the salient features of Big Data and how these features impact on paradigm change on statistical and computational methods as well as computing architectures. We also provide various new perspectives on the Big Data analysis and computation. In particular, we emphasize on the viability of the sparsest solution in high-confidence set and point out that exogenous assumptions in most statistical methods for Big Data cannot be validated due to incidental endogeneity. They can lead to wrong statistical inferences and consequently wrong scientific conclusions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Overfitting is a key risk in this context, which means that a machine may learn a complete model that also explains the errors, consequently failing to generalize appropriately beyond its training data (Fan, Han, & Liu, 2014).”
From Artificial Intelligence and Management: The Automation–Augmentation Paradox (2021) · cites this paper as Fan, Han, & Liu, 2014
Experimental — accuracy not yet measuredIn the citing paper
“In addition, the combination of datasets in the big data age needs to cope with a number of challenges listed in [20,61], for example efficient data representation, redundancy reduction and data compression, spurious correlations, and noise accumulation.”
From Opening up Smart Cities: Citizen-Centric Challenges and Opportunities from GIScience (2016) · cites this paper as [61]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Boyd, S., & Vandenberghe, L. (2004) · doi:10.1017/cbo9780511804441 · Cited by 56,601
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Golub, G. (2012) · doi:10.56021/9781421407944 · Cited by 34,505
The Elements of Statistical Learning
Hastie, T., Tibshirani, R., & Friedman, J. (2009) · Springer Series in Statistics · doi:10.1007/978-0-387-84858-7 · Cited by 25,970
The Elements of Statistical Learning
Hastie, T., Friedman, J., & Tibshirani, R. (2001) · Springer Series in Statistics · doi:10.1007/978-0-387-21606-5 · Cited by 24,162
Donoho, D. L. (2006) · IEEE Transactions on Information Theory · doi:10.1109/tit.2006.871582 · Cited by 23,994
Longitudinal data analysis using generalized linear models
LIANG, K.-Y., & ZEGER, S. L. (1986) · Biometrika · doi:10.1093/biomet/73.1.13 · Cited by 18,550
Boyd, S., Parikh, N., Chu, E., Peleato, B., & Eckstein, J. (2011) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000016 · Cited by 17,075
Flagged first, then by citations
Research works printed but not linked: 6
- Donoho, High-dimensional data analysis: the curses and blessings of dimensionality
- Bickel, 2008, Discussion on the paper ‘Sure independence screening for ultrahigh dimensional feature space’ by Fan and Lv, J Roy Stat Soc B, 70, 883
- Friedman, 2003, Gradient directed regularization for linear regression and classification, Technical report
- Milham, 2011, The International Neuroimaging Data-sharing Initiative (INDI) and the Functional Connectomes Project, 17th Annual Meeting of the Organization for Human Brain Mapping
- 2012, The ADHD-200 Consortium. The ADHD-200 consortium: a model to advance the translational potential of neuroimaging in clinical neuroscience, Front Syst Neurosci, 6, 62
- Cochrane, 2001, Asset Pricing
Cited by
Sorted by citations
Beyond the hype: Big data concepts, methods, and analytics
Gandomi, A., & Haider, M. (2015) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2014.10.007 · Cited by 4,226
Artificial Intelligence and Management: The Automation–Augmentation Paradox
Raisch, S., & Krakowski, S. (2021) · Academy of Management Review · doi:10.5465/amr.2018.0072 · Cited by 2,755
Majorization-Minimization Algorithms in Signal Processing, Communications, and Machine Learning
Sun, Y., Babu, P., & Palomar, D. P. (2017) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2016.2601299 · Cited by 1,820
Wang, G., Gunasekaran, A., Ngai, E. W. T., & Papadopoulos, T. (2016) · International Journal of Production Economics · doi:10.1016/j.ijpe.2016.03.014 · Cited by 1,545
Global ecosystem thresholds driven by aridity
Berdugo, M., Delgado‐Baquerizo, M., Soliveres, S., Hernández‐Clemente, R., Zhao, Y., Gaitán, J., Gross, N., Sáiz, H., Maire, V., Lehmann, A., et al. (2020) · Science · doi:10.1126/science.aay5958 · Cited by 1,265
On big data, artificial intelligence and smart cities
Allam, Z., & Dhunny, Z. A. (2019) · Cities · doi:10.1016/j.cities.2019.01.032 · Cited by 1,178
A survey on missing data in machine learning
Emmanuel, T., Maupong, T., Mpoeleng, D., Semong, T., Mphago, B., & Tabona, O. (2021) · Journal of Big Data · doi:10.1186/s40537-021-00516-9 · Cited by 1,067
Machine learning with big data: challenges and approaches.
L'Heureux, A., Grolinger, K., Elyamany, H. F., & Capretz, M. A. M. (2017) · IEEE Access · doi:10.1109/access.2017.2696365 · Cited by 1,023
Big Data for Remote Sensing: Challenges and Opportunities
Chi, M., Plaza, A., Benediktsson, J. A., Sun, Z., Shen, J., & Zhu, Y. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2016.2598228 · Cited by 610
Big data analytics in supply chain management between 2010 and 2016: Insights to industries
Tiwari, S., Wee, H. M., & Daryanto, Y. (2018) · Computers & Industrial Engineering · doi:10.1016/j.cie.2017.11.017 · Cited by 582
Artificial intelligence and big data in entrepreneurship: a new era has begun
Obschonka, M., & Audretsch, D. B. (2019) · Small Business Economics · doi:10.1007/s11187-019-00202-4 · Cited by 645
Real-time big data processing for anomaly detection: A survey
Ariyaluran Habeeb, R. A., Nasaruddin, F., Gani, A., Targio Hashem, I. A., Ahmed, E., & Imran, M. (2019) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.08.006 · Cited by 487
Business intelligence and big data in hospitality and tourism: a systematic literature review
Mariani, M. M., Baggio, R., Fuchs, M., & Höpken, W. (2018) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-07-2017-0461 · Cited by 502
Biomarkers for depression: recent insights, current challenges and future prospects
Strawbridge, R., Young, A. H., & Cleare, A. J. (2017) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s114542 · Cited by 415
From hype to reality: data science enabling personalized medicine
Fröhlich, H., Balling, R., Beerenwinkel, N., Kohlbacher, O., Kumar, S., Lengauer, T., Maathuis, M. H., Moreau, Y., Murphy, S. A., Przytycka, T. M., et al. (2018) · BMC Medicine · doi:10.1186/s12916-018-1122-7 · Cited by 428
Mavragani, A., Ochoa, G., & Tsagarakis, K. P. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9366 · Cited by 390
Big Data: Deep Learning for financial sentiment analysis
Sohangir, S., Wang, D., Pomeranets, A., & Khoshgoftaar, T. M. (2018) · Journal of Big Data · doi:10.1186/s40537-017-0111-6 · Cited by 390
Data sharing practices and data availability upon request differ across scientific disciplines
Tedersoo, L., Küngas, R., Oras, E., Köster, K., Eenmaa, H., Leijen, Ä., Pedaste, M., Raju, M., Сергеевна, А. А., Lukner, H., et al. (2021) · Scientific Data · doi:10.1038/s41597-021-00981-0 · Cited by 439
An overview of the estimation of large covariance and precision matrices
Fan, J., Liao, Y., & Liu, H. (2016) · Econometrics Journal · doi:10.1111/ectj.12061 · Cited by 390
Self-citationGenuer, R., Poggi, J., Tuleau-Malot, C., & Vialaneix, N. (2017) · Big Data Research · doi:10.1016/j.bdr.2017.07.003 · Cited by 385
Artificial intelligence in Internet of things
Ghosh, A. K., Chakraborty, D., & Law, A. (2018) · CAAI Transactions on Intelligence Technology · doi:10.1049/trit.2018.1008 · Cited by 370
Next-Generation Big Data Analytics: State of the Art, Challenges, and Future Research Topics
Lv, Z., Song, H. H., Val, P. B., Steed, A. J., & Jo, M. (2017) · IEEE Transactions on Industrial Informatics · doi:10.1109/tii.2017.2650204 · Cited by 366
The impact of big data on world-class sustainable manufacturing
Dubey, R., Gunasekaran, A., Childe, S. J., Wamba, S. F., & Παπαδόπουλος, Θ. (2015) · The International Journal of Advanced Manufacturing Technology · doi:10.1007/s00170-015-7674-1 · Cited by 366
The Australian Geoscience Data Cube — Foundations and lessons learned
Lewis, A., Oliver, S., Lymburner, L., Evans, B., Wyborn, L., Mueller, N., Raevksi, G., Hooke, J., Woodcock, R., Sixsmith, J., et al. (2017) · Remote Sensing of Environment · doi:10.1016/j.rse.2017.03.015 · Cited by 353
Emerging Technologies to Conserve Biodiversity
Pimm, S. L., Alibhai, S. K., Bergl, R. A., Dehgan, A. O., Giri, C. P., Jewell, Z. C., Joppa, L., Kays, R., & Loarie, S. R. (2015) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2015.08.008 · Cited by 376
Big Data sources and methods for social and economic analyses
Blazquez-Soriano, A., & Domènech, J. (2017) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2017.07.027 · Cited by 372
Big Data in Agriculture: A Challenge for the Future
Coble, K. H., Mishra, A. K., Ferrell, S., & Griffin, T. (2017) · Applied Economic Perspectives and Policy · doi:10.1093/aepp/ppx056 · Cited by 326
Innovations in Genomics and Big Data Analytics for Personalized Medicine and Health Care: A Review
Hassan, M., Awan, F. M., Naz, A., deAndrés-Galiana, E. J., Alvarez, O., Cernea, A., Fernández-Brillet, L., Fernández-Martínez, J. L., & Kloczkowski, A. (2022) · International Journal of Molecular Sciences · doi:10.3390/ijms23094645 · Cited by 317
“Although big data analysis promises great advantages and a potential solution to a diverse range of problems, there remain many unique technical, computational, and statistical challenges that must be addressed to fully explore its potential [103].”
BackgroundInfluentialScaling Up Scientific Discovery in Sleep Medicine: The National Sleep Research Resource
Dean, D. A., Goldberger, A. L., Mueller, R., Kim, M. J., Rueschman, M., Mobley, D. R., Sahoo, S. S., Jayapandian, C. P., Cui, L., Morrical, M. G., et al. (2016) · SLEEP · doi:10.5665/sleep.5774 · Cited by 315
A comprehensive survey on regularization strategies in machine learning
Tian, Y., & Zhang, Y. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.11.005 · Cited by 337
SICE: an improved missing data imputation technique
Khan, S. I., & Hoque, A. S. M. L. (2020) · Journal Of Big Data · doi:10.1186/s40537-020-00313-w · Cited by 298
Insect pest monitoring with camera-equipped traps: strengths and limitations
Preti, M., Verheggen, F. J., & Angeli, S. (2020) · Journal of Pest Science · doi:10.1007/s10340-020-01309-4 · Cited by 284
Impact of big data and predictive analytics capability on supply chain sustainability
Jeble, S., Dubey, R., Childe, S. J., Παπαδόπουλος, Θ., Roubaud, D., & Prakash, A. (2018) · The International Journal of Logistics Management · doi:10.1108/ijlm-05-2017-0134 · Cited by 327
Trends and Future Perspective Challenges in Big Data
Naeem, M., Jamal, T., Díaz-Martínez, J., Butt, S. A., Montesano, N., Tariq, M. I., De-La-Hoz-Franco, E., & Valdiris, E. M. D. L. H. (2021) · Smart innovation, systems and technologies · doi:10.1007/978-981-16-5036-9_30 · Cited by 272
Big Data in Earth system science and progress towards a digital twin
Li, X., Feng, M., Ran, Y., Su, Y., Liu, F., Huang, C., Shen, H., Xiao, Q., Su, J., Yuan, S., et al. (2023) · Nature Reviews Earth & Environment · doi:10.1038/s43017-023-00409-w · Cited by 291
Data-Driven Decision Making in Precision Agriculture: The Rise of Big Data in Agricultural Systems
Tantalaki, N., Souravlas, S. I., & Roumeliotis, Μ. (2019) · Journal of Agricultural & Food Information · doi:10.1080/10496505.2019.1638264 · Cited by 270
The Role of the Gut Microbiome in Cattle Production and Health: Driver or Passenger?
O’Hara, E., Neves, A. L. A., Song, Y., & Guan, L. L. (2020) · Annual Review of Animal Biosciences · doi:10.1146/annurev-animal-021419-083952 · Cited by 254
A Systematic Review of Synthetic Data Generation Techniques Using Generative AI
Goyal, M., & Mahmoud, Q. H. (2024) · Electronics · doi:10.3390/electronics13173509 · Cited by 315
Recent Advances of Volatile Memristors: Devices, Mechanisms, and Applications
Wang, R., Yang, J., Mao, J., Wang, Z., Wu, S., Zhou, M., Chen, T., Zhou, Y., & Han, S. (2020) · Advanced Intelligent Systems · doi:10.1002/aisy.202000055 · Cited by 248
Deep learning for time series forecasting: a survey
Kong, X., Chen, Z., Liu, W., Ning, K., Zhang, L., Marier, S. M., Liu, Y., Chen, Y., & Xia, F. (2025) · International Journal of Machine Learning and Cybernetics · doi:10.1007/s13042-025-02560-w · Cited by 315
Distributed testing and estimation under sparse high dimensional models
Battey, H., B, J. F. A., Liu, H., Lu, J., & Zhu, Z. (2018) · The Annals of Statistics · doi:10.1214/17-aos1587 · Cited by 223
Self-citationBig data and data science: a critical review of issues for educational research.
Daniel, B. K. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12595 · Cited by 220
Big Data Analytics: A Review on Theoretical Contributions and Tools Used in Literature
Grover, P., & Kar, A. K. (2017) · Global Journal of Flexible Systems Management · doi:10.1007/s40171-017-0159-3 · Cited by 219
Triguero, I., García-Gil, D., Maillo, J., Luengo, J., García, S., & Herrera, F. (2018) · WIREs Data Mining Knowl. Discov. · doi:10.1002/widm.1289 · Cited by 190
Copy-move forgery detection: Survey, challenges and future directions
Warif, N. B. A., Wahab, A. W. A., Idris, M. Y. I., Ramli, R., Salleh, R., Band, S. S., & Choo, K. R. (2016) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2016.09.008 · Cited by 211
Big data, machine learning, and digital twin assisted additive manufacturing: A review
Jin, L., Zhai, X., Wang, K., Zhang, K., Wu, D., Nazir, A., Jiang, J., & Liao, W. (2024) · Materials & Design · doi:10.1016/j.matdes.2024.113086 · Cited by 232
Big Data Reduction Methods: A Survey
Rehman, M. H. U., Liew, C. S., Abbas, A., Jayaraman, P. P., Wah, T. Y., & Khan, S. U. (2016) · Data Science and Engineering · doi:10.1007/s41019-016-0022-0 · Cited by 219
Vital Directions for Health and Health Care
Dzau, V. J., McClellan, M., McGinnis, J. M., Burke, S. P., Coye, M. J., Díaz, Á., Daschle, T. A., Frist, W. H., Gaines, M. E., Hamburg, M. A., et al. (2017) · JAMA · doi:10.1001/jama.2017.1964 · Cited by 205
Academic social networks: Modeling, analysis, mining and applications
Kong, X., Shi, Y., Yu, S., Liu, J., & Xia, F. (2019) · Journal of Network and Computer Applications · doi:10.1016/j.jnca.2019.01.029 · Cited by 220
Retailing and retailing research in the age of big data analytics
Dekimpe, M. G. (2020) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2019.09.001 · Cited by 202
Energy consumption forecasting based on Elman neural networks with evolutive optimization
Ruiz, L. G. B., Rueda, R., Cuéllar, M. P., & Pegalajar, M. C. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2017.09.059 · Cited by 198
Pouyanfar, S., Yang, Y., Chen, S., Shyu, M., & Iyengar, S. S. (2018) · ACM Computing Surveys · doi:10.1145/3150226 · Cited by 195
Big Data Analytics of Identifying Geochemical Anomalies Supported by Machine Learning Methods
Zuo, R., & Xiong, Y. (2017) · Natural Resources Research · doi:10.1007/s11053-017-9357-0 · Cited by 186
Wen, F., Chu, L., Liu, P., & Qiu, R. C. (2018) · IEEE Access · doi:10.1109/access.2018.2880454 · Cited by 191
Information leverage in interconnected ecosystems: Overcoming the curse of dimensionality
Ye, H., & Sugihara, G. (2016) · Science · doi:10.1126/science.aag0863 · Cited by 180
Perceived strategic value-based adoption of Big Data Analytics in emerging economy
Verma, S., & Bhattacharyya, S. S. (2017) · Journal of Enterprise Information Management · doi:10.1108/jeim-10-2015-0099 · Cited by 206
A Big Data-as-a-Service Framework: State-of-the-Art and Perspectives
Wang, X., Yang, L. T., Liu, H., & Deen, M. J. (2017) · IEEE Transactions on Big Data · doi:10.1109/tbdata.2017.2757942 · Cited by 184
Self-citationMachine-learning-based patient-specific prediction models for knee osteoarthritis
Jamshidi, A., Pelletier, J.-P., & Martel-Pelletier, J. (2019) · Nature Reviews Rheumatology · doi:10.1038/s41584-018-0130-5 · Cited by 190
Japec, L., Kreuter, F., Berg, M., Biemer, P. P., Decker, P. T., Lampe, C. A. C., Lane, J. I., O’Neil, C., & Usher, A. (2015) · Public Opinion Quarterly · doi:10.1093/poq/nfv039 · Cited by 188
Enabling Smart Data: Noise filtering in Big Data classification
García‐Gil, D., Luengo, J., García, S., & Herrera, F. (2018) · Information Sciences · doi:10.1016/j.ins.2018.12.002 · Cited by 176
Munawar, H. S., Qayyum, S., Ullah, F., & Sepasgozar, S. M. E. (2020) · Big Data and Cognitive Computing · doi:10.3390/bdcc4020004 · Cited by 194
Data Integration Challenges for Machine Learning in Precision Medicine
Martínez-García, M., & Hernández-Lemus, E. (2022) · Frontiers in Medicine · doi:10.3389/fmed.2021.784455 · Cited by 185
How Digital Information Transforms Project Delivery Models
Whyte, J. K. (2019) · Project Management Journal · doi:10.1177/8756972818823304 · Cited by 190
Opening up Smart Cities: Citizen-Centric Challenges and Opportunities from GIScience
Degbelo, A., Granell, C., Trilles, S., Bhattacharya, D., Casteleyn, S., & Kray, C. (2016) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi5020016 · Cited by 166
Singh, M., Kumar, A., Khanna, N. N., Laird, J. R., Nicolaides, A. N., Faa, G., Johri, A. M., Mantella, L. E., Fernandes, J. F. E., Teji, J. S., et al. (2024) · EClinicalMedicine · doi:10.1016/j.eclinm.2024.102660 · Cited by 197
An open source approach to the design and implementation of Digital Twins for Smart Manufacturing
Damjanović, V., & Behrendt, W. (2019) · International Journal of Computer Integrated Manufacturing · doi:10.1080/0951192x.2019.1599436 · Cited by 165
Optimal subsampling for quantile regression in big data
Wang, H., & Yanyuan Ma, B. (2020) · Biometrika · doi:10.1093/biomet/asaa043 · Cited by 162
Challenges for MapReduce in Big Data
Grolinger, K., Hayes, M., Higashino, W. A., L’Heureux, A., Allison, D. S., & Capretz, M. A. M. (2014) · IEEE World Congress on Services (SERVICES) · doi:10.1109/services.2014.41 · Cited by 160
A Highly Efficient Semismooth Newton Augmented Lagrangian Method for Solving Lasso Problems
Li, X., Sun, D., & Toh, K.-C. (2018) · SIAM Journal on Optimization · doi:10.1137/16m1097572 · Cited by 157
Silva, B. N., Khan, M., Jung, C., Seo, J., Diyan, M., Han, J., Yoon, Y., & Han, K. (2018) · Sensors · doi:10.3390/s18092994 · Cited by 173
Dinov, I. D. (2016) · GigaScience · doi:10.1186/s13742-016-0117-6 · Cited by 153
Going Digital: A Survey on Digitalization and Large-Scale Data Analytics in Healthcare
Volker Tresp, C., Overhage, J. M., Bundschus, M., Rabizadeh, S., Fasching, P. A., & Yu, S. (2016) · Proceedings of the IEEE · doi:10.1109/jproc.2016.2615052 · Cited by 162
Contextual anomaly detection framework for big sensor data
Hayes, M. A., & Capretz, M. A. (2015) · Journal of Big Data · doi:10.1186/s40537-014-0011-y · Cited by 149
Liu, C., Feng, Y., Lin, D., Wu, L., & Guo, M. (2020) · International Journal of Production Research · doi:10.1080/00207543.2019.1677961 · Cited by 146
Design principles for creating digital transparency in government
Matheus, R., Janssen, M., & Janowski, T. (2020) · Government Information Quarterly · doi:10.1016/j.giq.2020.101550 · Cited by 189
Stoll, A., & Benner, P. (2021) · GAMM-Mitteilungen · doi:10.1002/gamm.202100003 · Cited by 151
Navigating the Local Modes of Big Data: The Case of Topic Models
Roberts, M. E., Stewart, B., & Tingley, D. H. (2016) · Computational Social Science · doi:10.1017/cbo9781316257340.004 · Cited by 145
Machine Learning Approaches in Cardiovascular Imaging
Henglin, M., Stein, G., Hushcha, P. V., Snoek, J., Wiltschko, A. B., & Cheng, S. C. (2017) · Circulation Cardiovascular Imaging · doi:10.1161/circimaging.117.005614 · Cited by 146
Statistical methods and computing for big data
Wang, C., Chen, M., Schifano, E., Wu, J., & Yan, J. (2016) · Statistics and Its Interface · doi:10.4310/sii.2016.v9.n4.a1 · Cited by 138
CASEarth Poles: Big Data for the Three Poles
Li, X., Che, T., Li, X., Wang, L., Duan, A., Shangguan, D., Pan, X., Fang, M., & Bao, Q. (2020) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-19-0280.1 · Cited by 132
Nguyen, B. H., Xue, B., Andreae, P. M., Ishibuchi, H., & Zhang, M. (2019) · IEEE Transactions on Evolutionary Computation · doi:10.1109/tevc.2019.2913831 · Cited by 131
Predicting Tourist Demand Using Big Data
Song, H., & Liu, H. (2016) · Tourism on the verge · doi:10.1007/978-3-319-44263-1_2 · Cited by 129
Self-citationBig Data-enabled Customer Relationship Management: A holistic approach
Zerbino, P., Aloini, D., Dulmin, R., & Mininno, V. (2018) · Information Processing & Management · doi:10.1016/j.ipm.2017.10.005 · Cited by 112
Jena, R. K. (2020) · Industrial Marketing Management · doi:10.1016/j.indmarman.2019.12.012 · Cited by 137
From inverse optimal control to inverse reinforcement learning: A historical review
Azar, N. A., Shahmansoorian, A., & Davoudi, M. (2020) · Annual Reviews in Control · doi:10.1016/j.arcontrol.2020.06.001 · Cited by 127
Masoud, M. Z., Jaradat, Y. M., Manasrah, A. A., & Jannoud, I. (2019) · Journal of Sensors · doi:10.1155/2019/6514520 · Cited by 125
Challenges and Benefits of Deploying Big Data Analytics in the Cloud for Business Intelligence
Balachandran, B. M., & Prasad, S. T. (2017) · Procedia Computer Science · doi:10.1016/j.procs.2017.08.138 · Cited by 123
Blending Big Data Analytics: Review on Challenges and a Recent Study
Amalina, F., Hashem, M., Azizul, Z. H., Ang, T. F., Firdaus, A., Imran, M. A., & Anuar, N. B. (2019) · IEEE Access · doi:10.1109/access.2019.2923270 · Cited by 127
Large data sets and machine learning: Applications to statistical arbitrage
Huck, N. (2019) · European Journal of Operational Research · doi:10.1016/j.ejor.2019.04.013 · Cited by 121
Individual-Based Tracking Systems in Ornithology: Welcome to the Era of Big Data
López‐López, P. (2016) · Ardeola · doi:10.13157/arla.63.1.2016.rp5 · Cited by 117
Randomly distributed embedding making short-term high-dimensional data predictable
Ma, H., Leng, S., Aihara, K., Lin, W. J., & Chen, L. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1802987115 · Cited by 103
Zhang, X. (2020) · Springer eBooks · doi:10.1007/978-981-15-2770-8_6 · Cited by 118
Bioprospecting of Novel Extremozymes From Prokaryotes—The Advent of Culture-Independent Methods
Sysoev, M., Grötzinger, S. W., Renn, D., Eppinger, J., Rueping, M., & Karan, R. (2021) · Frontiers in Microbiology · doi:10.3389/fmicb.2021.630013 · Cited by 105
A selective overview of feature screening for ultrahigh-dimensional data
Liu, J., Zhong, W., & Li, R. (2015) · Science China Mathematics · doi:10.1007/s11425-015-5062-9 · Cited by 102
Ngo, J., Hwang, B., & Zhang, C. (2019) · Automation in Construction · doi:10.1016/j.autcon.2019.103042 · Cited by 104
Marcucci, E., Gatta, V., Pira, M. L., Hansson, L., & Bråthen, S. (2020) · Sustainability · doi:10.3390/su122410623 · Cited by 107
The Double-Edged Sword of Big Data in Organizational and Management Research
Wenzel, R., & Quaquebeke, N. V. (2017) · Organizational Research Methods · doi:10.1177/1094428117718627 · Cited by 107
Open Innovation Engineering—Preliminary Study on New Entrance of Technology to Market
Yun, J. J., Kim, D., & Yan, M.-R. (2020) · Electronics · doi:10.3390/electronics9050791 · Cited by 102
Impact of AI-Based Tools and Urban Big Data Analytics on the Design and Planning of Cities
Kamrowska-Załuska, D. (2021) · Land · doi:10.3390/land10111209 · Cited by 95
A semiparametric method for clustering mixed data
Foss, A., Markatou, M., Ray, B. K., & Heching, A. R. (2016) · Machine Learning · doi:10.1007/s10994-016-5575-7 · Cited by 102
Metadata
- Authors
- Fan, J., Han, F., & Liu, H.
- Affiliations
- Department of Operations Research and Financial Engineering, Princeton University, Princeton, NJ 08544, USA;
- Johns Hopkins University (US)
- Princeton University (US)
- Venue
- National Science Review
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-02-05
- Volume
- 1
- Issue
- 2
- Pages
- 293-314
- ISSN
- 2053-714X (ISSN-L)
- 2095-5138
- PMC
- PMC4236847
- OpenAlex
- W2114060717
- Cited by
- 1,482
- References
- 144
- Citations by year
- 2026: 86 · 2025: 132 · 2024: 142 · 2023: 172 · 2022: 118 · 2021: 122 · 2020: 125 · 2019: 157 · 2018: 162 · 2017: 120 · 2016: 90 · 2015: 40 · 2014: 15
- FWCI
- 165.47
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- National Science Review (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- arXiv (Cornell University) (submittedVersion)
- HighWire Press Open Archive (submittedVersion)
- arXiv (Cornell University)
- Funders
- National Science Foundation (R01-GM072611, 1206464, 1332109, 1116730)
- National Institutes of Health
- National Institute of Mental Health (R01MH102339)
- National Institute of General Medical Sciences (R01GM072611, R01GM100474)
- Topics
- Social Sciences › Decision Sciences › Information Systems and Management › Big Data Technologies and Applications
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Inference
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Applications
- Keywords
- big data analytics, high-dimensional data, scalability, noise accumulation, spurious correlations, measurement error, statistical inference, computer architecture
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
