Big data and its epistemology
The DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
The article considers whether B ig D ata, in the form of data‐driven science, will enable the discovery, or appraisal, of universal scientific theories, instrumentalist tools, or inductive inferences. It points out, initially, that such aspirations are similar to the now‐discredited inductivist approach to science. On the positive side, B ig D ata may permit larger sample sizes, cheaper and more extensive testing of theories, and the continuous assessment of theories. On the negative side, data‐driven science encourages passive data collection, as opposed to experimentation and testing, and hornswoggling (“unsound statistical fiddling”). The roles of theory and data in inductive algorithms, statistical modeling, and scientific discoveries are analyzed, and it is argued that theory is needed at every turn. Data‐driven science is a chimera.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“(Babyak, 2004, p. 414) There are many known possible errors to make in statistical analysis, and many books and articles on them (e.g., Faraway, 1992; Huff, 1954; Mills, 1993).”
BackgroundFalsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1970) · Criticism and the Growth of Knowledge · doi:10.1017/cbo9781139171434.009 · Cited by 4,649 · cited 1×
“…know from Pierre Duhem, Imre Lakatos, and others, there is more to practical refutation than the plain production of a counter-example (Duhem, 1914; Lakatos, 1970, 1974a, 1974b). measuring and what the instruments are telling us about some kind of reality beyond themselves and their apparent…”
BackgroundStatistical Modeling: The Two Cultures (with comments and a rejoinder by the author)
Breiman, L. (2001) · Statistical Science · doi:10.1214/ss/1009213726 · Cited by 4,340 · cited 1×
“There are also pure black-box statistical modelers, just like black-box machine learners (Leo Breiman might be an example of both (Breiman, 2001)).”
BackgroundCohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
The Logic of Scientific Discovery
Popper, K. R., & Weiss, G. (1959) · Physics Today · doi:10.1063/1.3060577 · Cited by 2,717
A practical solution to the pervasive problems ofp values
Wagenmakers, E.-J. (2007) · Psychonomic Bulletin & Review · doi:10.3758/bf03194105 · Cited by 2,490
A comprehensive review of genetic association studies
Hirschhorn, J. N., Lohmueller, K., Byrne, E., & Hirschhorn, K. (2002) · Genetics in Medicine · doi:10.1097/00125817-200203000-00002 · Cited by 1,674
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Bell, G., Hey, T., & Szalay, A. (2009) · Science · doi:10.1126/science.1170411 · Cited by 537 · cited 1×
“(Floridi, 2012) Others point to the ‘fourth paradigm’ for science—new algorithmic, computational and analytical tools to produce gold for us from this data resource (Bell, Hey, & Szalay, 2009; Hey, Tansley, & Tolle, 2009) In prospect, then, some see the advent of data-driven science.”
BackgroundKell, D. B., & Oliver, S. G. (2004) · BioEssays · doi:10.1002/bies.10385 · Cited by 535 · cited 2×
“The 654 JOURNAL OF THE ASSOCIATION FOR INFORMATION SCIENCE AND TECHNOLOGY—April 2015 DOI: 10.1002/asi apparent inductive nature of these has certainly given rise to debate (e.g., Allen, 2001a, 2001b; Gillies, 2001; Kell & Oliver, 2004; Kelley & Scott, 2001).”
BackgroundInfluentialSimultaneous and selective inference: Current successes and future challenges
Benjamini, Y. (2010) · Biometrical Journal · doi:10.1002/bimj.200900299 · Cited by 169 · cited 1×
“Post hoc analysis does not have to be unsound (and research statistics has plenty of theoretical and practical answers to multiple comparison problems and similar (see, for example, (Benjamini, 2010; Motulsky, 2013)).”
Background
Research works printed but not linked: 41
- 10.1002/1521-1878(200101)23:1<104::AID-BIES1013>3.0.CO;2-2 · DOI
- 10.1002/bies.1125 · DOI
- Anderson C., 2008, The end of theory: The data deluge makes the scientific method obsolete, Wired, 16
- 10.1016/j.jclinepi.2007.05.007 · DOI
- 10.1097/01.psy.0000127692.23278.a9 · DOI · Paper page
- 10.1038/497433a · DOI · Paper page
- 10.1002/pst.303 · DOI
- 10.1002/asi.22634 · DOI · Paper page
- Bretz F., 2007, Special issue on multiplicity in Pharmaceutical Statistics, Pharmaceutical Statistics, 6, 151
- 10.1002/(SICI)1097-4571(199106)42:5<351::AID-ASI5>3.0.CO;2-3 · DOI · Paper page
- Duhem P.(1914). La théorie physique son objet et sa structure 2nd ed. (T. A. a. S. o. P. T. English Translation Phillip Wiener Princeton: Princeton University Press 1954. Trans.).Paris:Chevalier et Rivière.
- 10.2307/1390717 · doi:10.2307/1390717
- 10.1007/s13347-012-0093-4 · DOI · Paper page
- Forster M.(1995).The curve‐fitting problem. InR.Audi(Ed.) The Cambridge dictionary of philosophy (pp.197–198).Cambridge:Cambridge University Press.
- 10.2307/270939 · DOI · Paper page
- 10.1214/ss/1009212409 · DOI · Paper page
- 10.1080/09332480.2008.10722888 · DOI
- 10.1177/0165551508094050 · DOI · Paper page
- 10.1002/bies.1123 · DOI
- Hey T. Tansley S. &Tolle K.(Eds.). (2009). The fourth paradigm: Data‐intensive scientific discovery.Redmond WA:Microsoft Research.
- Howson C. &Urbach P.(2006). Scientific reasoning: The bayesian approach (3rd ed.).Chicago:Open Court.
- International Committee of Medical Journal Editors. (2013).Recommendations for the conduct reporting editing and publication of scholarly work in medical journals: Publishing and editorial issues related to publication in medical journals: Clinical trial registration. Retrieved fromhttp://www.icmje.org/publishing_j.html
- 10.1126/science.1211811 · DOI · Paper page
- 10.1126/science.334.6060.1225 · DOI · Paper page
- 10.1111/j.1467-9450.2010.00852.x · DOI
- 10.1002/bies.1124 · DOI
- Lakatos I.(1974a).Popper on demarcation and induction. InP.A.Schilpp(Ed.) The philosophy of Karl Popper (Vol.1 p.1974).LaSalle IL:Open Court.
- 10.1016/0039-3681(74)90007-7 · DOI
- Lykken D.T.(1991).What's wrong with psychology anyway?InD.Cicchetti&W.M.Grove(Eds.) Thinking clearly about psychology (Vol.1 pp.3–39).Minneapolis:University of Minnesota Press.
- 10.1037/0033-2909.113.1.181 · doi:10.1037/0033-2909.113.1.181 · Paper page
- 10.1037/0022-006X.46.4.806 · DOI · Paper page
- 10.1056/NEJM199310143291613 · DOI · Paper page
- Motulsky H.J.(2013). Intuitive biostatistics.New York:Oxford University Press.
- Naik G., 2011, Scientists' elusive goal: Reproducing study results, Wall Street Journal, A1
- Popper K.R.(1963). Conjectures and refutations.London:Routledge and Kegan Paul. · DOI · Paper page
- 10.1037/a0018326 · DOI · Paper page
- 10.1126/science.1165893 · DOI · Paper page
- 10.1086/289243 · DOI
- 10.1126/science.1172781 · DOI · Paper page
- 10.1093/bjps/axm024 · DOI · Paper page
- 10.1038/485298a · DOI · Paper page
Cited by
Xiang, Z., Du, Q., Ma, Y., & Fan, W. (2017) · Tourism Management · doi:10.1016/j.tourman.2016.10.001 · Cited by 1,051
Sentiment Analysis in Tourism: Capitalizing on Big Data
Alaei, A. R., Becken, S., & Stantic, B. (2019) · Journal of Travel Research · doi:10.1177/0047287517747753 · Cited by 622
The Deluge of Spurious Correlations in Big Data
Calude, C. S., & Longo, G. (2017) · Foundations of Science · doi:10.1007/s10699-016-9489-4 · Cited by 385
Big data and data science: a critical review of issues for educational research.
Daniel, B. K. (2019) · British Journal of Educational Technology · doi:10.1111/bjet.12595 · Cited by 220
Dencik, L., Hintz, A., & Carey, Z. (2018) · New Media & Society · doi:10.1177/1461444817697722 · Cited by 90
“The motivation becomes to trust in probabilistic reasoning as a way to mathematically render uncertainty (Frické, 2014) and thus operationalize the ‘not-yet’ through mechanisms that do not have to rely on ‘feeling’ but on ‘objective’ and ‘rational’ forms of analysis, secure in the belief that the…”
Background
Metadata
- Authors
- Frické, M.
- Venue
- Journal of the Association for Information Science and Technology
- Publisher
- Wiley
- Published
- 2014-05-02
- Volume
- 66
- Issue
- 4
- Pages
- 651-661
- ISSN
- 2330-1635 (ISSN-L)
- 2330-1643
- OpenAlex
- W1729469618
- Cited by
- 134
- References
- 13
- FWCI
- 22.65
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.