Where Have All the Data Gone? A Critical Reflection on Academic Digital Research in the Post-API Age
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
In the wake of the 2018 Facebook–Cambridge Analytica scandal, social media companies began restricting academic researchers’ access to the easiest, most reliable means of systematic data collection via their application programming interfaces (APIs). Although these restrictions have been decried widely by digital researchers, in this essay, I argue that relatively little has changed. The underlying relationship between researchers, the platforms, and digital data remains largely the same. The platforms and their APIs have always been proprietary black boxes, never intended for scholarly use. Even when researchers could mine data seemingly endlessly, we rarely knew what type or quality of data were at hand. Moreover, the largesse of the API era allowed many researchers to conduct their work with little regard for the rigor, ethics, or focus on societal value, we should expect from scholarly inquiry. In other words, our digital research processes and output have not always occupied the high ground. Rather than viewing 2018 and Cambridge Analytica as a profound disjuncture and loss, I suggest that digital researchers need to take a more critical look at how our community collected and analyzed data when it still seemed so plentiful, and use these reflections to inform our approaches going forward.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The spread of true and false news online
Vosoughi, S., Roy, D., & Aral, S. (2018) · Science · doi:10.1126/science.aap9559 · Cited by 8,847 · cited 1×
“Occasionally, the platforms provided special data sets to external researchers (e.g., Vosoughi et al., 2018), and in a few instances, they collaborated directly with outside scholars (e.g., Kramer et al., 2014).”
BackgroundExperimental evidence of massive-scale emotional contagion through social networks
Kramer, A. D. I., Guillory, J. E., & Hancock, J. T. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1320040111 · Cited by 3,687 · cited 2×
“Numerous studies have collected and analyzed platform data without users’ informed consent (e.g., Catanese et al., 2011; Gjoka et al., 2010; Kramer et al., 2014; Lewis et al., 2008; Traud et al., 2012).”
BackgroundTastes, ties, and time: a new social network dataset using Facebook.com
Lewis, K., Kaufman, J., Gonzalez, M., Wimmer, A., & Christakis, N. (2008) · Social Networks · doi:10.1016/j.socnet.2008.07.002 · Cited by 1,024 · cited 2×
“Numerous studies have collected and analyzed platform data without users’ informed consent (e.g., Catanese et al., 2011; Gjoka et al., 2010; Kramer et al., 2014; Lewis et al., 2008; Traud et al., 2012).”
Background“But the data is already public”: on the ethics of research in Facebook
Zimmer, M. (2010) · Ethics and Information Technology · doi:10.1007/s10676-010-9227-5 · Cited by 900 · cited 2×
“As Zimmer (2010) argues, data opened to the platforms’ “public square” are not analogous to the data we might gather while observing people in physical public spaces.”
BackgroundComputational Research in the Post-API Age
Freelon, D. (2018) · Political Communication · doi:10.1080/10584609.2018.1477506 · Cited by 336 · cited 3×
“…health science, scholars from a wide variety of disciplines relied on these APIs to gather large amounts of data for research into the content and behaviors found in digital spaces, and the CA-inspired restrictions significantly undermined multiple lines of research (Freelon, 2018; Hemsley, 2019).”
BackgroundCrawford, K., & Finn, M. (2015) · GeoJournal · doi:10.1007/s10708-014-9597-z · Cited by 191 · cited 1×
“People often post sensitive information such as their location, political views, and religious affiliation online without understanding the potential implications (Crawford & Finn, 2015; Fiesler & Proferes, 2018).”
Background
Cited by
Towards a standard for identifying and managing bias in artificial intelligence
Schwartz, R., Vassilev, A., Greene, K., Perine, L., Burt, A., & Hall, P. (2022) · doi:10.6028/nist.sp.1270 · Cited by 548
“the data is,” and adapt their questions accordingly [126].”
BackgroundStudying Reddit: A Systematic Overview of Disciplines, Approaches, Methods, and Ethics
Proferes, N., Jones, N., Gilbert, S., Fiesler, C., & Zimmer, M. (2021) · Social Media + Society · doi:10.1177/20563051211019004 · Cited by 537
“In recent years, major social media platforms like Facebook (Freelon, 2018), Instagram, and Twitter (Bruns, 2019) have begun restricting API access (Tromble, 2021).”
BackgroundZuboff, S. (2022) · Organization Theory · doi:10.1177/26317877221129290 · Cited by 209
“…and their social effects, a problem that has intensified since government inquiries into Cambridge Analytica, including its role in the UK Brexit referendum and the 2016 US presidential elections (Benesch, 2021; Bruns, 2018, 2018, 2019; Ghaffary, 2021; Gibney, 2019; Puschmann, 2019; Tromble, 2021).”
BackgroundRemember the Human: A Systematic Review of Ethical Considerations in Reddit Research
Fiesler, C., Zimmer, M., Proferes, N., Gilbert, S., & Jones, N. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3633070 · Cited by 113
Broniatowski, D. A., Simons, J. R., Gu, J., Jamison, A. M., & Abroms, L. C. (2023) · Science Advances · doi:10.1126/sciadv.adh2132 · Cited by 62
Metadata
- Authors
- Tromble, R.
- Venue
- Social Media + Society
- Publisher
- SAGE Publications
- Published
- 2021-01
- Volume
- 7
- Issue
- 1
- ISSN
- 2056-3051 (ISSN-L)
- OpenAlex
- W3121702640
- Cited by
- 91
- References
- 6
- FWCI
- 19.44
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Where Have All the Data Gone? A Critical Reflection on Academic Digital Research in the Post-API Age. https://app.cochat.ai/papers/10.1177/2056305121988929
- The paper
- Tromble, R. (2021). Where Have All the Data Gone? A Critical Reflection on Academic Digital Research in the Post-API Age. Social Media + Society. https://doi.org/10.1177/2056305121988929
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.