Promises and Pitfalls of Using Digital Traces for Demographic Research
Open accessThe DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Abstract
The digital traces that we leave online are increasingly fruitful sources of data for social scientists, including those interested in demographic research. The collection and use of digital data also presents numerous statistical, computational, and ethical challenges, motivating the development of new research approaches to address these burgeoning issues. In this article, we argue that researchers with formal training in demography—those who have a history of developing innovative approaches to using challenging data—are well positioned to contribute to this area of work. We discuss the benefits and challenges of using digital trace data for social and demographic research, and we review examples of current demographic literature that creatively use digital trace data to study processes related to fertility, mortality, and migration. Focusing on Facebook data for advertisers—a novel “digital census” that has largely been untapped by demographers—we provide illustrative and empirical examples of how demographic researchers can manage issues such as bias and representation when using digital trace data. We conclude by offering our perspective on the road ahead regarding demography and its role in the data revolution.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
boyd, D., & Crawford, K. (2012) · Information, Communication & Society · doi:10.1080/1369118x.2012.678878 · Cited by 5,479
I tweet honestly, I tweet passionately: Twitter users, context collapse, and the imagined audience
Marwick, A. E., & boyd, D. (2011) · New Media & Society · doi:10.1177/1461444810365313 · Cited by 4,612 · cited 1×
“Digital traces can provide ready access to users’ controversial opinions and/or disclosure of engagement in deviant behavior, which may be easy to conceal through other forms of data collection (Berinksy 1999; Marwick and Boyd 2010).”
Sensitive questions in surveys.
Tourangeau, R., & Yan, T. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.5.859 · Cited by 3,057
The Parable of Google Flu: Traps in Big Data Analysis
Lazer, D., Kennedy, R., King, G., & Vespignani, A. (2014) · Science · doi:10.1126/science.1248506 · Cited by 2,523 · cited 1×
“Following the burst of initial research advocating the possibilities of using digital trace data to study social phenomena, a recent body of literature has emerged outlining ways in which these data have been misused, cautioning researchers about the unique challenges that they present (Adams and Brueckner 2015; boyd…”
Big Data, new epistemologies and paradigm shifts
Kitchin, R. (2014) · Big Data & Society · doi:10.1177/2053951714528481 · Cited by 2,355 · cited 2×
“Following the burst of initial research advocating the possibilities of using digital trace data to study social phenomena, a recent body of literature has emerged outlining ways in which these data have been misused, cautioning researchers about the unique challenges that they present (Adams and Brueckner 2015; boyd…”
MethodDiurnal and seasonal mood vary with work, sleep, and daylength across diverse cultures
Golder, S. A., & Macy, M. W. (2011) · Science · doi:10.1126/science.1202775 · Cited by 1,155
“But the data is already public”: on the ethics of research in Facebook
Zimmer, M. (2010) · Ethics and Information Technology · doi:10.1007/s10676-010-9227-5 · Cited by 900 · cited 2×
“…of anonymity is illustrated most clearly by the Taste, Ties, and Time (T3) project, a data collection initiative that gathered an entire university cohort’s worth of Facebook profile data but was disrupted when those assessing the research were able to identify individual students (Zimmer 2010).”
Tufekci, Z. (2014) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v8i1.14517 · Cited by 780
Zwitter, A. (2014) · Big Data & Society · doi:10.1177/2053951714559253 · Cited by 465 · cited 1×
“…cautioning researchers about the unique challenges that they present (Adams and Brueckner 2015; boyd and Crawford 2012; Couldry and Powell 2014; Felt 2016; Golder and Macy 2014; González-Bailón 2013; Kitchin 2014; Lazer et al. 2014; Lewis 2015; Lohr 2012; Manovich 2011; Tufekci 2014; Zwitter 2014).”
(2014) · iConference 2014 Proceedings · doi:10.9776/14308 · Cited by 423
Invisible Men: Mass Incarceration and the Myth of Black Progress
(2013) · Choice Reviews Online · doi:10.5860/choice.50-2982 · Cited by 401
The use of mobile phones as a data collection tool: A report from a household survey in South Africa
Tomlinson, M., Solomon, W., Singh, Y., Doherty, T., Chopra, M., Ijumba, P., Tsai, A. C., & Jackson, D. (2009) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-9-51 · Cited by 340
Inferring international and internal migration patterns from twitter data
Zagheni, E., Garimella, V. R. K., Weber, I., & State, B. (2014) · Proceedings of the 23rd International Conference on World Wide Web · doi:10.1145/2567948.2576930 · Cited by 224
Self-citationCouldry, N., & Powell, A. (2014) · Big Data & Society · doi:10.1177/2053951714539277 · Cited by 213 · cited 1×
“Following the burst of initial research advocating the possibilities of using digital trace data to study social phenomena, a recent body of literature has emerged outlining ways in which these data have been misused, cautioning researchers about the unique challenges that they present (Adams and Brueckner 2015; boyd…”
Demographic research with non-representative internet data
Zagheni, E., & Weber, I. (2015) · International Journal of Manpower · doi:10.1108/ijm-12-2014-0261 · Cited by 119
Self-citation
Research works printed but not linked: 78
- Adams, 2015, Wikipedia, sociology, and the promise and pitfalls of Big Data, Big Data & Society, 2, 1, 10.1177/2053951715614332 · DOI
- Alkema, 2012, Estimating trends in the total fertility rate with uncertainty using imperfect data: Examples from West Africa, Demographic Research, 26, 332
- Andrews, 2016, Keeping up with the Tweet-dashians: The impact of “official” accounts on online rumoring, 452
- Ang, 2013, Data in the wild: Some reflections, Interactions, 20, 39, 10.1145/2427076.2427085 · doi:10.1145/2427076.2427085
- Araújo, 2017, Using Facebook ads audiences for global lifestyle disease surveillance: Promises and limitations, 253, 10.1145/3091478.3091513 · DOI
- Barry, 2006, Friends for better or for worse: Interracial friendships in the United States as seen through wedding photos, Demography, 43, 491, 10.1353/dem.2006.0020 · DOI
- Belli, 1999, Reducing vote overreporting in surveys: Social desirability, memory failure, and source monitoring, Public Opinion Quarterly, 63, 90, 10.1086/297704 · DOI · Paper page
- Berinsky, 1999, The two faces of public opinion, American Journal of Political Science, 43, 1209, 10.2307/2991824 · DOI · Paper page
- Blei, 2017, Science and data science, Science, 114, 8689
- Billari, 2013, Forecasting births using Google
- Billari, 2017, Big data and population processes: A revolution?, 167
- Blumenstock, 2015, Predicting poverty and wealth from mobile phone metadata, Science, 350, 1073, 10.1126/science.aac4420 · DOI · Paper page
- Blumenstock, 2010, Mobile divides: Gender, socioeconomic status, and mobile phone use in Rwanda, 6, 10.1145/2369220.2369225 · DOI · Paper page
- Blumenstock, 2012, Inferring patterns of internal migration from mobile phone call records: evidence from Rwanda, Information Technology for Development, 18, 107, 10.1080/02681102.2011.643209 · DOI · Paper page
- Blumenstock, 2012, Divided we call: Disparities in access and use of mobile phones in Rwanda, Information Technologies and International Development, 8, 1
- Blumenstock, 2014, Segregation and “silent separation”: Using large-scale network data to model the determinants of ethnic segregation
- Brass, 1976, Indirect methods of estimating mortality illustrated by application to Middle East and North African data
- Cesare, 2015, Self-presentation and information disclosure on Twitter: Understanding patterns and mechanisms along demographic lines
- Cesare, 2017, Redrawing the silent “color line”: Examining racial segregation in associative networks on Twitter
- De Choudhury, 2013, Predicting postpartum changes in emotion and behavior via social media, 3267, 10.1145/2470654.2466447 · DOI · Paper page
- De Choudhury, M., Gamon, M., Counts, S., & Horvitz, E. (2013b). Predicting depression via social media. In Proceedings of the Seventh International AAAI Conference on Weblogs and Social Media (pp. 128–137). Palo Alto, CA: AAAI Press. Retrieved from https://www.aaai.org/ocs/index.php/ICWSM/ICWSM13/paper/viewFile/6124/6351 · DOI · Paper page
- De Choudhury, 2016, Characterizing dietary choices, nutrition, and language in food deserts via social media, 1157
- Deville, 2014, Dynamic population mapping using mobile phone data, Proceedings of the National Academy of Sciences, 111, 15853, 10.1073/pnas.1408439111 · DOI · Paper page
- Eichstaedt, 2015, Psychological Language on Twitter Predicts County-Level Heart Disease Mortality, Psychological Science, 26, 159, 10.1177/0956797614557867 · DOI · Paper page
- Fadnes, 2009, How to identify information bias due to self-reporting in epidemiological research, Internet Journal of Epidemiology, 7, 1
- Feehan, 2017, How many people have access to the Internet? Estimating Internet adoption around the world using Facebook
- Felt, 2016, Social media and the social sciences: How researchers employ Big Data analytics, Big Data & Society, 3, 1, 10.1177/2053951716645828 · DOI · Paper page
- Golder, 2014, Digital footprints: Opportunities and challenges for online social research, Annual Review of Sociology, 40, 129, 10.1146/annurev-soc-071913-043145 · DOI · Paper page
- González-Bailón, 2013, Social science in the era of big data, Policy and the Internet, 5, 147, 10.1002/1944-2866.POI328 · DOI
- Graham, 2012, Featured graphic: Digital divide: The geography of Internet access, Environment and Planning, 44, 1009, 10.1068/a44497 · DOI
- Heaivilin, 2011, Public health surveillance of dental pain via Twitter, Journal of Dental Research, 90, 1047, 10.1177/0022034511415273 · DOI · Paper page
- Holbrook, 2010, Social desirability bias in voter turnout reports: Tests using the item count technique, Public Opinion Quarterly, 74, 37, 10.1093/poq/nfp065 · DOI · Paper page
- Kashyap, 2017, Ultrasound technology and “missing women” in India: Analyses and now-casts based on Google searches
- Keyfitz, 2005, The matrix model framework, 47
- Kikas, 2015, Explaining international migration in the Skype network, 17, 10.1145/2806655.2806658 · DOI
- Latour, B. (2007). Beware, your imagination leaves digital traces. Times Higher Literary Supplement, 6(4). Retrieved from http://scholar.google.com/scholar?hl=en&btnG=Search&q=intitle:Beware+,+your+imagination+leaves+digital+traces#0
- Lazer, 2017, Data ex Machina: Introduction to Big Data, Annual Review of Sociology, 43, 19, 10.1146/annurev-soc-060116-053457 · DOI · Paper page
- Lee, 2014, Redrawing the “color line”: Examining racial homophily of associative networks in social media
- Lewis, 2015, Three fallacies of digital footprints, Big Data & Society, 2, 1, 10.1177/2053951715602496 · DOI
- Lewis, 2013, Content Analysis in an Era of Big Data: A Hybrid Approach to Computational and Manual Methods, Journal of Broadcasting & Electronic Media, 57, 34, 10.1080/08838151.2012.761702 · DOI · Paper page
- Malik, M. M., & Pfeffer, J. (2016, March). Social media data and computational models of mobility: A review for demography. Paper presented at the ICWSM Workshop on Social Media and Demographic Research, Cologne, Germany. Retrieved from http://www.pfeffer.at/papers/2016_demography.pdf
- Manovich, 2011, Trending: The promises and the challenges of big social data, 460
- Massey, 2016, Measuring racial prejudice using Google trends
- Mateos, 2014, Netnography and demography: Mining Internet discussion forums on migration and citizenship
- McCormick, 2015, Using Twitter for demographic and social science research: Tools for data collection and processing, Sociological Methods & Research, 46, 390, 10.1177/0049124115605339 · DOI · Paper page
- Mendieta, 2016, Geo-localized social media data to improve characterization of international travelers, 126, 10.1109/ICEDEG.2016.7461709 · DOI
- Metzler, 2016, Who is doing computational social science? Trends in big data research
- Mislove, A., Lehmann, S., & Ahn, Y. (2011). Understanding the demographics of Twitter users. In Proceedings of the Fifth International Conference on Weblogs and Social Media (pp. 554–557). Menlo Park, CA: AAAI Press. Retrieved from http://www.aaai.org/ocs/index.php/ICWSM/ICWSM11/paper/viewFile/2816/3234
- Moreno, 2012, Associations between displayed alcohol references on Facebook and problem drinking among college students, Archives of Pediatrics & Adolescent Medicine, 166, 157, 10.1001/archpediatrics.2011.180 · DOI · Paper page
- National Research Council (NRC), 2014, Proposed revisions to the common rule for the protection of human subjects in the behavioral and social sciences
- O’Connor, B., Balasubramanyan, R., Routledge, B. R., & Smith, N. A. (2010). From tweets to polls: Linking text sentiment to public opinion time series. In Proceedings of the Fourth International AAAI Conference on Weblogs and Social Media (pp. 122–129). Palo Alto, CA: AAAI Press. Retrieved from https://www.aaai.org/ocs/index.php/ICWSM/ICWSM10/paper/viewFile/1536/1842 · DOI · Paper page
- Ojala, 2017, Fertility and its meaning: Evidence from search behavior, 640
- Palmer, 2013, New approaches to human mobility: Using mobile phones for demographic research, Demography, 50, 1105, 10.1007/s13524-012-0175-z · DOI · Paper page
- Park, 1925, The city
- Pötzschke, 2016, Migrant Sampling Using Facebook Advertisements, Social Science Computer Review, 35, 633, 10.1177/0894439316666262 · DOI
- Preston, 2001, Demography: Measuring and modeling population processes
- Reeder, 2014, Online information behaviors during disaster events: Roles, routines, and reactions
- Reis, 2010, Measuring the impact of health policies using Internet search patterns: The case of abortion, BMC Public Health, 10
- Rosenfeld, 2012, Searching for a mate: The rise of the Internet as a social intermediary, American Sociological Review, 77, 523, 10.1177/0003122412448050 · DOI · Paper page
- Ruggles, 2014, Big microdata for population research, Demography, 51, 287, 10.1007/s13524-013-0240-2 · DOI
- Ruppert, 2013, Reassembling social science methods: The challenge of digital devices, Theory, Culture and Society, 30, 22, 10.1177/0263276413484941 · DOI · Paper page
- Sagiroglu, 2013, Big Data: A review, 42, 10.1109/CTS.2013.6567202 · DOI · Paper page
- Ševčíková, 2007, Assessing uncertainty in urban simulations using Bayesian melding, Transportation Research, Part B: Methodological, 41, 652, 10.1016/j.trb.2006.11.001 · DOI
- Shaw, 1942, Juvenile delinquency and urban areas
- Snijders, C., Matzat, U., & Reips, U.-D. (2012). Big data: Big gaps of knowledge in the field of Internet science. International Journal of Internet Science, 7, 1–5. Retrieved from http://www.ijis.net/ijis7_1/ijis7_1_editorial_pre.html
- Starbird, 2016, Could this be true? I think so! Expressed uncertainty in online rumoring, 360, 10.1145/2858036.2858551 · DOI · Paper page
- State, 2014, Migration of professionals to the U.S.: Evidence from LinkedIn data, 531
- Stevenson, 2014, Finding the Twitter users who stood with Wendy, Contraception, 90, 502, 10.1016/j.contraception.2014.07.007 · DOI
- Sutton, 2014, Warning tweets: Serial transmission of messages during the warning phase of a disaster event, Information, Communication & Society, 17, 765, 10.1080/1369118X.2013.862561 · DOI · Paper page
- Tamgno, J. K., Faye, R. M., & Lishou, C. (2013). Verbal autopsies, mobile data collection for monitoring and warning causes of deaths. In 14th International Conference on Advanced Communication Technology, Technical Proceedings, 2013 (pp. 495–501). Piscataway, NJ: Institute of Electrical and Electronics Engineers. Retrieved from https://ieeexplore.ieee.org/document/6488236/
- Taylor, 2017, Group privacy: New challenges of data technologies, 10.1007/978-3-319-46608-8 · DOI · Paper page
- Tourassi, 2016, A novel web informatics approach for automated surveillance of cancer mortality trends, Journal of Biomedical Informatics, 61, 110, 10.1016/j.jbi.2016.03.027 · DOI
- Wang, 2015, Forecasting elections with non-representative polls, International Journal of Forecasting, 31, 980, 10.1016/j.ijforecast.2014.06.001 · DOI · Paper page
- Willekens, 2016, International migration under the microscope, Science, 352, 897, 10.1126/science.aaf6545 · DOI
- Williams, 2015, Measures of human mobility using mobile phone records enhanced with GIS data, PLoS One, 10, 1, 10.1371/journal.pone.0133630 · DOI · Paper page
- Zagheni, 2012, You are where you e-mail: using e-mail data to estimate international migration rates, 348, 10.1145/2380718.2380764 · DOI · Paper page
- Zagheni, 2017, Leveraging Facebook’s advertising platform to monitor stocks of migrants, Population and Development Review, 43, 721, 10.1111/padr.12102 · DOI · Paper page
- Zeng, 2016, Rumors at the speed of light? Modeling the rate of rumor transmission during crisis, 1969, 10.1109/HICSS.2016.248 · DOI · Paper page
Cited by
Computational Social Science and Sociology
Edelmann, A., Wolff, T., Montagne, D., & Bail, C. A. (2020) · Annual Review of Sociology · doi:10.1146/annurev-soc-121919-054621 · Cited by 305
“Computational social science has emerged within demography only relatively recently, but it is rapidly gaining popularity (Cesare et al. 2018).”
BackgroundMethodHoffmann, R., Šedová, B., & Vinke, K. (2021) · Global Environmental Change · doi:10.1016/j.gloenvcha.2021.102367 · Cited by 159
Billari, F. C. (2022) · Population and Development Review · doi:10.1111/padr.12464 · Cited by 52
Jeon, J., Kim, L., & Park, J. (2025) · Technology in Society · doi:10.1016/j.techsoc.2025.102836 · Cited by 41
The Internetization of International Migration
Pesando, L. M., Rotondi, V., Stranges, M., Kashyap, R., & Billari, F. C. (2021) · Population and Development Review · doi:10.1111/padr.12371 · Cited by 35
Metadata
- Authors
- Cesare, N., Lee, H., McCormick, T., Spiro, E., & Zagheni, E.
- Venue
- Demography
- Publisher
- Duke University Press
- Published
- 2018-10-01
- Volume
- 55
- Issue
- 5
- Pages
- 1979-1999
- ISSN
- 0070-3370 (ISSN-L)
- 1533-7790
- OpenAlex
- W3125934683
- Cited by
- 137
- References
- 15
- FWCI
- 16.30
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.springer.com/tdm (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.