Mining the Quantified Self: Personal Knowledge Discovery as a Challenge for Data Science
The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.
Abstract
The last several years have seen an explosion of interest in wearable computing, personal tracking devices, and the so-called quantified self (QS) movement. Quantified self involves ordinary people recording and analyzing numerous aspects of their lives to understand and improve themselves. This is now a mainstream phenomenon, attracting a great deal of attention, participation, and funding. As more people are attracted to the movement, companies are offering various new platforms (hardware and software) that allow ever more aspects of daily life to be tracked. Nearly every aspect of the QS ecosystem is advancing rapidly, except for analytic capabilities, which remain surprisingly primitive. With increasing numbers of qualified self participants collecting ever greater amounts and types of data, many people literally have more data than they know what to do with. This article reviews the opportunities and challenges posed by the QS movement. Data science provides well-tested techniques for knowledge discovery. But making these useful for the QS domain poses unique challenges that derive from the characteristics of the data collected as well as the specific types of actionable insights that people want from the data. Using a small sample of QS time series data containing information about personal health we provide a formulation of the QS problem that connects data to the decisions of interest to the user.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Experiencing SAX: A novel symbolic representation of time series
Lin, J., Keogh, E., Wei, L., & Lonardi, S. (2007) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-007-0064-z · Cited by 1,618 · cited 3×
“An extensive description of SAX, including the justification for these steps and for theGaussianassumption,isavailableintheseminalpaperofLin,Keogh,andWei.”
InfluentialSwan, M. (2012) · Journal of Sensor and Actuator Networks · doi:10.3390/jsan1030217 · Cited by 934 · cited 1×
“The human body is the first domain in which a large number of coordinated sensors will be placed and monitored.(9) This is another reason why QS should be interesting to data science: it provides an accessible domain for experimenting with IOT problems, and experience with QS sensor analysis should provide insight int…”
The Quantified Self: Fundamental Disruption in Big Data Science and Biological Discovery
Swan, M. (2013) · Big Data · doi:10.1089/big.2012.0002 · Cited by 931
Cited by
Data Science: A Comprehensive Overview
Cao, L. (2018) · ACM Computing Surveys · doi:10.1145/3076253 · Cited by 407
“Datafication [Ayankoya et al. 2014], the quantified self (QS) [Swan 2013; Clay 2013; Wolf 2012; Duncan 2009; Smarr 2012; Fawcett 2016], initiatives by governments and research institutions and open data are discussed as the key drivers of the era of big data and data science.”
BackgroundUnderstanding self-reflection: how people reflect on personal data through visual data exploration
Choe, E. K., Lee, B., Zhu, H., Riche, N. H., & Baur, D. (2017) · Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3154862.3154881 · Cited by 194
Blockchain applications in the biomedical domain: A scoping review
Drosatos, G., & Kaldoudi, E. (2019) · Computational and Structural Biotechnology Journal · doi:10.1016/j.csbj.2019.01.010 · Cited by 145
“The recent trend of quantified self [81] brought attention to personal biosensors (wearables and embedded) creating an exploding amount of complex personal data streams, usually stored in various third-party sensor provider clouds or personal health records.”
Backgroundde Vries, H. J., Kooiman, T. J. M., van Ittersum, M. W., van Brussel, M., & de Groot, M. (2016) · Obesity · doi:10.1002/oby.21619 · Cited by 123
Kroll, R. R., Boyd, J. G., & Maslove, D. M. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6025 · Cited by 123
Metadata
- Authors
- Fawcett, T.
- Venue
- Big Data
- Publisher
- SAGE Publications
- Published
- 2015-12
- Volume
- 3
- Issue
- 4
- Pages
- 249-266
- ISSN
- 2167-6461 (ISSN-L)
- 2167-647X
- OpenAlex
- W2236421841
- Cited by
- 78
- References
- 3
- FWCI
- 12.42
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.