SurveySignal: A Convenient Solution for Experience Sampling Research Using Participants’ Own Smartphones
The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Abstract
Experience sampling or ecological momentary assessment offers unique insights into how people think, feel, and behave in their natural environments. Because the method is able to capture situational variation as it happens in “real time,” experience sampling has become an increasingly popular method in social and personality, psychology, and beyond. With the ubiquity of smartphone ownership and the recent technical advances, conducting experience sampling studies on participants’ own devices has become increasingly easy to do. Here, we present one reliable, user-friendly, highly customizable, and cost-effective solution. The web-based application, SurveySignal, integrates the idea of using short message service (SMS) messages as signals and reminders, according to fixed or random schedules and of linking these signals to mobile surveys designed with common online survey software. We describe the method and customizable parameters and then present evaluation results from nine social–psychological studies conducted with SurveySignal (overall N = 1,852). Mean response rates averaged 77% and the median response delay to signals was 8 min. An experimental manipulation of the reminder signal in one study showed that installing a reminder SMS led to a 10% increase in response rates. Next to advantages and limitations of the SMS approach, we discuss how ecologically valid research methods such as smartphone experience sampling can enrich psychological research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2017) · Cited by 16,319
Multilevel analysis : an introduction to basic and advanced multilevel modeling
Snijders, T. A. B., & Bosker, R. (1999) · Cited by 13,775
Multilevel analysis techniques and applications
Hox, J. J., Moerbeek, M., & van de Schoot, R. (2002) · Cited by 6,728
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
(2003) · Manual for Research Ethics Committees · doi:10.1017/cbo9780511550089.028 · Cited by 3,413
Validity and reliability of the Experience-Sampling Method
CSIKSZENTMIHALYI, M., & LARSON, R. (1987) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-198709000-00004 · Cited by 2,544
Handbook of Research Methods in Social and Personality Psychology
(2024) · Cambridge University Press eBooks · doi:10.1017/9781009170123 · Cited by 2,121
Handbook of Research Methods in Social and Personality Psychology
(2014) · Cambridge University Press eBooks · doi:10.1017/cbo9780511996481 · Cited by 1,942
A practical guide to multilevel modeling
Peugh, J. L. (2010) · Journal of School Psychology · doi:10.1016/j.jsp.2009.09.002 · Cited by 1,418
Experience Sampling Method: Measuring the Quality of Everyday Life
Hektner, J. M., Schmidt, J. A., & Csíkszentmihályi, M. (2006) · Cited by 1,239
Everyday temptations: an experience sampling study of desire, conflict, and self-control
Hofmann, W., Baumeister, R. F., Förster, G., & Vohs, K. D. (2012) · Journal of Personality and Social Psychology · doi:10.1037/a0026545 · Cited by 986 · cited 1×
“…sampling study of temptation and self-control in daily life revealed that people high in trait self-control reported fewer self-control conflicts and less use of effortful self-control rather than the other way around as traditionally assumed (Hofmann, Baumeister, Fo¨rster, & Vohs, 2012).”
BackgroundSelf-citationThe Smartphone Psychology Manifesto
Miller, G. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612441215 · Cited by 624
Hofmann, W., Wisneski, D. C., Brandt, M. J., & Skitka, L. J. (2014) · Science · doi:10.1126/science.1251560 · Cited by 575 · cited 1×
“Study 7 (Wilkey & Eastwick, 2013) offered response-based course credit, and Study 4 (Hofmann, Skitka, Wisneski, & Brandt, 2013) offered a raffle of two tablets worth US$200 each (or gift cards of equal value).”
BackgroundSelf-citationSnijders, T. A. B. (2011) · International Encyclopedia of Statistical Science · doi:10.1007/978-3-642-04898-2_387 · Cited by 546
An Introduction to Computerized Experience Sampling in Psychology
Barrett, L. F., & Barrett, D. J. (2001) · Social Science Computer Review · doi:10.1177/089443930101900204 · Cited by 421
Experience Sampling Methods: A Modern Idiographic Approach to Personality Research
Conner, T. S., Tennen, H., Fleeson, W., & Barrett, L. F. (2009) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2009.00170.x · Cited by 315
The sampling of experiences in situ
Hormuth, S. E. (1986) · Journal of Personality · doi:10.1111/j.1467-6494.1986.tb00395.x · Cited by 294
Berkman, E. T., Falk, E. B., & Lieberman, M. D. (2011) · Psychological Science · doi:10.1177/0956797611400918 · Cited by 209
Hofmann, W., Finkel, E. J., & Fitzsimons, G. M. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000020 · Cited by 104
Self-citationBerkman, E. T., Dickenson, J., Falk, E. B., & Lieberman, M. D. (2011) · Health Psychology · doi:10.1037/a0022201 · Cited by 85
Effects of Intensive Mobile Happiness Reporting in Daily Life
Conner, T. S., & Reid, K. A. (2012) · Social Psychological and Personality Science · doi:10.1177/1948550611419677 · Cited by 76
Psychometric properties of a computerized mobile phone method for assessing mood in daily life
Courvoisier, D. S., Eid, M., Lischetzke, T., & Schreiber, W. H. (2010) · Emotion · doi:10.1037/a0017813 · Cited by 56
Palm or Cell? Comparing Personal Digital Assistants and Cell Phones for Experience Sampling Research
Burgin, C. J., Silvia, P. J., Eddington, K. M., & Kwapil, T. R. (2013) · Social Science Computer Review · doi:10.1177/0894439312441577 · Cited by 31
Cited by
Milyavskaya, M., Inzlicht, M., Hope, N., & Koestner, R. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000045 · Cited by 313
Lab And/Or Field? Measuring Personality Processes and Their Social Consequences
Wrzus, C., & Mehl, M. R. (2015) · European Journal of Personality · doi:10.1002/per.1986 · Cited by 200
Reinecke, L., & Hofmann, W. (2016) · Human Communication Research · doi:10.1111/hcre.12082 · Cited by 160
Self-citationMedin, D., Ojalehto, B., Marin, A., & Bang, M. (2017) · Nature Human Behaviour · doi:10.1038/s41562-017-0088 · Cited by 146
Users of the main smartphone operating systems (iOS, Android) differ only little in personality
Götz, F. M., Stieger, S., & Reips, U.-D. (2017) · PLOS ONE · doi:10.1371/journal.pone.0176921 · Cited by 127
Metadata
- Authors
- Hofmann, W., & Patel, P. V.
- Venue
- Social Science Computer Review
- Publisher
- SAGE Publications
- Published
- 2014-03-24
- Volume
- 33
- Issue
- 2
- Pages
- 235-253
- ISSN
- 0894-4393 (ISSN-L)
- 1552-8286
- OpenAlex
- W2154039829
- Cited by
- 255
- References
- 23
- FWCI
- 22.62
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.