The feasibility of using cellular phones to collect ecological momentary assessment data: Application to alcohol consumption.
Abstract
The limitations of paper-and-pencil self-monitoring (PM) are leading to the use of more sophisticated techniques. PM was compared with cellular phone monitoring (CM) to collect ecological momentary assessment data on alcohol use. Twenty social drinkers were randomly assigned to the 2 groups, and their drinking was monitored for 14 days. PM participants recorded data on cards. CM participants carried telephones and responded to an interactive voice response system. The authors found few significant group differences in alcohol use, compliance with the self-monitoring, and satisfaction. However, CM had useful advantages, including instantaneous entry of data into a central database, date and time stamping of data, and easy integration into daily life. Although preliminary, this study suggests that CM is a promising alternative to PM.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The sample size for usability testing was based on previously published development and feasibility studies testing mobile phone technology to promote behavior change.
“The sample size was based on previously published development and feasibility studies testing mobile phone technology to promote behavior change [39,40].”
Cited by
Sorted by citations
Patrick, K., Griswold, W. G., Raab, F., & Intille, S. S. (2008) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2008.05.001 · Cited by 479 · see citing works
HAPPINESS ECONOMICS FROM 35 000 FEET
MacKerron, G. (2012) · Journal of Economic Surveys · doi:10.1111/j.1467-6419.2010.00672.x · Cited by 320 · see citing works
Proudfoot, J., Parker, G., Hadzi Pavlovic, D., Manicavasagar, V., Adler, E., & Whitton, A. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1475 · Cited by 274 · see citing works
“Mobile phones have been used for monitoring within behavioral health applications such as alcohol consumption [5] and gambling [6].”
MethodMobile mental health: Review of the emerging field and proof of concept study
Harrison, V., Proudfoot, J., Wee, P. P., Parker, G., Pavlovic, D. H., & Manicavasagar, V. (2011) · Journal of Mental Health · doi:10.3109/09638237.2011.608746 · Cited by 267 · see citing works
“Mobile phones have also been used effectively in lifestyle interventions, such as for the reduction of alcohol consumption (Collins et al., 2003), smoking (Bramley et al.”
MethodMoore, R. C., Depp, C. A., Wetherell, J. L., & Lenze, E. J. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.01.011 · Cited by 274 · see citing works
“Measurement error known to be associated with traditional paper-and-pencil measures can result in low assay sensitivity and potentially smaller intervention effect sizes of clinical trials (Cain et al., 2009; Collins et al., 2003; Slater and Bick, 1994).”
BackgroundTsai, C. C., Lee, G., Raab, F., Norman, G. J., Sohn, T. Y., Griswold, W. G., & Patrick, K. (2007) · Mobile Networks and Applications · doi:10.1007/s11036-007-0014-4 · Cited by 267 · see citing works
Clinical and laboratory assessment of the subjective experience of drug craving
Rosenberg, H. (2009) · Clinical Psychology Review · doi:10.1016/j.cpr.2009.06.002 · Cited by 251 · see citing works
“Ecological momentary assessment devices used to assess craving in natural settings (e.g., Collins et al., 2003; Freedman et al., 2006; Shiffman et al., 1997) could be employed to compare the subjective experience of craving within subjects across different clinical, laboratory and real-life…”
BackgroundA lifespan view of anxiety disorders
Lenze, E. J., & Wetherell, J. L. (2011) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2011.13.4/elenze · Cited by 227 · see citing works
Mobile phone-based interventions for smoking cessation
Whittaker, R., Borland, R., Bullen, C., Lin, R. B., McRobbie, H., & Rodgers, A. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006611.pub2 · Cited by 196 · see citing works
Cell phones for ecological momentary assessment with cocaine-addicted homeless patients in treatment
Freedman, M. J., Lester, K. M., McNamara, C. L., Milby, J. B., & Schumacher, J. E. (2006) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2005.10.005 · Cited by 168 · see citing works
“This result compares favorably with many studies using EMA that have timed their assessments for waking hours only (Collins et al., 2003; Litt et al., 1998; Shiffman et al., 2002, 1996).”
ResultBauer, S., Golkaramnay, V., & Kordy, H. (2004) · Psychotherapeut · doi:10.1007/s00278-004-0403-0 · Cited by 144 · see citing works
μEMA: Microinteraction-based ecological momentary assessment (EMA) using a smartwatch
Intille, S., Haynes, C., Maniar, D., Ponnada, A., & Manjourides, J. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2971648.2971717 · Cited by 130 · see citing works
Mobile health monitoring for the elderly: Designing for diversity
Lorenz, A., & Oppermann, R. (2008) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2008.09.010 · Cited by 135 · see citing works
“Other examples include an alcohol consumption monitor where electronic and paper monitoring were compared [9] and a dietary advisor [10].”
Reid, S. C., Kauer, S. D., Dudgeon, P., Sanci, L. A., Shrier, L. A., & Patton, G. C. (2009) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-008-0455-5 · Cited by 122 · see citing works
“Whilst some research has captured MS data by calling participants on their mobile phones and used either automated interactive voice response systems to conduct interviews [3] or researcher-lead interviews over the phone [1], to date mobile phones have not been used in any study as an electronic means of gathering MS…”
BackgroundPosadzki, P., Mastellos, N., Ryan, R. E., Gunn, L. H., Felix, L. M., Pappas, Y., Gagnon, M., Julious, S. A., Xiang, L., Oldenburg, B. F., et al. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009921.pub2 · Cited by 132 · see citing works
Internet use and multitasking among older adolescents: An experience sampling approach
Moreno, M. A., Jelenchick, L. A., Koff, R. N., Eikoff, J. C., Diermyer, C., & Christakis, D. (2012) · Computers in Human Behavior · doi:10.1016/j.chb.2012.01.016 · Cited by 128 · see citing works
Chung, T., & Maisto, S. A. (2006) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.11.004 · Cited by 127 · see citing works
Alessi, S. M., & Petry, N. (2013) · Addiction · doi:10.1111/add.12093 · Cited by 118 · see citing works
“There is precedence for asking social drinkers to respond to four random prompts daily to complete Interactive Voice Response (IVR) surveys for 14 days, with 92% adherence [26], and for asking smokers trying to quit to respond to four random prompts daily to complete surveys via palmtop computers for one week, with 78…”
BackgroundBauer, S., de Niet, J. E., Timman, R., & Kordy, H. (2010) · Patient Education and Counseling · doi:10.1016/j.pec.2010.03.014 · Cited by 122 · see citing works
Conceptual, methodological, and analytical issues in the study of relapse
McKay, J. R., Franklin, T. R., Patapis, N. S., & Lynch, K. G. (2005) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.11.002 · Cited by 115 · see citing works
“A recent report (Collins et al., 2003) describes a pilot study that seeks to combine IVR and EMA approaches, capitalizing on complementary strengths of each approach.”
BackgroundDulin, P. L., Gonzalez, V. M., & Campbell, K. (2013) · Substance Abuse · doi:10.1080/08897077.2013.821437 · Cited by 110 · see citing works
“(13) Research specific to mobile health alcohol intervention suggests that participants used cell phones in a manner consistent with the instructions and appeared to record drinking episodes when they actually took place, demonstrating that such systems can collect valid data.(14) Participant-rated usability of such d…”
BackgroundSpook, J. E., Paulussen, T. G., Kok, G., & van Empelen, P. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2617 · Cited by 104 · see citing works
“With the increasing popularity of smartphones, recent studies have indicated the usefulness of mobile-based Ecological Momentary Assessment (mEMA) [12-19].”
Therapeutic applications of the mobile phone
Preziosa, A., Grassi, A., Gaggioli, A., & Riva, G. (2009) · British Journal of Guidance and Counselling · doi:10.1080/03069880902957031 · Cited by 107 · see citing works
“These preliminary studies suggest that the use of mobile phones for assessment is a promising alternative to traditional self-monitoring procedures (Barrett & Feldman Barrett, 2001; Chen, 2006; Collins, Kashdan, & Gollnisch 2003; Green, Rafaeli, Bolger, Shrout, & Reis, 2006).”
BackgroundMonk, R. L., Heim, D., Qureshi, A., & Price, A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0126209 · Cited by 103 · see citing works
Hicks, J., Ramanathan, N., Kim, D., Monibi, M., Selsky, J., Hansen, M. H., & Estrin, D. L. (2010) · Wireless Health · doi:10.1145/1921081.1921087 · Cited by 106 · see citing works
“data collection to contact participants who are failing to call in and by handing out mobiles to facilitate the ease of calling in [3].”
BackgroundTechnological adjuncts to enhance current psychotherapy practices: a review
Clough, B. A., & Casey, L. M. (2011) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.12.008 · Cited by 103 · see citing works
Development and feasibility testing of a smart phone based attentive eating intervention
Robinson, E., Higgs, S., Daley, A. J., Jolly, K., Lycett, D., Lewis, A., & Aveyard, P. (2013) · BMC Public Health · doi:10.1186/1471-2458-13-639 · Cited by 99 · see citing works
“The sample size was based on published feasibility studies testing mobile phone technology to promote behavioral change [13,14].”
Simpson, T. L., Kivlahan, D. R., Bush, K. R., & McFall, M. (2005) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2005.02.001 · Cited by 96 · see citing works
Individual Differences and Differential Psychology
Revelle, W., Wilt, J. A., & Condon, D. M. (2011) · Wiley eBooks · doi:10.1002/9781444343120.ch1 · Cited by 93 · see citing works
Short Message Service (SMS) Technology in Alcohol Research--A Feasibility Study
Kuntsche, E. N., & Robert, B. (2009) · Alcohol and Alcoholism · doi:10.1093/alcalc/agp033 · Cited by 89 · see citing works
“Interactive voice response (IVR: Searles et al., 2000; Collins et al., 2003), wireless personal digital assistants (PDA: Bolger et al., 2003; LaBrie et al., 2006; Bernhardt et al., 2007) and the Internet (McCabe et al., 2002; Miller et al., 2002; Kypri et al., 2004; Parks et al., 2006; Kuntsche et…”
BackgroundYang, C., Linas, B., Kirk, G., Bollinger, R., Chang, L., Chander, G., Siconolfi, D., Braxton, S., Rudolph, A., & Latkin, C. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4344 · Cited by 73 · see citing works
“…of EMA have shown a high compliance rate among diverse populations, including homeless persons with crack-cocaine addiction [15], heroin and cocaine users in treatment [16], ecstasy users who also engaged in use of alcohol, marijuana, cocaine and hallucinogens [17], and social drinkers [18].”
Social Psychological Methods Outside the Laboratory
Reis, H. T., & Gosling, S. D. (2010) · Wiley eBooks · doi:10.1002/9780470561119.socpsy001003 · Cited by 90 · see citing works
The dynamic relationships of affective synchrony to perceptions of situations
Wilt, J. A., Funkhouser, K., & Revelle, W. (2011) · Journal of Research in Personality · doi:10.1016/j.jrp.2011.03.005 · Cited by 85 · see citing works
“Cell-phones have been used previously to collect experience sampling data, relying on either automated voice-recording or software (Collins et al., 2003; Kauer et al., 2009; Modi and Quittner, 2006; Reid et al., 2008) and freeresponse text-messages (Anhj and Mldrup, 2004; Kuntsche and Robert, 2009).”
MethodJones, A., Tiplady, B., Houben, K., Nederkoorn, C., & Field, M. (2018) · Psychopharmacology · doi:10.1007/s00213-018-4860-5 · Cited by 84 · see citing works
“Future research could ask participants to access the smartphone each time they consume an alcoholic beverage (see Collins et al. 2003).”
BackgroundAssessment of Alcohol Use in the Natural Environment
Piasecki, T. M. (2019) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.13975 · Cited by 83 · see citing works
“…older drinkers have generally reported small delays relative to the target event, with 93 to 95% logging begin-drink reports within 5 minutes of starting to drink, and 48 to 68% logging end-drink reports within 1 minute of finishing the last drink (Collins et al., 1998, 2003; Muraven et al., 2005).”
InfluentialStanesby, O., Labhart, F., Dietze, P., Wright, C. C. J., & Kuntsche, E. N. (2019) · PLoS ONE · doi:10.1371/journal.pone.0218465 · Cited by 81 · see citing works
A Daily Process Approach to Individual Differences in Stress‐Related Alcohol Use
Armeli, S., Todd, M. W., & Mohr, C. D. (2005) · Journal of Personality · doi:10.1111/j.0022-3506.2005.00362.x · Cited by 77 · see citing works
Using Personal Cell Phones for Ecological Momentary Assessment
Kuntsche, E. N., & Labhart, F. (2013) · European Psychologist · doi:10.1027/1016-9040/a000127 · Cited by 65 · see citing works
Social Anxiety and Positive Outcome Expectancies on Risk-Taking Behaviors
Kashdan, T. B., Collins, R. L., & Elhai, J. D. (2006) · Cognitive Therapy and Research · doi:10.1007/s10608-006-9017-x · Cited by 64 · see citing works
“With the use of daily diaries and cellular phones, the frequency, antecedents, and consequences of risky behaviors can be collected unobtrusively in each participant’s natural environment ( Collins, Kashdan, & Gollnisch, 2003 ).”
BackgroundSelf-citationComparisons of alcohol consumption by timeline follow back vs.smartphone-based daily interviews
Dulin, P. L., Alvarado, C. E., Fitterling, J. M., & Gonzalez, V. M. (2016) · Addiction Research & Theory · doi:10.1080/16066359.2016.1239081 · Cited by 65 · see citing works
“A number of studies have shown the utility of cellphone technology for collecting self-report data on alcohol consumption in real time (Collins et al. 2003; Alessi & Petry 2012).”
BackgroundAmlung, M. T., McCarty, K. N., Morris, D. H., Tsai, C., & McCarthy, D. M. (2015) · Addiction · doi:10.1111/add.12897 · Cited by 63 · see citing works
“The brevity of the demand single items makes them particularly amenable to studies using an ecological momentary assessment framework, which would allow for the examination of fluctuations in alcohol motivation outside the laboratory [45-47].”
BackgroundChataway, M. L., Hart, T. C., Coomber, R., & Bond, C. (2017) · Applied Geography · doi:10.1016/j.apgeog.2017.06.010 · Cited by 62 · see citing works
Mood state and gambling: Using mobile telephones to track emotions
Gee, P., Coventry, K. R., & Birkenhead, D. (2005) · British Journal of Psychology · doi:10.1348/000712604x15536 · Cited by 61 · see citing works
Mobile phone technology in chronic disease management
Blake, H. (2008) · Nursing Standard · doi:10.7748/ns.23.12.43.s56 · Cited by 61 · see citing works
“…2004, Wang et al 2006), physical activity (Consolvo et al 2006, Hurling et al 2007), smoking (Lazev et al 2004, Obermayer et al 2004, Bramley et al 2005, Rodgers et al 2005, Vidrine et al 2006a, 2006b), and drug and alcohol consumption (Collins et al 2003, Wilkins et al 2003, Freedman et al 2006).”
BackgroundWilt, J., Oehlberg, K. A., & Revelle, W. (2011) · Personality and Individual Differences · doi:10.1016/j.paid.2010.11.014 · Cited by 75 · see citing works
Evaluation of Spoken Dialogue Technology for Real-Time Health Data Collection
Levin, E., & Levin, A. (2006) · Journal of Medical Internet Research · doi:10.2196/jmir.8.4.e30 · Cited by 54 · see citing works
The feasibility of cell phone based electronic diaries for STI/HIV research
Hensel, D. J., Fortenberry, J. D., Harezlak, J., & Craig, D. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-75 · Cited by 55 · see citing works
“The pervasive use of cell phones and other electronic devices in the study population may make protocol training and data entry easier for participants [29,30].”
BackgroundLee, G., Tsai, C., Griswold, W. G., Raab, F., & Patrick, K. (2006) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1125451.1125645 · Cited by 53 · see citing works
“In [3], Collins et. al. report on the benefits of cell-phone monitoring as substantiated by a comparative study with paper-and-pencil monitoring.”
BackgroundModi, A. C., & Quittner, A. L. (2006) · Children s Health Care · doi:10.1207/s15326888chc3501_4 · Cited by 52 · see citing works
“…(e.g., PalmPilots) have made it possible to collect data from individuals in “real time” on the activities they are engaged in, the frequency and intensity of stressors, and ratings of mood that have spurred new interest in this area (Collins, Kashdan, & Gollnisch, 2003; Stone et al., 1998).”
BackgroundMoss, T. G., Carney, C. E., Haynes, P. L., & Harris, A. L. (2014) · Chronobiology International · doi:10.3109/07420528.2014.956361 · Cited by 47 · see citing works
“Future studies should consider this method, as it would ensure that the timing is correct via a time stamp, data entry would be instant and less vulnerable to inaccurate reporting, and it is easy to integrate into daily life (Collins et al., 2003).”
MethodWray, T. B., Kahler, C. W., & Monti, P. M. (2016) · AIDS and Behavior · doi:10.1007/s10461-015-1272-y · Cited by 51 · see citing works
“Some past studies have reported similar difficulty with comparatively poor response rates for event-contingent assessments of substance use [50, 51].”
ResultThe future is now—using personal cellphones to gather data on substance use and related factors
Kuntsche, E. N., & Labhart, F. (2014) · Addiction · doi:10.1111/add.12540 · Cited by 47 · see citing works
“Over the years, researchers improved diary protocols with (at that time) revolutionary technologies including interactive voice response [7], cellphone text messages (SMS) [8] or hand-held computers (palmtops) [9].”
BackgroundSpeech2Health: A Mobile Framework for Monitoring Dietary Composition From Spoken Data
Hezarjaribi, N., Mazrouee, S., & Ghasemzadeh, H. (2018) · IEEE journal of biomedical and health informatics · doi:10.1109/jbhi.2017.2709333 · Cited by 45 · see citing works
“One of the self-monitoring techniques is the use of pen/pencil and paper diaries [7], [8].”
MethodSleep after Heavy Alcohol Consumption and Physical Activity Levels during Alcohol Hangover
Devenney, L. E., Coyle, K. B., Roth, T. G., & Verster, J. C. (2019) · Journal of Clinical Medicine · doi:10.3390/jcm8050752 · Cited by 46 · see citing works
Garcia, C. M., Hardeman, R. R., Kwon, G., Lando-King, E. A., Zhang, L., Genis, T., Brady, S. S., & Kinder, E. (2014) · JMIR mhealth and uhealth · doi:10.2196/mhealth.2576 · Cited by 43 · see citing works
“Some researchers have reported using cell phones and real time text messaging technology to collect and transmit EMAs about adolescents’ alcohol use (N=26 [7]; N=20 [8]), children’s bleeding episodes (N=104) [9], overweight children’s self-management behaviors (N=141) [10], adolescent health information needs (N=60) […”
BackgroundAn interactive voice response program to reduce drinking relapse: A feasibility study
Mundt, J. C., Moore, H. K., & Bean, P. (2005) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2005.08.010 · Cited by 42 · see citing works
Sullivan, T. P., Armeli, S., Tennen, H. A., Weiss, N. H., & Hansen, N. B. (2019) · The American Journal of Drug and Alcohol Abuse · doi:10.1080/00952990.2019.1624765 · Cited by 42 · see citing works
Weiss, N. H., Brick, L. A. D., Schick, M. R., Forkus, S. R., Raudales, A. M., Contractor, A. A., & Sullivan, T. P. (2022) · Addiction · doi:10.1111/add.15992 · Cited by 39 · see citing works
Ecological momentary assessment in addiction
Lukasiewicz, M., Fareng, M., Benyamina, A., Blecha, L., Reynaud, M., & Falissard, B. (2007) · Expert Review of Neurotherapeutics · doi:10.1586/14737175.7.8.939 · Cited by 37 · see citing works
Sinadinovic, K., Wennberg, P., & Berman, A. H. (2010) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2010.09.004 · Cited by 36 · see citing works
Ponnada, A., Thapa-Chhetry, B., Manjourides, J., & Intille, S. S. (2021) · JMIR mhealth and uhealth · doi:10.2196/23391 · Cited by 34 · see citing works
“The drawback of EMA is participation burden [7-9].”
BackgroundCompliance to Cell Phone-Based EMA Among Latino Youth in Outpatient Treatment
Comulada, W. S., Lightfoot, M. A., Swendeman, D. T., Grella, C. E., & Wu, N. (2015) · Journal of Ethnicity in Substance Abuse · doi:10.1080/15332640.2014.986354 · Cited by 33 · see citing works
Developing smartphone apps for behavioural studies: The AlcoRisk app case study
Smith, A. D. M., de Salas, K., Lewis, I. J., & Schüz, B. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.07.007 · Cited by 32 · see citing works
Use of Novel Technology-Based Techniques to Improve Alcohol-Related Outcomes in Clinical Trials
Gurvich, E. M., Kenna, G. A., & Leggio, L. (2013) · Alcohol and Alcoholism · doi:10.1093/alcalc/agt134 · Cited by 31 · see citing works
“Collins et al. (2003) also demonstrated the feasibility of collecting EMA data on alcohol consumption using cellular phones with an IVR system, which demonstrates the interdependence of both IVR and EMA.”
BackgroundPalm or Cell? Comparing Personal Digital Assistants and Cell Phones for Experience Sampling Research
Burgin, C. J., Silvia, P. J., Eddington, K. M., & Kwapil, T. R. (2012) · Social Science Computer Review · doi:10.1177/0894439312441577 · Cited by 31 · see citing works
Chen, J. A., Fearey, E., & Smith, R. E. (2017) · Journal Of Behavior Therapy And Mental Health · doi:10.14302/issn.2474-9273.jbtm-16-1180 · Cited by 27 · see citing works
Kaplan, B. A., & Koffarnus, M. N. (2019) · Alcohol and Alcoholism · doi:10.1093/alcalc/agz031 · Cited by 27 · see citing works
Turner, C., Coffin, P. O., Santos, D., Huffaker, S., Matheson, T., Euren, J., DeMartini, A., Rowe, C., Batki, S. L., & Santos, G. (2017) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2017.01.007 · Cited by 26 · see citing works
“Although researchers are concerned that compliance with EMA is questionable among substanceusing populations, studies have demonstrated that this is not the case (Yang et al., 2015; Serre et al., 2012; Freedman et al., 2006; Hopper et al. 2006; Collins et al., 2003).”
BackgroundCapturing Affective Experiences using the SMS Experience Sampling (SMS-ES) method
Andrews, L., Russell‐Bennett, R., & Drennan, J. C. (2011) · International Journal of Market Research · doi:10.2501/ijmr-53-4-479-506 · Cited by 24 · see citing works
Coughlin, L., Nahum-Shani, I., Bonar, E., Philyaw-Kotov, M. L., Rabbi, M., Klasnja, P., & Walton, M. (2021) · Substance Use & Misuse · doi:10.1080/10826084.2021.1972314 · Cited by 20 · see citing works
“…and wearables, the use of ecological momentary assessments and daily process measures are increasingly common in substance use research (Cohn et al., 2011; Collins et al., 2003; Fridberg et al., 2019; Heron et al., 2017; Serre et al., 2015; Shiffman, 2009; Stone et al., 2007; Wray et al., 2014).”
MethodBonar, E. E., Cunningham, R. M., Collins, R. L., Cranford, J. A., Chermack, S. T., Zimmerman, M. A., Blow, F. C., & Walton, M. A. (2017) · Addiction Research & Theory · doi:10.1080/16066359.2017.1310205 · Cited by 22 · see citing works
“Few researchers using IVR for substance use data have enrolled youth or emerging adults, with the exception of Collins and colleagues (Collins et al. 2003) who sampled 10 emerging adults.”
BackgroundResultInfluentialSelf-citationA Smartphone App to Assess Alcohol Consumption Behavior: Development, Compliance, and Reactivity
Poulton, A., Pan, J., Bruns, L., Sinnott, R., & Hester, R. (2018) · JMIR mhealth and uhealth · doi:10.2196/11157 · Cited by 22 · see citing works
“Early studies typically featured hand-held electronic devices [6,7] or interactive voice response systems [8,9].”
Cranford, J. A., Tennen, H. A., & Zucker, R. A. (2009) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2009.01115.x · Cited by 21 · see citing works
“Kranzler and colleagues (2004) also found evidence for the effectiveness of automated reminder calls in an IVR study of heavy drinkers, and Corkrey and Parkinson (2002) reviewed several studies showing that automated IVR calls increased appointment rates and treatment compliance (also see Abu-Hasaballah et al.”
BackgroundA Cognitive Behavioral Therapy-Based Text Messaging Intervention for Methamphetamine Dependence
Keoleian, V., Stalcup, S. A., Polcin, D. L., Brown, M. J., & Galloway, G. P. (2013) · Journal of Psychoactive Drugs · doi:10.1080/02791072.2013.847995 · Cited by 21 · see citing works
Lauckner, C., Taylor, E. W., Patel, D., & Whitmire, A. (2019) · Addiction Science & Clinical Practice · doi:10.1186/s13722-019-0174-0 · Cited by 21 · see citing works
Mays, D. M., Cremeens, J. L., Usdan, S., Martin, R. J., Arriola, K. J., & Bernhardt, J. M. (2010) · Health Education Journal · doi:10.1177/0017896910364831 · Cited by 20 · see citing works
Thatte, G., Li, M., Lee, S., Emken, A., Narayanan, S. S., Mitra, U., Spruijt‐Metz, D., & Annavaram, M. (2012) · ACM Transactions on Embedded Computing Systems · doi:10.1145/2331147.2331158 · Cited by 20 · see citing works
“Recent studies have demonstrated the efficacy of mobile phones for monitoring alcohol abuse [Collins et al. 2003] and controlling tobacco [Rodgers et al.”
BackgroundChataway, M., Hart, T. C., & Bond, C. E. W. (2019) · Australian & New Zealand Journal of Criminology · doi:10.1177/0004865819836153 · Cited by 19 · see citing works
Kawakyu, N., Nduati, R., Munguambe, K., Coutinho, J., Mburu, N., DeCastro, G., Inguane, C., Zunt, A., Abburi, N., Sherr, K., et al. (2019) · JMIR mHealth and uHealth · doi:10.2196/13963 · Cited by 19 · see citing works
“The sample size was based on previously published development and feasibility studies testing mobile phone technology to promote behavior change [39,40].”
Space and Place in Alcohol Research
Mair, C., Frankeberger, J., Gruenewald, P. J., Morrison, C. N., & Freisthler, B. (2019) · Current Epidemiology Reports · doi:10.1007/s40471-019-00215-3 · Cited by 20 · see citing works
Galloway, G. P., Didier, R. A., Garrison, K. J., & Mendelson, J. E. (2008) · Substance Abuse Research and Treatment · doi:10.4137/sart.s428 · Cited by 18 · see citing works
“While both methods produced similar adherence rates, confi dence in IVR data was higher due to the ability to verify data entry date and time [5].”
Alcohol Use and Alcohol Use Disorders
Sher, K. J., Talley, A. E., Littlefield, A. K., & Martinez, J. A. (2012) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780195342819.013.0028 · Cited by 21 · see citing works
Feasibility and Utility of Momentary Sampling of Sex Events in Young Couples
Sunner, L. E., Walls, C. E., Blood, E., et al. (2012) · The Journal of Sex Research · doi:10.1080/00224499.2012.674574 · Cited by 16 · see citing works
Utility of ecological momentary assessments to collect data on fear of crime
Irvin-Erickson, Y., Malik, A. A., Kamiran, F., et al. (2020) · International Journal of Comparative and Applied Criminal Justice · doi:10.1080/01924036.2020.1719532 · Cited by 16 · see citing works
Mobile Phones in Data Collection
Şahin, F., & Yan, Z. (2013) · International Journal of Cyber Behavior Psychology and Learning · doi:10.4018/ijcbpl.2013070106 · Cited by 16 · see citing works
Visual Data Mining With Self-organizing Maps for “Self-monitoring” Data Analysis
Oliver, E., Vallés-Ṕerez, I., Baños, R., et al. (2016) · Sociological Methods & Research · doi:10.1177/0049124116661576 · Cited by 14 · see citing works
“A consistent relationship has been found between self-register adherence and success in both losing weight and maintaining weight loss (Baker and Kirschenbaum 1998; Collins, Kashdan, and Gollnish 2003).”
BackgroundUse of Real‐Time Interactive Voice Response in a Study of Stress and Alcohol Consumption
Andersson, C. R., Gordh, A. S., & Berglund, M. (2007) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2007.00520.x · Cited by 14 · see citing works
Tsai, C. C., Lee, G., Raab, F., Norman, G. J., Sohn, T. Y., Griswold, W. G., & Patrick, K. (2006) · doi:10.1109/pcthealth.2006.361659 · Cited by 13 · see citing works
“who compared the benefits of mobile phone monitoring versus paper-and-pencil monitoring of alcohol consumption [13].”
BackgroundShacham, E., Lew, D., Xiao, T., López, J. D., Trull, T. J., Schootman, M., & Presti, R. M. (2019) · AIDS and Behavior · doi:10.1007/s10461-018-2378-9 · Cited by 13 · see citing works
Maisto, S. A., Xie, F. C., Witkiewitz, K. A., Ewart, C. K., Connors, G. J., Hongtu Zhu, B., Elder, G. J., Ditmar, M., & Chow, S. (2017) · Journal of Social and Clinical Psychology · doi:10.1521/jscp.2017.36.3.238 · Cited by 13 · see citing works
Mobile diaries – Benchmark against metered measurements: An empirical investigation
Lovett, M. J., & Peres, R. (2018) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2018.01.002 · Cited by 13 · see citing works
Faceit: supporting reflection upon social anxiety events with lifelogging
Rennert, K., & Karapanos, E. (2013) · CHI Extended Abstracts · doi:10.1145/2468356.2468437 · Cited by 19 · see citing works
“Many patients fail to return accurate and useful monitoring data to their therapists [5, 6] as they have a hard time committing to logging occurrences on a daily or regular basis [2].”
BackgroundWeiss, N. H., Brick, L. A. D., Forkus, S. R., Goldstein, S. C., Thomas, E. D., Schick, M. R., Barnett, N. P., Contractor, A. A., & Sullivan, T. P. (2022) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.14881 · Cited by 12 · see citing works
TelEMA: a low-cost and user-friendly telephone assessment platform
Fernandez, K. C., Johnson, M. R., & Rodebaugh, T. L. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0287-9 · Cited by 12 · see citing works
“An IVR system uses a central computer that is programmed to send and receive telephone calls and administer verbal interviews or collect other forms of information (Collins et al., 2003).”
BackgroundS2NI: A mobile platform for nutrition monitoring from spoken data
Hezarjaribi, N., Reynolds, C. A., Miller, D. T., Chaytor, N. S., & Ghasemzadeh, H. G. (2016) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2016.7591115 · Cited by 12 · see citing works
Kotani, K., Morii, M., Asai, Y., et al. (2005) · Australian Journal of Rural Health · doi:10.1111/j.1440-1854.2005.00682.x · Cited by 11 · see citing works
Acceptability of ecological momentary assessment among young men who have sex with men
Duncan, D. T., Kapadia, F., Kirchner, T., et al. (2017) · Journal of LGBT Youth · doi:10.1080/19361653.2017.1365038 · Cited by 8 · see citing works
History of Substance Abuse Research in the United States
VanGeest, J. B., Johnson, T. P., & Alemagno, S. A. (2017) · Springer eBooks · doi:10.1007/978-3-319-55980-3_1 · Cited by 7 · see citing works
Perfect for a Gin and Tonic: How Context Drives Consumption Within a Modified Bogus Taste Test
Monk, R. L., Qureshi, A., McNeill, A. M., Erskine-Shaw, M., & Heim, D. (2017) · Alcohol and Alcoholism · doi:10.1093/alcalc/agx084 · Cited by 7 · see citing works
Weiss, N. H., Raudales, A. M., Contractor, A. A., Forkus, S. R., Kiefer, R., Brick, L. A. D., & Sullivan, T. P. (2023) · Journal of Emotion and Psychopathology · doi:10.55913/joep.v1i1.23 · Cited by 6 · see citing works
“First, though acceptable, survey compliance was slightly lower than other studies using ESM (Collins et al., 2003; Searles et al., 2002; Searles et al., 1995).”
- Authors
- Collins, R. L., Kashdan, T. B., & Gollnisch, G.
- Affiliations
- University at Buffalo, State University of New York (US)
- ORCID
- Kashdan, Todd B.
- Venue
- Experimental and Clinical Psychopharmacology
- Published
- 2003-02
- Volume
- 11
- Issue
- 1
- Pages
- 73-78
- ISSN
- 1064-1297 (ISSN-L)
- 1936-2293
- OpenAlex
- W2124478199
- Cited by
- 185
- References
- 0
- Citations by year
- 2026: 3 · 2025: 4 · 2024: 1 · 2023: 5 · 2022: 5 · 2021: 5 · 2020: 3 · 2019: 13 · 2018: 5 · 2017: 15 · 2016: 12 · 2015: 5 · 2014: 8 · 2013: 14 · 2012: 19
- FWCI
- 10.52
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Experimental and Clinical Psychopharmacology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- U.S. Public Health Service (R01-07595)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- ecological momentary assessment, alcohol consumption, self-monitoring, interactive voice response, compliance, participant satisfaction, social drinkers, data collection feasibility
- MeSH terms
- Adult, Alcohol Drinking, Consumer Behavior, Data Collection, Feasibility Studies, Female, Humans, Male, Marijuana Smoking, Surveys and Questionnaires, Smoking, Social Environment, Cell Phone
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review