Patient compliance with paper and electronic diaries
Abstract
Paper diaries are commonly used in health care and clinical research to assess patient experiences. There is concern that patients do not comply with diary protocols, possibly invalidating the benefit of diary data. Compliance with paper diaries was examined with a paper diary and with an electronic diary that incorporated compliance-enhancing features. Participants were chronic pain patients and they were assigned to use either a paper diary instrumented to track diary use or an electronic diary that time-stamped entries. Participants were instructed to make three pain entries per day at predetermined times for 21 consecutive days. Primary outcome measures were reported vs actual compliance with paper diaries and actual compliance with paper diaries (defined by comparing the written times and the electronically-recorded times of diary use). Actual compliance was recorded by the electronic diary. Participants submitted diary cards corresponding to 90% of assigned times (+/-15 min). However, electronic records indicated that actual compliance was only 11%, indicating a high level of faked compliance. On 32% of all study days the paper diary binder was not opened, yet reported compliance for these days exceeded 90%. For the electronic diary, the actual compliance rate was 94%. In summary, participants with chronic pain enrolled in a study for research were not compliant with paper diaries but were compliant with an electronic diary with enhanced compliance features. The finding…
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Participants in diary studies often claim to be recording their activities on a regular basis even though such consistency may not be the case.
“Participants in diary studies often claim to be recording their activities on a regular basis even though such consistency may not be the case (Stone et al. 2003).”
From Company–Community Logging Contracts in Amazonian Settlements: Impacts on Livelihoods and NTFP Harvests (2009) · cites this paper as Stone et al. 2003
Cites
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454 · see citing works
Self-citationBehavioral and Pharmacological Therapies for Late-Life Insomnia: A Randomized Controlled Trial
Morin, C. M., Colecchi, C., Stone, J., Sood, R., & Brink, D. (1999) · JAMA · doi:10.1001/jama.281.11.991 · Cited by 1,095 · see citing works
Patient non-compliance with paper diaries
Stone, A. A., Shiffman, S., Schwartz, J. E., Broderick, J. E., & Hufford, M. R. (2002) · BMJ · doi:10.1136/bmj.324.7347.1193 · Cited by 810 · see citing works
Self-citationReliability of blood glucose monitoring by patients with diabetes mellitus
Mazze, R. S., Shamoon, H., Pasmantier, R., Lucido, D., Murphy, J., Hartmann, K., Kuykendall, V., & Lopatin, W. (1984) · The American Journal of Medicine · doi:10.1016/0002-9343(84)90693-4 · Cited by 261 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454 · see citing works
Self-citationMcGrath, P. J., Walco, G. A., Turk, D. C., Dworkin, R. H., Brown, M. T., Davidson, K., Eccleston, C., Finley, G. A., Goldschneider, K., Haverkos, L., et al. (2008) · The Journal of Pain · doi:10.1016/j.jpain.2008.04.007 · Cited by 851 · see citing works
Experience sampling research in psychopathology: opening the black box of daily life
Myin-Germeys, I., Oorschot, M., Collip, D., Lataster, J., Delespaul, P., & van Os, J. (2009) · Psychological Medicine · doi:10.1017/s0033291708004947 · Cited by 817 · see citing works
Design of Treatment Trials for Functional Gastrointestinal Disorders
Irvine, E. J., Tack, J., Crowell, M. D., Gwee, K. A., Ke, M., Schmulson, M. J., Whitehead, W. E., & Spiegel, B. (2016) · Gastroenterology · doi:10.1053/j.gastro.2016.02.010 · Cited by 550 · see citing works
Quantitative wearable sensors for objective assessment of Parkinson's disease
Maetzler, W., Domingos, J., Srulijes, K., Ferreira, J. J., & Bloem, B. R. (2013) · Movement Disorders · doi:10.1002/mds.25628 · Cited by 374 · see citing works
Assessment of Psychosocial and Functional Impact of Chronic Pain
Turk, D. C., Fillingim, R. B., Ohrbach, R., & Patel, K. V. (2016) · The Journal of Pain · doi:10.1016/j.jpain.2016.02.006 · Cited by 350 · see citing works
Wen, C. K. F., Schneider, S., Stone, A. A., & Spruijt-Metz, D. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6641 · Cited by 350 · see citing works
Self-citationBeinart, N. A., Goodchild, C. E., Weinman, J. A., Ayis, S., & Godfrey, E. L. (2013) · The Spine Journal · doi:10.1016/j.spinee.2013.08.027 · Cited by 294 · see citing works
James, E. L., Lau-Zhu, A., Clark, I. A., Visser, R. M., Hagenaars, M. A., & Holmes, E. A. (2016) · Clinical Psychology Review · doi:10.1016/j.cpr.2016.04.010 · Cited by 300 · see citing works
Experience sampling research in individuals with mental illness: reflections and guidance
Palmier-Claus, J. E., Myin-Germeys, I., Barkus, E., Bentley, L., Udachina, A., Delespaul, P. A. E. G., Lewis, S. W., & Dunn, G. (2011) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2010.01596.x · Cited by 287 · see citing works
Glaser, J.-P., van Os, J., Portegijs, P. J. M., & Myin-Germeys, I. (2006) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2006.04.014 · Cited by 280 · see citing works
Mobile mental health: Review of the emerging field and proof of concept study
Harrison, V., Proudfoot, J., Wee, P. P., Parker, G., Pavlovic, D. H., & Manicavasagar, V. (2011) · Journal of Mental Health · doi:10.3109/09638237.2011.608746 · Cited by 267 · see citing works
Wearable devices in clinical trials: hype and hypothesis
Izmailova, E. S., Wagner, J. A., & Perakslis, E. D. (2018) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.966 · Cited by 265 · see citing works
Burke, L. E., Shiffman, S., Music, E., Styn, M. A., Kriska, A., Smailagic, A., Siewiorek, D., Ewing, L. J., Chasens, E., French, B., et al. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7138 · Cited by 267 · see citing works
Self-citationEcological momentary assessment methodology in chronic pain research: a systematic review
May, M., Junghaenel, D. U., Ono, M., Stone, A. A., & Schneider, S. (2018) · The Journal of Pain · doi:10.1016/j.jpain.2018.01.006 · Cited by 247 · see citing works
Self-citationEffect of insomnia treatments on depression: A systematic review and meta-analysis
Gebara, M. A., Siripong, N., DiNapoli, E. A., Maree, R. D., Germain, A., Reynolds, C. F., Kasckow, J. W., Weiss, P. M., & Karp, J. F. (2018) · Depression and Anxiety · doi:10.1002/da.22776 · Cited by 247 · see citing works
Faurholt-Jepsen, M., Frost, M., Ritz, C., Christensen, E. M., Jacoby, A. S., Mikkelsen, R. L., Knorr, U., Bardram, J. E., Vinberg, M., & Kessing, L. V. (2015) · Psychological Medicine · doi:10.1017/s0033291715000410 · Cited by 213 · see citing works
Reliability, validity and sensitivity of a computerized visual analog scale measuring state anxiety
Abend, R., Dan, O., Maoz, K., Raz, S., & Bar-Haim, Y. (2014) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2014.06.004 · Cited by 217 · see citing works
Interventions for enhancing adherence with physiotherapy: A systematic review
McLean, S. M., Burton, M., Bradley, L., & Littlewood, C. (2010) · Manual Therapy · doi:10.1016/j.math.2010.05.012 · Cited by 204 · see citing works
Ethical issues in electronic health records: A general overview
Jamshed, N., Ozair, F., Sharma, A., & Aggarwal, P. (2015) · Perspectives in Clinical Research · doi:10.4103/2229-3485.153997 · Cited by 211 · see citing works
Lane, S. J., Heddle, N. M., Arnold, E., & Walker, I. (2006) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-6-23 · Cited by 208 · see citing works
Use of ecological momentary assessment in mood disorders research
Wenze, S. J., & Miller, I. W. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.06.007 · Cited by 205 · see citing works
Dale, O., & Hagen, K. B. (2007) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.04.005 · Cited by 191 · see citing works
Stress and sleep duration predict headache severity in chronic headache sufferers
Houle, T. T., Butschek, R. A., Turner, D. P., Smitherman, T. A., Rains, J. C., & Penzien, D. B. (2012) · Pain · doi:10.1016/j.pain.2012.08.014 · Cited by 188 · see citing works
Van Rhoon, L., Byrne, M., Morrissey, E., Murphy, J., & McSharry, J. (2020) · DIGITAL HEALTH · doi:10.1177/2055207620914427 · Cited by 182 · see citing works
Yon, B. A., Johnson, R. K., Harvey-Berino, J., Gold, B. C., & Howard, A. B. (2007) · Journal of Behavioral Medicine · doi:10.1007/s10865-006-9092-1 · Cited by 175 · see citing works
Self-Monitoring Dietary Intake: Current and Future Practices
Burke, L. E., Warziski, M., Starrett, T., Choo, J., Music, E., Sereika, S., Stark, S., & Sevick, M. A. (2005) · Journal of Renal Nutrition · doi:10.1016/j.jrn.2005.04.002 · Cited by 172 · see citing works
Don't Miss the Moment: A Systematic Review of Ecological Momentary Assessment in Suicide Research
Kivelä, L., van der Does, W. A. J., Riese, H., & Antypa, N. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.876595 · Cited by 163 · see citing works
Courvoisier, D. S., Eid, M., & Lischetzke, T. (2012) · Psychological Assessment · doi:10.1037/a0026733 · Cited by 153 · see citing works
Development of a smartphone application for eating disorder self‐monitoring
Tregarthen, J. P., Lock, J., & Darcy, A. M. (2015) · International Journal of Eating Disorders · doi:10.1002/eat.22386 · Cited by 152 · see citing works
Text4Diet: A randomized controlled study using text messaging for weight loss behaviors
Shapiro, J. R., Koro, T., Doran, N., Thompson, S., Sallis, J. F., Calfas, K., & Patrick, K. (2012) · Preventive Medicine · doi:10.1016/j.ypmed.2012.08.011 · Cited by 151 · see citing works
Using e-technologies in clinical trials
Rosa, C., Campbell, A. N. C., Miele, G. M., Brunner, M., & Winstanley, E. L. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2015.07.007 · Cited by 147 · see citing works
Reid, S. C., Kauer, S. D., Dudgeon, P., Sanci, L. A., Shrier, L. A., & Patton, G. C. (2009) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-008-0455-5 · Cited by 122 · see citing works
Using instrumented paper diaries to document self-monitoring patterns in weight loss
Burke, L. E., Sereika, S. M., Music, E., Warziski, M., Styn, M. A., & Stone, A. (2008) · Contemporary Clinical Trials · doi:10.1016/j.cct.2007.07.004 · Cited by 129 · see citing works
Self-citationProudfoot, J. (2013) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867412471441 · Cited by 126 · see citing works
Feasibility and validity of ecological momentary assessment in the investigation of suicide risk
Husky, M., Olié, E., Guillaume, S., Genty, C., Swendsen, J., & Courtet, P. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.08.019 · Cited by 124 · see citing works
Johnson, E. I., Grondin, O., Barrault, M., Faytout, M., Helbig, S., Husky, M., Granholm, E. L., Loh, C., Nadeau, L., Wittchen, H., et al. (2009) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.276 · Cited by 122 · see citing works
Nair, S. G., Adams-Deutsch, T., Epstein, D. H., & Shaham, Y. (2009) · Progress in Neurobiology · doi:10.1016/j.pneurobio.2009.05.003 · Cited by 112 · see citing works
Ecological momentary assessment is a neglected methodology in suicidology
Davidson, C. L., Anestis, M. D., & Gutierrez, P. M. (2017) · Archives of Suicide Research · doi:10.1080/13811118.2015.1004482 · Cited by 108 · see citing works
Effect of isometric exercise and body scanning on cigarette cravings and withdrawal symptoms
Ussher, M., Cropley, M., Playle, S., Mohidin, R., & West, R. (2009) · Addiction · doi:10.1111/j.1360-0443.2009.02605.x · Cited by 110 · see citing works
Conley, C. S., Durlak, J. A., Shapiro, J. B., Kirsch, A. C., & Zahniser, E. (2016) · Prevention Science · doi:10.1007/s11121-016-0662-3 · Cited by 110 · see citing works
Moskowitz, D. S., Russell, J. J., Sadikaj, G., & Sutton, R. (2009) · Canadian Psychology / Psychologie canadienne · doi:10.1037/a0016625 · Cited by 103 · see citing works
Performance of health status measures with a pen based personal digital assistant
Kvien, T. K., Mowinckel, P., Heiberg, T., Dammann, K. L., Dale, Ø., Aanerud, G. J., Alme, T. N., & Uhlig, T. (2005) · Annals of the Rheumatic Diseases · doi:10.1136/ard.2004.030437 · Cited by 92 · see citing works
Zadro, J. R., Shirley, D., Simic, M., Mousavi, S. J., Ceprnja, D., Maka, K., Sung, J., & Ferreira, P. (2019) · Physical Therapy · doi:10.1093/ptj/pzy112 · Cited by 94 · see citing works
Daily pain variations among patients with hand, hip, and knee osteoarthritis
Allen, K. D., Coffman, C. J., Golightly, Y. M., Stechuchak, K. M., & Keefe, F. J. (2009) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2009.03.021 · Cited by 92 · see citing works
Axelson, D. A., Bertocci, M. A., Lewin, D. S., Trubnick, L. S., Birmaher, B., Williamson, D. E., Ryan, N. D., & Dahl, R. E. (2003) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/104454603322572589 · Cited by 91 · see citing works
Garcia‐Palacios, A., Herrero, R., Belmonte, M. A., Castilla, D., Guixeres, J., Molinari, G., Baños, R. M., & Botella, C. (2014) · European Journal of Pain · doi:10.1002/j.1532-2149.2013.00425.x · Cited by 90 · see citing works
Wearables in epilepsy and Parkinson's disease—A focus group study
Ozanne, A., Johansson, D., Hällgren Graneheim, U., Malmgren, K., Bergquist, F., & Alt Murphy, M. (2018) · Acta Neurologica Scandinavica · doi:10.1111/ane.12798 · Cited by 87 · see citing works
Thompson, E. L., Broadbent, J., Bertino, M. D., & Staiger, P. K. (2016) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000235 · Cited by 84 · see citing works
Shay, L. E., Seibert, D., Watts, D., Sbrocco, T., & Pagliara, C. (2009) · Eating Behaviors · doi:10.1016/j.eatbeh.2009.07.004 · Cited by 68 · see citing works
The role of experiential avoidance in paranoid delusions: an experience sampling study.
Udachina, A., Varese, F., Myin‐Germeys, I., & Bentall, R. P. (2014) · British Journal of Clinical Psychology · doi:10.1111/bjc.12054 · Cited by 66 · see citing works
Digitally Enabled, Patient‐Centric Clinical Trials: Shifting the Drug Development Paradigm
Dockendorf, M. F., Hansen, B. J., Bateman, K. P., Moyer, M., Shah, J. K., & Shipley, L. A. (2021) · Clinical and Translational Science · doi:10.1111/cts.12910 · Cited by 67 · see citing works
Mera, T. O., Burack, M. A., & Giuffrida, J. P. (2013) · Journal of Parkinson’s Disease · doi:10.3233/jpd-120166 · Cited by 66 · see citing works
“A movement threshold was calculated from trials in which the clinician mAIMS score and tremor score calculated using a previously validated algorithm [16] were both less than 0.”
Computerized ambulatory monitoring in mood disorders: Feasibility, compliance, and reactivity
Husky, M. M., Gindre, C., Mazure, C. M., Brebant, C., Nolen-Hoeksema, S., Sanacora, G., & Swendsen, J. (2010) · Psychiatry Research · doi:10.1016/j.psychres.2010.04.045 · Cited by 62 · see citing works
Psychometric properties of a computerized mobile phone method for assessing mood in daily life
Courvoisier, D. S., Eid, M., Lischetzke, T., & Schreiber, W. H. (2010) · Emotion · doi:10.1037/a0017813 · Cited by 56 · see citing works
Cho, Y., Zhang, H., Harris, M. R., Gong, Y., Smith, E. L., & Jiang, Y. (2021) · Journal of Medical Internet Research · doi:10.2196/24638 · Cited by 53 · see citing works
Strategies to Measure and Improve Patient Adherence in Clinical Trials
Matsui, D. (2009) · Pharmaceutical Medicine · doi:10.1007/bf03256784 · Cited by 40 · see citing works
Menton, M. C. S., Merry, F. D., Lawrence, A., & Brown, N. (2009) · Ecology and Society · doi:10.5751/es-02831-140139 · Cited by 42 · see citing works
Rushton, K., Ardern, K., Hopkin, E., Welsh, C., Gellatly, J., Faija, C., Armitage, C. J., Lidbetter, N., Lovell, K., Bower, P., et al. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02564-6 · Cited by 36 · see citing works
Acute and medium term effects of a 10-week running intervention on mood state in apprentices
Walter, K., von Haaren, B., Löffler, S., Härtel, S., Jansen, C.-P., Werner, C., Stumpp, J., Bös, K., & Hey, S. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00411 · Cited by 21 · see citing works
Burke, L. E., Sereika, S., Choo, J., Warziski, M., Music, E., Styn, M., Novak, J., & Stone, A. (2006) · Contemporary Clinical Trials · doi:10.1016/j.cct.2005.10.006 · Cited by 24 · see citing works
Self-citationCognitive-behavioral therapy (CBT) for generalized anxiety disorder (GAD)
Newman, M. G., Zainal, N. H., & Hoyer, J. (2020) · Generalized Anxiety Disorder and Worrying · doi:10.1002/9781119189909.ch10 · Cited by 25 · see citing works
Chittaro, L., & Vianello, A. (2016) · Interacting with Computers · doi:10.1093/iwc/iwv044 · Cited by 19 · see citing works
Improving pain treatment with a smartphone app: Study protocol for a randomized controlled trial
Suso-Ribera, C., Mesas, Á., Medel, J., Server, A., Márquez, E., Castilla, D., Zaragozá, I., & García-Palacios, A. (2018) · Trials · doi:10.1186/s13063-018-2539-1 · Cited by 20 · see citing works
Factors that influence the use of electronic diaries in health care: scoping review
Daniëls, N. E. M., Hochstenbach, L. M. J., van Zelst, C., van Bokhoven, M. A., Delespaul, P. A. E. G., & Beurskens, A. J. H. M. (2021) · JMIR mhealth and uhealth · doi:10.2196/19536 · Cited by 20 · see citing works
Gómez-Pérez, M. C., García-Palacios, A., Castilla, D., Zaragozá, I., & Suso-Ribera, C. (2020) · Pain Research and Management · doi:10.1155/2020/7897268 · Cited by 18 · see citing works
Technological Interventions for Pain Management
Suso-Ribera, C., Castilla, D., Martínez-Borba, V., Jaén, I., Botella, C., Baños, R. M., & García-Palacios, A. (2022) · Comprehensive Clinical Psychology · doi:10.1016/b978-0-12-818697-8.00009-1 · Cited by 6 · see citing works
- Authors
- Stone, A. A., Shiffman, S., Schwartz, J. E., Broderick, J. E., & Hufford, M. R.
- Affiliations
- Stony Brook University (US)
- University of Pittsburgh (US)
- Corresponding author
- Stone, Arthur A
- Venue
- Controlled Clinical Trials
- Publisher
- Elsevier BV
- Published
- 2003-04
- Volume
- 24
- Issue
- 2
- Pages
- 182-199
- ISSN
- 0197-2456 (ISSN-L)
- OpenAlex
- W2163672276
- Cited by
- 910
- References
- 4
- Citations by year
- 2026: 30 · 2025: 27 · 2024: 31 · 2023: 27 · 2022: 41 · 2021: 46 · 2020: 55 · 2019: 39 · 2018: 46 · 2017: 36 · 2016: 55 · 2015: 54 · 2014: 43 · 2013: 39 · 2012: 54
- FWCI
- 104.47
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Controlled Clinical Trials (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Cancer Institute (R01CA085819, CA-85819)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Health Sciences › Medicine › Family Practice › Medication Adherence and Compliance
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- medication adherence, electronic diary, paper diaries, chronic pain, pain diary
- MeSH terms
- Adolescent, Adult, Aged, Analysis of Variance, Data Collection, Female, Humans, Male, Medical Records, Middle Aged, Pain Measurement, Patient Compliance, Reproducibility of Results, Medical Records Systems, Computerized
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
