What Affects the Completion of Ecological Momentary Assessments in Chronic Pain Research? An Individual Patient Data Meta-Analysis
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Ecological momentary assessment (EMA) involves repeated sampling of people's current experiences in real time in their natural environments, which offers a granular perspective on patients' experience of pain and other symptoms. However, EMA can be burdensome to patients, and its benefits depend upon patients' engagement in the assessments. OBJECTIVE: The goal of this study was to investigate factors affecting EMA-completion rates among patients with chronic pain. METHODS: This individual patient data meta-analysis was based on 12 EMA datasets that examined patients with chronic noncancer-related pain (n=701). The EMA-completion rates were calculated on a daily basis for each patient. Multilevel models were used to test the following predictors of completion rates at different levels: within-patient factors (days into the study and daily pain level), between-patient factors (age, sex, pain diagnosis, and average pain level per person), and between-study EMA design factors (study duration, sampling density, and survey length). RESULTS: Across datasets, an EMA-completion rate of 85% was observed. The strongest results were found for the between-patient factor age: Younger respondents reported lower completion rates than older respondents (P=.002). One within-patient factor, study day, was associated with completion rates (P<.001): over the course of the studies, the completion rates declined. The two abovementioned factors interacted with each other (P=.02) in that younger participants showed a more rapid decline in EMA completion over time. In addition, none of the other hypothesized factors including gender, chronic pain diagnoses, pain intensity levels, or measures of study burden showed any significant effects. CONCLUSION: Many factors thought to influence the EMA-completion rates in chronic pain studies were not confirmed. However, future EMA research in chronic pain should note that study length and young age can impact the quality of the momentary data and devise strategies to maximize completion rates across different age groups and study days.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454
Self-citationIdentifying careless responses in survey data.
Meade, A. W., & Craig, S. B. (2012) · Psychological Methods · doi:10.1037/a0028085 · Cited by 3,865 · cited 1×
“to engage in multitasking, limiting their attention to study participation [36].”
How to Use a Monte Carlo Study to Decide on Sample Size and Determine Power
Muthén, L. K., & Muthén, B. O. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0904_8 · Cited by 2,362
Meta-analysis of individual participant data: rationale, conduct, and reporting
Riley, R. D., Lambert, P. C., & Abo-Zaid, G. (2010) · BMJ · doi:10.1136/bmj.c221 · Cited by 1,701
Heron, K. E., & Smyth, J. M. (2010) · British Journal of Health Psychology · doi:10.1348/135910709x466063 · Cited by 1,438
Integrative data analysis: The simultaneous analysis of multiple data sets
Curran, P. J., & Hussong, A. M. (2009) · Psychological Methods · doi:10.1037/a0015914 · Cited by 867 · cited 1×
“The present study attempts to overcome these limitations by conducting an Individual Patient Data (IPD) meta-analysis [13-15].”
Patient non-compliance with paper diaries
Stone, A. A., Shiffman, S., Schwartz, J. E., Broderick, J. E., & Hufford, M. R. (2002) · BMJ · doi:10.1136/bmj.324.7347.1193 · Cited by 810
Self-citationCapturing momentary, self-report data: A proposal for reporting guidelines
Stone, A. A., & Shiffman, S. (2002) · Annals of Behavioral Medicine · doi:10.1207/s15324796abm2403_09 · Cited by 807 · cited 1×
“Despite the advantages of EMA, the quality of these data depends on adequate completion rates of the sampling protocol [3].”
Self-citationThe power of statistical tests for moderators in meta-analysis
Hedges, L. V., & Pigott, T. D. (2004) · Psychological Methods · doi:10.1037/1082-989x.9.4.426 · Cited by 672 · cited 1×
“Additionally, despite the sizeable number of participants included in the analyses, IPD meta-analysis can suffer from low statistical power at the highest (between-study) level of analysis, which may have limited our ability to detect effects based on study-level design features [41].”
Sterne, J. A., Egger, M., & Moher, D. (2008) · Cochrane Handbook for Systematic Reviews of Interventions · doi:10.1002/9780470712184.ch10 · Cited by 651
Ahmed, I., Sutton, A. J., & Riley, R. D. (2012) · BMJ · doi:10.1136/bmj.d7762 · Cited by 404 · cited 1×
“Inclusion of >90% of the eligible studies in IPD meta-analyses has been suggested as an ideal target [38], although, in practice, many IPD meta-analyses include <80% of the eligible datasets [39].”
Stone, A. A., Broderick, J. E., Schwartz, J. E., Shiffman, S., Litcher-Kelly, L., & Calvanese, P. (2003) · Pain · doi:10.1016/s0304-3959(03)00040-x · Cited by 293
Self-citationCourvoisier, D. S., Eid, M., & Lischetzke, T. (2012) · Psychological Assessment · doi:10.1037/a0026733 · Cited by 153 · cited 2×
“Specifically, systematic differences in completion patterns according to characteristics of the situation, person, or EMA protocol could lead to input of data that are not missing at random, which could severely bias the results of subsequent analyses [4].”
Viane, I., Crombez, G., Eccleston, C., Devulder, J., & De Corte, W. (2004) · Pain · doi:10.1016/j.pain.2004.09.008 · Cited by 140
μEMA: Microinteraction-based ecological momentary assessment (EMA) using a smartwatch
Intille, S., Haynes, C., Maniar, D., Ponnada, A., & Manjourides, J. (2016) · Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2971648.2971717 · Cited by 130
Litt, M. D., Shafer, D. M., Ibanez, C. R., Kreutzer, D. L., & Tawfik-Yonkers, Z. (2009) · Pain · doi:10.1016/j.pain.2009.06.003 · Cited by 92
Cited by
Wrzus, C., & Neubauer, A. B. (2023) · Assessment · doi:10.1177/10731911211067538 · Cited by 500
Eisele, G., Vachon, H., Lafit, G., Kuppens, P., Houben, M., Myin-Germeys, I., & Viechtbauer, W. (2022) · Assessment · doi:10.1177/1073191120957102 · Cited by 459
Investigating the feasibility of idiographic network models.
Mansueto, A. C., Wiers, R. W., van Weert, J. C. M., Schouten, B. C., & Epskamp, S. (2023) · Psychological Methods · doi:10.1037/met0000466 · Cited by 147
Momentary predictors of compliance in studies using the experience sampling method
Rintala, A., Wampers, M., Myin-Germeys, I., & Viechtbauer, W. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2020.112896 · Cited by 68
Hart, A., Reis, D., Prestele, E., & Jacobson, N. C. (2022) · Journal of Medical Internet Research · doi:10.2196/34015 · Cited by 22
Metadata
- Authors
- Ono, M., Schneider, S., Junghaenel, D. U., & Stone, A. A.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-02-05
- Volume
- 21
- Issue
- 2
- Pages
- e11398
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2898459803
- Cited by
- 108
- References
- 16
- FWCI
- 1.62
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.