When All Else Fails, Listen to the Patient: A Viewpoint on the Use of Ecological Momentary Assessment in Clinical Trials
Open accessPublished version of a preprint
The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Abstract
A major problem in mental health clinical trials, such as depression, is low assay sensitivity in primary outcome measures. This has contributed to clinical trial failures, resulting in the exodus of the pharmaceutical industry from the Central Nervous System space. This reduced assay sensitivity in psychiatry outcome measures stems from inappropriately broad measures, recall bias, and poor interrater reliability. Limitations in the ability of traditional measures to differentiate between the trait versus state-like nature of individual depressive symptoms also contributes to measurement error in clinical trials. In this viewpoint, we argue that ecological momentary assessment (EMA)—frequent, real time, in-the-moment assessments of outcomes, delivered via smartphone—can both overcome these psychometric challenges and reduce clinical trial failures by increasing assay sensitivity and minimizing recall and rater bias. Used in this manner, EMA has the potential to further our understanding of treatment response by allowing for the assessment of dynamic interactions between treatment and distinct symptom response.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This flawed approach fails to take into account the complexity of neurobehavioural disorders in 3 ways.9,34–37”
From Precision clinical trials: a framework for getting to precision medicine for neurobehavioural disorders (2021) · cites this paper as [36]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“First, patient subgroups are defined by baseline pre-randomization markers that are hypothesized to modulate the effect size of the intervention (i.e., modulators), an approach commonly used in cardiovascular disease, for example.”
From Precision clinical trials: a framework for getting to precision medicine for neurobehavioural disorders (2021) · cites this paper as [36]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817 · cited 1×
“The 17-item HAM-D (HAM-D-17) determines efficacy similarly [26].”
A new depression scale designed to be sensitive to change
Montgomery, S. A., & Åsberg, M. (1979) · British Journal of Psychiatry · doi:10.1192/bjp.134.4.382 · Cited by 13,962
Ahmed, A., Jorna, T., & Bhandari, S. (2016) · Nephron · doi:10.1159/000447068 · Cited by 11,717
From best evidence to best practice: effective implementation of change in patients' care
Grol, R., & Grimshaw, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14546-1 · Cited by 4,531
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298 · cited 1×
“The reason for such results may be that clinicians, even when given rules governing the scoring of the assessment at hand, will tend to drift from standard calibrated practice [37].”
Handbook of research methods for studying daily life
(2012) · Choice Reviews Online · doi:10.5860/choice.50-1159 · Cited by 2,111
The halo effect: Evidence for unconscious alteration of judgments.
Nisbett, R. E., & Wilson, T. D. (1977) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.35.4.250 · Cited by 2,021
Mode of questionnaire administration can have serious effects on data quality
Bowling, A. (2005) · Journal of Public Health · doi:10.1093/pubmed/fdi031 · Cited by 1,871
On the bipolarity of positive and negative affect.
Russell, J. A., & Carroll, J. M. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.1.3 · Cited by 1,481 · cited 1×
“Limited sampling likely further compromises psychiatric research because trait measures require respondents to attempt a summation of states via recall of past experiences, which has been shown to introduce error [53].”
Placebo Response in Studies of Major Depression: Variable, Substantial, and Growing
Walsh, B. T., Seidman, S. N., Sysko, R., & Gould, M. (2002) · JAMA · doi:10.1001/jama.287.14.1840 · Cited by 1,109 · cited 1×
“The contribution of poor measures to treatment failures is particularly well-illustrated in antidepressant trials [10-12].”
Research works printed but not linked: 5
- Hyman, SE, 2013, Cerebrum, 2013, 5
- Puttagunta, PS, 2002, Health Law Rev, 10, 30
- Gershon, RC, 2010, J Appl Meas, 11, 304
- Guy, W, 1976, NCDEU Assessment Manual for Psychopharmacology, 91
- Nunnally, JD, 1994, Psychometric Theory
Cited by
Lenze, E. J., Mattar, C., Zorumski, C. F., Stevens, A., Schweiger, J., Nicol, G. E., Miller, J. P., Yang, L., Yingling, M., Avidan, M. S., et al. (2020) · JAMA · doi:10.1001/jama.2020.22760 · Cited by 495
Self-citationPeterson, C. B., Engel, S. G., Crosby, R. D., Strauman, T., Smith, T. L., Klein, M., Crow, S. J., Mitchell, J. E., Erickson, A., Cao, L., et al. (2020) · International Journal of Eating Disorders · doi:10.1002/eat.23324 · Cited by 86
Lenze, E. J., Nicol, G. E., Barbour, D. L., Kannampallil, T., Wong, A. W. K., Piccirillo, J., Drysdale, A. T., Sylvester, C. M., Haddad, R., Miller, J. P., et al. (2021) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.200042 · Cited by 43
Self-citationA Framework for Advancing Precision Medicine in Clinical Trials for Mental Disorders
Lenze, E. J., Rodebaugh, T. L., & Nicol, G. E. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.0114 · Cited by 45
Self-citationSlow down and be critical before using early warning signals in psychopathology
Helmich, M. A., Schreuder, M. J., Bringmann, L. F., Riese, H., Snippe, E., & Smit, A. C. (2024) · Nature Reviews Psychology · doi:10.1038/s44159-024-00369-y · Cited by 39
Metadata
- Authors
- Mofsen, A. M., Rodebaugh, T. L., Nicol, G. E., Depp, C. A., Miller, J. P., & Lenze, E. J.
- Affiliations
- Washington University in St. Louis (US)
- University of California San Diego (US)
- Corresponding author
- Depp, Colin A
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2019-04-21
- Volume
- 6
- Issue
- 5
- Pages
- e11845
- ISSN
- 2368-7959 (ISSN-L)
- PMC
- PMC6524455
- OpenAlex
- W2931245270
- Cited by
- 51
- References
- 73
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 5 · 2023: 11 · 2022: 10 · 2021: 3 · 2020: 7
- FWCI
- 5.90
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Mental Health (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Digital Commons@Becker (Washington University School of Medicine) (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- ecological momentary assessment, depression, assay sensitivity, recall bias, inter-rater reliability, measurement error, treatment response, clinical trial failure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: When All Else Fails, Listen to the Patient: A Viewpoint on the Use of Ecological Momentary Assessment in Clinical Trials. https://app.cochat.ai/papers/10.2196/11845
- The paper
- Mofsen, A. M., Rodebaugh, T. L., Nicol, G. E., Depp, C. A., Miller, J. P., & Lenze, E. J. (2019). When All Else Fails, Listen to the Patient: A Viewpoint on the Use of Ecological Momentary Assessment in Clinical Trials. JMIR Mental Health. https://doi.org/10.2196/11845
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.