When All Else Fails, Listen to the Patient: A Viewpoint on the Use of Ecological Momentary Assessment in Clinical Trials
Open accessPublished version of a preprint
The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Abstract
A major problem in mental health clinical trials, such as depression, is low assay sensitivity in primary outcome measures. This has contributed to clinical trial failures, resulting in the exodus of the pharmaceutical industry from the Central Nervous System space. This reduced assay sensitivity in psychiatry outcome measures stems from inappropriately broad measures, recall bias, and poor interrater reliability. Limitations in the ability of traditional measures to differentiate between the trait versus state-like nature of individual depressive symptoms also contributes to measurement error in clinical trials. In this viewpoint, we argue that ecological momentary assessment (EMA)—frequent, real time, in-the-moment assessments of outcomes, delivered via smartphone—can both overcome these psychometric challenges and reduce clinical trial failures by increasing assay sensitivity and minimizing recall and rater bias. Used in this manner, EMA has the potential to further our understanding of treatment response by allowing for the assessment of dynamic interactions between treatment and distinct symptom response.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This flawed approach fails to take into account the complexity of neurobehavioural disorders in 3 ways.9,34–37”
From Precision clinical trials: a framework for getting to precision medicine for neurobehavioural disorders (2021) · cites this paper as [36]
Experimental — accuracy not yet measuredThe check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“First, patient subgroups are defined by baseline pre-randomization markers that are hypothesized to modulate the effect size of the intervention (i.e., modulators), an approach commonly used in cardiovascular disease, for example.”
From Precision clinical trials: a framework for getting to precision medicine for neurobehavioural disorders (2021) · cites this paper as [36]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817 · cited 1×
“The 17-item HAM-D (HAM-D-17) determines efficacy similarly [26].”
A new depression scale designed to be sensitive to change
Montgomery, S. A., & Åsberg, M. (1979) · British Journal of Psychiatry · doi:10.1192/bjp.134.4.382 · Cited by 13,962
Ahmed, A., Jorna, T., & Bhandari, S. (2016) · Nephron · doi:10.1159/000447068 · Cited by 11,717
From best evidence to best practice: effective implementation of change in patients' care
Grol, R., & Grimshaw, J. (2003) · The Lancet · doi:10.1016/s0140-6736(03)14546-1 · Cited by 4,531
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298 · cited 1×
“The reason for such results may be that clinicians, even when given rules governing the scoring of the assessment at hand, will tend to drift from standard calibrated practice [37].”
Handbook of research methods for studying daily life
(2012) · Choice Reviews Online · doi:10.5860/choice.50-1159 · Cited by 2,111
The halo effect: Evidence for unconscious alteration of judgments.
Nisbett, R. E., & Wilson, T. D. (1977) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.35.4.250 · Cited by 2,021
Mode of questionnaire administration can have serious effects on data quality
Bowling, A. (2005) · Journal of Public Health · doi:10.1093/pubmed/fdi031 · Cited by 1,871
On the bipolarity of positive and negative affect.
Russell, J. A., & Carroll, J. M. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.1.3 · Cited by 1,481 · cited 1×
“Limited sampling likely further compromises psychiatric research because trait measures require respondents to attempt a summation of states via recall of past experiences, which has been shown to introduce error [53].”
Placebo Response in Studies of Major Depression: Variable, Substantial, and Growing
Walsh, B. T., Seidman, S. N., Sysko, R., & Gould, M. (2002) · JAMA · doi:10.1001/jama.287.14.1840 · Cited by 1,109 · cited 1×
“The contribution of poor measures to treatment failures is particularly well-illustrated in antidepressant trials [10-12].”
NIH Toolbox for Assessment of Neurological and Behavioral Function
Gershon, R. C., Wagster, M. V., Hendrie, H. C., Fox, N. A., Cook, K. F., & Nowinski, C. J. (2013) · Neurology · doi:10.1212/wnl.0b013e3182872e5f · Cited by 895 · cited 1×
“For example, the National Institutes of Health toolbox was designed specifically for this purpose [21].”
Ambulatory Blood-Pressure Monitoring
Pickering, T. G., Shimbo, D., & Haas, D. (2006) · New England Journal of Medicine · doi:10.1056/nejmra060433 · Cited by 778
Trull, T. J., & Ebner-Priemer, U. (2013) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-050212-185510 · Cited by 761
Embretson, S. E., & Reise, S. P. (2013) · Psychology Press eBooks · doi:10.4324/9781410605269 · Cited by 761
A Network Approach to Psychopathology: New Insights into Clinical Longitudinal Data
Bringmann, L. F., Vissers, N., Wichers, M., Geschwind, N., Kuppens, P., Peeters, F., Borsboom, D., & Tuerlinckx, F. (2013) · PLoS ONE · doi:10.1371/journal.pone.0060188 · Cited by 680
Microrandomized trials: An experimental design for developing just-in-time adaptive interventions.
Klasnja, P., Hekler, E. B., Shiffman, S., Boruvka, A., Almirall, D., Tewari, A., & Murphy, S. A. (2015) · Health Psychology · doi:10.1037/hea0000305 · Cited by 671 · cited 1×
“There is no doubt some theoretical limit on high-frequency sampling to the extent that it may, if administered often enough, conflate mood and emotions or succeed in becoming itself a source of negative mood, affect, or emotions [50,51].”
The 52 symptoms of major depression: lack of content overlap among seven common depression scales
Fried, E. I. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.10.019 · Cited by 649
Hamaker, E. L., Asparouhov, T., Brose, A., Schmiedek, F., & Muthén, B. (2018) · Multivariate Behavioral Research · doi:10.1080/00273171.2018.1446819 · Cited by 549 · cited 1×
“Multiple methods, including multilevel vector autoregression and multilevel dynamic structural equation modeling, can help researchers examine how individuals may vary from group trends over time [71,72].”
Leucht, S., Leucht, C., Huhn, M., Chaimani, A., Mavridis, D., Helfer, B., Samara, M., Rabaioli, M., Bächer, S., Cipriani, A., et al. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2017.16121358 · Cited by 542
Increasing value and reducing waste in biomedical research regulation and management
Salman, R. A.-S., Beller, E., Kagan, J., Hemminki, E., Phillips, R. S., Savulescu, J., Macleod, M., Wisely, J., & Chalmers, I. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62297-7 · Cited by 534
Comparative Effects of Ramipril on Ambulatory and Office Blood Pressures: A HOPE Substudy
Svensson, P., de Faire, U., Sleight, P., Yusuf, S., & Östergren, J. (2001) · Hypertension · doi:10.1161/hy1101.099502 · Cited by 491
Bech, P., Gram, L. F., Dein, E., Jacobsen, O., Vitger, J., & Bolwig, T. G. (1975) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1975.tb00002.x · Cited by 489
Fava, M., Evins, A. E., Dorer, D. J., & Schoenfeld, D. A. (2003) · Psychotherapy and Psychosomatics · doi:10.1159/000069738 · Cited by 452
The Measurement of Affect, Mood, and Emotion: A Guide for Health-Behavioral Research
Ekkekakis, P., & Russell, J. A. (2013) · Cambridge University Press eBooks · doi:10.1017/cbo9780511820724 · Cited by 361
Fried, E. I., van Borkulo, C. D., Epskamp, S., Schoevers, R. A., Tuerlinckx, F., & Borsboom, D. (2016) · Psychological Assessment · doi:10.1037/pas0000275 · Cited by 314 · cited 1×
“To further complicate matters, measuring multiple constructs inflates the chance that items tied to each construct will shift unpredictably over time (eg, due to lack of longitudinal factorial invariance) [28].”
Diurnal mood variation in major depressive disorder
Peeters, F., Berkhof, J., Delespaul, P., Rottenberg, J., & Nicolson, N. A. (2006) · Emotion · doi:10.1037/1528-3542.6.3.383 · Cited by 306 · cited 2×
“For example, in an individual with major depression, mood might be very depressed at a certain point in the morning and near-normal later that same day [48].”
Schultzberg, M., & Muthén, B. (2018) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705511.2017.1392862 · Cited by 293
Is Pharma Running Out of Brainy Ideas?
Miller, G. (2010) · Science · doi:10.1126/science.329.5991.502 · Cited by 284 · cited 1×
“This has resulted in decreased investment in drug discovery [5].”
Chekroud, A. M., Gueorguieva, R., Krumholz, H. M., Trivedi, M. H., Krystal, J. H., & McCarthy, G. (2017) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2017.0025 · Cited by 276
Moore, R. C., Depp, C. A., Wetherell, J. L., & Lenze, E. J. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.01.011 · Cited by 274 · cited 1×
“An example of how infrequent sampling adversely affects assay sensitivity in clinical trials was recently provided by Moore et al [64].”
Self-citationAffective dynamics in psychopathology
Trull, T. J., Lane, S. P., Koval, P., & Ebner-Priemer, U. W. (2015) · Emotion Review · doi:10.1177/1754073915590617 · Cited by 274
The Primary Outcome Fails — What Next?
Pocock, S. J., & Stone, G. W. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1510064 · Cited by 274
A Model of Placebo Response in Antidepressant Clinical Trials
Rutherford, B. R., & Roose, S. P. (2013) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2012.12040474 · Cited by 268
Gershon, R. C., Rothrock, N. E., Hanrahan, R. T., Bass, M., & Cella, D. F. (2010) · PubMed · Cited by 267
Snapinn, S. M. (2000) · Trials · doi:10.1186/cvm-1-1-019 · Cited by 267
Uher, R., Perlis, R. H., Placentino, A., Dernovšek, M. Z., Henigsberg, N., Mors, O., Maier, W., McGuffin, P., & Farmer, A. (2012) · Depression and Anxiety · doi:10.1002/da.21993 · Cited by 262
Antidepressants versus placebo in major depression: an overview
Khan, A., & Brown, W. A. (2015) · World Psychiatry · doi:10.1002/wps.20241 · Cited by 235
Torous, J., Chan, S. R., Yee-Marie Tan, S., Behrens, J., Mathew, I., Conrad, E. J., Hinton, L., Yellowlees, P., & Keshavan, M. (2014) · JMIR Mental Health · doi:10.2196/mental.4004 · Cited by 228
Use of the experience sampling method in the context of clinical trials
Verhagen, S. J. W., Hasmi, L., Drukker, M., van Os, J., & Delespaul, P. A. E. G. (2016) · Evidence Based Mental Health · doi:10.1136/ebmental-2016-102418 · Cited by 208
Improving and Accelerating Drug Development for Nervous System Disorders
Pankevich, D. E., Altevogt, B. M., Dunlop, J., Gage, F. H., & Hyman, S. E. (2014) · Neuron · doi:10.1016/j.neuron.2014.10.007 · Cited by 206
Stone, A. A., Schwartz, J. E., Broderick, J. E., & Shiffman, S. S. (2005) · Personality and Social Psychology Bulletin · doi:10.1177/0146167205275615 · Cited by 206
Hieronymus, F., Emilsson, J. F., Nilsson, S., & Eriksson, E. (2016) · Molecular Psychiatry · doi:10.1038/mp.2015.53 · Cited by 201
Time Frames for Mood: Relations between Momentary and Generalized Ratings of Affect
Parkinson, B., Briner, R. B., Reynolds, S., & Totterdell, P. (1995) · Personality and Social Psychology Bulletin · doi:10.1177/0146167295214003 · Cited by 159
The neuroscience of memory: implications for the courtroom
Lacy, J. W., & Stark, C. E. L. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3563 · Cited by 155
Wichers, M. C., Barge-Schaapveld, D. Q. C. M., Nicolson, N. A., Peeters, F., de Vries, M., Mengelers, R., & van Os, J. (2009) · Neuropsychopharmacology · doi:10.1038/npp.2008.66 · Cited by 139 · cited 1×
“Frequent real-time sampling has also been shown to unmask differences between treatment responders and nonresponders and to detect treatment effects earlier than clinician-administered assessments [62,63].”
Quiroz, J. A., Tamburri, P., Deptula, D., Banken, L., Beyer, U., Rabbia, M., Parkar, N., Fontoura, P., & Santarelli, L. (2016) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2016.0838 · Cited by 133 · cited 1×
“Similarly, basimglurant, a postsynaptic metabotropic glutamate subtype 5 receptor antagonist, showed promise in early phase trials but failed to separate from placebo on the primary outcome measure in a larger phase 2b trial [15].”
Rating scales in depression: limitations and pitfalls
Bech, P. (2006) · Dialogues in Clinical Neuroscience · doi:10.31887/dcns.2006.8.2/pbech · Cited by 129
Innovative solutions to novel drug development in mental health
Insel, T. R., Voon, V., Nye, J. S., Brown, V. J., Altevogt, B. M., Bullmore, E. T., Goodwin, G. M., Howard, R. J., Kupfer, D. J., Malloch, G., et al. (2013) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2013.03.022 · Cited by 124
Sanacora, G., Johnson, M. R., Khan, A., Atkinson, S. D., Riesenberg, R. R., Schronen, J. P., Burke, M. A., Zajecka, J. M., Barra, L., Su, H.-L., et al. (2017) · Neuropsychopharmacology · doi:10.1038/npp.2016.224 · Cited by 120 · cited 1×
“For example, lanicemine, an N-methyl-D-aspartate receptor antagonist differing from ketamine that produces lower psychotomimetic side effects, was thought to show promise in treating depression [13].”
Mobile health: the power of wearables, sensors, and apps to transform clinical trials
Munos, B., Baker, P. C., Bot, B. M., Crouthamel, M., de Vries, G., Ferguson, I., Hixson, J. D., Malek, L. A., Mastrototaro, J. J., Misra, V., et al. (2016) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.13117 · Cited by 118
Kobak, K. A., Kane, J. M., Thase, M. E., & Nierenberg, A. A. (2007) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0b013e31802eb4b7 · Cited by 113
Lessons learned from placebo groups in antidepressant trials
Mora, M. S., Nestoriuc, Y., & Rief, W. (2011) · Philosophical Transactions of the Royal Society B: Biological Sciences · doi:10.1098/rstb.2010.0394 · Cited by 105
THE WORLD AS WILL AND REPRESENTATION VOLUME 1
Norman, J., & Welchman, A. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511780943.007 · Cited by 103
Iovieno, N., & Papakostas, G. I. (2012) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.11r07485 · Cited by 103
Measuring the mind. Conceptual issues in contemporary psychometrics
Bech, P. (2006) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2006.00820.x · Cited by 102
Nutt, D., & Goodwin, G. M. (2011) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2011.05.004 · Cited by 99
Depression history and memory bias for specific daily emotions
Urban, E. J., Charles, S. T., Levine, L. J., & Almeida, D. M. (2018) · PLOS ONE · doi:10.1371/journal.pone.0203574 · Cited by 96
Psychiatric drug development: diagnosing a crisis.
Hyman, S. E. (2013) · PubMed Central · Cited by 91
Zimmermann, J., Woods, W. C., Ritter, S., Happel, M., Masuhr, O., Jaeger, U., Spitzer, C., & Wright, A. G. C. (2019) · Psychological Assessment · doi:10.1037/pas0000625 · Cited by 87 · cited 2×
“In other words, frequent sampling would ideally be used to inform the creation of a scale before using it to track efficacy [52].”
Effects of Antidepressant Treatment on the Quality of Daily Life: An Experience Sampling Study
Barge-Schaapveld, D. Q. C. M., & Nicolson, N. A. (2002) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v63n0603 · Cited by 81
Pragmatic nihilism: how a Theory of Nothing can help health psychology progress
Peters, G.-J., & Crutzen, R. (2017) · Health Psychology Review · doi:10.1080/17437199.2017.1284015 · Cited by 77
Kobak, K. A., Leuchter, A., DeBrota, D., Engelhardt, N., Williams, J. B. W., Cook, I. A., Leon, A. C., & Alpert, J. (2010) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0b013e3181d20912 · Cited by 68
McCann, D. J., Petry, N. M., Bresell, A., Isacsson, E., Wilson, E., & Alexander, R. C. (2015) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0000000000000372 · Cited by 60
Fried, E. I., Boschloo, L., van Borkulo, C. D., Schoevers, R. A., Romeijn, J.-W., Wichers, M., de Jonge, P., Nesse, R. M., Tuerlinckx, F., & Borsboom, D. (2015) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2015.00117 · Cited by 59
LUPIEN, S. J., Sasseville, M., François, N., Giguère, C., Boissonneault, J., Plusquellec, P., Godbout, R., Xiong, L., Potvin, S., Kouassi, É., et al. (2017) · Stress · doi:10.1080/10253890.2017.1286324 · Cited by 58
Kyle, P. R., Lemming, O. M., Timmerby, N., Søndergaard, S., Andreasson, K., & Bech, P. (2016) · Journal of Clinical Psychopharmacology · doi:10.1097/jcp.0000000000000557 · Cited by 50
Ambulatory blood pressure monitoring in the evaluation of drug efficacy
O'Brien, E., O'MALLEY, K., Cox, J. P., & Stanton, A. V. (1991) · American Heart Journal · doi:10.1016/0002-8703(91)90611-k · Cited by 42
Daily process methodology for measuring earlier antidepressant response
Lenderking, W. R., Hu, M., Tennen, H. A., Cappelleri, J. C., Petrie, C. D., & Rush, A. J. (2008) · Contemporary Clinical Trials · doi:10.1016/j.cct.2008.05.012 · Cited by 41
Depp, C. A., Moore, R. C., Dev, S. I., Mausbach, B. T., Eyler, L. T., & Granholm, E. L. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.12.016 · Cited by 38
Self-citationHow do you feel? Detection of recurrent Major Depressive Disorder using a single-item screening tool
van Rijsbergen, G. D., Burger, H., Hollon, S. D., Elgersma, H. J., Kok, G. D., Dekker, J., de Jong, P. J., & Bockting, C. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.06.052 · Cited by 34
Why Are Innovative Drugs Failing in Phase III?
Marder, S. R., LAUGHREN, T. P., & Romano, S. J. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2017.17040426 · Cited by 22
Kharasch, E. D., Neiner, A., Kraus, K., Blood, J., Stevens, A., Schweiger, J. A., Miller, J. P., & Lenze, E. J. (2018) · Clinical Pharmacology & Therapeutics · doi:10.1002/cpt.1309 · Cited by 22
Self-citationZimmermann, J., Woods, W. C., Ritter, S., Happel, M., Masuhr, O., Jaeger, U., Spitzer, C., & Wright, A. G. C. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/5zcth · Cited by 19
Puttagunta, P. S., Caulfield, T., & Griener, G. (2002) · PubMed · Cited by 13
Research works printed but not linked: 5
- Hyman, SE, 2013, Cerebrum, 2013, 5
- Puttagunta, PS, 2002, Health Law Rev, 10, 30
- Gershon, RC, 2010, J Appl Meas, 11, 304
- Guy, W, 1976, NCDEU Assessment Manual for Psychopharmacology, 91
- Nunnally, JD, 1994, Psychometric Theory
Cited by
Lenze, E. J., Mattar, C., Zorumski, C. F., Stevens, A., Schweiger, J., Nicol, G. E., Miller, J. P., Yang, L., Yingling, M., Avidan, M. S., et al. (2020) · JAMA · doi:10.1001/jama.2020.22760 · Cited by 495
Self-citationPeterson, C. B., Engel, S. G., Crosby, R. D., Strauman, T., Smith, T. L., Klein, M., Crow, S. J., Mitchell, J. E., Erickson, A., Cao, L., et al. (2020) · International Journal of Eating Disorders · doi:10.1002/eat.23324 · Cited by 86
Lenze, E. J., Nicol, G. E., Barbour, D. L., Kannampallil, T., Wong, A. W. K., Piccirillo, J., Drysdale, A. T., Sylvester, C. M., Haddad, R., Miller, J. P., et al. (2021) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.200042 · Cited by 43
Self-citationA Framework for Advancing Precision Medicine in Clinical Trials for Mental Disorders
Lenze, E. J., Rodebaugh, T. L., & Nicol, G. E. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.0114 · Cited by 45
Self-citationSlow down and be critical before using early warning signals in psychopathology
Helmich, M. A., Schreuder, M. J., Bringmann, L. F., Riese, H., Snippe, E., & Smit, A. C. (2024) · Nature Reviews Psychology · doi:10.1038/s44159-024-00369-y · Cited by 39
Metadata
- Authors
- Mofsen, A. M., Rodebaugh, T. L., Nicol, G. E., Depp, C. A., Miller, J. P., & Lenze, E. J.
- Affiliations
- Washington University in St. Louis (US)
- University of California San Diego (US)
- Corresponding author
- Depp, Colin A
- Venue
- JMIR Mental Health
- Publisher
- JMIR Publications Inc.
- Published
- 2019-04-21
- Volume
- 6
- Issue
- 5
- Pages
- e11845
- ISSN
- 2368-7959 (ISSN-L)
- PMC
- PMC6524455
- OpenAlex
- W2931245270
- Cited by
- 51
- References
- 73
- Citations by year
- 2026: 6 · 2025: 9 · 2024: 5 · 2023: 11 · 2022: 10 · 2021: 3 · 2020: 7
- FWCI
- 5.90
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Mental Health (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Digital Commons@Becker (Washington University School of Medicine) (submittedVersion, cc-by)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- ecological momentary assessment, depression, assay sensitivity, recall bias, inter-rater reliability, measurement error, treatment response, clinical trial failure
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.