Ecological momentary assessment: what it is and why it is a method of the future in clinical psychopharmacology
Open accessAbstract
Current methods of assessment in clinical psychopharmacology have several serious disadvantages, particularly for the study of social functioning. We aimed to review the strengths and weaknesses of current methods used in clinical psychopharmacology and to compare them with a group of methods, developed by personality/social psychologists, termed ecological momentary assessment (EMA), which permit the research participant to report on symptoms, affect and behaviour close in time to experience and which sample many events or time periods. EMA has a number of advantages over more traditional methods for the assessment of patients in clinical psychopharmacological studies. It can both complement and, in part, replace existing methods. EMA methods will permit more sensitive assessments and will enable more wide-ranging and detailed measurements of mood and behaviour. These types of methods should be adopted more widely by clinical psychopharmacology researchers.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The ability to overcome memory bias and to capture variations over time contributes to increasing the ecological validity of ecological momentary assessment.
“These two factors contribute to increasing the ecological validity of the EMA (70, 76, 77).”
From Mobile intervention for individuals with psychosis, dual disorders, and their common comorbidities: A literature review (2019) · cites this paper as [77]
EMA has been used in clinical trials only to a very limited extent.
“This approach has been used in clinical trials,97 but only to a very limited extent, leading some to describe it as a “neglected methodology.”98”
From Precision clinical trials: a framework for getting to precision medicine for neurobehavioural disorders (2021) · cites this paper as [97]
Cites
“Clinical versus Actuarial Judgment.”
Dawes, R. M., Faust, D., & Meehl, P. E. (1989) · Science · doi:10.1126/science.2648573 · Cited by 2,298 · see citing works
Assessment of social adjustment by patient self report.
Weissman, M. M. (1976) · Archives of General Psychiatry · doi:10.1001/archpsyc.1976.01770090101010 · Cited by 1,782 · see citing works
Emotional Reactivity to Daily Life Stress in Psychosis
Myin-Germeys, I., van Os, J., Schwartz, J. E., Stone, A. A., & Delespaul, P. A. (2001) · Archives of General Psychiatry · doi:10.1001/archpsyc.58.12.1137 · Cited by 653 · see citing works
Cross-situational generality and the interpersonal circumplex
Moskowitz, D. S. (1994) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.66.5.921 · Cited by 290 · see citing works
Self-citationDeterminants of occurrence and recovery from hallucinations in daily life
Delespaul, P., deVries, M., & van Os, J. (2002) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s001270200000 · Cited by 247 · see citing works
Quality of life in depression: Daily life determinants and variability
Barge-Schaapveld, D. Q. C. M., Nicolson, N. A., Berkhof, J., & deVries, M. W. (1999) · Psychiatry Research · doi:10.1016/s0165-1781(99)00081-5 · Cited by 132 · see citing works
Axelson, D. A., Bertocci, M. A., Lewin, D. S., Trubnick, L. S., Birmaher, B., Williamson, D. E., Ryan, N. D., & Dahl, R. E. (2003) · Journal of Child and Adolescent Psychopharmacology · doi:10.1089/104454603322572589 · Cited by 91 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Ecological momentary assessment
Shiffman, S., Stone, A. A., & Hufford, M. R. (2008) · Annual Review of Clinical Psychology · doi:10.1146/annurev.clinpsy.3.022806.091415 · Cited by 6,454 · see citing works
Network analysis of multivariate data in psychological science
Borsboom, D., Deserno, M. K., Rhemtulla, M., Epskamp, S., Fried, E. I., McNally, R. J., Robinaugh, D. J., Perugini, M., Dalege, J., Costantini, G., et al. (2021) · Nature Reviews Methods Primers · doi:10.1038/s43586-021-00055-w · Cited by 1,371 · see citing works
Experience sampling research in psychopathology: opening the black box of daily life
Myin-Germeys, I., Oorschot, M., Collip, D., Lataster, J., Delespaul, P., & van Os, J. (2009) · Psychological Medicine · doi:10.1017/s0033291708004947 · Cited by 817 · see citing works
Yetisen, A. K., Martinez‐Hurtado, J. L., Ünal, B., Khademhosseini, A., & Butt, H. (2018) · Advanced Materials · doi:10.1002/adma.201706910 · Cited by 569 · see citing works
aan het Rot, M., Hogenelst, K., & Schoevers, R. A. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.05.007 · Cited by 325 · see citing works
Moore, R. C., Depp, C. A., Wetherell, J. L., & Lenze, E. J. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.01.011 · Cited by 274 · see citing works
The association between green space and adolescents' mental well-being: a systematic review
Zhang, Y., Mavoa, S., Zhao, J., Raphael, D., & Smith, M. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17186640 · Cited by 240 · see citing works
Dvořáková, K., Kishida, M., Li, J., Elavsky, S., Broderick, P. C., Agrusti, M. R., & Greenberg, M. T. (2017) · Journal of American College Health · doi:10.1080/07448481.2017.1278605 · Cited by 231 · see citing works
Asselbergs, J., Ruwaard, J., Ejdys, M., Schrader, N., Sijbrandij, M., & Riper, H. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5505 · Cited by 193 · see citing works
Use of ecological momentary assessment in mood disorders research
Wenze, S. J., & Miller, I. W. (2010) · Clinical Psychology Review · doi:10.1016/j.cpr.2010.06.007 · Cited by 205 · see citing works
DeepMood: Forecasting Depressed Mood Based on Self-Reported Histories via Recurrent Neural Networks
Suhara, Y., Xu, Y., & Pentland, A. '. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052676 · Cited by 163 · see citing works
Ecological momentary assessment in aging research: A critical review
Cain, A. E., Depp, C. A., & Jeste, D. V. (2009) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2009.01.014 · Cited by 164 · see citing works
Craving in Opioid Use Disorder: From Neurobiology to Clinical Practice
Kakko, J., Alho, H., Baldacchino, A., Molina, R., Nava, F. A., & Shaya, G. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00592 · Cited by 140 · see citing works
Czyz, E. K., Horwitz, A. G., Arango, A., & King, C. A. (2019) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12974 · Cited by 130 · see citing works
Johnson, E. I., Grondin, O., Barrault, M., Faytout, M., Helbig, S., Husky, M., Granholm, E. L., Loh, C., Nadeau, L., Wittchen, H., et al. (2009) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.276 · Cited by 122 · see citing works
Mobile Tele-Mental Health: Increasing Applications and a Move to Hybrid Models of Care
Chan, S., Torous, J., Hinton, L., & Yellowlees, P. (2014) · Healthcare · doi:10.3390/healthcare2020220 · Cited by 108 · see citing works
Czyz, E. K., King, C. A., & Nahum-Shani, I. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.06.031 · Cited by 112 · see citing works
Czyz, E. K., King, C. A., & Biermann, B. J. (2019) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2018.1496442 · Cited by 105 · see citing works
Challenges and Opportunities of eHealth Research
Ahern, D. K. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.016 · Cited by 103 · see citing works
Moskowitz, D. S., Russell, J. J., Sadikaj, G., & Sutton, R. (2009) · Canadian Psychology / Psychologie canadienne · doi:10.1037/a0016625 · Cited by 103 · see citing works
Self-citationRussell, J. J., Moskowitz, D. S., Zuroff, D. C., Bleau, P., Pinard, G., & Young, S. N. (2011) · Psychological Medicine · doi:10.1017/s0033291710000863 · Cited by 80 · see citing works
Self-citationBos, F. M., Schoevers, R. A., & aan het Rot, M. (2015) · European Neuropsychopharmacology · doi:10.1016/j.euroneuro.2015.08.008 · Cited by 81 · see citing works
Torok, M., Han, J., McGillivray, L., Wong, Q., Werner-Seidler, A., O’Dea, B., Calear, A., & Christensen, H. (2022) · PLoS Medicine · doi:10.1371/journal.pmed.1003978 · Cited by 71 · see citing works
“Also, the inclusion of novel methods, such as ecological momentary assessment (EMA) and data linkage [42,43], in this trial would have improved the capture of real-time and long-term impacts of LifeBuoy on suicide ideation, attempt, and death, which would further strengthen causal inferences regarding the contribution…”
BackgroundThe promise of digital mood tracking technologies: are we heading on the right track?
Malhi, G. S., Hamilton, A., Morris, G., Mannie, Z., Das, P., & Outhred, T. (2017) · Evidence Based Mental Health · doi:10.1136/eb-2017-102757 · Cited by 62 · see citing works
Lenze, E. J., & Wetherell, J. L. (2009) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.2074 · Cited by 57 · see citing works
Huhn, A. S., Harris, J., Cleveland, H. H., Lydon, D. M., Stankoski, D., Cleveland, M. J., Deneke, E., & Bunce, S. C. (2016) · Brain Research Bulletin · doi:10.1016/j.brainresbull.2016.01.012 · Cited by 53 · see citing works
The role of mobile phone technology in understanding and preventing suicidal behavior
de Beurs, D., Kirtley, O., Kerkhof, A., Portzky, G., & O’Connor, R. C. (2015) · Crisis · doi:10.1027/0227-5910/a000316 · Cited by 47 · see citing works
Lenze, E. J., Nicol, G. E., Barbour, D. L., Kannampallil, T., Wong, A. W. K., Piccirillo, J., Drysdale, A. T., Sylvester, C. M., Haddad, R., Miller, J. P., et al. (2021) · Journal of Psychiatry and Neuroscience · doi:10.1503/jpn.200042 · Cited by 43 · see citing works
Czyz, E. K., Glenn, C. R., Arango, A., Koo, H. J., & King, C. A. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.05.104 · Cited by 39 · see citing works
Bell, I. H., Fielding-Smith, S. F., Hayward, M., Rossell, S. L., Lim, M. H., Farhall, J., & Thomas, N. (2018) · Internet Interventions · doi:10.1016/j.invent.2018.11.001 · Cited by 36 · see citing works
Pennou, A., Lecomte, T., Potvin, S., & Khazaal, Y. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00302 · Cited by 34 · see citing works
Naved, R. T., Rimi, N. A., Jahan, S., & Lindmark, G. (2009) · Journal of Health, Population and Nutrition · doi:10.3329/jhpn.v27i4.3391 · Cited by 32 · see citing works
Internet delivered support for tobacco control in dental practice: randomized controlled trial
Houston, T. K., Richman, J. S., Ray, M. N., Allison, J. J., Gilbert, G. H., Shewchuk, R. M., Kohler, C. L., Kiefe, C. I., & DPBRN Collaborative Group (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1095 · Cited by 27 · see citing works
Chen, C., Lifset, E. T., Han, Y., Roy, A., Hogarth, M., Moore, A. A., Farcas, E., & Weibel, N. (2023) · The 25th International ACM SIGACCESS Conference on Computers and Accessibility · doi:10.1145/3597638.3608378 · Cited by 25 · see citing works
“reports a fixed number of times per day [53]), and event-based sampling (self-reports are solicited at the time the variable of interest such as physical activity takes place [7]).”
BackgroundMethodHarrison, A., Scott, W., Timmins, L., Graham, C. D., & Harrison, A. M. (2021) · AIDS Care · doi:10.1080/09540121.2020.1771263 · Cited by 12 · see citing works
A Shared Decision-Making Tool to Prevent Substance Abuse: Protocol for a Randomized Controlled Trial
Long, J., Yuan, J. M., & Johnson, R. K. (2018) · JMIR Research Protocols · doi:10.2196/resprot.7650 · Cited by 2 · see citing works
- Authors
- Moskowitz, D. S., & Young, S. N.
- Affiliations
- McGill University (CA)
- Venue
- Journal of Psychiatry and Neuroscience
- Publisher
- Canadian Science Publishing
- Published
- 2006-01
- Volume
- 31
- Issue
- 1
- Pages
- 13-20
- ISSN
- 1180-4882 (ISSN-L)
- 1488-2434
- PMC
- PMC1325062
- OpenAlex
- W2188070812
- Cited by
- 457
- References
- 7
- Citations by year
- 2026: 24 · 2025: 19 · 2024: 36 · 2023: 36 · 2022: 40 · 2021: 37 · 2020: 34 · 2019: 32 · 2018: 39 · 2017: 28 · 2016: 27 · 2015: 22 · 2014: 16 · 2013: 9 · 2012: 15
- FWCI
- 11.31
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Psychiatry and Neuroscience (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- PubMed
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Social Sciences › Psychology › Social Psychology › Mental Health via Writing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- ecological momentary assessment, clinical psychopharmacology, social functioning, mood measurement, affective states, behaviour measurement, assessment methods, longitudinal data collection
- MeSH terms
- Mental Disorders, Data Collection, Forecasting, Humans, Psychopharmacology, Surveys and Questionnaires, Social Behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review