Administering the MADRS by telephone or face-to-face: a validity study.
Open accessThe DOI matches its Crossref record; 31 of the 31 references it cites were found in a registry or an index.
Abstract
Background: The Montgomery Åsberg Depression Rating Scale (MADRS) is a frequently used observer-rated depression scale. In the present study, a telephonic rating was compared with a face-to-face rating in 66 primary care patients with minor or mild-major depression. The aim of the present study was to assess the validity of the administration by telephone. Additional objective was to study the validity of the first item, 'apparent sadness', the only item purely based on observation. Methods: The present study was a validity study. During an in-person interview at the patient's home a trained interviewer administered the MADRS. A few days later the MADRS was administered again, but now by telephone and by a different interviewer. The validity of the telephone rating was calculated through the appropriate intraclass correlation coefficient (ICC). Results: Mean total score on the in-person administration was 24.0 (SD = 11.1), and on the telephone administration 23.5 (SD = 10.4). The ICC for the full scale was 0.65. Homogeneity analysis showed that the observation item 'apparent sadness' fitted well into the scale. Conclusion: The full MADRS, including the observation item 'apparent sadness', can be administered reliably by telephone.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. (2013) · Encyclopedia of Social Work · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,519
STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT
Martin Bland, J., & Altman, D. (1986) · The Lancet · doi:10.1016/s0140-6736(86)90837-8 · Cited by 47,965
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032 · cited 1×
“The BDI is the most widely used self-rating depression scale [3].”
MethodIntraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532 · cited 1×
“The validity of the telephonic rating mode was calculated from the variance (var) components through the appropriate intraclass correlation coefficient (ICC) according to the following formula [19-21]:”
MethodA new depression scale designed to be sensitive to change
Montgomery, S. A., & Åsberg, M. (1979) · British Journal of Psychiatry · doi:10.1192/bjp.134.4.382 · Cited by 13,962 · cited 1×
“The items were taken from the 65-item Comprehensive Psychopathological Rating Scale (CPRS) and were selected because of their sensitivity to change [14,15].”
MethodCook, R. J., Dickens, B. M., & Fathalla, M. F. (2003) · Reproductive Health and Human Rights · doi:10.1093/acprof:oso/9780199241323.003.0025 · Cited by 10,769
Scoville, W. B. (1949) · Journal of neurosurgery · doi:10.3171/jns.1949.6.1.0065 · Cited by 7,381
Forming inferences about some intraclass correlation coefficients.
McGraw, K. O., & Wong, S. P. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.30 · Cited by 6,903 · cited 1×
“The validity of the telephonic rating mode was calculated from the variance (var) components through the appropriate intraclass correlation coefficient (ICC) according to the following formula [19-21]:”
Method(2001) · Journal of Obstetrics and Gynaecology Research · doi:10.1111/j.1447-0756.2001.tb01222.x · Cited by 3,461
Christiane, Druml, Wolzt, & Pleiner (2001) · Acta Scientiarum Naturalium Universitatis Sunyatseni · Cited by 3,419
Mendelson, G. (1995) · Australian & New Zealand Journal of Psychiatry · doi:10.3109/00048679509064964 · Cited by 2,858
Gulliksen, H. (1950) · John Wiley & Sons, Inc. eBooks · doi:10.1037/13240-000 · Cited by 2,177
Statistical analysis of sets of congeneric tests
Jöreskog, K. G. (1971) · Psychometrika · doi:10.1007/bf02291393 · Cited by 1,481
Diagnostic and Statistical Manual of Mental Disorders
(2018) · The SAGE Encyclopedia of Educational Research, Measurement, and Evaluation · doi:10.4135/9781506326139.n198 · Cited by 1,230
STATISTICAL ANALYSIS OF SETS OF CONGENERIC TESTS*
Jo̎reskog, K. G. (1969) · ETS Research Bulletin Series · doi:10.1002/j.2333-8504.1969.tb00777.x · Cited by 1,203 · cited 1×
“This analysis was used to demonstrate congenericity [24].”
MethodHandbook of Psychiatric Measures
SALZMAN, C. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.8.1343 · Cited by 1,174
The psychometric properties of the Composite International Diagnostic Interview
Andrews, G., & Peters, L. (1998) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s001270050026 · Cited by 876 · cited 3×
“During this home visit the interviewer administered the MADRS, the CIDI and other scales and questionnaires.”
MethodInfluentialRankin, G., & Stokes, M. (1998) · Clinical Rehabilitation · doi:10.1191/026921598672178340 · Cited by 856 · cited 1×
“The 'limits of agreement' are calculated (mean difference ± 2*SD) defining the range that contains 95% of all differences [19,22,23].”
BackgroundHandbook of Psychiatric Measures
Rush, A. J., First, M. B., & Blacker, D. (2000) · Medical Entomology and Zoology · Cited by 846
(1999) · Choice Reviews Online · doi:10.5860/choice.36-3094 · Cited by 560
Svanborg, P., & Åsberg, M. (2001) · Journal of Affective Disorders · doi:10.1016/s0165-0327(00)00242-1 · Cited by 481 · cited 1×
“alent to the Beck Depression Inventory (BDI), also a selfrating instrument for depression [2].”
BackgroundSample size requirements for the design of reliability study: review and new results
Shoukri, M. M., Asyali, M. H., & Donner, A. (2004) · Statistical Methods in Medical Research · doi:10.1191/0962280204sm365ra · Cited by 459
Epidemiology: Reflections on Testing the Validity of Psychiatric Interviews
Robins, L. N. (1985) · Archives of General Psychiatry · doi:10.1001/archpsyc.1985.01790320090013 · Cited by 411 · cited 1×
“Robins [17] has described desirable characteristics of studies of agreement between psychiatric measures: (1) the order of administration should be reversed for a random sample of the participants to compensate for any sequence effects; (2) the time interval between administrations should be minimized and recency effe…”
BackgroundA comparison of mail, telephone, and home interview strategies for household health surveys.
Siemiatycki, J. (1979) · American Journal of Public Health · doi:10.2105/ajph.69.3.238 · Cited by 402
Wells, K. B., Burnam, M. A., Leake, B., & Robins, L. N. (1988) · Journal of Psychiatric Research · doi:10.1016/0022-3956(88)90006-4 · Cited by 230 · cited 1×
“Previous studies have examined the comparability of face-to-face and telephoneadministered interviews for obtaining data on health status or psychiatric symptoms [ 5-8 ].”
BackgroundGetting What You Ask For: On the Selectivity of Depression Rating Scales
Demyttenaere, K., & De Fruyt, J. (2003) · Psychotherapy and Psychosomatics · doi:10.1159/000068690 · Cited by 206 · cited 2×
“Total scores on the MADRS range from 0 to 60 [1].”
BackgroundMeasuring Depression in the Community: A Comparison of Telephone and Personal Interviews
Aneshensel, C. S., Frerichs, R. R., Clark, V. A., & Yokopenic, P. A. (1982) · Public Opinion Quarterly · doi:10.1086/268703 · Cited by 180 · cited 1×
“Previous studies have examined the comparability of face-to-face and telephoneadministered interviews for obtaining data on health status or psychiatric symptoms [5-8].”
Background(2002) · PubMed · Cited by 144
Observer Reliability and Agreement
de Vet, H. C. W. (2005) · Wiley eBooks · doi:10.1002/0470011815.b2a04033 · Cited by 62 · cited 2×
“The 'limits of agreement' are calculated (mean difference ± 2*SD) defining the range that contains 95% of all differences [19,22,23].”
BackgroundMethodTwo Methods of Psychiatric Interviewing: Telephone and Face-To-Face
Simon, R. J., Fleiss, J. L., Fisher, B., & Gurland, B. J. (1974) · The Journal of Psychology · doi:10.1080/00223980.1974.9915723 · Cited by 27 · cited 1×
“Previous studies have examined the comparability of face-to-face and telephoneadministered interviews for obtaining data on health status or psychiatric symptoms [5-8].”
BackgroundA statistical criterion for parallel tests.
Gulliksen, H. O. (2011) · John Wiley & Sons, Inc. eBooks · doi:10.1037/13240-014 · Cited by 3 · cited 3×
“The test of Wilks [25] was not significant, neither for the 10 item scales (χ2 df2 (F,T) = 5.”
BackgroundMethodInfluential
Research works printed but not linked: 4
- Hartong EGThM Goekoop JG De Montgomery-Åsberg beoordelingsschaal voor depressie Tijdschrift voor Psychiatrie 1985 27 657 668
- Van Marwijk HWJ Grundmeijer HGLM Brueren MM Sigling HOHJ Stolk J Van Gelderen MG NHG-Standaard Depressie. [Guidelines on Depression of the Dutch College of General Practitioners] Huisarts Wet 1994 37 482 490
- Ashcraft MH Cognition 2002 3 Upper Saddle River, New Jersey: Pearson Education
- Shavelson RJ Webb NM Generalizibility Theory 1991 Newbury Park London New Delhi: Sage Publication
Cited by
Single-Dose Psilocybin Treatment for Major Depressive Disorder: A Randomized Clinical Trial
Raison, C. L., Sanacora, G., Woolley, J., Heinzerling, K., Dunlop, B. W., Brown, R. T., Kakar, R., Hassman, M., Trivedi, R. P., Robison, R., et al. (2023) · JAMA · doi:10.1001/jama.2023.14530 · Cited by 545
Williams, J. B. W., & Kobak, K. A. (2008) · British Journal of Psychiatry · doi:10.1192/bjp.bp.106.032532 · Cited by 463
“This technique has been used successfully in self-report and telephone-administered versions of the MADRS, 10,19 as well as in computerised and paper-and-pencil self-report versions of the HRSD 20,21 and the Hamilton Rating Scale for Anxiety.”
Preferences and perceived barriers to treatment for depression during the perinatal period
O'Mahen, H. A., & Flynn, H. A. (2008) · Journal of Women s Health · doi:10.1089/jwh.2007.0631 · Cited by 277
A randomized controlled trial of mindfulness‐based cognitive therapy for bipolar disorder
Perich, T., Manicavasagar, V., Mitchell, P. B., Ball, J. R., & Hadzi‐Pavlovic, D. (2013) · Acta Psychiatrica Scandinavica · doi:10.1111/acps.12033 · Cited by 136
“85) (30) and inter-rater reliability (0.”
Randomized trial of ketamine masked by surgical anesthesia in patients with depression
Lii, T. R., Smith, A. E., Flohr, J. R., Okada, R. L., Nyongesa, C. A., Cianfichi, L. J., Hack, L. M., Schatzberg, A. F., & Heifets, B. D. (2023) · Nature Mental Health · doi:10.1038/s44220-023-00140-x · Cited by 139
“These scales were administered in person or by secure videoconference or telephone, which has been validated for the PHQ 77 , HADS 78 and MADRS 79,80 .”
Method
Metadata
- Authors
- Hermens, M. L., Adèr, H. J., van Hout, H. P., Terluin, B., van Dyck, R., & de Haan, M.
- Affiliations
- Amsterdam UMC Location Vrije Universiteit Amsterdam (NL)
- ORCID
- Terluin, Berend
- Venue
- Annals of General Psychiatry
- Published
- 2006-03-22
- Volume
- 5
- Issue
- 1
- Pages
- 3-3
- ISSN
- 1744-859X (ISSN-L)
- PMC
- PMC1435896
- OpenAlex
- W2156458337
- Semantic Scholar
- f459d7412013a301dea50e90378bd97c420e777e
- Cited by
- 47
- References
- 31
- Citations by year
- 2026: 1 · 2025: 5 · 2024: 2 · 2023: 5 · 2022: 3 · 2021: 1 · 2020: 1 · 2019: 4 · 2017: 1 · 2016: 1 · 2015: 1 · 2014: 2 · 2013: 2 · 2012: 2
- FWCI
- 3.36
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0/ (tdm)
- creativecommons.org/licenses/by/2.0/ (vor)
- Locations
- Annals of General Psychiatry (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion, other-oa)
- Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion, other-oa)
- UvA-DARE (University of Amsterdam) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- Montgomery-Asberg Depression Rating Scale, telephone administration, inter-rater reliability, primary care depression, mild depression, scale validity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
