Cited by 239Psychometric Methodologies and TestingHealth Education and ValidationMental Health Treatment and Access

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Cross-Cultural Validity and Reliability Testing of a Standard Psychiatric Assessment Instrument without a Gold Standard

BOLTON, PAUL·2001·The Journal of Nervous and Mental Disease

DOI 10.1097/00005053-200104000-00005

Open this paper in CoChat — free account

Abstract

The objective of this study was to assess the cross-culture validity and reliability of a standard psychiatric assessment instrument without the usual "gold standards." Normally criterion validity testing requires comparison with such a standard--usually another instrument or a professional diagnosis. Instead local informants identified persons with and without "agahinda gakabije" (a locally described grief syndrome) who were then asked if they thought they had this syndrome and also interviewed using the depression section of the Hopkins Symptom Checklist (DHSCL). To assess criterion validity, interviews where respondent and informant agreed on the presence or absence of agahinda gakabije were compared with depression diagnosis using the DHSCL. We also assessed construct validity (using factor analysis), internal reliability (Cronbach's alpha), and test-retest reliability using results from a subsequent community-based survey employing the DHSCL. We found a similar relationship between depression and agahinda gakabije as between depression and grief in western countries, which supports criterion validity. Construct validity and internal reliability were good (Cronbach's alpha = 0.87). Test-retest reliability of a DHSCL-based scale was less adequate (0.67). Although not replacing the usual gold standards for testing criterion validity, this approach may prove useful where these standards are unavailable. As this includes much of the developing world, this could result in more accurate mental health assessments among populations for whom this has hitherto not been possible.

Integrity signals

Registry

Crossref · 10.1097/00005053-200104000-00005

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The Hopkins Symptom Checklist (HSCL): A self-report symptom inventory
Derogatis, L. R., Lipman, R. S., Rickels, K., Uhlenhuth, E. H., & Covi, L. (1974) · Behavioral Science · doi:10.1002/bs.3830190102 · Cited by 4,604
Indochinese versions of the Hopkins Symptom Checklist-25: a screening instrument for the psychiatric care of refugees.
(1987) · American Journal of Psychiatry · doi:10.1176/ajp.144.4.497 · Cited by 712
Disability Associated With Psychiatric Comorbidity and Health Status in Bosnian Refugees Living in Croatia
Mollica, R. F. (1999) · JAMA · doi:10.1001/jama.282.5.433 · Cited by 466
Depressive episodes and dysphoria resulting from conjugal bereavement in a prospective community sample
BRUCE, M. L., Kim, K., Leaf, P. J., & Jacobs, S. (1990) · American Journal of Psychiatry · doi:10.1176/ajp.147.5.608 · Cited by 164
Local Perceptions of the Mental Health Effects of the Rwandan Genocide
Bolton, P. A. (2001) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-200104000-00006 · Cited by 141
Self-citation
Clinical and Biological Aspects of Bereavement and Loss-Induced Depression: A Reappraisal
Biondi, M., & Picardi, A. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000289082 · Cited by 91
The Hamilton Scales and the Hopkins Symptom Checklist (SCL–90): A Cross-National Validity Study in Patients with Panic Disorders
Bech, P., Allerup, P., Maier, W., Albus, M., Lavori, P., & Ayuso, J. L. (1992) · British Journal of Psychiatry · doi:10.1192/bjp.160.2.206 · Cited by 75
Screening for major depression in vietnamese refugees
Hinton, W. L., Du, N., Chen, Y.-C. J., Tran, C. G., Newman, T. B., & Lu, F. G. (1994) · Journal of General Internal Medicine · doi:10.1007/bf02600124 · Cited by 67
Psychiatric Complications of Bereavement
Jacobs, S., & Kim, K. (1990) · Psychiatric Annals · doi:10.3928/0048-5713-19900601-08 · Cited by 41
An examination of the internal structure of the Center for Epidemiological Studies-Depression Scale in two medical samples
Helmes, E., & Nielson, W. R. (1998) · Personality and Individual Differences · doi:10.1016/s0191-8869(98)00110-x · Cited by 26

Show all 11 references

Sorted by citations

Items 201–237 of 237

An evaluation of the Kakuma Emotional Wellbeing Interview (KEWI)
Horn, R. (2009) · Intervention · doi:10.1097/wtf.0b013e32833463d3 · Cited by 1
The Function of Specialized Vocabulary Development in Psychosocial Rehabilitation in Traumatized Populations
Willis, A. S., & Nagel, M. (2018) · Journal of Human Rights and Social Work · doi:10.1007/s41134-017-0046-z · Cited by 1
Counting What Counts: Epidemiologic Measurement and Generating Meaningful Findings
Kaiser, B. N. (2021) · Springer eBooks · doi:10.1007/978-3-030-66296-7_6 · Cited by 1
Life Goes On: Psychosocial Suffering from war and healing pathways in northern Rwanda.
Otake, Y. (2017) · LSHTM Research Online (London School of Hygiene and Tropical Medicine) · doi:10.17037/pubs.04645469 · Cited by 1
“with the Bolton’s (2001a) study in Kigali, Rwanda; he found the application of the concept of ‘trauma’ only occurred in a community where foreign aid organizations taught it.”
BackgroundMethodResultInfluential
Cognitive interviewing to assess and adapt three measures of mental health symptoms among people living with HIV in Rakai, Uganda: the Thinking a Lot Questionnaire, the Patient Health Questionnaire 9 (PHQ-9), and the Hopkins Symptoms Checklist (HSCL)Preprint
West, N., Namuganga, L. P., Isabirye, D., Nakubulwa, R., Ddaaki, W. G., Nakyanjo, N., Nalugoda, F. K., Murray, S. M., & Kennedy, C. E. (2024) · Research Square · doi:10.21203/rs.3.rs-4697900/v1 · Cited by 1
Human resources and capacity building
Okpaku, S. O. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9781139136341.033
Measuring psychosocial wellbeing in Democratic Republic of Congo report of a pilot study
Horn, R. (2014)
Evaluation of the Possibility to Decontaminate a Medical Triage Tag
Trabold, F., Zink, J. C., Grandgeorge, M. P., Allemann, H., Woehl, J. M., Muller, D. A., & Giordan, D. (2010) · Prehospital and Disaster Medicine · doi:10.1017/s1049023x00023438
Israeli Field Clinic Sent to Sri Lanka—A Provisional Alternative to the Local Medical System of the Community of Balapitya
Feigenberg, Z. (2005) · Prehospital and Disaster Medicine · doi:10.1017/s1049023x0001462x
System Developments—New Horizons and Evaluation
Walter, D., & Wulterkens, D. (2008) · Prehospital and Disaster Medicine · doi:10.1017/s1049023x00021336
Men’s engagement with mental health treatment: towards inclusive interventions in low-income contexts
Lakin, D. P. (2019)
Transkulturelle Aspekte psychischer Erkrankungen
Machleidt, W., & Graef-Calliess, I. T. (2015) · Springer eBooks · doi:10.1007/978-3-642-45028-0_17-1 · Cited by 1
Task Shifting
Kinyanjui, D. W., & Ayuku, D. (2021) · Springer eBooks · doi:10.1007/978-3-319-70134-9_143-1
Task Shifting
Kinyanjui, D. W., & Ayuku, D. (2021) · Springer eBooks · doi:10.1007/978-3-030-57296-9_143
Toward Assessment of Child Survivors of Restavèk in Haiti: Development and Evaluation of a Locally Adapted Psychosocial Assessment Instrument
Kennedy, C. L. (2015) · Slavery Today Journal · doi:10.22150/stj/ugtl9677
Data Mining-driven Multiple Regression Analysis of Cultural Identity in International Students’ Perceptions of Chinese Culture
Zhang, L. J. L. (2024) · Journal of Electrical Systems · doi:10.52783/jes.1626
“Like Bolton P. did 2011 (Bolton P,2011) [40], employing SPSS 27.0, the standardized Cronbach’s Alpha coefficient was calculated to be 0.729, significantly surpassing the standard threshold of 0.6.”
MethodInfluential
Hindi translation and validation of Ultra Brief peripartum Mental Health Screening Tool (UBPMHST)
Harit, I., Kukreti, P., Kataria, D. K., Puri, M., Goel, M. K., & Prasad, S. (2026) · BMC Psychology · doi:10.1186/s40359-025-03269-9
“Screening tools must be locally validated against a ‘gold standard’ diagnostic interview prior to use, in order to assess their validity, establish appropriate diagnostic thresholds and ensure their cultural appropriateness and acceptability [13].”
Neural correlates of resilience under different operational definitions: A resting-state fMRI studyPreprint
Tai, A. P.-L., Leung, M.-K., Yuen, K. C. P., Geng, X., & Lau, W. K. (2024) · Research Square · doi:10.21203/rs.3.rs-4356664/v1
Ethics and Morale in Global Mental Health Work
Cherepanov, E. (2024) · Contemporary humanitarian action and emergency management · doi:10.1007/978-3-031-74268-2_10
Cultural adaptation and psychometric properties of the 8-item Patient Health Questionnaire (PHQ-8) to screen for depression in southwestern Madagascar
Randriamady, H. J., Sharma, M., Stroud, R. E., Falinirina, A. M., Romario, Rasoanirina, M., Volasoa, N. V., Declèrque, F., Solofoarimanana, M. Y., Mahefa, J. C., et al. (2025) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2025.10032 · Cited by 1
“Only a few studies have considered this approach when adapting or developing measures to screen for depression in Africa (e.g., Bolton, 2001; Bolton et al., 2004; Betancourt et al., 2009), and there is now a greater emphasis on incorporating culturally specific symptoms into Western measures for…”
An analysis of the constraints and opportunities for scaling-up health human resources in the delivery of a non-pharmacological intervention for the treatment of depression in Uganda
Matthews, S. (2008) · Summit (Simon Fraser University)
Additional file 2 of Validated screening tools to identify common mental disorders in perinatal and postpartum women in India: a systematic review and meta-analysis
Fellmeth, G. L., Harrison, S., Opondo, C., Nair, M., Kurinczuk, J. J., & Alderdice, F. (2021) · Figshare · doi:10.6084/m9.figshare.14456819
Additional file 1 of The development of a contextually appropriate measure of psychological distress in Sierra Leone
Horn, R., Jailobaeva, K., Arakelyan, S., & Ager, A. (2021) · Figshare · doi:10.6084/m9.figshare.15032977
Additional file 2 of Measuring implementation in global mental health: validation of a pragmatic implementation science measure in eastern Ukraine using an experimental vignette design
Haroz, E. E., Bolton, P. A., Nguyen, A. J., Lee, C., Bogdanov, S., Bass, J., Singh, N. S., Doty, B., & Murray, L. K. (2019) · Figshare · doi:10.6084/m9.figshare.8057684
Self-citation
Additional file 2 of Broadening the scope of social support, coping skills and resilience among caretakers of children with disabilities in Uganda: a sequential explanatory mixed-methods study
Namasaba, M., Kazembe, N., Seera, G., & Baguwemu, A. A. (2022) · Figshare · doi:10.6084/m9.figshare.19556203
Additional file 4 of Validated screening tools to identify common mental disorders in perinatal and postpartum women in India: a systematic review and meta-analysis
Fellmeth, G. L., Harrison, S., Opondo, C., Nair, M., Kurinczuk, J. J., & Alderdice, F. (2021) · Figshare · doi:10.6084/m9.figshare.14456825
Additional file 3 of Validated screening tools to identify common mental disorders in perinatal and postpartum women in India: a systematic review and meta-analysis
Fellmeth, G. L., Harrison, S., Opondo, C., Nair, M., Kurinczuk, J. J., & Alderdice, F. (2021) · Figshare · doi:10.6084/m9.figshare.14456822
Additional file 3 of Broadening the scope of social support, coping skills and resilience among caretakers of children with disabilities in Uganda: a sequential explanatory mixed-methods study
Namasaba, M., Kazembe, N., Seera, G., & Baguwemu, A. A. (2022) · Figshare · doi:10.6084/m9.figshare.19556206
Additional file 1 of Broadening the scope of social support, coping skills and resilience among caretakers of children with disabilities in Uganda: a sequential explanatory mixed-methods study
Namasaba, M., Kazembe, N., Seera, G., & Baguwemu, A. A. (2022) · Figshare · doi:10.6084/m9.figshare.19556200
Additional file 3 of Measuring implementation in global mental health: validation of a pragmatic implementation science measure in eastern Ukraine using an experimental vignette design
Haroz, E. E., Bolton, P. A., Nguyen, A. J., Lee, C., Bogdanov, S., Bass, J., Singh, N. S., Doty, B., & Murray, L. K. (2019) · Figshare · doi:10.6084/m9.figshare.8057690
Self-citation
Additional file 4 of Measuring implementation in global mental health: validation of a pragmatic implementation science measure in eastern Ukraine using an experimental vignette design
Haroz, E. E., Bolton, P. A., Nguyen, A. J., Lee, C., Bogdanov, S., Bass, J., Singh, N. S., Doty, B., & Murray, L. K. (2019) · Figshare · doi:10.6084/m9.figshare.8057696
Self-citation
Additional file 5 of Measuring implementation in global mental health: validation of a pragmatic implementation science measure in eastern Ukraine using an experimental vignette design
Haroz, E. E., Bolton, P. A., Nguyen, A. J., Lee, C., Bogdanov, S., Bass, J., Singh, N. S., Doty, B., & Murray, L. K. (2019) · Figshare · doi:10.6084/m9.figshare.8057702
Self-citation
Additional file 1 of Assessing factors associated with poor maternal mental health among mothers of children born small and sick at 24–47 months in rural Rwanda
Abimana, M. C., Karangwa, E., Hakizimana, I., Kirk, C. M., Beck, K., Miller, A. C., Havugarurema, S., Bahizi, S., Uwamahoro, A., Wilson, K. A., et al. (2020) · Figshare · doi:10.6084/m9.figshare.13126479
Additional file 1 of Measuring implementation in global mental health: validation of a pragmatic implementation science measure in eastern Ukraine using an experimental vignette design
Haroz, E. E., Bolton, P. A., Nguyen, A. J., Lee, C., Bogdanov, S., Bass, J., Singh, N. S., Doty, B., & Murray, L. K. (2019) · Figshare · doi:10.6084/m9.figshare.8057678
Self-citation
Additional file 1 of Validated screening tools to identify common mental disorders in perinatal and postpartum women in India: a systematic review and meta-analysis
Fellmeth, G. L., Harrison, S., Opondo, C., Nair, M., Kurinczuk, J. J., & Alderdice, F. (2021) · Figshare · doi:10.6084/m9.figshare.14456816
Additional file 4 of Broadening the scope of social support, coping skills and resilience among caretakers of children with disabilities in Uganda: a sequential explanatory mixed-methods study
Namasaba, M., Kazembe, N., Seera, G., & Baguwemu, A. A. (2022) · Figshare · doi:10.6084/m9.figshare.19556209
Completing the journey : an exploratory study of factors predicting emotional distress in recently resettled adult refugees.
Rhema (2014) · doi:10.18297/etd/1199
“Additional research testing cross-cultural reliability and validity using Ki-Swahili terms concluded that the instrument has criterion validity (Bolton, 2001).”
Background

Authors: BOLTON, P.
Affiliations: Johns Hopkins University (US)
Corresponding author: BOLTON, PAUL
ORCID: BOLTON, PAUL
Venue: The Journal of Nervous and Mental Disease
Publisher: Ovid Technologies (Wolters Kluwer Health)
Published: 2001-04
Volume: 189
Issue: 4
Pages: 238-242
ISSN: 0022-3018 (ISSN-L)
DOI: 10.1097/00005053-200104000-00005
OpenAlex: W1987889140
Cited by: 239
References: 11
Citations by year: 2026: 2 · 2025: 5 · 2024: 13 · 2023: 3 · 2022: 12 · 2021: 20 · 2020: 10 · 2019: 13 · 2018: 10 · 2017: 13 · 2016: 5 · 2015: 14 · 2014: 22 · 2013: 13 · 2012: 8
FWCI: 5.12
Type: journal article
Language: en
Open access: closed
Locations: The Journal of Nervous and Mental Disease (publishedVersion)
PubMed (publishedVersion)
Topics: Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Health Sciences › Nursing › Research and Theory › Health Education and Validation
Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
Keywords: cross-cultural validity, criterion validity, psychiatric assessment instruments, depression, Hopkins Symptom Checklist, local informants, test-retest reliability, construct validity, mental health assessment, developing countries
MeSH terms: Adult, Anthropology, Cultural, Cross-Cultural Comparison, Depressive Disorder, Factor Analysis, Statistical, Female, Health Services Needs and Demand, Homicide, Humans, Life Change Events, Male, Medicine, Traditional, Personality Inventory, Psychometrics, Rwanda, Sampling Studies, Sensitivity and Specificity, Sex Factors, Stress Disorders, Post-Traumatic, Reproducibility of Results

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Cross-Cultural Validity and Reliability Testing of a Standard Psychiatric Assessment Instrument without a Gold Standard

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks