The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Cross-Cultural Validity and Reliability Testing of a Standard Psychiatric Assessment Instrument without a Gold Standard
Abstract
The objective of this study was to assess the cross-culture validity and reliability of a standard psychiatric assessment instrument without the usual "gold standards." Normally criterion validity testing requires comparison with such a standard--usually another instrument or a professional diagnosis. Instead local informants identified persons with and without "agahinda gakabije" (a locally described grief syndrome) who were then asked if they thought they had this syndrome and also interviewed using the depression section of the Hopkins Symptom Checklist (DHSCL). To assess criterion validity, interviews where respondent and informant agreed on the presence or absence of agahinda gakabije were compared with depression diagnosis using the DHSCL. We also assessed construct validity (using factor analysis), internal reliability (Cronbach's alpha), and test-retest reliability using results from a subsequent community-based survey employing the DHSCL. We found a similar relationship between depression and agahinda gakabije as between depression and grief in western countries, which supports criterion validity. Construct validity and internal reliability were good (Cronbach's alpha = 0.87). Test-retest reliability of a DHSCL-based scale was less adequate (0.67). Although not replacing the usual gold standards for testing criterion validity, this approach may prove useful where these standards are unavailable. As this includes much of the developing world, this could result in more accurate mental health assessments among populations for whom this has hitherto not been possible.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The modification and cross-cultural validation of the HSCL with this population has been described (Bolton, 2001), as has the development and validation of the function instrument (Bolton & Tang, 2002).”
From Group interpersonal psychotherapy for depression in rural Uganda: 6-month outcomes: Randomised controlled trial (2006) · cites this paper as Bolton, 2001
Citations
Cites
The Hopkins Symptom Checklist (HSCL): A self-report symptom inventory
Derogatis, L. R., Lipman, R. S., Rickels, K., Uhlenhuth, E. H., & Covi, L. (1974) · Behavioral Science · doi:10.1002/bs.3830190102 · Cited by 4,604
(1987) · American Journal of Psychiatry · doi:10.1176/ajp.144.4.497 · Cited by 712
Mollica, R. F. (1999) · JAMA · doi:10.1001/jama.282.5.433 · Cited by 466
BRUCE, M. L., Kim, K., Leaf, P. J., & Jacobs, S. (1990) · American Journal of Psychiatry · doi:10.1176/ajp.147.5.608 · Cited by 164
Local Perceptions of the Mental Health Effects of the Rwandan Genocide
Bolton, P. A. (2001) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-200104000-00006 · Cited by 141
Self-citationClinical and Biological Aspects of Bereavement and Loss-Induced Depression: A Reappraisal
Biondi, M., & Picardi, A. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000289082 · Cited by 91
Bech, P., Allerup, P., Maier, W., Albus, M., Lavori, P., & Ayuso, J. L. (1992) · British Journal of Psychiatry · doi:10.1192/bjp.160.2.206 · Cited by 75
Screening for major depression in vietnamese refugees
Hinton, W. L., Du, N., Chen, Y.-C. J., Tran, C. G., Newman, T. B., & Lu, F. G. (1994) · Journal of General Internal Medicine · doi:10.1007/bf02600124 · Cited by 67
Psychiatric Complications of Bereavement
Jacobs, S., & Kim, K. (1990) · Psychiatric Annals · doi:10.3928/0048-5713-19900601-08 · Cited by 41
Helmes, E., & Nielson, W. R. (1998) · Personality and Individual Differences · doi:10.1016/s0191-8869(98)00110-x · Cited by 26
Flagged first, then by citations
Cited by
Sorted by citations
Group Interpersonal Psychotherapy for Depression in Rural Uganda: A Randomized Controlled Trial
Bolton, P., Bass, J., Neugebauer, R., Verdeli, H., Clougherty, K. F., Wickramaratne, P., Speelman, L., Ndogoni, L., & Weissman, M. (2003) · JAMA · doi:10.1001/jama.289.23.3117 · Cited by 655
“Moreover, the tasks assessed were those previously chosen by a sample of the population as being particularly important to them.(6) Therefore, we believe that a large improvement in the ability to do these tasks could significantly affect community welfare and development, depending on how many people are affected by…”
MethodSelf-citationBolton, P., Bass, J., Betancourt, T., Speelman, L., Onyango, G., Clougherty, K. F., Neugebauer, R., Murray, L., & Verdeli, H. (2007) · JAMA · doi:10.1001/jama.298.5.519 · Cited by 589
“Therefore, we used an alternative method of exploring criterion validity.(10) We identified individuals among this group for whom youth-caregiver pairs concurred that the youth had at least 2 of the 3 local depression-like syndromes(cases)andpairs concurring that the youth had none of these syndromes (noncases).”
MethodSelf-citationvan Ginneken, N., Tharyan, P., Lewin, S., Rao, G. N., Meera, S., Pian, J., Chandrashekar, S., & Patel, V. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009149.pub2 · Cited by 575
Ali, G.-C., Ryan, G., & De Silva, M. J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0156939 · Cited by 358
“The most reliable gold standards employed in cross-cultural mental health research are diagnostic interviews conducted by qualified mental health professionals [16].”
BackgroundMethodHossain, M., Zimmerman, C., Abas, M., Light, M., & Watts, C. H. (2010) · American Journal of Public Health · doi:10.2105/ajph.2009.173229 · Cited by 366
Metadata
- Authors
- BOLTON, P.
- Affiliations
- Johns Hopkins University (US)
- Corresponding author
- BOLTON, PAUL
- ORCID
- BOLTON, PAUL
- Venue
- The Journal of Nervous and Mental Disease
- Published
- 2001-04
- Volume
- 189
- Issue
- 4
- Pages
- 238-242
- ISSN
- 0022-3018 (ISSN-L)
- OpenAlex
- W1987889140
- Cited by
- 239
- References
- 11
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 13 · 2023: 3 · 2022: 12 · 2021: 20 · 2020: 10 · 2019: 13 · 2018: 10 · 2017: 13 · 2016: 5 · 2015: 14 · 2014: 22 · 2013: 13 · 2012: 8
- FWCI
- 5.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Nervous and Mental Disease (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- cross-cultural validity, criterion validity, psychiatric assessment instruments, depression, Hopkins Symptom Checklist, local informants, test-retest reliability, construct validity, mental health assessment, developing countries
- MeSH terms
- Adult, Anthropology, Cultural, Cross-Cultural Comparison, Depressive Disorder, Factor Analysis, Statistical, Female, Health Services Needs and Demand, Homicide, Humans, Life Change Events, Male, Medicine, Traditional, Personality Inventory, Psychometrics, Rwanda, Sampling Studies, Sensitivity and Specificity, Sex Factors, Stress Disorders, Post-Traumatic, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review