The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Cross-Cultural Validity and Reliability Testing of a Standard Psychiatric Assessment Instrument without a Gold Standard
Abstract
The objective of this study was to assess the cross-culture validity and reliability of a standard psychiatric assessment instrument without the usual "gold standards." Normally criterion validity testing requires comparison with such a standard--usually another instrument or a professional diagnosis. Instead local informants identified persons with and without "agahinda gakabije" (a locally described grief syndrome) who were then asked if they thought they had this syndrome and also interviewed using the depression section of the Hopkins Symptom Checklist (DHSCL). To assess criterion validity, interviews where respondent and informant agreed on the presence or absence of agahinda gakabije were compared with depression diagnosis using the DHSCL. We also assessed construct validity (using factor analysis), internal reliability (Cronbach's alpha), and test-retest reliability using results from a subsequent community-based survey employing the DHSCL. We found a similar relationship between depression and agahinda gakabije as between depression and grief in western countries, which supports criterion validity. Construct validity and internal reliability were good (Cronbach's alpha = 0.87). Test-retest reliability of a DHSCL-based scale was less adequate (0.67). Although not replacing the usual gold standards for testing criterion validity, this approach may prove useful where these standards are unavailable. As this includes much of the developing world, this could result in more accurate mental health assessments among populations for whom this has hitherto not been possible.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The modification and cross-cultural validation of the HSCL with this population has been described (Bolton, 2001), as has the development and validation of the function instrument (Bolton & Tang, 2002).”
From Group interpersonal psychotherapy for depression in rural Uganda: 6-month outcomes: Randomised controlled trial (2006) · cites this paper as Bolton, 2001
Citations
Cites
The Hopkins Symptom Checklist (HSCL): A self-report symptom inventory
Derogatis, L. R., Lipman, R. S., Rickels, K., Uhlenhuth, E. H., & Covi, L. (1974) · Behavioral Science · doi:10.1002/bs.3830190102 · Cited by 4,604
(1987) · American Journal of Psychiatry · doi:10.1176/ajp.144.4.497 · Cited by 712
Mollica, R. F. (1999) · JAMA · doi:10.1001/jama.282.5.433 · Cited by 466
BRUCE, M. L., Kim, K., Leaf, P. J., & Jacobs, S. (1990) · American Journal of Psychiatry · doi:10.1176/ajp.147.5.608 · Cited by 164
Local Perceptions of the Mental Health Effects of the Rwandan Genocide
Bolton, P. A. (2001) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-200104000-00006 · Cited by 141
Self-citationClinical and Biological Aspects of Bereavement and Loss-Induced Depression: A Reappraisal
Biondi, M., & Picardi, A. (2010) · Psychotherapy and Psychosomatics · doi:10.1159/000289082 · Cited by 91
Bech, P., Allerup, P., Maier, W., Albus, M., Lavori, P., & Ayuso, J. L. (1992) · British Journal of Psychiatry · doi:10.1192/bjp.160.2.206 · Cited by 75
Screening for major depression in vietnamese refugees
Hinton, W. L., Du, N., Chen, Y.-C. J., Tran, C. G., Newman, T. B., & Lu, F. G. (1994) · Journal of General Internal Medicine · doi:10.1007/bf02600124 · Cited by 67
Psychiatric Complications of Bereavement
Jacobs, S., & Kim, K. (1990) · Psychiatric Annals · doi:10.3928/0048-5713-19900601-08 · Cited by 41
Helmes, E., & Nielson, W. R. (1998) · Personality and Individual Differences · doi:10.1016/s0191-8869(98)00110-x · Cited by 26
Cited by
Sorted by citations
Group Interpersonal Psychotherapy for Depression in Rural Uganda: A Randomized Controlled Trial
Bolton, P., Bass, J., Neugebauer, R., Verdeli, H., Clougherty, K. F., Wickramaratne, P., Speelman, L., Ndogoni, L., & Weissman, M. (2003) · JAMA · doi:10.1001/jama.289.23.3117 · Cited by 655
“Moreover, the tasks assessed were those previously chosen by a sample of the population as being particularly important to them.(6) Therefore, we believe that a large improvement in the ability to do these tasks could significantly affect community welfare and development, depending on how many people are affected by…”
MethodSelf-citationBolton, P., Bass, J., Betancourt, T., Speelman, L., Onyango, G., Clougherty, K. F., Neugebauer, R., Murray, L., & Verdeli, H. (2007) · JAMA · doi:10.1001/jama.298.5.519 · Cited by 589
“Therefore, we used an alternative method of exploring criterion validity.(10) We identified individuals among this group for whom youth-caregiver pairs concurred that the youth had at least 2 of the 3 local depression-like syndromes(cases)andpairs concurring that the youth had none of these syndromes (noncases).”
MethodSelf-citationvan Ginneken, N., Tharyan, P., Lewin, S., Rao, G. N., Meera, S., Pian, J., Chandrashekar, S., & Patel, V. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009149.pub2 · Cited by 575
Ali, G.-C., Ryan, G., & De Silva, M. J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0156939 · Cited by 358
“The most reliable gold standards employed in cross-cultural mental health research are diagnostic interviews conducted by qualified mental health professionals [16].”
BackgroundMethodHossain, M., Zimmerman, C., Abas, M., Light, M., & Watts, C. H. (2010) · American Journal of Public Health · doi:10.2105/ajph.2009.173229 · Cited by 366
Shoeb, M., Weinstein, H. M., & Mollica, R. F. (2007) · International Journal of Social Psychiatry · doi:10.1177/0020764007078362 · Cited by 274
“Bolton (2001) used three ethnographic qualitative methods to investigate Rwandans’ perceptions of problems following the 1994 genocidal confl ict and the local validity of Western concepts and to adapt existing measures, such as the HSCL-25, for local use.”
BackgroundMethodIntergenerational Trauma: Convergence of Multiple Processes among First Nations peoples in Canada
Bombay, A., Matheson, K., & Anisman, H. (2009) · International Journal of Indigenous Health · doi:10.18357/ijih53200912337 · Cited by 219
“For a detailed explanation of the process necessary for the development of assessment instruments and their validation, several excellent reviews and books are available (Bolton, 2001; Marsella et al., 2002; Mollica et al., 1992).”
Kiss, L., Pocock, N. S., Naisanguansri, V., Suos, S., Dickson, B., Thuy, D., Koehler, J., Sirisup, K., Pongrungsee, N., Nguyen, V. A., et al. (2015) · The Lancet Global Health · doi:10.1016/s2214-109x(15)70016-1 · Cited by 222
Kohrt, B. A., Jordans, M. J., Tol, W. A., Luitel, N. P., Maharjan, S. M., & Upadhaya, N. (2011) · BMC Psychiatry · doi:10.1186/1471-244x-11-127 · Cited by 213
“Bolton and colleagues have developed a validation approach that uses rapid ethnographic measures to pronounce cross-cultural applicability when concordance between Western measures and local idioms is demonstrated [15].”
Bass, J., Neugebauer, R., Clougherty, K. F., Verdeli, H., Wickramaratne, P., Ndogoni, L., Speelman, L., Weissman, M., & Bolton, P. (2006) · British Journal of Psychiatry · doi:10.1192/bjp.188.6.567 · Cited by 214
“The modification and cross-cultural validation of the HSCL with this population has been described (Bolton, 2001), as has the development and validation of the function instrument (Bolton & Tang, 2002).”
Self-citationPosttraumatic Resilience in Former Ugandan Child Soldiers
Klasen, F., Oettingen, G., Daniels, J. K., Post, M., Hoyer, C., & Adam, H. (2010) · Child Development · doi:10.1111/j.1467-8624.2010.01456.x · Cited by 213
“Assessment of crossculture validity and reliability of standard psychiatric measurements are needed even without the usual ‘‘gold standards’’ (Bolton, 2001).”
BackgroundPsychological distress among displaced persons during an armed conflict in Nepal
Thapa, S. B., & Hauff, E. (2005) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-005-0943-9 · Cited by 206
“The other important issue [28] that has rarely been considered when carrying out a mental health survey, especially in low-income countries, is the need for a cultural validation of international instruments [1, 16].”
BackgroundPackages of care for depression in low- and middle-income countries
Patel, V., Simon, G., Chowdhary, N., Kaaya, S., & Araya, R. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000159 · Cited by 202
“syndrome approximating depression derived from ethnographic research, this instrument had a sensitivity of 95% [58], Further,”
MethodBuilding an evidence base on mental health interventions for children affected by armed conflict
Betancourt, T. S., & Williams, T. P. (2008) · Intervention · doi:10.1097/wtf.0b013e3282f761ff · Cited by 210
“Unautho 52 canbe highly ethical andoftenmatchedwith the natural roll out of interventions while contributing to the knowledge base (Bolton &Betancourt,2004).Going forward, applied research must aim to ensure unbiased/ randomised assignments of study participants to treatment protocols and the use of control groups. Re…”
Roberts, B., Damundu, E. Y., Lomoro, O., & Sondorp, E. (2009) · BMC Psychiatry · doi:10.1186/1471-244x-9-7 · Cited by 203
“However, further research is required to establish the sensitivity and specificity of mental health diagnostic instruments in Southern Sudan and other conflict-affected areas [24,39,42,43].”
van Ginneken, N., Chin, W. Y., Lim, Y. C., Ussif, A., Singh, R. K., Shahmalak, U., Purgato, M., Rojas‐García, A., Uphoff, E., McMullen, S., et al. (2021) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009149.pub3 · Cited by 198
Assessment of depression prevalence in rural Uganda using symptom and function criteria
Bolton, P., Wilk, C., & Ndogoni, L. (2004) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-004-0763-3 · Cited by 219
“Symptom occurrence and duration were assessed using an approach described elsewhere [19].”
MethodSelf-citationPREVALENCE OF DEPRESSION IN RURAL RWANDA BASED ON SYMPTOM AND FUNCTIONAL CRITERIA
Bolton, P. A., Neugebauer, R., & Ndogoni, L. (2002) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-200209000-00009 · Cited by 167
“Prior to this survey, we had adapted and validated it among adults drawn from the same study population in Kanzenze (Bolton, 2001a).4 The A criteria have been applied to data obtained using the Hopkins Symptom Checklist (HSCL) in previous studies (Mollica et al., 1999, see Table 1).”
BackgroundMethodInfluentialSelf-citationChibanda, D., Benjamin, L. A., Weiss, H. A., & Abas, M. (2014) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000258 · Cited by 159
“If they are validated, the methods used should take into account local concepts of mental disorder.(18,19,25) In Uganda, a visual depression screening tool showed good psychometric properties among PLWH with low literacy.”
MethodMEASURING DEPRESSION AND ANXIETY IN SUB-SAHARAN AFRICA
Sweetland, A. C., Belkin, G. S., & Verdeli, H. (2013) · Depression and Anxiety · doi:10.1002/da.22142 · Cited by 145
“Bolton[28, 29] employed similar methods to validate the HCSL in Rwanda and Uganda and found several local syndromes that closely resembled Western “depression,” but that differed enough to require local instrument adaptation.”
MethodKiss, L., Yun, K., Pocock, N. S., & Zimmerman, C. (2015) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/jamapediatrics.2015.2278 · Cited by 142
Do not forget culture when studying mental health
Bass, J. K., Bolton, P. A., & Murray, L. K. (2007) · The Lancet · doi:10.1016/s0140-6736(07)61426-3 · Cited by 131
Self-citationDorsey, S., Lucid, L., Martin, P., King, K. M., O’Donnell, K., Murray, L. K., Wasonga, A. I., Itemba, D., Cohen, J. A., Manongi, R. N., et al. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2019.4475 · Cited by 126
Assessing local instrument reliability and validity: a field-based example from northern Uganda
Betancourt, T. S., Bass, J., Borisova, I., Neugebauer, R., Speelman, L., Onyango, G., & Bolton, P. (2009) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-008-0475-1 · Cited by 124
“The study presented here builds on methods originally developed for research among adults to identify salient mental health problems as well as select, adapt and validate appropriate mental health measures [12].”
MethodSelf-citationKaiser, B. N., Kohrt, B. A., Keys, H. M., Khoury, N. M., & Brewster, A.-R. T. (2013) · Transcultural Psychiatry · doi:10.1177/1363461513502697 · Cited by 134
“…interventions, the best approach to identifying and measuring mental disorders would appear to be a combination of adapting Western instruments (Bolton, 2001; van Ommeren et al., 1999); exploring additional nosologies, symptoms, and expressions that an adaptation-only approach would have…”
BackgroundMethodInfluentialOsborn, T. L., Venturo‐Conerly, K. E., Susana Arango, G., Roe, E., Rodriguez, M., Alemu, R. E. G., Gan, J. Y., Wasil, A. R., Otieno, B. H., Rusch, T. W., et al. (2021) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2021.1129 · Cited by 118
Reliability and Validity of Depression Assessment Among Persons With HIV in Sub-Saharan Africa
Tsai, A. C. (2014) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000210 · Cited by 109
Bass, J. K., Ryder, R. W., Lammers, M., Mukaba, T. N., & Bolton, P. A. (2008) · Tropical Medicine & International Health · doi:10.1111/j.1365-3156.2008.02160.x · Cited by 105
“To identify ‘cases’ and ‘non-cases’ we relied on identification and ‘diagnosis’ by local non-professionals, given the lack of an appropriate gold standard for evaluating specific mental illnesses among the study population (Bolton 2001b).”
MethodSelf-citationDepression in Sub-Saharan Africa
Gbadamosi, I., Henneh, I. T., Aluko, O. M., Yawson, E. O., Fokoua, A. R., Koomson, A. E., Torbi, J., Olorunnado, S. E., Lewu, F. S., Yusha’u, Y., et al. (2022) · IBRO Neuroscience Reports · doi:10.1016/j.ibneur.2022.03.005 · Cited by 134
Gadeberg, A. K., Montgomery, E., Frederiksen, H. W., & Norredam, M. (2017) · European Journal of Public Health · doi:10.1093/eurpub/ckx034 · Cited by 112
Murray, L. K., Dorsey, S., Skavenski, S. V. W., Kasoma, M., Imasiku, M. L., Bolton, P. A., Bass, J., & Cohen, J. A. (2013) · International Journal of Mental Health Systems · doi:10.1186/1752-4458-7-24 · Cited by 101
“Step 2 in the DIME process includes the development/ adaptation, translation, and validation of mental health assessment tools for the local population [34,35].”
MethodSelf-citationPsychological Assessment of Children in Disasters and Emergencies
Balaban, V. (2006) · Disasters · doi:10.1111/j.0361-3666.2006.00314.x · Cited by 107
Psychosocial challenges facing women living with HIV during the perinatal period in rural Uganda
Ashaba, S., Kaida, A., Coleman, J. N., Burns, B., Dunkley, E., O’Neil, K., Kastner, J., Sanyu, N., Akatukwasa, C., Bangsberg, D. R., et al. (2017) · PLoS ONE · doi:10.1371/journal.pone.0176256 · Cited by 101
Tsai, A. C., Bangsberg, D. R., Bwana, M., Haberer, J. E., Frongillo, E. A., Muzoora, C. K., Kumbakumba, E., Hunt, P. W., Martin, J. N., & Weiser, S. D. (2013) · AIDS and Behavior · doi:10.1007/s10461-013-0503-3 · Cited by 91
“Depression symptom severity was measured with the 15-item depression subscale of the Hopkins Symptom Checklist (HSCL) [38], modified for the local context with the addition of a 16th item (‘‘feeling like I don’t care about my health’’) [14, 39].”
MethodManifestations of affective disturbance in sub-Saharan Africa: Key themes
Tomlinson, M., Swartz, L. M., Kruger, L., & Gureje, O. (2006) · Journal of Affective Disorders · doi:10.1016/j.jad.2006.09.029 · Cited by 94
Tension Among Women in North India: An Idiom of Distress and a Cultural Syndrome
Weaver, L. J. (2017) · Culture Medicine and Psychiatry · doi:10.1007/s11013-016-9516-5 · Cited by 89
Martínez, P., Tsai, A. C., Muzoora, C. K., Kembabazi, A., Weiser, S. D., Huang, Y., Haberer, J. E., Martin, J. N., Bangsberg, D. R., & Hunt, P. W. (2013) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000062 · Cited by 83
Chan, B. T., Weiser, S. D., Boum, Y., Siedner, M. J., Mocello, A. R., Haberer, J. E., Hunt, P. W., Martin, J. N., Mayer, K. H., Bangsberg, D. R., et al. (2014) · AIDS · doi:10.1097/qad.0000000000000495 · Cited by 82
“The scale was adapted for the Ugandan context [28,29], with the four somatic items deleted to avoid possible overlap between symptoms of depression and symptoms of HIV infection [30].”
MethodHaroz, E. E., Bolton, P., Nguyen, A. J., Lee, C., Bogdanov, S., Bass, J., Singh, N. S., Doty, B., & Murray, L. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4097-y · Cited by 70
Self-citationHIV and Child Mental Health: A Case-Control Study in Rwanda
Betancourt, T. S., Scorza, P., Kanyanganzi, F., Fawzi, M. C. S., Sezibera, V., Cyamatare, F. R., Beardslee, W. R., Stulac, S. N., Bizimana, J. I., Stevenson, A., et al. (2014) · PEDIATRICS · doi:10.1542/peds.2013-2734 · Cited by 81
Severe mental disorders in complex emergencies
Jones, L., Asare, J. B., El Masri, M., Mohanraj, A., Sherief, H., & van Ommeren, M. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61253-8 · Cited by 145
Fawzi, M. C. S., Eustache, E., Oswald, C., Louis, E., Surkan, P. J., Scanlan, F., Hook, S., Mancuso, A., & Mukherjee, J. S. (2012) · Social Science & Medicine · doi:10.1016/j.socscimed.2012.01.022 · Cited by 85
Evaluating the Cultural Validity of the Stressful Life Events Screening Questionnaire
Green, B. L., Chung, J. Y., Daroowalla, A., Kaltman, S. I., & DeBenedictis, C. N. (2006) · Violence Against Women · doi:10.1177/1077801206294534 · Cited by 80
“Bolton (2001) used a procedure of having informants in Rwanda identify themselves as having (or not) a locally described syndrome for grief and compared the results to the depression section of the Hopkins Symptom Checklist.”
ResultSnodgrass, J. G., Lacy, M. G., & Upadhyay, C. (2017) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.06.037 · Cited by 76
Haberer, J. E., Kiwanuka, J. P., Nansera, D., Ragland, K. E., Mellins, C. A., & Bangsberg, D. R. (2012) · PLoS ONE · doi:10.1371/journal.pone.0036737 · Cited by 73
“The interview covered various socio-demographic, behavioral, and clinical factors with potential to influence adherence behavior (see Table 1), and included the following standardized measures: 1) Caregiver depressive symptoms were assessed using the Hopkins Symptom Checklist Depression Scale (with a cut off for possi…”
MethodInfluentialCohen, M. H., Fabri, M. R., Cai, X., Shi, Q., Hoover, D. R., Binagwaho, A., Maravić, M. C., Mukanyonga, H., Karegeya, D. K., & Anastos, K. (2009) · Journal of Women s Health · doi:10.1089/jwh.2009.1367 · Cited by 72
“Bolton 44,45 has discussed the utility of mental health instruments and the need to meet the gold standards for criterion validity with a diagnostic assessment conducted by a qualified psychiatrist or psychologist.”
Violence and Abuse Among HIV-Infected Women and Their Children in Zambia
Murray, L. K., Haworth, A., Semrau, K. E. A., Singh, M. P., Aldrovandi, G. M., Sinkala, M., Thea, D. M., & Bolton, P. A. (2006) · The Journal of Nervous and Mental Disease · doi:10.1097/01.nmd.0000230662.01953.bc · Cited by 72
“This article describes the first phase of a mixed-method approach including qualitative and quantitative methods (see Bolton, 2001; Bolton and Tang, 2002) to understand the relationship between HIV and mental health in Lusaka, Zambia.”
MethodSelf-citationHaroz, E. E., Bass, J. K., Lee, C., Murray, L. K., Robinson, C., & Bolton, P. (2014) · BMC Psychology · doi:10.1186/s40359-014-0031-6 · Cited by 71
“Step 2: Reliability and validity testing”
MethodSelf-citationAlcohol use, depressive symptoms and the receipt of antiretroviral therapy in Southwest Uganda
Martinez, P., Andia, I., Emenyonu, N., Hahn, J. A., Hauff, E., Pepper, L., & Bangsberg, D. R. (2008) · AIDS and Behavior · doi:10.1007/s10461-007-9312-x · Cited by 68
Mitchell, A. J., Rao, S., & Vaze, A. (2011) · British Journal of General Practice · doi:10.3399/bjgp11x556227 · Cited by 73
“Further, welldesigned studies demonstrating beneficial patient outcomes are lacking (with no data in low and middle-income countries) even though research supports application by non-physicians and community health workers.(34,35) Despite the strengths of the WHO’s PPGHC study, its major limitation is that only diagno…”
ResultSexual relationship power and depression among HIV-infected women in Rural Uganda
Hatcher, A. M., Tsai, A. C., Kumbakumba, E., Dworkin, S. L., Hunt, P. W., Martin, J. N., Clark, G., Bangsberg, D. R., & Weiser, S. D. (2012) · PLoS ONE · doi:10.1371/journal.pone.0049821 · Cited by 67
“Our primary outcome was depression symptom severity, measured as a continuous variable in primary analyses using a modified version of the Hopkins Symptom Checklist for Depression (HSCL-D) [45–47].”
MethodCabral, A., Baeten, J. M., Ngure, K., Velloza, J., Odoyo, J. B., Haberer, J. E., Celum, C., Muwonge, T. R., Asiimwe, S. B., Heffron, R. A., et al. (2017) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000001574 · Cited by 66
Krumme, A. A., Kaigamba, F., Binagwaho, A., Murray, M. B., Rich, M., & Franke, M. F. (2014) · Journal of Epidemiology & Community Health · doi:10.1136/jech-2014-204494 · Cited by 69
Tinghög, P., & Carstensen, J. M. (2009) · Community Mental Health Journal · doi:10.1007/s10597-009-9227-2 · Cited by 63
Findings from Mental Health Screening of Newly Arrived Refugees in Colorado
Savin, D. M., Seymour, D. J., Littleford, L. N., Bettridge, J., & Giese, A. A. (2005) · Public Health Reports · doi:10.1177/003335490512000303 · Cited by 61
Measuring Trauma and Health Status in Refugees: A Critical Review
Hollifield, M., Warner, T. D., Lian, N., Krakow, B., Jenkins, J. H., Kesler, J., Stevenson, J., & Westermeyer, J. (2002) · JAMA · doi:10.1001/jama.288.5.611 · Cited by 60
“67).(60) This instrument is new and its design is not well described.”
BackgroundReview of Refugee Mental Health Assessment: Best Practices and Recommendations
Davidson, G. R., Murray, K. E., & Schweitzer, R. (2010) · Journal of Pacific Rim Psychology · doi:10.1375/prp.4.1.72 · Cited by 60
“As examples of decentring following back-translation, the study by Bolton (2001b) of the Adapted Hopkins Symptom Checklist–Depression (AHDSCL) commented on the researchers’ replacement of western terms with local terms when both terms were used interchangeably by the bilingual translators and…”
MethodInfluentialSyed, H. R., Zachrisson, H. D., Dalgard, O. S., Dalen, I., & Ahlberg, N. (2008) · BMC Psychiatry · doi:10.1186/1471-244x-8-59 · Cited by 56
“A change to the optimal cut-off scores has also been observed with other well established instruments in various studies [50].”
Social integration in global mental health: what is it and how can it be measured?
Baumgartner, J. N., & Susser, E. (2012) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796012000303 · Cited by 56
“Bolton (2001a, b) and Bolton & Tang (2002) have developed an approach for developing culturally specific instruments that starts with gathering input from the local community about the area of interest for measurement.”
BackgroundDepressive Symptoms in Youth Heads of Household in Rwanda
Boris, N. W., Brown, L. F., Thurman, T. R., Rice, J. C., Snider, L. M., Ntaganira, J., & Nyirazinyoye, L. (2008) · Archives of Pediatrics and Adolescent Medicine · doi:10.1001/archpedi.162.9.836 · Cited by 55
Bruner, D. W., Pugh, S. L., Lee, W. R., Hall, W. A., Dignam, J. J., Low, D. A., Swanson, G. P., Shah, A. B., Malone, S. C., Michalski, J. M., et al. (2019) · JAMA Oncology · doi:10.1001/jamaoncol.2018.6752 · Cited by 55
Green, E. P., Tuli, H., Kwobah, E., Menya, D., Chesire, I., & Schmidt, C. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.11.027 · Cited by 53
Southam‐Gerow, M. A., & Dorsey, S. (2014) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2014.930690 · Cited by 53
“…tech,’’ but 848 SOUTHAM-GEROW AND DORSEY equally valid, coding methods of domain analysis, developed by the larger investigative team were used (see Bolton, 2001), demonstrating the ability to identify themes and achieve convergence across raters using a variety of methodologies (NVivo,…”
MethodMental health conditions after snakebite: a scoping review
Bhaumik, S., Kallakuri, S., Kaur, A., Devarapalli, S., & Daniel, M. (2020) · BMJ Global Health · doi:10.1136/bmjgh-2020-004131 · Cited by 52
Fellmeth, G. L., Harrison, S., Opondo, C., Nair, M., Kurinczuk, J. J., & Alderdice, F. A. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03190-6 · Cited by 56
“Screening tools must be validated locally against a ‘gold standard’ diagnostic interview prior to use to assess their validity, establish the appropriate diagnostic thresholds and ensure their cultural appropriateness and acceptability [9].”
MethodDeveloping and Testing Locally Derived Mental Health Scales
Weaver, L. J., & Kaiser, B. N. (2014) · Field Methods · doi:10.1177/1525822x14547191 · Cited by 52
Germann, S. (2009) · Unisa Institutional Repository (University of South Africa) · Cited by 52
An ethnopsychology of idioms of distress in urban Kenya
Mendenhall, E., Rinehart, R., Musyimi, C. W., Bosire, E. N., Ndetei, D. M., & Mutiso, V. (2019) · Transcultural Psychiatry · doi:10.1177/1363461518824431 · Cited by 60
Puffer, E. S., Friis-Healy, E. A., Giusto, A. M., Stafford, S., & Ayuku, D. (2019) · Global Social Welfare · doi:10.1007/s40609-019-00151-6 · Cited by 53
Tsai, A. C., Wolfe, W. R., Kumbakumba, E., Kawuma, A., Hunt, P. W., Martin, J. N., Bangsberg, D. R., & Weiser, S. D. (2016) · Journal of Interpersonal Violence · doi:10.1177/0886260514567966 · Cited by 50
“…has been shown to have good reliability, construct validity, and criterion-related validity when administered in general population samples and among people living with HIV, both in Uganda (Bolton, 2001; Psaros et al., 2015; Tsai et al., 2012) and elsewhere in sub-Saharan Africa (Tsai, 2014).”
BackgroundTol, W. A., Rees, S. J., & Silove, D. M. (2013) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796013000188 · Cited by 50
“Alternatives are to rely on paraprofessionals or consult with key informants about the absence or presence of disorder (Bolton, 2001; Kohrt et al., 2011), and to ensure that at least disability associated with symptoms is assessed.”
BackgroundReflechi twòp—Thinking Too Much: Description of a Cultural Syndrome in Haiti’s Central Plateau
Kaiser, B. N., McLean, K. E., Kohrt, B. A., Hagaman, A. K., Wagenaar, B. H., Khoury, N. M., & Keys, H. M. (2014) · Culture Medicine and Psychiatry · doi:10.1007/s11013-014-9380-0 · Cited by 52
The role of mental health professionals in political asylum processing.
Meffert, S. M., Musalo, K., McNiel, D. E., & Binder, R. L. (2010) · PubMed · Cited by 49
Mels, C., Derluyn, I., Broekaert, E., & Rosseel, Y. (2009) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-009-0128-z · Cited by 48
“been previously found psychometrically weak [5, 12].”
BackgroundMethodInfluentialResilience enhancing psychosocial programmes for youth in different cultural contexts
Henley, R. R. (2010) · Progress in Development Studies · doi:10.1177/146499340901000403 · Cited by 48
“A challenge in creating a new measure where none other exists, is that it cannot be cross-validated with already validated measures (Bolton, 2001; De Silva et al., 2006).”
BackgroundMethodWILK, C. M., & BOLTON, P. (2002) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-200206000-00008 · Cited by 67
“We used two qualitative interviewing methods (free listing and key-informant interviewing as previously described in Bolton, 2001b) to collect data from local informants.”
MethodSelf-citationEpino, H. M., Rich, M., Kaigamba, F., Hakizamungu, M., Socci, A. R., Bagiruwigize, E., & Franke, M. F. (2012) · AIDS Care · doi:10.1080/09540121.2012.661840 · Cited by 47
“(Bolton, 2001).”
MethodHustache, S., Moro, M. R., Roptin, J., de Souza, R. R., Gansou, G. M., Mbemba, A., Roederer, T., Grais, R. F., Gaboulaud, V., & Baubet, T. (2009) · International Journal of Mental Health Systems · doi:10.1186/1752-4458-3-7 · Cited by 47
Using Ethnographic Methods in the Selection of Post-Disaster, Mental Health Interventions
Bolton, P. A., & Tang, A. (2004) · Prehospital and Disaster Medicine · doi:10.1017/s1049023x00001540 · Cited by 47
Self-citationRisk and protective factors for suicidal ideation and behaviour in Rwandan children
Ng, L. C., Kirk, C. M., Kanyanganzi, F., Fawzi, M. C. S., Sezibera, V., Shema, E., Bizimana, J. I., Cyamatare, F. R., & Betancourt, T. S. (2015) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.114.154591 · Cited by 46
Development and validation of the child psychosocial distress screener in Burundi.
Jordans, M. J. D., Komproe, I. H., Ventevogel, P., Tol, W. A., & de Jong, J. T. V. M. (2008) · American Journal of Orthopsychiatry · doi:10.1037/a0014216 · Cited by 45
Validation of the UCLA Child Post traumatic stress disorder-reaction index in Zambia
Murray, L. K., Bass, J., Chomba, E., Imasiku, M. L., Thea, D. M., Semrau, K. E. A., Cohen, J. A., Lam, C., & Bolton, P. A. (2011) · International Journal of Mental Health Systems · doi:10.1186/1752-4458-5-24 · Cited by 45
“In the work that forms the basis of this approach, Bolton [17] used Key Informants from a community in Rwanda to identify samples of individuals with and without a locally defined syndrome (i.”
InfluentialSelf-citationAl‐Adawi, S., Dorvlo, A. S. S., Al‐Naamani, A., Glenn, M. B., Karamouz, N., Chae, H., Zaidan, Z. A. J., & Burke, D. T. (2007) · Brain Injury · doi:10.1080/02699050701311059 · Cited by 44
Bolton, P. A., Michalopoulos, L., Ahmed, A. M. A., Murray, L. K., & Bass, J. (2013) · PubMed · doi:10.7916/d8c24v6p · Cited by 43
Self-citationDeveloping an African youth psychosocial assessment: an application of item response theory
Betancourt, T. S., Yang, F. M., Bolton, P. A., & Normand, S. T. (2014) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1420 · Cited by 43
“Validity study—A study to validate the APAI using a comparison of parent and selfreported ratings on presence of local syndrome terms has been published previously (Betancourt et al., 2009a; Bolton, 2001).”
MethodInfluentialSelf-citationPost traumatic stress disorder
Yule, W., & Smith, P. A. (2015) · Wiley eBooks · doi:10.1002/9781118381953.ch59 · Cited by 44
Vinck, P. (2010) · JAMA · doi:10.1001/jama.2010.1065 · Cited by 41
“The use of various scales to measure symptoms of depression and anxiety has been debated, highlighting the need to adapt measures to the culture and to develop indigenously informed measures of distress.(35) The HSCL-25 has been used and validated in various cultural contexts in subSaharan Africa, but not specifically…”
MethodJiang, R. F., Tong, H. Q., Delucchi, K., Neylan, T. C., Shi, Q., & Meffert, S. M. (2014) · Conflict and Health · doi:10.1186/1752-1505-8-14 · Cited by 41
“A standard process of forward/backward translation with resolution of discrepancies was used [20-22].”
MethodWells, R., Lawsin, C. R., Hunt, C. J., Yousef, O. S., Abujado, F., & Steel, Z. (2018) · Cambridge Prisms Global Mental Health · doi:10.1017/gmh.2018.30 · Cited by 42
Niwandinda, F., Lukyamuzi, E. J., Ainebyona, C., Ssebunya, V. N., Murungi, G., & Atukunda, E. C. (2020) · Integrated Pharmacy Research and Practice · doi:10.2147/iprp.s237940 · Cited by 44
“The Hopkins Symptom Checklist (DHSCL) tool for depression was modified by adding a 16th item “feeling like I don’t care about my health” to reflect the local context as shown by previous studies on depression in Uganda.(17,18) A test score of ≥1.”
MethodInfluentialBoris, N. W., Thurman, T. R., Snider, L., SPENCER, E., & Brown, L. F. (2006) · Infant Mental Health Journal · doi:10.1002/imhj.20116 · Cited by 40
Lawton, K., & Spencer, A. (2021) · Journal of Immigrant and Minority Health · doi:10.1007/s10903-021-01151-5 · Cited by 39
Mychailyszyn, M. P., & Elson, D. M. (2018) · Children and Youth Services Review · doi:10.1016/j.childyouth.2018.02.011 · Cited by 27
Veling, W., Hall, B. J., & Joosse, P. (2013) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2013.01.007 · Cited by 37
“Local symptoms derived from these methods can be included in measures to increase the usefulness of an assessment and the validity of this adapted measure can be directly evaluated within a quantitative validity study (see Bolton, 2001 for a review of this method).”
BackgroundEffect of Depression on Adherence to Oral PrEP Among Men and Women in East Africa
Velloza, J., Baeten, J. M., Haberer, J. E., Ngure, K., Irungu, E., Mugo, N., Celum, C., Heffron, R. A., & for the Partners Demonstration Project Team (2018) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000001821 · Cited by 36
Brown, L. F., Thurman, T. R., Rice, J. C., Boris, N. W., Ntaganira, J., Nyirazinyoye, L., de Dieu, J., & Snider, L. (2009) · Vulnerable Children and Youth Studies · doi:10.1080/17450120903193915 · Cited by 35
Betancourt, T. S., Yudron, M., Wheaton, W., & Smith-Fawzi, M. C. (2012) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2012.01.001 · Cited by 38
Hall, B. J., Puffer, E. S., Murray, L. K., Ismael, A., Bass, J., Sim, A. L., & Bolton, P. A. (2014) · Psychological Injury and Law · doi:10.1007/s12207-014-9188-9 · Cited by 32
Self-citationDeveloping and Validating the Youth Conduct Problems Scale-Rwanda: A Mixed Methods Approach
Ng, L. C., Kanyanganzi, F., Munyanah, M., Mushashi, C., & Betancourt, T. S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0100549 · Cited by 30
“Moreover, this study provides an example of the importance, and process, of ensuring that measures are culturally relevant and appropriate for the settings in which they are used [42,43].”
BackgroundExposure to violence and PTSD symptoms among Somali women
de Jong, K., van der Kam, S., Swarthout, T. D., Ford, N. P., Mills, C., Yun, O., & Kleber, R. J. (2011) · Journal of Traumatic Stress · doi:10.1002/jts.20694 · Cited by 29
Metadata
- Authors
- BOLTON, P.
- Affiliations
- Johns Hopkins University (US)
- Corresponding author
- BOLTON, PAUL
- ORCID
- BOLTON, PAUL
- Venue
- The Journal of Nervous and Mental Disease
- Published
- 2001-04
- Volume
- 189
- Issue
- 4
- Pages
- 238-242
- ISSN
- 0022-3018 (ISSN-L)
- OpenAlex
- W1987889140
- Cited by
- 239
- References
- 11
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 13 · 2023: 3 · 2022: 12 · 2021: 20 · 2020: 10 · 2019: 13 · 2018: 10 · 2017: 13 · 2016: 5 · 2015: 14 · 2014: 22 · 2013: 13 · 2012: 8
- FWCI
- 5.12
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Journal of Nervous and Mental Disease (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Health Sciences › Nursing › Research and Theory › Health Education and Validation
- Health Sciences › Medicine › Psychiatry and Mental health › Mental Health Treatment and Access
- Keywords
- cross-cultural validity, criterion validity, psychiatric assessment instruments, depression, Hopkins Symptom Checklist, local informants, test-retest reliability, construct validity, mental health assessment, developing countries
- MeSH terms
- Adult, Anthropology, Cultural, Cross-Cultural Comparison, Depressive Disorder, Factor Analysis, Statistical, Female, Health Services Needs and Demand, Homicide, Humans, Life Change Events, Male, Medicine, Traditional, Personality Inventory, Psychometrics, Rwanda, Sampling Studies, Sensitivity and Specificity, Sex Factors, Stress Disorders, Post-Traumatic, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
