Survey Conditioning in Self‐Reported Mental Health Service Use: Randomized Comparison of Alternative Instrument Formats
Open accessThe DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Objective. To test the effect of survey conditioning (whether observed survey responses are affected by previous experience in the same survey or similar surveys) in a survey instrument used to assess mental health service use. Data Sources. Primary data collected in the National Latino and Asian American Study, a cross‐sectional household survey of Latinos and Asian Americans residing in the United States. Study Design. Study participants are randomly assigned to a Traditional Instrument with an interleafed format placing service use questions after detailed questions on disorders, or a Modified Instrument with an ensemble format screening for service use near the beginning of the survey. We hypothesize the ensemble format to be less susceptible to survey conditioning than the interleafed format. We compare self‐reported mental health services use measures (overall, aggregate categories, and specific categories) between recipients of the two instruments, using 2 × 2 χ2 tests and logistic regressions that control for key covariates. Data Collection. In‐person computer‐assisted interviews, conducted in respondent's preferred language (English, Spanish, Mandarin Chinese, Tagalog, or Vietnamese). Principal Findings. Higher service use rates are reported with the Modified Instrument than with the Traditional Instrument for all service use measures; odds ratios range from 1.41 to 3.10, all p‐values <.001. Results are similar across ethnic groups and insensitive to model specification. Conclusions. Survey conditioning biases downward reported mental health service use when the instrument follows an interleafed format. An ensemble format should be used when it is feasible for measures that are susceptible to survey conditioning.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Considering context, place, and culture: the national Latino and Asian American study
Alegria, M., Takeuchi, D., Canino, G., Duan, N., Shrout, P., Meng, X., Vega, W., Zane, N., Vila, D., Woo, M., et al. (2004) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.178 · Cited by 733
Self-citationKessler, R. C., Wittchen, H., Abelson, J. M., Mcgonagle, K., Schwarz, N., Kendler, K. S., Knäuper, B., & Zhao, S. (1998) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.33 · Cited by 483 · cited 5×
“Ten years later, the National Comorbidity Survey (NCS, http://www.hcp.med.harvard.edu/ncs/) adopted the ensemble format, and found higher rates of psychiatric disorders (Kessler et al. 1994, 1998, 2000).”
BackgroundMethodInfluentialJensen, P. S., Watanabe, H. K., & Richters, J. E. (1999) · Journal of Abnormal Child Psychology · doi:10.1023/a:1021927909027 · Cited by 82 · cited 1×
“Jensen, Watanabe, and Richters (1999) conducted such a randomized trial, and reported that psychiatric disorder modules placed near the front of a survey were more frequently endorsed; attenuation of symptom reports was observed with items placed in later sections of the survey.”
BackgroundMeasurement-induced improvement in anxiety: Mean shifts with repeated assessment.
Knowles, E. S., Coker, M. C., Scott, R. A., Cook, D. A., & Neville, J. W. (1996) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.71.2.352 · Cited by 58 · cited 2×
“…items placed in the latter segment of a survey instrument are affected by experience gained from earlier segments of the survey (Kessler et al. 1994, 1998, 2000; Knowles et al. 1996; Vega et al. 1998; Lucas et al. 1999; Piacentini et al. 1999; Kessler and Merikangas 2004; Kessler and Ustun 2004).”
Background
Cited by
Barriers to mental health treatment: results from the National Comorbidity Survey Replication
Mojtabai, R., Olfson, M., Sampson, N. A., Jin, R., Druss, B., Wang, P. S., Wells, K. B., Pincus, H. A., & Kessler, R. C. (2011) · Psychological Medicine · doi:10.1017/s0033291710002291 · Cited by 951
Disparity in Depression Treatment Among Racial and Ethnic Minority Populations in the United States
Alegría, M., Chatterji, P., Wells, K., Cao, Z., Chen, C.-N., Takeuchi, D., Jackson, J., & Meng, X.-L. (2008) · Psychiatric Services · doi:10.1176/ps.2008.59.11.1264 · Cited by 993
Self-citationConsidering context, place, and culture: the national Latino and Asian American study
Alegria, M., Takeuchi, D., Canino, G., Duan, N., Shrout, P., Meng, X., Vega, W., Zane, N., Vila, D., Woo, M., et al. (2004) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.178 · Cited by 733
Self-citationScaling Up mHealth: Where Is the Evidence?
Tomlinson, M., Rotheram-Borus, M. J., Swartz, L., & Tsai, A. C. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001382 · Cited by 673
Alegría, M., Mulvaney-Day, N., Woo, M., Torres, M., Gao, S., & Oddo, V. (2007) · American Journal of Public Health · doi:10.2105/ajph.2006.087197 · Cited by 403
Metadata
- Authors
- Duan, N., Alegria, M., Canino, G., McGuire, T. G., & Takeuchi, D.
- Venue
- Health Services Research
- Publisher
- Wiley
- Published
- 2006-08-17
- Volume
- 42
- Issue
- 2
- Pages
- 890-907
- ISSN
- 0017-9124 (ISSN-L)
- 1475-6773
- OpenAlex
- W1964347542
- Cited by
- 68
- References
- 4
- FWCI
- 5.76
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.