Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 53 of the 54 references it cites were found in a registry or an index.

The Four-Dimensional Symptom Questionnaire (4DSQ): a validation study of a multidimensional self-report questionnaire to assess distress, depression, anxiety and somatization

Open access
Terluin, Berend, van Marwijk, Harm WJ, Adèr, Herman J, de Vet, Henrica CW, Penninx, Brenda WJH, Hermens, Marleen LM, van Boeijen, Christine A, van Balkom, Anton JLM, van der Klink, Jac JL, Stalman, Wim AB · 2006 · BMC Psychiatry

Abstract

BACKGROUND: The Four-Dimensional Symptom Questionnaire (4DSQ) is a self-report questionnaire that has been developed in primary care to distinguish non-specific general distress from depression, anxiety and somatization. The purpose of this paper is to evaluate its criterion and construct validity. METHODS: Data from 10 different primary care studies have been used. Criterion validity was assessed by comparing the 4DSQ scores with clinical diagnoses, the GPs' diagnosis of any psychosocial problem for Distress, standardised psychiatric diagnoses for Depression and Anxiety, and GPs' suspicion of somatization for Somatization. ROC analyses and logistic regression analyses were used to examine the associations. Construct validity was evaluated by investigating the inter-correlations between the scales, the factorial structure, the associations with other symptom questionnaires, and the associations with stress, personality and social functioning. The factorial structure of the 4DSQ was assessed through confirmatory factor analysis (CFA). The associations with other questionnaires were assessed with Pearson correlations and regression analyses. RESULTS: Regarding criterion validity, the Distress scale was associated with any psychosocial diagnosis (area under the ROC curve [AUC] 0.79), the Depression scale was associated with major depression (AUC = 0.83), the Anxiety scale was associated with anxiety disorder (AUC = 0.66), and the Somatization scale was associated with the GPs' suspicion of somatization (AUC = 0.65). Regarding the construct validity, the 4DSQ scales appeared to have considerable inter-correlations (r = 0.35-0.71). However, 30-40% of the variance of each scale was unique for that scale. CFA confirmed the 4-factor structure with a comparative fit index (CFI) of 0.92. The 4DSQ scales correlated with most other questionnaires measuring corresponding constructs. However, the 4DSQ Distress scale appeared to correlate with some other depression scales more than the 4DSQ Depression scale. Measures of stress (i.e. life events, psychosocial problems, and work stress) were mainly associated with Distress, while Distress, in turn, was mainly associated with psychosocial dysfunctioning, including sick leave. CONCLUSION: The 4DSQ seems to be a valid self-report questionnaire to measure distress, depression, anxiety and somatization in primary care patients. The 4DSQ Distress scale appears to measure the most general, most common, expression of psychological problems.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/1471-244x-6-34

Cites

53 of 53 references verified0 citation errors · 0 not checkable

Statistics

Figures

Figure 1 Receiver operating characteristic (ROC) curves of the 4DSQ scales with respect to detecting a psychosocial diagnosis in general practice patients. Dis = Distress score, Dep = Depression score, Anx = Anxiety score, Som = Somatization score, AUC = Area Under the Curve, CI = 95% confidence interval.
Figure 1 Receiver operating characteristic (ROC) curves of the 4DSQ scales with respect to detecting a psychosocial diagnosis in general practice patients. Dis = Distress score, Dep = Depression score, Anx = Anxiety score, Som = Somatization score, AUC = Area Under the Curve, CI = 95% confidence interval.CC BY · PubMed Central
Figure 2 Receiver operating characteristic (ROC) curves of the 4DSQ scales with respect to detecting a DSM-IV major depression. Dis = Distress score, Dep = Depression score, Anx = Anxiety score, Som = Somatization score, AUC = Area Under the Curve, CI = 95% confidence interval.
Figure 2 Receiver operating characteristic (ROC) curves of the 4DSQ scales with respect to detecting a DSM-IV major depression. Dis = Distress score, Dep = Depression score, Anx = Anxiety score, Som = Somatization score, AUC = Area Under the Curve, CI = 95% confidence interval.CC BY · PubMed Central
Figure 3 Receiver operating characteristic (ROC) curves of the 4DSQ scales with respect to detecting any DSM-IV anxiety disorder. Dis = Distress score, Dep = Depression score, Anx = Anxiety score, Som = Somatization score, AUC = Area Under the Curve, CI = 95% confidence interval.
Figure 3 Receiver operating characteristic (ROC) curves of the 4DSQ scales with respect to detecting any DSM-IV anxiety disorder. Dis = Distress score, Dep = Depression score, Anx = Anxiety score, Som = Somatization score, AUC = Area Under the Curve, CI = 95% confidence interval.CC BY · PubMed Central
Figure 4 Receiver operating characteristic (ROC) curves of the 4DSQ scales with respect to detecting suspected (possible or definitive) somatization in general practice patients. Dis = Distress score, Dep = Depression score, Anx = Anxiety score, Som = Somatization score, AUC = Area Under the Curve, CI = 95% confidence interval.
Figure 4 Receiver operating characteristic (ROC) curves of the 4DSQ scales with respect to detecting suspected (possible or definitive) somatization in general practice patients. Dis = Distress score, Dep = Depression score, Anx = Anxiety score, Som = Somatization score, AUC = Area Under the Curve, CI = 95% confidence interval.CC BY · PubMed Central
Figure 5 Scatterplots of the associations between the 4DSQ Distress score and the 4DSQ Depression, Anxiety and Somatization scores. One dot represents one or more observations (subjects). In the upper graph 94% of the observations are located in the right-lower triangle. The same is true for 93% of the observations in the middle graph, and 79% of the observations in the lower graph.
Figure 5 Scatterplots of the associations between the 4DSQ Distress score and the 4DSQ Depression, Anxiety and Somatization scores. One dot represents one or more observations (subjects). In the upper graph 94% of the observations are located in the right-lower triangle. The same is true for 93% of the observations in the middle graph, and 79% of the observations in the lower graph.CC BY · PubMed Central
Figure 6 Diagram of the four-factor model of the 4DSQ. Numbers are standardised coefficients in the test set (and the exploration set respectively).
Figure 6 Diagram of the four-factor model of the 4DSQ. Numbers are standardised coefficients in the test set (and the exploration set respectively).CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 54 references

Research works printed but not linked: 14

  1. Terluin B: De Vierdimensionale Klachtenlijst (4DKL). Een vragenlijst voor het meten van distress, depressie, angst en somatisatie [The Four-Dimensional Symptom Questionnaire (4DSQ). A questionnaire to measure distress, depression, anxiety, and somatization]. Huisarts Wet. 1996, 39: 538-547.
  2. Terluin B: Overspanning onderbouwd. Een onderzoek naar de diagnose surmenage in de huisartspraktijk [Nervous breakdown substantiated. A study of the general practitioner's diagnosis of surmenage]. 1994, Utrecht, Universiteit Utrecht
  3. Terluin B, Gill K, Winnubst JAM: Hoe zien huisartsen surmenage? [General practitioners' perception of "nervous breakdown"]. Huisarts Wet. 1992, 35: 311-315.
  4. Romeijnders ACM, Vriezen JA, Van der Klink JJL, Hulshof CTJ, Terluin B, Flikweert S, Baart PC: Landelijke Eerstelijns Samenwerkings Afspraak Overspanning [National Primary Care Collaboration Agreement on Nervous Breakdown]. Huisarts Wet. 2005, 48: 20-23.
  5. Bentler P, Wu E: EQS for Windows user's guide. 1995, Encino, Multivariate Software
  6. Dijkstra P: De zelfbeoordelingsschaal voor depressie van Zung [The self-rating depression scale of Zung]. Stemming en ontstemming. Theorie en praktijk bij de diagnostiek van depressies. Edited by: Van Praag HM and Rooymans HGM. 1974, Amsterdam, Erven Bohn, 98-120.
  7. Beck AT, Steer RA: Beck Anxiety Inventory manual. 1993, San Antonio TX, Psychological Corporation, 2nd
  8. Van der Ploeg HM, Defares PB, Spielberger CD: Handleiding bij de Zelf-Beoordelings Vragenlijst (ZBV). Een Nederlandstalige bewerking van de Spielberger State-Trait Anxiety Inventory STAI-DY [Manual of the Self-Assessment Questionnaire. A Dutch adaptation of the Spielberger State-Trait Anxiety Inventory STAI-DY]. 1980, Lisse, Swets & Zeitlinger
  9. Hosman CMH: Psychosociale problematiek en hulpzoeken. Een sociaal-epidemiologische studie ten behoeve van de preventieve geestelijke gezondheidszorg [Psychosocial problems and seeking help. A socio-epidemiological study for the preventive mental health care]. 1983, Nijmegen, Katholieke Universiteit Nijmegen
  10. Ormel J: Moeite met leven of een moeilijk leven. Een vervolgonderzoek naar de invloed van psychosociale belasting op het welbevinden van driehonderd Nederlanders [A troublesome life, or trouble with living. A follow-up study of the influence of psycosocial stress on the well-being of threehundred Dutch inhabitants]. 1980, Groningen, Rijksuniversiteit Groningen
  11. Hoekstra HA, Ormel J, De Fruyt F: De NEO-PI-R/NEO-FFI; Big Five persoonlijkheidsvragenlijsten. Handleiding [Manual of the Dutch version of the NEO-PI-R/NEO-FFI]. 1996, Lisse, Swets en Zeitlinger
  12. Costa PT, McCrae RR: Revised NEO Personality Inventory (NEO-PI-R) and NEO Five Factor Inventory (NEO-FFI): professional manual. 1992, Odessa FL, Psychological Assessment Resources
  13. Van der Zee KL, Sanderman R: Het meten van de gezondheidstoestand met de RAND-36. Een handleiding [Measuring the health status with the RAND-36. A manual]. 1993, Groningen, Noordelijk Centrum voor Gezondheidsvraagstukken
  14. Terluin B: Factoranalyse van drie klachtenlijsten [Factor analysis of three symptom questionnaires]. Tijdschrift voor psychosomatische fysiotherapie. 1999, 4: 25-31.

Cited by

See all 470

Metadata

Authors
Terluin, B., van Marwijk, H. W., Adèr, H. J., de Vet, H. C., Penninx, B. W., Hermens, M. L., van Boeijen, C. A., van Balkom, A. J., van der Klink, J. J., & Stalman, W. A.
Affiliations
  • Amsterdam Public Health (NL)
  • Amsterdam UMC Location Vrije Universiteit Amsterdam (NL)
Corresponding author
Terluin, Berend
Venue
BMC Psychiatry
Published
2006-08-22
Volume
6
Issue
1
Pages
34-34
ISSN
1471-244X (ISSN-L)
OpenAlex
W2115145758
Cited by
469
References
54
Citations by year
2026: 16 · 2025: 10 · 2024: 25 · 2023: 30 · 2022: 32 · 2021: 36 · 2020: 27 · 2019: 21 · 2018: 26 · 2017: 42 · 2016: 37 · 2015: 35 · 2014: 24 · 2013: 22 · 2012: 18
FWCI
15.95
Type
journal article
Language
en
Open access
Licence
  • cc-by
  • creativecommons.org/licenses/by/2.0 (tdm)
Locations
  • BMC Psychiatry (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Pure Amsterdam UMC (publishedVersion, other-oa)
  • Amsterdam UMC (VU Amsterdam) - Institutional Repository (publishedVersion, other-oa)
  • VU Research Portal (publishedVersion, other-oa)
  • Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
  • Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) (submittedVersion)
  • UvA-DARE (University of Amsterdam) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • Data Archiving and Networked Services (DANS) (submittedVersion)
Funders
  • ZonMw (22000113)
  • Nederlandse Organisatie voor Wetenschappelijk Onderzoek
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
  • Health Sciences › Medicine › Psychiatry and Mental health › Psychosomatic Disorders and Their Treatments
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Keywords
Four-Dimensional Symptom Questionnaire, distress, depression, anxiety, somatization, psychosomatic symptoms, primary care, questionnaire validation, criterion validity, construct validity, psychosocial problems, sick leave, occupational stress, life events, psychosocial functioning, self-report questionnaire, factor structure, psychometric properties, general practitioner diagnosis, social functioning
MeSH terms
Anxiety, Depression, Family Practice, Humans, Psychiatric Status Rating Scales, Surveys and Questionnaires, Somatoform Disorders, Stress, Psychological, Reproducibility of Results

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Four-Dimensional Symptom Questionnaire (4DSQ): a validation study of a multidimensional self-report questionnaire to assess distress, depression, anxiety and somatization. https://app.cochat.ai/papers/10.1186/1471-244x-6-34
The paper
Terluin, B., van Marwijk, H. W., Adèr, H. J., de Vet, H. C., Penninx, B. W., Hermens, M. L., van Boeijen, C. A., van Balkom, A. J., van der Klink, J. J., & Stalman, W. A. (2006). The Four-Dimensional Symptom Questionnaire (4DSQ): a validation study of a multidimensional self-report questionnaire to assess distress, depression, anxiety and somatization. BMC Psychiatry. https://doi.org/10.1186/1471-244x-6-34

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.