Comparison of Web‐Based versus Paper‐and‐Pencil Self‐Administered Questionnaire: Effects on Health Indicators in Dutch Adolescents
Open accessAbstract
Objective. The aim of this study is to investigate differences in responses related to (mental) health and behavior between two methods of data collection: web‐based (web) and paper‐and‐pencil (p&p). Study Design. Within each participating school all third‐grade classes (mainly 14–15‐year‐old pupils) were randomly assigned to either the Internet condition (n=271) or the paper‐and‐pencil condition (n=261). Principal Findings. Significant but small differences were found for the strengths and difficulties subscales “emotional symptoms” (p&p>web) and “prosocial behavior” (p&p>web), and carrying a weapon (web>p&p). Perceived level of privacy and confidentiality did not differ between the two modes. Conclusions. The findings suggest that in a controlled school setting, web‐based administration of health indicators yields almost the same results as paper‐and‐pencil administration. To generalize these findings, we recommend repeated studies in other populations and settings.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Internet-based interventions have not been shown to prevent suicidal behavior, and only 3 of 10 studies reported benefit for suicidal ideation.
“Internet-based interventions have not been shown to prevent suicidal behavior (Table S5) but are highly scalable. Only 3/10 studies reported benefit for suicidal ideation(117–123) (Table S5).”
From Improving Suicide Prevention Through Evidence-Based Strategies: A Systematic Review (2021) · cites this paper as [123]
The Methods section, “Measures (Mental) Health and Problem Behavior” (page unavailable), says the study asked adolescents about suicidal ideation and suicide attempts. The Abstract (page unavailable) describes a comparison of web-based and paper questionnaires, not an intervention. Searches for intervention effects and the claimed 3-of-10 result found no passage addressing either claim. (LLM, conf=0.78)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Society and the Adolescent Self-Image
Rosenberg, M. (1965) · doi:10.1515/9781400876136 · Cited by 30,126 · see citing works
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,631 · see citing works
Mail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070237 · Cited by 3,459 · see citing works
Resilience in the Face of Catastrophe: Optimism, Personality, and Coping in the Kosovo Crisis
Riolli, L., Savicki, V., & Cepani, A. (2002) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2002.tb02765.x · Cited by 2,166 · see citing works
Turner, C. F., Ku, L. C., Rogers, S., Lindberg, L., Pleck, J. H., & Sonenstein, F. L. (1998) · Science · doi:10.1126/science.280.5365.867 · Cited by 2,048 · see citing works
Mode of questionnaire administration can have serious effects on data quality
Bowling, A. (2005) · Journal of Public Health · doi:10.1093/pubmed/fdi031 · Cited by 1,870 · see citing works
Brener, N. D., Billy, J. O. G., & Grady, W. R. (2003) · Journal of Adolescent Health · doi:10.1016/s1054-139x(03)00052-1 · Cited by 1,331 · see citing works
Tourangeau, R., & Smith, T. (1996) · Public Opinion Quarterly · doi:10.1086/297751 · Cited by 1,325 · see citing works
Dutch version of the Strengths and Difficulties Questionnaire (SDQ)
van Widenfelt, B. M., Goedhart, A. W., Treffers, P. D. A., & Goodman, R. (2003) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-003-0341-3 · Cited by 691 · see citing works
Brug, J., Campbell, M. K., & van Assema, P. (1999) · Patient Education and Counseling · doi:10.1016/s0738-3991(98)00131-1 · Cited by 352 · see citing works
Wright, D. L., Aquilino, W. S., & Supple, A. J. (1998) · Public Opinion Quarterly · doi:10.1086/297849 · Cited by 205 · see citing works
Computer-assisted detection and intervention in adolescent high-risk health behaviors
Paperny, D. M. N., Aono, J. Y., Lehman, R. M., Hammar, S. L., & Risser, J. (1990) · The Journal of Pediatrics · doi:10.1016/s0022-3476(05)82844-6 · Cited by 201 · see citing works
The Strengths and Difficulties Questionnaire
Truman, J., Robinson, K., Evans, A. L., Smith, D., Cunningham, L., Millward, R., & Minnis, H. (2003) · European Child and Adolescent Psychiatry · doi:10.1007/s00787-003-0303-9 · Cited by 178 · see citing works
Raat, H., Landgraf, J. M., Bonsel, G. J., Gemke, R. J. B. J., & Essink‐Bot, M. (2002) · Quality of Life Research · doi:10.1023/a:1016393311799 · Cited by 155 · see citing works
Webb, P., Zimet, G. D., Fortenberry, J. D., & Blythe, M. J. (1999) · Journal of Adolescent Health · doi:10.1016/s1054-139x(99)00005-1 · Cited by 127 · see citing works
Wang, Y., Lee, C., Lew‐Ting, C., Hsiao, C. K., Chen, D., & Chen, W. J. (2005) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2005.03.017 · Cited by 121 · see citing works
Hallfors, D. D., Khatapoush, S., Kadushin, C., Watson, K., & Saxe, L. (2000) · Evaluation and Program Planning · doi:10.1016/s0149-7189(00)00011-2 · Cited by 116 · see citing works
Multiple Gating: A Multistage Assessment Procedure for Identifying Youths at Risk for Delinquency
Loeber, R., Dishion, T. J., & Patterson, G. R. (1984) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427884021001002 · Cited by 111 · see citing works
Mangunkusumo, R. T., Moorman, P. W., Ruiter, A. E. V. D. B.-D., van der Lei, J., de Koning, H. J., & Raat, H. (2005) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2004.02.020 · Cited by 91 · see citing works
Vereecken, C. A., & Maes, L. (2006) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2004.10.010 · Cited by 77 · see citing works
An Evaluation of Computer-Assisted Self-Interviews in a School Setting
Beebe, T. J., Harrison, P. A., McRae, J. A., Anderson, R. E., & Fulkerson, J. A. (1998) · Public Opinion Quarterly · doi:10.1086/297863 · Cited by 72 · see citing works
Mangunkusumo, R. T., Duisterhout, J. S., Graaff, N. D., Maarsingh, E. J., de Koning, H. J., & Raat, H. (2006) · Journal of School Health · doi:10.1111/j.1746-1561.2006.00072.x · Cited by 55 · see citing works
McCabe, S. E., Boyd, C. J., Young, A. M., Crawford, S. D., & Pope, D. (2004) · Addictive Behaviors · doi:10.1016/j.addbeh.2004.08.012 · Cited by 36 · see citing works
Assessment of trauma symptoms among adolescent assault victims
McCart, M. R., Davies, W. H., Harris, R., Wincek, J. M., Calhoun, A. D., & Melzer-Lange, M. D. (2005) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2004.03.004 · Cited by 27 · see citing works
Hays, S. K., & McCallum, R. S. (2005) · Psychology in the Schools · doi:10.1002/pits.20106 · Cited by 24 · see citing works
Effects of Question Order on Estimates of the Prevalence of Attempted Weight Loss
Serdula, M. K., Mokdad, A. H., Pamuk, E. R., Williamson, D. F., & Byers, T. (1995) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117546 · Cited by 14 · see citing works
Flagged first, then by citations
Research works printed but not linked: 2
- Cohen, J. 1988. In Statistical Power Analysis for the Behavior Sciences (Revised Edition). New York: Academic.
- Rothman, K. J., and S. Greenland. 1998. Modern Epidemiology. Philadelphia: Lippincott- Raven Publishers.
Cited by
Sorted by citations
Improving Suicide Prevention Through Evidence-Based Strategies: A Systematic Review
Mann, J. J., Michel, C. A., & Auerbach, R. P. (2021) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.20060864 · Cited by 577 · see citing works
Mewton, L., Kessler, R. C., Slade, T., Hobbs, M. J., Brownhill, L., Birrell, L., Tonks, Z., Teesson, M., Newton, N., Chapman, C., et al. (2016) · Psychological Assessment · doi:10.1037/pas0000239 · Cited by 196 · see citing works
Dragun, R., Veček, N. N., Marendić, M., Pribisalić, A., Đivić, G., Cena, H., Polašek, O., & Kolčić, I. (2020) · Nutrients · doi:10.3390/nu13010097 · Cited by 187 · see citing works
- Authors
- Van De Looij‐Jansen, P. M., & De Wilde, E. J.
- Venue
- Health Services Research
- Publisher
- Wiley
- Published
- 2008-09-20
- Volume
- 43
- Issue
- 5p1
- Pages
- 1708-1721
- ISSN
- 0017-9124 (ISSN-L)
- 1475-6773
- PMC
- PMC2653887
- OpenAlex
- W1559302404
- Cited by
- 102
- References
- 26
- Citations by year
- 2026: 5 · 2025: 1 · 2024: 8 · 2023: 5 · 2022: 6 · 2021: 5 · 2020: 10 · 2019: 9 · 2018: 8 · 2017: 7 · 2016: 10 · 2015: 4 · 2014: 5 · 2013: 6 · 2012: 7
- FWCI
- 6.92
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Health Services Research (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Health Sciences › Health Professions › General Health Professions › Health and Medical Studies
- Social Sciences › Education › Health Education and Validation
- Keywords
- web-based questionnaire, paper-and-pencil questionnaires, self-administered questionnaire, mode of data collection, adolescent mental health, emotional symptoms, prosocial behavior, weapon carrying, Strengths and Difficulties Questionnaire
- MeSH terms
- Adolescent, Confidentiality, Data Collection, Female, Health Status, Health Status Indicators, Humans, Male, Mental Health, Netherlands, Surveys and Questionnaires, Sexual Behavior, Sex Factors, Socioeconomic Factors, Suicide, Health Behavior, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
