Self-selection biases in psychological studies: Personality and affective disorders are prevalent among participants
Open accessThe DOI matches its Crossref record; 37 of the 38 references it cites were found in a registry or an index.
Abstract
Respondents select the type of psychological studies that they want to participate in consistence with their needs and individual characteristics, which creates an unintentional self-selection bias. The question remains whether participants attracted by psychological studies may have more psychological dysfunctions related to personality and affective disorders compared to the general population. We investigated (N = 947; 62% women) whether the type of the invitation (to talk about recent critical or regular life events) or the source of the data (either face-to-face or online) attracts people with different psychopathology. Most importantly, participants who alone applied to take part in paid psychological studies had more symptoms of personality disorders than those who had never before applied to take part in psychological studies. The current results strongly translate into a recommendation for either the modification of recruitment strategies or much greater caution when generalizing results for this methodological reason.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Differences between volunteers and non-participants for psychological research, especially those attracted to studies on negative life events, show higher rates of personality and affective disorders. This demonstrates a self-selection bias, where individuals’ psychological characteristics influence their decision to participate, leading to samples not representative of the general population94.”
From Bias recognition and mitigation strategies in artificial intelligence healthcare applications (2025) · cites this paper as [94]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Faul, F., Erdfelder, E., Lang, A.-G., & Buchner, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193146 · Cited by 65,971
The Hospital Anxiety and Depression Scale
Zigmond, A. S., & Snaith, R. P. (1983) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1983.tb09716.x · Cited by 47,139
Diagnostic and Statistical Manual of Mental Disorders, 5th ed.
Carter, M. J. (2014) · Therapeutic Recreation Journal · Cited by 15,169
Depression and quality of life in older persons: A review
Sivertsen, H., Bjørkløf, G. H., Engedal, K., Selbæk, G., & Helvik, A.-S. (2015) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000437299 · Cited by 14,152
Internet paradox: A social technology that reduces social involvement and psychological well-being?
Kraut, R., Patterson, M., Lundmark, V., Kiesler, S., Mukophadhyay, T., & Scherlis, W. (1998) · American Psychologist · doi:10.1037/0003-066x.53.9.1017 · Cited by 4,793
(1997) · American Psychiatric Press eBooks · Cited by 3,056
Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P. (2004) · American Psychologist · doi:10.1037/0003-066x.59.2.93 · Cited by 2,932 · cited 1×
“Many studies show that participants with PDs demonstrate specific attentional coping styles [36] and biased attention to emotions and facial expressions [37, 38], which might interplay with all experimental procedures.”
BackgroundThe Prevalence of Personality Disorders in a Community Sample
Torgersen, S., Kringlen, E., & Cramer, V. (2001) · Archives of General Psychiatry · doi:10.1001/archpsyc.58.6.590 · Cited by 1,313
Prevalence and correlates of personality disorder in Great Britain
Coid, J., Yang, M., Tyrer, P., Roberts, A., & Ullrich, S. (2006) · British Journal of Psychiatry · doi:10.1192/bjp.188.5.423 · Cited by 901
The prevalence of DSM-IV personality disorders in psychiatric outpatients
Zimmerman, M., Rothschild, L., & Chelminski, I. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.10.1911 · Cited by 825 · cited 4×
“Furthermore, online participants were higher on depression and anxiety (their mean scores indicate clinical “caseness” using the cut-off of 11 points suggested by Zigmond and Snaith [31] as compared to those who never participated in research before (their mean scores indicate a borderline level for depression and cli…”
ResultInfluential
Research works printed but not linked: 5
- Cierpiałkowska L. (2001). Adaptacja Kwestionariusza Osobowości Borderline Leichsenringa [polish adaptation of Leichsenring’s borderline personality inventory] (Unpublished manual).
- Majkowicz M, Chojnacka-Szawłowska G. Metodologiczne problemy badania jakości życia [Methodological issues of studying the quality of life]. In de Walden-Gałuszko K, Majkowicz M (eds.): Jakość życia w chorobie nowotworowej [Quality of Life in Cancer]. Wydawnictwo Uniwersytetu Gdańskiego. Gdańsk 1994: 65– 81
- Czapiński J. Jakość życia Polaków w czasie zmiany społecznej 1991–1997 (The quality of life of Poles during the 1991–1997 social change). Institute of Social Studies, Warsaw University; 1998.
- First MB, Gibbon M, Spitzer RL, Williams JBW, Benjamin LS. Structured Clinical Interview for DSM-IV Axis II Personality Disorders, (SCID-II). American Psychiatric Press, Inc; 1997.
- Lenhart A. Who’s not online: 57% of those without Internet access say they do not plan to log on. Retrieved July 6, 2003, from Pew Internet & American Life Project Web site: http://www.pewinternet.org/reports/toc.asp?Report21; 2000.
Cited by
Bias recognition and mitigation strategies in artificial intelligence healthcare applications
Hasanzadeh, F., Josephson, C. B., Waters, G., Adedinsewo, D., Azizi, Z., & White, J. A. (2025) · npj Digital Medicine · doi:10.1038/s41746-025-01503-7 · Cited by 320
Janoušková, M., Pekara, J., Kučera, M., Kearns, P. B., Šeblová, J., Wolfová, K., Kuklová, M., & Šeblová, D. (2024) · Scientific Reports · doi:10.1038/s41598-024-59700-5 · Cited by 27
Weiland, A.-M., Taubner, S., Zettl, M., Bartmann, L. C., Frohn, N., Luginsland, M., & Volkert, J. (2024) · PLoS ONE · doi:10.1371/journal.pone.0312995 · Cited by 25
Donkin, L., Henry, N., Kercher, A., Pedersen, M., Wilson, H., & Chan, A. H. Y. (2025) · Interactive Journal of Medical Research · doi:10.2196/60548 · Cited by 21
The Impact of Clinical Supervision on the Mental Health Nursing Workforce: A Scoping Review
McDonough, J., Rhodes, K., & Procter, N. G. (2024) · International Journal of Mental Health Nursing · doi:10.1111/inm.13463 · Cited by 18
Metadata
- Authors
- Kaźmierczak, I., Zajenkowska, A., Rogoza, R., Jonason, P. K., & Ścigała, D.
- Affiliations
- The Maria Grzegorzewska University (PL)
- Universitat de Lleida (ES)
- University of Padua (IT)
- Corresponding author
- Kaźmierczak, Izabela
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2023-03-08
- Volume
- 18
- Issue
- 3
- Pages
- e0281046
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC9994707
- OpenAlex
- W4323533076
- Cited by
- 90
- References
- 38
- Citations by year
- 2026: 41 · 2025: 28 · 2024: 17 · 2023: 4
- FWCI
- 38.67
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Padua Research Archive (University of Padova) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Repositori ObertUDL (University of Lleida) (submittedVersion, cc-by)
- Funders
- Maria Grzegorzewska University (BNS 52/20-P)
- National Center of Science (2017/01/X/HS6/02022, 2019/35/B/HS6/00682)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Ethics in Clinical Research
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- self-selection bias, participant recruitment, personality disorders, mood disorders, psychopathology, generalizability of research findings, recruitment strategies
- MeSH terms
- Female, Humans, Male, Personality, Personality Disorders, Psychopathology, Selection Bias, Mood Disorders
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.