The DOI matches its Crossref record; 68 of the 72 references it cites were found in a registry or an index.
Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires.
Abstract
The rapid growth of the Internet provides a wealth of new research opportunities for psychologists. Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods. Six preconceptions about Internet samples and data quality are evaluated by comparing a new large Internet sample (N = 361,703) with a set of 510 published traditional samples. Internet samples are shown to be relatively diverse with respect to gender, socioeconomic status, geographic region, and age. Moreover, Internet findings generalize across presentation formats, are not adversely affected by nonserious or repeat responders, and are consistent with findings from traditional methods. It is concluded that Internet methods can contribute to many areas of psychology.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The proportion of females (62%) to males in this study was more representative than in traditional survey methods, where women often comprise 71% to 77% of the participants [39]”
From Effects of Mock Facebook Workday Comments on Public Perception of Professional Credibility: A Field Study in Canada (2019) · cites this paper as [39]
In the citing paper
“Self-presentation is an unlikely confound in Study 1 because the motivation to self-present is absent when participants feel anonymous (Paulhus, 1984(Paulhus, , 1991) ) as they do in anonymous online studies such as the present one, where they don't provide identifying information (Gosling et al., 2004).”
From Cultural norm fulfillment, interpersonal belonging, or getting ahead? A large-scale cross-cultural test of three perspectives on the function of self-esteem. (2015) · cites this paper as Gosling et al., 2004
In the citing paper
“As described in the Appendix, the reliability and validity of internet data collection has become increasingly clear in recent years.”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“The validity of internet testing has been well supported in recent reviews (Gosling et al., 2004), with excellent correspondence between results obtained with internet samples are results obtained in the laboratory (e.g., Birnbaum, 1999;Krantz & Dalal, 2000;McGraw, Tew, & Williams, 2000;Reips, 2002).”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“Furthermore, previous research has suggested populations for online studies and Facebook are quite representative [23], [24].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [23]
In the citing paper
“Still, the sample sizes and availability of demographic information afforded by social media bring us closer to a more ideal representative sample [99].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [99]
Citations
Cites
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
(1999) · Cited by 7,995
Self-citationInternet paradox: A social technology that reduces social involvement and psychological well-being?
Kraut, R., Patterson, M., Lundmark, V., Kiesler, S., Mukophadhyay, T., & Scherlis, W. (1998) · American Psychologist · doi:10.1037/0003-066x.53.9.1017 · Cited by 4,793
Handbook of Personality : Theory and Research
Pervin, L. A. (1992) · Cited by 4,543
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Mail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070237 · Cited by 3,463
Gender differences in personality traits across cultures: Robust and surprising findings.
Costa, P. T., Terracciano, A., & McCrae, R. R. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.2.322 · Cited by 2,986
Kraut, R. E., Kiesler, S. B., Boneva, B. S., Cummings, J. N., Helgeson, V. S., & Crawford, A. M. (2002) · Journal of Social Issues · doi:10.1111/1540-4560.00248 · Cited by 2,367
Gender differences in personality: A meta-analysis.
Feingold, A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.3.429 · Cited by 2,240
Handbook of Personality Theory and Research.
Schwartz, M. L., Borgatta, E. F., & Lambert, W. W. (1970) · American Sociological Review · doi:10.2307/2093310 · Cited by 2,182
Research works printed but not linked: 7
- Azar, 2000, A web of research: They're fun, they're fast, and they save money, but do Web experiments yield quality results?, Monitor on Psychology, 31, 42
- 10.1037/0022-3514.75.3.729 · DOI · Paper page
- Dillman. 1998 · DOI
- Locke, 1995, Method of psychological assessment, self-disclosure, and experiential differences: A study of computer, questionnaire, and interview assessment formats., Journal of Social Behavior and Personality, 10, 255
- 2000, Digest of education statistics 2000.
- Skitka, (in press). Social psychological research and me Internet: The promise and the perils of a new methodological frontier.
- 2000, Population, 1
Cited by
Sorted by citations
Items 601–700 of 1,012
Caillier, J. G. (2020) · Public Performance & Management Review · doi:10.1080/15309576.2020.1730919 · Cited by 89
Bias in Self-Reports: An Initial Elevation Phenomenon
Anvari, F., Efendić, E., Olsen, J., Arslan, R. C., Elson, M., & Schneider, I. K. (2022) · Social Psychological and Personality Science · doi:10.1177/19485506221129160 · Cited by 86
“In addition, a benefit of online participant pools is that they are demographically more diverse than student research pools (Berinsky et al., 2012; Gosling et al., 2004).”
BackgroundUK adults’ implicit and explicit attitudes towards obesity: a cross-sectional study
Flint, S. W., Hudson, J., & Lavallee, D. (2015) · BMC Obesity · doi:10.1186/s40608-015-0064-2 · Cited by 83
A taxonomy of situations from Chinese idioms
Yu, Y., Read, S. J., & Miller, L. C. (2005) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.09.007 · Cited by 77
Hierarchical cultural values predict success and mortality in high-stakes teams
Anicich, E. M., Swaab, R. I., & Galinsky, A. D. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1408800112 · Cited by 85
Psychopathy and subjective well-being
Love, A. B., & Holder, M. D. (2014) · Personality and Individual Differences · doi:10.1016/j.paid.2014.03.033 · Cited by 75
Who Bought the Drinks? Juror Perceptions of Intoxication in a Rape Trial
Lynch, K. R., Wasarhaley, N. E., Golding, J. M., & Simcic, T. A. (2013) · Journal of Interpersonal Violence · doi:10.1177/0886260513496900 · Cited by 75
Burnout is associated with a depressive cognitive style
Bianchi, R., & Schonfeld, I. S. (2016) · Personality and Individual Differences · doi:10.1016/j.paid.2016.01.008 · Cited by 89
Mappings between linguistic sound and motion
Cuskley, C. F. (2013) · Public Journal of Semiotics · doi:10.37693/pjos.2013.5.9651 · Cited by 80
Loosemore, M., Lim, B. T., Ling, F. Y. Y., & Zeng, H. (2018) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2018.04.157 · Cited by 74
Paluck, E. L., & Cialdini, R. B. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9780511996481.008 · Cited by 74
Cappeliez, P., & Robitaille, A. (2010) · Aging & Mental Health · doi:10.1080/13607861003713307 · Cited by 75
“Contrary to common misconceptions, participants recruited via the Internet are more demographically diverse and equally motivated to provide viable data (Gosling et al., 2004).”
BackgroundComparing Internet-Based and Venue-Based Methods to Sample MSM in the San Francisco Bay Area
Raymond, H. F., Rebchook, G., Curotto, A., Vaudrey, J., Amsden, M., Levine, D., & McFarland, W. (2009) · AIDS and Behavior · doi:10.1007/s10461-009-9521-6 · Cited by 74
Modern health worries and idiopathic environmental intolerance
Bailer, J., Witthöft, M., & Rist, F. (2008) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2008.05.006 · Cited by 74
How Can a Deontological Decision Lead to Moral Behavior? The Moderating Role of Moral Identity
Xu, Z., & Ma, H. K. (2015) · Journal of Business Ethics · doi:10.1007/s10551-015-2576-6 · Cited by 77
“, paper and pencil or lab) formats (Gosling et al. 2004).”
BackgroundMethodHealth Anxiety, Cognitive Coping, and Emotion Regulation: A Latent Variable Approach
Görgen, S. M., Hiller, W., & Witthöft, M. (2013) · International Journal of Behavioral Medicine · doi:10.1007/s12529-013-9297-y · Cited by 80
The Relationship between the Integration of Faith and Work with Life and Job Outcomes
Walker, A. G. (2012) · Journal of Business Ethics · doi:10.1007/s10551-012-1271-0 · Cited by 74
Arès, I., Lebel, S., & Bielajew, C. H. (2014) · Psychology and Health · doi:10.1080/08870446.2014.881998 · Cited by 86
The Effects of Ingratiation and Client Incentive on Auditor Judgment
Robertson, J. C. (2010) · Behavioral Research in Accounting · doi:10.2308/bria.2010.22.2.69 · Cited by 73
Hildebrandt, T., Langenbucher, J. W., Carr, S. J., & Sanjuan, P. M. (2007) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.116.4.717 · Cited by 74
Fruhen, L. S., Watkins, C. D., & Jones, B. C. (2015) · The Leadership Quarterly · doi:10.1016/j.leaqua.2015.07.001 · Cited by 76
Limoncin, E., Tomassetti, M., Gravina, G. L., Ciocca, G., Carosa, E., Di Sante, S., Gentile, V., Mirone, V., Montorsi, F., Lenzi, A., et al. (2013) · Journal of Urology · doi:10.1016/j.juro.2012.11.007 · Cited by 74
Stewart, A. E. (2009) · Bulletin of the American Meteorological Society · doi:10.1175/2009bams2794.1 · Cited by 73
Sorokowska, A., Słowińska, A. M., Zbieg, A., & Sorokowski, P. (2014) · CeON Repository (Centre for Evaluation in Education and Science) · doi:10.13140/2.1.4811.5521 · Cited by 73
Stability of Initial Autism Spectrum Disorder Diagnoses in Community Settings
Daniels, A. M., Rosenberg, R. E., Law, J. K., Lord, C., Kaufmann, W. E., & Law, P. A. (2010) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-010-1031-x · Cited by 73
Personality differences between surgery residents, nonsurgery residents, and medical students
Hoffman, B. M., Coons, M. J., & Kuo, P. C. (2010) · Surgery · doi:10.1016/j.surg.2010.04.005 · Cited by 77
Sexual Satisfaction and Desire Discrepancy in Same Sex Women's Relationships
Bridges, S. K., & Horne, S. G. (2006) · Journal of Sex & Marital Therapy · doi:10.1080/00926230600998466 · Cited by 84
“In comparison with traditional methods of survey research, web-based research has been found to be as reliable, appears to improve accuracy when accessing special populations, and allows people to be represented who would be unattainable if more traditional methods were used ( Kraut, Olson, Banaji, Cohen, & Couper, 20…”
MethodMemory Detection 2.0: The First Web-Based Memory Detection Test
Kleinberg, B., & Verschuère, B. (2015) · PLoS ONE · doi:10.1371/journal.pone.0118715 · Cited by 75
“Apart from technical challenges, another disadvantage of online testing may arise from the fact that one has less control on whether the examinee understands the task, takes the task seriously and pays sufficient attention to the task, which may imply loss of quality in the data (but see [29]; [30]; [28]; [31]; [32];…”
BackgroundResultWho are People Willing to Date? Ethnic and Gender Patterns in Online Dating
Hwang, W. (2012) · Race and Social Problems · doi:10.1007/s12552-012-9082-6 · Cited by 73
“outcomes as more traditional methods of data collection (Gosling et al. 2004).”
MethodTelework and Social Services in Spain during the COVID-19 Pandemic
Morilla-Luchena, A., Moreno, R. M., Chaves-Montero, A., & Aguado, O. V. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18020725 · Cited by 72
“Different authors [27,28] endorse the use of this information collection tool, since it has proven to be methodologically practical, suitable and especially useful for obtaining a satisfactory statistical product.”
BackgroundInvestigating the humor of gelotophobes: Does feeling ridiculous equal being humorless?
Ruch, W., Beermann, U., & Proyer, R. T. (2009) · Humor - International Journal of Humor Research · doi:10.1515/humr.2009.006 · Cited by 72
Parental Burden Associated with Borderline Personality Disorder in Female Offspring
Goodman, M. S., Patil, U., Triebwasser, J., Hoffman, P. D., Weinstein, Z. A., & New, A. S. (2011) · Journal of Personality Disorders · doi:10.1521/pedi.2011.25.1.59 · Cited by 72
Relationship Contingency and Sexual Motivation in Women: Implications for Sexual Satisfaction
Sanchez, D. T., Moss‐Racusin, C. A., Phelan, J. E., & Crocker, J. (2010) · Archives of Sexual Behavior · doi:10.1007/s10508-009-9593-4 · Cited by 83
“Although many issues should be considered when evaluating Internet research, such as uncontrollable experimental conditions and representativeness, researchers suggest that samples in Internet survey research are just as representative as those in non-Internet survey research, if not more diverse than traditional meth…”
BackgroundPrevalence and Predictors of Cyberbullying Perpetration by High School Seniors
Roberto, A. J., Eden, J., Savage, M. W., Salazar, L. R., & Deiss, D. M. (2014) · Communication Quarterly · doi:10.1080/01463373.2013.860906 · Cited by 72
“Specifically, Hinduja and Patchin (2008) indicated that neither boys nor girls were especially more likely to take on the role of cyberbullying perpetrator or victim. On the other hand, Willard (2007) purported that girls are responsible for a higher ratio of online bullying occurrences than boys are.”
BackgroundStein, D. J., Flessner, C. A., Franklin, M. E., Keuthen, N. J., Löchner, C., & Woods, D. W. (2008) · Annals of Clinical Psychiatry · doi:10.1080/10401230802435625 · Cited by 74
Robson, C., & Lian, O. S. (2017) · Wellcome Open Research · doi:10.12688/wellcomeopenres.12133.2 · Cited by 72
Service lifetime, storage time, and disposal pathways of electronic equipment: a swiss case study
Thiébaud (‐Müller), E., Hilty, L. M., Schluep, M., Widmer, R., & Faulstich, M. (2018) · Journal of Industrial Ecology · doi:10.1111/jiec.12551 · Cited by 71
“This means that the survey sample is not randomly selected from the target population and thus the principles of probability sampling are not followed (Bethlehem 2009, 2010; Gosling et al. 2004).”
Color red in web-based knowledge testing
Gnambs, T., Appel, M., & Batinic, B. (2010) · Computers in Human Behavior · doi:10.1016/j.chb.2010.06.010 · Cited by 73
“Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P. (2004).”
Loosemore, M., & Benson, L. T. H. (2021) · International Journal of Project Management · doi:10.1016/j.ijproman.2021.05.002 · Cited by 85
Szymanski, D. M., & Owens, G. P. (2008) · Psychology of Women Quarterly · doi:10.1111/j.1471-6402.2007.00410.x · Cited by 79
Foundations of life-long sexual health literacy
Graf, A. S., & Patrick, J. H. (2015) · Health Education · doi:10.1108/he-12-2013-0073 · Cited by 78
“Also, online samples traditionally have higher education levels than samples recruited through other methods (Gosling et al., 2004) and more education has been found to correspond with greater sexual knowledge and more positive attitudes (Henderson et al.”
BackgroundRoles for software technologies in advancing research and theory in educational psychology
Hadwin, A. F., Winne, P. H., & Nesbit, J. C. (2005) · British Journal of Educational Psychology · doi:10.1348/000709904x19263 · Cited by 71
Lieberman, J. D., & Sales, B. D. (2007) · American Psychological Association eBooks · doi:10.1037/11498-000 · Cited by 71
Normality evaluations and their relation to personality traits and well-being.
Wood, D., Gosling, S. D., & Potter, J. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.93.5.861 · Cited by 76
Self-citationThe appropriated racial oppression scale: Development and preliminary validation
Campón, R. R., & Carter, R. T. (2015) · Cultural Diversity & Ethnic Minority Psychology · doi:10.1037/cdp0000037 · Cited by 68
Faculty-Student Collaborations: Ethics and Satisfaction in Authorship Credit
Sandler, J. C., & Russell, B. L. (2005) · Ethics & Behavior · doi:10.1207/s15327019eb1501_5 · Cited by 70
“Such steps have been found to be commensurate both with APA ethical guidelines for research, and with valid research techniques (Gosling et al., 2004; Kraut et al., 2004).”
BackgroundResultSkills in demand for ICT and statistical occupations: Evidence from web‐based job vacancies
Lovaglio, P. G., Cesarini, M., Mercorio, F., & Mezzanzanica, M. (2018) · Statistical Analysis and Data Mining The ASA Data Science Journal · doi:10.1002/sam.11372 · Cited by 76
“Notwithstanding, several methodological issues persist concerning the use of web vacancies, which are predominantly related to the quality and representativeness of such data and generalizability of the findings [54–57].”
BackgroundEbert, T., Gebauer, J. E., Brenner, T., Bleidorn, W., Gosling, S. D., Potter, J., & Rentfrow, P. J. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691621998326 · Cited by 88
“To address the aims of the investigation, we used data from the Gosling-Potter Internet Personality Project (GPIPP; Gosling et al., 2004).”
MethodResultInfluentialSelf-citationBoyraz, G., Lightsey, O. R., & Can, A. (2013) · Journal of Personality Assessment · doi:10.1080/00223891.2013.765882 · Cited by 73
“…samples were at least as diverse as many of the traditional samples used in psychological research and that the quality of the data obtained through web-based surveys was at least as good as the quality of data obtained by traditional methods (see Gosling et al., 2004, for further information).”
MethodConducting Research Online: Challenges Facing Researchers in Family and Consumer Sciences
Lyons, A. C., Cude, B. J., Lawrence, F. C., & Gutter, M. S. (2005) · Family and Consumer Sciences Research Journal · doi:10.1177/1077727x04274116 · Cited by 70
Parrott, A. C., Rodgers, J., Buchanan, T., Ling, J., Heffernan, T., & Scholey, A. B. (2006) · Human Psychopharmacology Clinical and Experimental · doi:10.1002/hup.773 · Cited by 70
How Does the General Public Evaluate Risk Information? The Impact of Associations with Other Risks
Visschers, V. H. M., Meertens, R. M., Passchier, W. F., & de Vries, N. K. (2007) · Risk Analysis · doi:10.1111/j.1539-6924.2007.00915.x · Cited by 70
“(44) However, Internet research has been criticized for its limited opportunities to monitor the respondents; respondents may not fill in the survey honestly or seriously.(45) It has also been argued that the respondent samples of Internet studies are selfselected.”
BackgroundGrief following pet and human loss: Closeness is key
Eckerd, L. M., Barnett, J. E. F., & Jett-Dias, L. E. Y. (2016) · Death Studies · doi:10.1080/07481187.2016.1139014 · Cited by 70
Attachment features and functions in adult romantic relationships
Heffernan, M. E., Fraley, R. C., Vicary, A. M., & Brumbaugh, C. C. (2012) · Journal of Social and Personal Relationships · doi:10.1177/0265407512443435 · Cited by 78
Watanabe, R., & Watanabe, T. (2019) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2019.04.017 · Cited by 69
Lahath, A., Omar, N. A., Ali, M. H., Tseng, M., & Yazid, Z. (2021) · Sustainable Production and Consumption · doi:10.1016/j.spc.2021.06.008 · Cited by 80
COVID-19 Fear, Resilience, Social Support, Anxiety, and Suicide among College Students in Spain
Rodríguez, J. M., Caravaca-Sánchez, F., & Fernández-Prados, J. S. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18158156 · Cited by 84
“This tool is methodologically suitable for obtaining satisfactory statistical products [57] and has recently been used among college samples to collect sensitive information [40,58].”
MethodStoeber, J., Harvey, M., Ward, J. A., & Edbrooke-Childs, J. H. (2011) · Personality and Individual Differences · doi:10.1016/j.paid.2011.08.006 · Cited by 77
Identifying meta‐clusters of students' interest in science and their change with age
Baram‐Tsabari, A., & Yarden, A. (2009) · Journal of Research in Science Teaching · doi:10.1002/tea.20294 · Cited by 69
Yule, M. A., Brotto, L. A., & Gorzalka, B. B. (2013) · Archives of Sexual Behavior · doi:10.1007/s10508-013-0175-0 · Cited by 69
Choose Your Own Adventure: Attachment Dynamics in a Simulated Relationship
Vicary, A. M., & Fraley, R. C. (2007) · Personality and Social Psychology Bulletin · doi:10.1177/0146167207303013 · Cited by 69
“Procedure. Participants completed the Experiences in Close Relationships–Revised questionnaire ( Fraley et al., 2000 ).”
MethodInfluentialSelf-reflection as a mediator between self-efficacy and well-being
van Seggelen-Damen, I. C. M., & van Dam, K. (2016) · Journal of Managerial Psychology · doi:10.1108/jmp-01-2013-0022 · Cited by 74
Budge, S. L., Thai, J. L., Tebbe, E. A., & Howard, K. A. S. (2016) · The Counseling Psychologist · doi:10.1177/0011000015609046 · Cited by 72
Forming impressions of facial attractiveness is mandatory
Ritchie, K. L., Palermo, R., & Rhodes, G. (2017) · Scientific Reports · doi:10.1038/s41598-017-00526-9 · Cited by 75
Examination of interoception along the suicidality continuum
Rogers, M. L., Hagan, C. R., & Joiner, T. E. (2018) · Journal of Clinical Psychology · doi:10.1002/jclp.22564 · Cited by 76
Social value, content value, and brand equity in social media brand communities
Jiao, Y., Ertz, M., Jo, M., & Sarigöllü, E. (2018) · International Marketing Review · doi:10.1108/imr-07-2016-0132 · Cited by 80
Self-Care Strategies and Sources of Information for HIV/AIDS Symptom Management
Chou, F., Holzemer, W. L., Portillo, C. J., & Slaughter, R. E. (2004) · Nursing Research · doi:10.1097/00006199-200409000-00008 · Cited by 69
Renzetti, C. M., DeWall, C. N., Messer, A., & Pond, R. S. (2015) · Journal of Family Issues · doi:10.1177/0192513x15576964 · Cited by 74
Nayak, S. S., Fraser, T., Panagopoulos, C., Aldrich, D. P., & Kim, D. J. (2021) · Social Science & Medicine · doi:10.1016/j.socscimed.2021.113976 · Cited by 74
Holmes, S. (2008) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2008.08.004 · Cited by 68
“The anonymity and con- fidentiality of participants could be seen to be protected to a greater extent than is possible through other approaches to data collection perhaps motivating them to participate in online studies (Barry, 2001; Gosling et al., 2004).”
BackgroundResultDepression, anxiety, and functional impairment in children with trichotillomania
Lewin, A. B., Piacentini, J., Flessner, C. A., Woods, D. W., Franklin, M. E., Keuthen, N. J., Moore, P., Khanna, M., March, J. S., Stein, D. J., et al. (2008) · Depression and Anxiety · doi:10.1002/da.20537 · Cited by 68
“However, Gosling and colleagues([28]) have demonstrated that data collected from internet samples ‘‘generalize across presentation formats, do not appear to be tainted by false data or repeat responders, and are, so far, consistent with results from traditional methods.”
ResultPlayer identification in online games
LOOY, J. V., Courtois, C., & Vocht, M. D. (2010) · International Conference on Fun and Games · doi:10.1145/1823818.1823832 · Cited by 86
Individual Differences in Cognition: New Methods for Examining the Personality-Cognition Link
Revelle, W., Wilt, J. A., & Rosenthal, A. M. (2010) · Plenum series on human exceptionality · doi:10.1007/978-1-4419-1210-7_2 · Cited by 70
“As discussed in reviews of web-based research (Fraley, 2004; Gosling et al., 2004; Skitka & Sargis, 2006), the participants are demographically diverse but not a representative sample of anybody other than those who want to take web-based surveys.”
BackgroundPsychometric evaluation of the German version of the Intuitive Eating Scale-2 in a community sample
Gisch, U. A., & Warschburger, P. (2017) · Appetite · doi:10.1016/j.appet.2017.06.018 · Cited by 68
Social anxiety and posttraumatic stress symptoms: The impact of distressing social events
Carleton, R. N., Peluso, D. L., Collimore, K. C., & Asmundson, G. J. G. (2010) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2010.08.002 · Cited by 67
BARR, P. A. (2018) · Journal of Advanced Nursing · doi:10.1111/jan.13543 · Cited by 67
Modern-day hoarding: A model for understanding and measuring digital hoarding
Sedera, D., Lokuge, S., & Grover, V. (2022) · Information & Management · doi:10.1016/j.im.2022.103700 · Cited by 78
Social Media Adoption in Business-to-Business: IT and Industrial Companies Compared
Veldeman, C., Praet, E. V., & Mechant, P. (2015) · International Journal of Business Communication · doi:10.1177/2329488415572785 · Cited by 67
“On a methodological level, issues such as self-selection, multiple submissions, nonserious responses, and dropouts are pointed out to be problematic (Gosling, Vazire, Srivastava, & John, 2004).”
BackgroundJanda, M., DiSipio, T., Hurst, C. P., Cella, D. F., & Newman, B. M. (2008) · Psycho-Oncology · doi:10.1002/pon.1428 · Cited by 67
Development of an abbreviated Personal Globe Inventory using item response theory: The PGI-Short
Tracey, T. J. G. (2009) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2009.06.007 · Cited by 67
Conflicting influences on UK mothers' decisions to introduce solid foods to their infants
Arden, M. A. (2009) · Maternal and Child Nutrition · doi:10.1111/j.1740-8709.2009.00194.x · Cited by 67
Κube, T., D’Astolfo, L., Glombiewski, J. A., Doering, B. K., & Rief, W. (2016) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.12114 · Cited by 65
Pittman, D. M., Brooks, J. J., Kaur, P., & Obasi, E. M. (2017) · Journal of Ethnicity in Substance Abuse · doi:10.1080/15332640.2017.1336958 · Cited by 70
A computer-based intervention to reduce internalized heterosexism in men
Lin, Y.-J., & Israel, T. (2012) · Journal of Counseling Psychology · doi:10.1037/a0028282 · Cited by 66
Tavassoli, S., Obschonka, M., & Audretsch, D. B. (2021) · Research Policy · doi:10.1016/j.respol.2021.104255 · Cited by 71
Walther, M. R., Snorrason, I., Flessner, C., Franklin, M., Burkel, R., & Woods, D. W. (2013) · Child Psychiatry and Human Development · doi:10.1007/s10578-013-0373-y · Cited by 66
Powell, P. A., Simpson, J., & Overton, P. G. (2013) · Cognition & Emotion · doi:10.1080/02699931.2013.767223 · Cited by 66
A phenomenological investigation of women with Tourette or other chronic tic disorders.
Lewin, A., Murphy, T., Storch, E., Conelea, C. A., Woods, D. W., Scahill, L., Compton, S., Zinner, S., Budman, C., & Walkup, J. (2012) · Comprehensive Psychiatry · doi:10.1016/j.comppsych.2011.07.004 · Cited by 56
“However, previous research using similar methodologies have demonstrated data consistent in reliability and content validity compared to clinic and community samples [38-43,72].”
MethodDyadic Empathy Predicts Sexual and Relationship Well-Being in Couples Transitioning to Parenthood
Rosen, N., Mooney, K. M., & Muise, A. (2017) · Journal of Sex & Marital Therapy · doi:10.1080/0092623x.2016.1208698 · Cited by 57
“Furthermore, nonserious or repeat responders do not adversely impact self-reported data collected via the Internet, and findings are typically consistent with those from more traditional methods (Gosling et al., 2004).”
ResultMeasuring national resilience: A new short version of the scale (NR‐13)
Kimhi, S., & Eshel, Y. (2018) · Journal of Community Psychology · doi:10.1002/jcop.22135 · Cited by 71
Stereotypes about surgeon warmth and competence: The role of surgeon gender
Ashton-James, C. E., Tybur, J. M., Grießer, V., & Costa, D. (2019) · PLoS ONE · doi:10.1371/journal.pone.0211890 · Cited by 63
Stakeholder views on treating pain due to dehorning dairy calves
Robbins, J., Weary, D. M., Schuppli, C. A., & von Keyserlingk, M. A. G. (2015) · Animal Welfare · doi:10.7120/09627286.24.4.399 · Cited by 66
Anhedonia in obsessive-compulsive disorder: Beyond comorbid depression
Abramovitch, A., Pizzagalli, D. A., Reuman, L., & Wilhelm, S. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.02.002 · Cited by 64
“Notably, it is important to keep in mind that multiple web-based psychology studies have yielded reliable results when appropriate control measures were employed (Birnbaum, 2004; Gosling et al., 2004).”
Lewandowsky, S., Cook, J., Oberauer, K., & Marriott, M. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00073 · Cited by 69
RetractedPark, Y., & Sprung, J. M. (2014) · Journal of Organizational Behavior · doi:10.1002/job.1953 · Cited by 67
McCallum, E. B., & Peterson, Z. D. (2012) · The Journal of Sex Research · doi:10.1080/00224499.2012.658923 · Cited by 64
“It is also worth noting that, although early critics of Web-based research suggested that participants may have been particularly psychologically dysfunctional or maladjusted, a number of studies provide evidence that counters this assumption (Gosling et al., 2004).”
BackgroundInfluentialPerceived control and maternal satisfaction with childbirth: a measure development study
Stevens, N. R., Wallston, K., & Hamilton, N. (2012) · Journal of Psychosomatic Obstetrics and Gynaecology · doi:10.3109/0167482x.2011.652996 · Cited by 59
“However, previous research indicates that online responses are generally consistent and no less accurate than responses obtained via face-to-face contact [56].”
BackgroundPsychologists’ sexual education and training in graduate school.
Miller, S., & Byers, E. S. (2010) · Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement · doi:10.1037/a0018571 · Cited by 65
Hidaka, Y., & Operario, D. (2006) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2005.045336 · Cited by 65
Willing to Give but Not to Forgive: Borderline Personality Features and Cooperative Behavior
Thielmann, I., Hilbig, B. E., & Niedtfeld, I. (2014) · Journal of Personality Disorders · doi:10.1521/pedi_2014_28_135 · Cited by 66
Metadata
- Authors
- Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P.
- Affiliations
- The University of Texas at Austin (US)
- Stanford University (US)
- University of California, Berkeley (US)
- Venue
- American Psychologist
- Published
- 2004
- Volume
- 59
- Issue
- 2
- Pages
- 93-104
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W1992490637
- Cited by
- 2,932
- References
- 72
- Citations by year
- 2026: 40 · 2025: 64 · 2024: 72 · 2023: 85 · 2022: 123 · 2021: 135 · 2020: 157 · 2019: 163 · 2018: 148 · 2017: 170 · 2016: 181 · 2015: 192 · 2014: 218 · 2013: 184 · 2012: 189
- FWCI
- 261.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Keywords
- online data collection, paper-and-pencil questionnaires, sample representativeness, data quality, response format effects, generalizability, self-report questionnaire
- MeSH terms
- Adult, Aged, Attitude, Female, Humans, Male, Middle Aged, Psychology, Surveys and Questionnaires, Evidence-Based Medicine, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
