The DOI matches its Crossref record; 68 of the 72 references it cites were found in a registry or an index.
Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires.
Abstract
The rapid growth of the Internet provides a wealth of new research opportunities for psychologists. Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods. Six preconceptions about Internet samples and data quality are evaluated by comparing a new large Internet sample (N = 361,703) with a set of 510 published traditional samples. Internet samples are shown to be relatively diverse with respect to gender, socioeconomic status, geographic region, and age. Moreover, Internet findings generalize across presentation formats, are not adversely affected by nonserious or repeat responders, and are consistent with findings from traditional methods. It is concluded that Internet methods can contribute to many areas of psychology.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The proportion of females (62%) to males in this study was more representative than in traditional survey methods, where women often comprise 71% to 77% of the participants [39]”
From Effects of Mock Facebook Workday Comments on Public Perception of Professional Credibility: A Field Study in Canada (2019) · cites this paper as [39]
In the citing paper
“Self-presentation is an unlikely confound in Study 1 because the motivation to self-present is absent when participants feel anonymous (Paulhus, 1984(Paulhus, , 1991) ) as they do in anonymous online studies such as the present one, where they don't provide identifying information (Gosling et al., 2004).”
From Cultural norm fulfillment, interpersonal belonging, or getting ahead? A large-scale cross-cultural test of three perspectives on the function of self-esteem. (2015) · cites this paper as Gosling et al., 2004
In the citing paper
“As described in the Appendix, the reliability and validity of internet data collection has become increasingly clear in recent years.”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“The validity of internet testing has been well supported in recent reviews (Gosling et al., 2004), with excellent correspondence between results obtained with internet samples are results obtained in the laboratory (e.g., Birnbaum, 1999;Krantz & Dalal, 2000;McGraw, Tew, & Williams, 2000;Reips, 2002).”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“Furthermore, previous research has suggested populations for online studies and Facebook are quite representative [23], [24].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [23]
In the citing paper
“Still, the sample sizes and availability of demographic information afforded by social media bring us closer to a more ideal representative sample [99].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [99]
Citations
Cites
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
(1999) · Cited by 7,995
Self-citationInternet paradox: A social technology that reduces social involvement and psychological well-being?
Kraut, R., Patterson, M., Lundmark, V., Kiesler, S., Mukophadhyay, T., & Scherlis, W. (1998) · American Psychologist · doi:10.1037/0003-066x.53.9.1017 · Cited by 4,793
Handbook of Personality : Theory and Research
Pervin, L. A. (1992) · Cited by 4,543
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Mail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070237 · Cited by 3,463
Gender differences in personality traits across cultures: Robust and surprising findings.
Costa, P. T., Terracciano, A., & McCrae, R. R. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.2.322 · Cited by 2,986
Kraut, R. E., Kiesler, S. B., Boneva, B. S., Cummings, J. N., Helgeson, V. S., & Crawford, A. M. (2002) · Journal of Social Issues · doi:10.1111/1540-4560.00248 · Cited by 2,367
Gender differences in personality: A meta-analysis.
Feingold, A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.3.429 · Cited by 2,240
Handbook of Personality Theory and Research.
Schwartz, M. L., Borgatta, E. F., & Lambert, W. W. (1970) · American Sociological Review · doi:10.2307/2093310 · Cited by 2,182
Research works printed but not linked: 7
- Azar, 2000, A web of research: They're fun, they're fast, and they save money, but do Web experiments yield quality results?, Monitor on Psychology, 31, 42
- 10.1037/0022-3514.75.3.729 · DOI · Paper page
- Dillman. 1998 · DOI
- Locke, 1995, Method of psychological assessment, self-disclosure, and experiential differences: A study of computer, questionnaire, and interview assessment formats., Journal of Social Behavior and Personality, 10, 255
- 2000, Digest of education statistics 2000.
- Skitka, (in press). Social psychological research and me Internet: The promise and the perils of a new methodological frontier.
- 2000, Population, 1
Cited by
Sorted by citations
Items 301–400 of 1,012
Close adult friendships, gender, and the life cycle
Gillespie, B. J., Lever, J., Frederick, D. A., & Royce, T. (2014) · Journal of Social and Personal Relationships · doi:10.1177/0265407514546977 · Cited by 145
Extended Reality (XR) Remote Research: a Survey of Drawbacks and Opportunities
Ratcliffe, J., Soave, F., Bryan–Kinns, N., Tokarchuk, L. N., & Farkhatdinov, I. (2021) · University of the Arts London Research Online (University of the Arts London) · Cited by 145
The Skin Picking Scale-Revised: Factor structure and psychometric properties
Snorrason, Í., Ólafsson, R. P., Flessner, C. A., Keuthen, N. J., Franklin, M. E., & Woods, D. W. (2012) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2012.03.001 · Cited by 143
Young and worried: Age and fear of recurrence in breast cancer survivors.
Lebel, S., Beattie, S., Arès, I., & Bielajew, C. H. (2012) · Health Psychology · doi:10.1037/a0030186 · Cited by 158
Ali, F. M., & Chamorro‐Premuzic, T. (2009) · Personality and Individual Differences · doi:10.1016/j.paid.2009.10.016 · Cited by 142
The approach-avoidance task as an online intervention in cigarette smoking: A pilot study
Wittekind, C. E., Feist, A., Schneider, B. C., Moritz, S., & Fritzsche, A. (2014) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2014.08.006 · Cited by 154
Goin‐Kochel, R. P., Mackintosh, V. H., & Myers, B. J. (2009) · Research in Autism · doi:10.1016/j.rasd.2008.11.001 · Cited by 142
Blair, K. L., Cappell, J., & Pukall, C. F. (2017) · The Journal of Sex Research · doi:10.1080/00224499.2017.1303437 · Cited by 142
Suspicious and fraudulent online survey participation: Introducing the REAL framework
Lawlor, J., Thomas, C. C., Guhin, A. T., Kenyon, K., Lerner, M. D., & Drahota, A. (2021) · Methodological Innovations · doi:10.1177/20597991211050467 · Cited by 167
“Researchers can also add questions to their survey to test the seriousness of responses, include trick questions, or instructional manipulations that make it difficult to move quickly through a survey (Aust et al., 2013; Gosling et al., 2004; Nosek et al., 2002; Oppenheimer et al., 2009; Pequegnat et al., 2007).”
BackgroundResultInfluentialRosenberg, R. E., Mandell, D. S., Farmer, J. E., Law, J. K., Marvin, A. R., & Law, P. A. (2010) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-009-0878-1 · Cited by 154
“Although the US Food and Drug Administration has indicated only one medication for use in ASD treatment (risperidone), many other medications are commonly prescribed (Filipek et al. 2000; Findling 2005; Myers et al. 2007; Posey et al. 2008; Tsai 1999; Volkmar 2001).”
BackgroundLatner, J. D., Barile, J. P., Durso, L. E., & O’Brien, K. (2014) · Eating Behaviors · doi:10.1016/j.eatbeh.2014.08.014 · Cited by 141
An Exploration of the Psychometric Properties of the PASS-20 With a Nonclinical Sample
Abrams, M. P., Carleton, R. N., & Asmundson, G. J. G. (2007) · Journal of Pain · doi:10.1016/j.jpain.2007.06.004 · Cited by 152
Prospective effects of emotion-regulation skills on emotional adjustment.
Berking, M., Orth, U., Wupperman, P., Meier, L. L., & Caspar, F. (2008) · Journal of Counseling Psychology · doi:10.1037/a0013589 · Cited by 166
New times, new needs; e-epidemiology
Ekman, A., & Litton, J. (2007) · European Journal of Epidemiology · doi:10.1007/s10654-007-9119-0 · Cited by 139
“Computerized administration also allows researchers to obtain sample sizes that far exceed those obtained with most traditional techniques [48].”
BackgroundProyer, R. T., Gander, F., Wellenzohn, S., & Ruch, W. (2013) · The Journal of Positive Psychology · doi:10.1080/17439760.2013.777767 · Cited by 164
Resistance in repressive contexts: A comprehensive test of psychological predictors.
Ayanian, A. H., Tausch, N., Acar, Y. G., Chayinska, M., Cheung, W.-Y., & Lukyanova, Y. (2021) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000285 · Cited by 137
Vaughan, M. D., & Waehler, C. A. (2009) · Journal of Adult Development · doi:10.1007/s10804-009-9084-9 · Cited by 137
Formalizing Neurath’s ship: approximate algorithms for online causal learning.
Bramley, N. R., Dayan, P., Griffiths, T. L., & Lagnado, D. A. (2017) · Psychological Review · doi:10.1037/rev0000061 · Cited by 136
Advances on remote laboratories and e-learning experiences
García-Zubía, J., & Gomes, L. (2007) · Cited by 136
Rosser, B. R. S., Oakes, J. M., Bockting, W. O., & Miner, M. H. (2007) · Sexuality Research and Social Policy · doi:10.1525/srsp.2007.4.2.50 · Cited by 136
Exploring ethical issues associated with using online surveys in educational research
Roberts, L. D., & Allen, P. (2015) · Educational Research and Evaluation · doi:10.1080/13803611.2015.1024421 · Cited by 155
“Participants can also be asked if they have completed the survey previously, and responses from those answering affirmatively deleted (Gosling et al., 2004).”
BackgroundMethodResultInfluentialFrederick, D. A., Sandhu, G., Morse, P. J., & Swami, V. (2016) · Body Image · doi:10.1016/j.bodyim.2016.04.001 · Cited by 136
James, O., Jilke, S., Petersen, C., & de Walle, S. V. (2015) · Public Administration Review · doi:10.1111/puar.12471 · Cited by 135
“Gosling et al. (2004, 93) found that large internet samples are typically diverse in terms of gender, socio-economic status, geographical region and age and found self-reporting internet questionnaires were consistent with responses from traditional (paper-and-pen) methods.”
BackgroundResultInfluentialThe Cambridge Handbook of Personality Psychology
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108264822 · Cited by 148
Rives Bogart, K., & Matsumoto, D. (2010) · Social Neuroscience · doi:10.1080/17470910903395692 · Cited by 135
“Several researchers have suggested that the Internet can be a useful tool for many cognitive and social psychological studies, particularly for collecting large samples of rare populations, and that comparisons of Internet-based studies with lab-based studies showed that results are consistent across presentation mode…”
Rumination Mediates the Prospective Effect of Low Self-Esteem on Depression
Kuster, F., Orth, U., & Meier, L. L. (2012) · Personality and Social Psychology Bulletin · doi:10.1177/0146167212437250 · Cited by 158
Personality assessment: Does the medium matter? No
Chuah, S. C., Drasgow, F., & Roberts, B. W. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.01.006 · Cited by 140
Competing selves: Negotiating the intersection of spiritual and sexual identities.
Sherry, A. R., Adelman, A., Whilde, M. R., & Quick, D. (2010) · Professional Psychology Research and Practice · doi:10.1037/a0017471 · Cited by 132
Szymanski, D. M., & Kashubeck‐West, S. (2008) · The Counseling Psychologist · doi:10.1177/0011000007309490 · Cited by 141
Appel, M., Kronberger, N., & Aronson, J. M. (2011) · European Journal of Social Psychology · doi:10.1002/ejsp.835 · Cited by 151
Gebauer, J. E., Bleidorn, W., Gosling, S. D., Rentfrow, P. J., Lamb, M. E., & Potter, J. (2014) · Journal of Personality and Social Psychology · doi:10.1037/a0037683 · Cited by 145
Self-citationPerceived Marginalization and the Prediction of Romantic Relationship Stability
Lehmiller, J. J., & Agnew, C. R. (2007) · Journal of Marriage and the Family · doi:10.1111/j.1741-3737.2007.00429.x · Cited by 130
Flessner, C., Conelea, C. A., Woods, D. W., Franklin, M., Keuthen, N., & Cashin, S. E. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2007.12.009 · Cited by 127
González, C. A., Gallego, J. D., & Bockting, W. O. (2017) · The Journal of Primary Prevention · doi:10.1007/s10935-017-0469-4 · Cited by 146
Backx, R., Skirrow, C., Dente, P., Barnett, J. H., & Cormack, F. K. (2020) · Journal of Medical Internet Research · doi:10.2196/16792 · Cited by 125
“Web-based automated assessments are inexpensive, are quick to conduct, and provide fewer restrictions on timing and location [2,5-7].”
BackgroundConcurrent validity of an online version of the timeline followback assessment
Pedersen, E. R., Grow, J., Duncan, S., Neighbors, C., & Larimer, M. E. (2012) · Psychology of Addictive Behaviors · doi:10.1037/a0027945 · Cited by 128
Jasper, K., Weise, C., Conrad, I., Andersson, G., Hiller, W., & Kleinstäuber, M. (2014) · Psychotherapy and Psychosomatics · doi:10.1159/000360705 · Cited by 126
Lippke, S., Schwarzer, R., Ziegelmann, J. P., Scholz, U., & Schüz, B. (2010) · Health Education & Behavior · doi:10.1177/1090198109359386 · Cited by 128
Conflict styles of men and women at six organization levels
Thomas, K. W., Thomas, G. F., & Schaubhut, N. A. (2008) · International Journal of Conflict Management · doi:10.1108/10444060810856085 · Cited by 128
“(For evidence of the equivalence of pencil-and-paper and online versions of instruments, see Gosling et al., 2004, and Naglieri et al., 2004.)”
BackgroundObschonka, M., Stuetzer, M., Rentfrow, P. J., Shaw-Taylor, L., Satchell, M., Silbereisen, R. K., Potter, J., & Gosling, S. D. (2018) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000175 · Cited by 127
Self-citationMusical Aptitude Is Associated with AVPR1A-Haplotypes
Ukkola, L. T., Onkamo, P., Raijas, P., Karma, K., & Järvelä, I. E. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005534 · Cited by 136
“The pros, including time and money saving, as well as the possible cons, like poor diversity (age, sex, and education), lack of motivation, nonserious responses and dishonesty, additional drop-outs, anonymity, and multiple submissions [69], of the method were considered.”
MethodActivity Engagement as Escape from Self: The Role of Self-Suppression and Self-Expansion
Stenseng, F., Rise, J., & Kraft, P. (2012) · Leisure Sciences · doi:10.1080/01490400.2012.633849 · Cited by 158
“For more information on the reliability and validity of web-based surveys, see Gosling et al, 2004 .”
Mellner, C. (2016) · International Journal of Workplace Health Management · doi:10.1108/ijwhm-07-2015-0050 · Cited by 133
Szymanski, D. M., & Carr, E. R. (2008) · Psychology of Men & Masculinity · doi:10.1037/1524-9220.9.1.40 · Cited by 140
“Research has found that more gender role conflict is related to more depression, anxiety, emotional distress, loneliness, anger, conduct problems, substance abuse, and family and interpersonal problems in presumably heterosexual boys and men (Blazina, Pisecco, & O’Neil, 2005; Blazina & Watkins, 2000; Cournoyer & Mahal…”
BackgroundZentner, M., & Mitura, K. (2012) · Psychological Science · doi:10.1177/0956797612441004 · Cited by 151
Functions of reminiscence and the psychological well-being of young-old and older adults over time
O’Rourke, N., Cappeliez, P., & Claxton, A. (2010) · Aging & Mental Health · doi:10.1080/13607861003713281 · Cited by 126
“Of particular relevance to this study is that the web-based study participants do not appear to differ from self-selected participants recruited by more traditional means with respect to various well-being constructs (Gosling et al., 2004).”
BackgroundFactor Structure of the Chinese Virtues Questionnaire
Duan, W., Ho, S. M. Y., Yu, B., Tang, X., Zhang, Y., Li, T., & Yuen, T. (2012) · Research on Social Work Practice · doi:10.1177/1049731512450074 · Cited by 126
Moral Emotions and Social Activism: The Case of Animal Rights
Herzog, H. A., & Golden, L. L. (2009) · Journal of Social Issues · doi:10.1111/j.1540-4560.2009.01610.x · Cited by 137
“Research comparing data from web-based studies and traditional college samples suggests that the results of Internet research are surprisingly consistent with data gathered by traditional means (Gosling et al., 2004).”
Result“What Do You Like/Dislike About the Treatments You’re Currently Using?”
Mackintosh, V. H., Goin‐Kochel, R. P., & Myers, B. J. (2012) · Focus on Autism and Other Developmental Disabilities · doi:10.1177/1088357611423542 · Cited by 126
A Model of Volunteer Retention in Youth Sport
Kim, M., Chelladurai, P., & Trail, G. T. (2007) · Journal of Sport Management · doi:10.1123/jsm.21.2.151 · Cited by 132
Timming, A. R. (2016) · Work Employment and Society · doi:10.1177/0950017016630260 · Cited by 126
“Finally, one might point to the non-random nature of the online sample as a limitation, but research has shown that web-based samples like this one are generally comparable to those drawn by more traditional methods of sampling anyway (Gosling et al., 2004).”
ResultSaridakis, G., Benson, V., Ezingeard, J., & Tennakoon, H. (2015) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2015.08.012 · Cited by 140
“However, research findings indicate that participants from self-selected samples provide clearer, more complete responses than participants who are not self-selected volunteers (Gosling & Vazire, 2004).”
Measurement of Maternal Perceptions of Support and Control in Birth (SCIB)
Ford, E. M., Ayers, S., & Wright, D. B. (2009) · Journal of Women s Health · doi:10.1089/jwh.2008.0882 · Cited by 125
“34 Sample.”
Prevalence of Sexual Dysfunction and Impact of Contraception in Female German Medical Students
Wallwiener, C. W., Wallwiener, L.-M., Seeger, H., Mück, A. O., Bitzer, J., & Wallwiener, M. (2010) · The Journal of Sexual Medicine · doi:10.1111/j.1743-6109.2010.01742.x · Cited by 132
Attachment Styles and Male Sex Addiction
Zapf, J. L., Greiner, J., & Carroll, J. (2008) · Sexual Addiction & Compulsivity · doi:10.1080/10720160802035832 · Cited by 123
Food addiction as a causal model of obesity. Effects on stigma, blame, and perceived psychopathology
Latner, J. D., Puhl, R. M., Murakami, J. M., & O'Brien, K. S. (2014) · Appetite · doi:10.1016/j.appet.2014.03.004 · Cited by 124
Walther, M. R., Flessner, C., Conelea, C. A., & Woods, D. W. (2009) · Journal of Behavior Therapy and Experimental Psychiatry · doi:10.1016/j.jbtep.2008.07.002 · Cited by 124
Resilience predicts well-being in teachers, but not in non-teaching employees
Pretsch, J., Flunger, B., & Schmitt, M. (2012) · Social Psychology of Education · doi:10.1007/s11218-012-9180-8 · Cited by 148
Reiner, D. M., Curry, T. E., de Figueiredo, M. A., Herzog, H. J., Ansolabehere, S. D., Itaoka, K., Johnsson, F., & Odenberger, M. (2006) · Environmental Science & Technology · doi:10.1021/es052010b · Cited by 124
Janssen, S. M. J., Rubin, D. C., & St. Jacques, P. L. (2011) · Memory & Cognition · doi:10.3758/s13421-010-0003-x · Cited by 122
“Given the considerations associated with Internet testing (e.g., Gosling et al., 2004; Reips, 2000, 2002; Schmidt, 1997), several measures were undertaken to ensure quality control.”
BackgroundInfluentialCannabis use at a young age is associated with psychotic experiences
Schubart, C. D., van Gastel, W. A., Breetvelt, E., Beetz, S. L., Ophoff, R. A., Sommer, I. E., Kahn, R. S., & Boks, M. P. (2010) · Psychological Medicine · doi:10.1017/s003329171000187x · Cited by 128
“…of better web-based tools have improved the possibilities of acquiring information on psychiatric symptoms via the internet such that they are considered a valid additional method in epidemiological research (Meyerson & Tryon, 2003 ; Gosling et al. 2004 ; Balter et al. 2005 ; Ekman et al. 2006).”
MethodDifferences in responses to Web and paper surveys among school professionals
Yetter, G., & Capaccioli, K. A. (2010) · Behavior Research Methods · doi:10.3758/brm.42.1.266 · Cited by 123
Moors, A. C., Conley, T. D., Edelstein, R. S., & Chopik, W. J. (2014) · Journal of Social and Personal Relationships · doi:10.1177/0265407514529065 · Cited by 152
Flessner, C., Woods, D. W., Franklin, M., Cashin, S. E., Keuthen, N., & Trichotillomania Learning Center Scientific Advisory Board (2008) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-007-9073-x · Cited by 115
“…provide results consistent with traditional methods, and have been used recently to examine the impact of both TTM and chronic skin picking (Gosling et al. 2004; Flessner and Woods 2006; Woods et al. 2006) with research by Wetterneck et al. (2006) demonstrating that internet-derived…”
ResultInternet Cognitive Testing of Large Samples Needed in Genetic Research
Haworth, C., Harlaar, N., Kovas, Y., Davis, O., Oliver, B. R., Hayiou-Thomas, M., Frances, J., Busfield, P., McMillan, A., Dale, P. S., et al. (2007) · Twin Research and Human Genetics · doi:10.1375/twin.10.4.554 · Cited by 139
True happiness: The role of morality in the folk concept of happiness.
Phillips, J., Freitas, J. D., Mott, C., Gruber, J., & Knobe, J. (2017) · Journal of Experimental Psychology General · doi:10.1037/xge0000252 · Cited by 134
Factors Affecting Age at Initial Autism Spectrum Disorder Diagnosis in a National Survey
Rosenberg, R. E., Landa, R. J., Law, K., Stuart, E. A., & Law, P. A. (2011) · Autism Research and Treatment · doi:10.1155/2011/874619 · Cited by 145
“In terms of information bias presented by an internetbased registry, we have previously discussed [63] the growing research supporting the validity of web-collected data [64].”
BackgroundA pathway from neuroticism to depression: examining the role of emotion regulation
Yoon, K. L., Maltby, J., & Joormann, J. (2012) · Anxiety Stress & Coping · doi:10.1080/10615806.2012.734810 · Cited by 131
Gellis, L. A., & Lichstein, K. L. (2008) · Behavior Therapy · doi:10.1016/j.beth.2008.02.001 · Cited by 122
“Our data include a greater proportion of female participants who are less prone to excessive drinking (Grant et al., 2004), and thus, less likely to self-medicate with alcohol, become reliant on alcohol for sleep, or experience sleeping difficulties due to consistent drinking.”
Perceived similarity and complementarity as predictors of subjective person‐organization fit
Piasentin, K. A., & Chapman, D. S. (2006) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317906x115453 · Cited by 122
Fales, M. R., Frederick, D. A., Garcia, J. R., Gildersleeve, K. A., Haselton, M. G., & Fisher, H. E. (2015) · Personality and Individual Differences · doi:10.1016/j.paid.2015.08.041 · Cited by 131
Attitudes towards foreign accents among adult multilingual language users
Dewaele, J., & McCloskey, J. (2014) · Journal of Multilingual and Multicultural Development · doi:10.1080/01434632.2014.909445 · Cited by 121
Pro-anorexics and recovering anorexics differ in their linguistic Internet self-presentation
Lyons, E., Mehl, M. R., & Pennebaker, J. W. (2006) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2005.07.017 · Cited by 128
Single chords convey distinct emotional qualities to both naïve and expert listeners
Lahdelma, I., & Eerola, T. (2014) · Psychology of Music · doi:10.1177/0305735614552006 · Cited by 133
Gellert, P. R., Ziegelmann, J. P., Lippke, S., & Schwarzer, R. (2011) · Annals of Behavioral Medicine · doi:10.1007/s12160-011-9312-y · Cited by 120
“However, studies that address effects of data collection modes showed that an online questionnaire and an interview resulted in the same reports of frequencies of health behaviors [46].”
BackgroundPerceived social network support and well-being in same-sex versus mixed-sex romantic relationships
Blair, K. L., & Holmberg, D. (2008) · Journal of Social and Personal Relationships · doi:10.1177/0265407508096695 · Cited by 120
“or haphazardly, simply to gain points towards prize draws; however, the strong reliability indices and factor loadings do not suggest careless responding, and research suggests such careless responding is not a major issue in internet studies (Gosling et al., 2004).”
BackgroundJuggling multiple racial identities: Malleable racial identification and psychological well-being.
Sanchez, D. T., Shih, M. J., & García, J. A. (2009) · Cultural Diversity & Ethnic Minority Psychology · doi:10.1037/a0014373 · Cited by 132
Participant recruitment and data collection through Facebook: the role of personality factors
Rife, S. C., Cate, K. L., Kosiński, M., & Stillwell, D. J. (2014) · International Journal of Social Research Methodology · doi:10.1080/13645579.2014.957069 · Cited by 135
Wired but not WEIRD: The promise of the Internet in reaching more diverse samples
Gosling, S. D., Sandy, C. J., John, O. P., & Potter, J. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x10000300 · Cited by 119
Self-citationThe Influence of Paratext on Narrative Persuasion: Fact, Fiction, or Fake?
Appel, M., & Malečkar, B. (2012) · Human Communication Research · doi:10.1111/j.1468-2958.2012.01432.x · Cited by 118
“The software used in both studies, EFS-Survey, blocked potential repeat responders, one main obstacle in web-based studies (Gosling et al., 2004).”
MethodJennissen, S., Holl, J., Mai, H., Wolff, S., & Barnow, S. (2016) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2016.10.015 · Cited by 118
Baby-led weaning: what a systematic review of the literature adds on
on behalf of the Italian Society of Pediatrics, D’Auria, E., Bergamini, M., Staiano, A., Banderali, G., Pendezza, E., Penagini, F., Zuccotti, G., & Peroni, D. G. (2018) · The Italian Journal of Pediatrics/Italian journal of pediatrics · doi:10.1186/s13052-018-0487-8 · Cited by 119
“Concerning the method of recruitment, most studies recruited via internet sites, that can represent a selection bias [41].”
MethodThe Role of Online Support Communities
Idriss, S. Z., Kvedar, J. C., & Watson, A. J. (2009) · Archives of Dermatology · doi:10.1001/archdermatol.2008.529 · Cited by 119
Feitosa, J., Joseph, D. L., & Newman, D. A. (2014) · Personality and Individual Differences · doi:10.1016/j.paid.2014.11.017 · Cited by 121
Psychometric evaluation of the Financial Threat Scale (FTS) in the context of the great recession
Marjanovic, Z., Greenglass, E. R., Fıksenbaum, L., & Bell, C. M. (2013) · Journal of Economic Psychology · doi:10.1016/j.joep.2013.02.005 · Cited by 136
Berthold, A., & Ruch, W. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00876 · Cited by 123
House, A. S., Horn, E. V., Coppeans, C., & Stepleman, L. M. (2011) · Traumatology An International Journal · doi:10.1177/1534765610395621 · Cited by 120
The role of social identity and online social capital on psychosocial outcomes in MMO players
Kaye, L. K., Kowert, R., & Quinn, S. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.04.030 · Cited by 118
The BBC Internet Study: General Methodology
Reimers, S. (2007) · Archives of Sexual Behavior · doi:10.1007/s10508-006-9143-2 · Cited by 116
“This rate of non-heterosexuality is higher than that found in some research on college students (e.g., Ellis, Robb, & Burke, 2005 ), although similar to that found in some other studies (e.g., Bagley & Tremblay, 1998).”
ResultIllusions of causality at the heart of pseudoscience
Matute, H., Yarritu, I., & Vadillo, M. A. (2010) · British Journal of Psychology · doi:10.1348/000712610x532210 · Cited by 116
Personalities of Self-Identified “Dog People” and “Cat People”
Gosling, S. D., Sandy, C. J., & Potter, J. (2010) · Anthrozoös · doi:10.2752/175303710x12750451258850 · Cited by 117
“However, extensive empirical comparisons between Internet-based and traditional forms of data collection have shown that Internet samples are relatively diverse with respect to gender, socioeconomic status, geographic region, and age, that Internet-based findings generalize across presentation formats, are not adverse…”
BackgroundResultSelf-citationPadilla, Y. C., Crisp, C., & Rew, L. (2010) · Social Work · doi:10.1093/sw/55.3.265 · Cited by 117
Szymanski, D. M., & Henrichs-Beck, C. (2014) · Sex Roles · doi:10.1007/s11199-013-0329-5 · Cited by 116
“Gosling et al. (2004) reported that results from Internet studies are not adversely affected by repeat or non-serious responders and are consistent with findings obtained from traditional pen-andpaper methods.”
ResultUsing online vacancies and web surveys to analyse the labour market: a methodological inquiry
Kureková, L. M., Beblavý, M., & Thum-Thysen, A. (2015) · IZA Journal of Labor Economics · doi:10.1186/s40172-015-0034-4 · Cited by 116
“Several methodological issues persist, however, which are predominantly related to the quality, reliability and representativeness of such data as well as generalisability of findings (Gosling et al. 2004; Steinmetz et al. 2009; de Stefánik 2012).”
BackgroundTo Help My Supervisor: Identification, Moral Identity, and Unethical Pro-supervisor Behavior
Johnson, H. H., & Umphress, E. E. (2018) · Journal of Business Ethics · doi:10.1007/s10551-018-3836-z · Cited by 116
The Influence of Prior Relationship, Gender, and Fear on the Consequences of Stalking Victimization
Sheridan, L. P., & Lyndon, A. E. (2010) · Sex Roles · doi:10.1007/s11199-010-9889-9 · Cited by 116
“Support for on-line research is provided by Gosling et al. (2004). After noting scepticism concerning internet data collection methods, these authors conducted an empirical comparison of a web sample of 361,703 respondents with data collected Sex Roles”
MethodHammer, J. H., & Good, G. E. (2010) · Psychology of Men & Masculinity · doi:10.1037/a0019056 · Cited by 137
Duan, W., Guo, P., & Gan, P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0125707 · Cited by 134
“Gosling, Vazire [32] and King, O’Rourke [33] considered that web-based data collection method is reliable and helpful in obtaining sensitive information and inaccessible populations.”
BackgroundHowNutsAreTheDutch (HoeGekIsNL): A crowdsourcing study of mental symptoms and strengths
van der Krieke, L., Jeronimus, B. F., Blaauw, F. J., Wanders, R. B. K., Emerencia, A. C., Schenk, H., de Vos, S., Snippe, E., Wichers, M., Wigman, J. T. W., et al. (2015) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.1495 · Cited by 119
“Self-selection is not necessarily problematic, as previous crowdsourcing studies attracted more diverse participants than any other means of recruitment did (Gosling et al., 2004; Revelle et al., 2010; Skitka and Sargis, 2006).”
BackgroundRochlen, A. B., McKelley, R. A., Suizzo, M., & Scaringi, V. (2008) · Psychology of Men & Masculinity · doi:10.1037/1524-9220.9.1.17 · Cited by 115
Metadata
- Authors
- Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P.
- Affiliations
- The University of Texas at Austin (US)
- Stanford University (US)
- University of California, Berkeley (US)
- Venue
- American Psychologist
- Published
- 2004
- Volume
- 59
- Issue
- 2
- Pages
- 93-104
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W1992490637
- Cited by
- 2,932
- References
- 72
- Citations by year
- 2026: 40 · 2025: 64 · 2024: 72 · 2023: 85 · 2022: 123 · 2021: 135 · 2020: 157 · 2019: 163 · 2018: 148 · 2017: 170 · 2016: 181 · 2015: 192 · 2014: 218 · 2013: 184 · 2012: 189
- FWCI
- 261.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Keywords
- online data collection, paper-and-pencil questionnaires, sample representativeness, data quality, response format effects, generalizability, self-report questionnaire
- MeSH terms
- Adult, Aged, Attitude, Female, Humans, Male, Middle Aged, Psychology, Surveys and Questionnaires, Evidence-Based Medicine, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
