The DOI matches its Crossref record; 68 of the 72 references it cites were found in a registry or an index.
Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires.
Abstract
The rapid growth of the Internet provides a wealth of new research opportunities for psychologists. Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods. Six preconceptions about Internet samples and data quality are evaluated by comparing a new large Internet sample (N = 361,703) with a set of 510 published traditional samples. Internet samples are shown to be relatively diverse with respect to gender, socioeconomic status, geographic region, and age. Moreover, Internet findings generalize across presentation formats, are not adversely affected by nonserious or repeat responders, and are consistent with findings from traditional methods. It is concluded that Internet methods can contribute to many areas of psychology.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The proportion of females (62%) to males in this study was more representative than in traditional survey methods, where women often comprise 71% to 77% of the participants [39]”
From Effects of Mock Facebook Workday Comments on Public Perception of Professional Credibility: A Field Study in Canada (2019) · cites this paper as [39]
In the citing paper
“Self-presentation is an unlikely confound in Study 1 because the motivation to self-present is absent when participants feel anonymous (Paulhus, 1984(Paulhus, , 1991) ) as they do in anonymous online studies such as the present one, where they don't provide identifying information (Gosling et al., 2004).”
From Cultural norm fulfillment, interpersonal belonging, or getting ahead? A large-scale cross-cultural test of three perspectives on the function of self-esteem. (2015) · cites this paper as Gosling et al., 2004
In the citing paper
“As described in the Appendix, the reliability and validity of internet data collection has become increasingly clear in recent years.”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“The validity of internet testing has been well supported in recent reviews (Gosling et al., 2004), with excellent correspondence between results obtained with internet samples are results obtained in the laboratory (e.g., Birnbaum, 1999;Krantz & Dalal, 2000;McGraw, Tew, & Williams, 2000;Reips, 2002).”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“Furthermore, previous research has suggested populations for online studies and Facebook are quite representative [23], [24].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [23]
In the citing paper
“Still, the sample sizes and availability of demographic information afforded by social media bring us closer to a more ideal representative sample [99].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [99]
Citations
Cites
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
(1999) · Cited by 7,995
Self-citationInternet paradox: A social technology that reduces social involvement and psychological well-being?
Kraut, R., Patterson, M., Lundmark, V., Kiesler, S., Mukophadhyay, T., & Scherlis, W. (1998) · American Psychologist · doi:10.1037/0003-066x.53.9.1017 · Cited by 4,793
Handbook of Personality : Theory and Research
Pervin, L. A. (1992) · Cited by 4,543
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Mail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070237 · Cited by 3,463
Gender differences in personality traits across cultures: Robust and surprising findings.
Costa, P. T., Terracciano, A., & McCrae, R. R. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.2.322 · Cited by 2,986
Kraut, R. E., Kiesler, S. B., Boneva, B. S., Cummings, J. N., Helgeson, V. S., & Crawford, A. M. (2002) · Journal of Social Issues · doi:10.1111/1540-4560.00248 · Cited by 2,367
Gender differences in personality: A meta-analysis.
Feingold, A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.3.429 · Cited by 2,240
Handbook of Personality Theory and Research.
Schwartz, M. L., Borgatta, E. F., & Lambert, W. W. (1970) · American Sociological Review · doi:10.2307/2093310 · Cited by 2,182
Research works printed but not linked: 7
- Azar, 2000, A web of research: They're fun, they're fast, and they save money, but do Web experiments yield quality results?, Monitor on Psychology, 31, 42
- 10.1037/0022-3514.75.3.729 · DOI · Paper page
- Dillman. 1998 · DOI
- Locke, 1995, Method of psychological assessment, self-disclosure, and experiential differences: A study of computer, questionnaire, and interview assessment formats., Journal of Social Behavior and Personality, 10, 255
- 2000, Digest of education statistics 2000.
- Skitka, (in press). Social psychological research and me Internet: The promise and the perils of a new methodological frontier.
- 2000, Population, 1
Cited by
Sorted by citations
Items 501–600 of 1,012
Social Psychological Methods Outside the Laboratory
Reis, H. T., & Gosling, S. D. (2010) · Wiley eBooks · doi:10.1002/9780470561119.socpsy001003 · Cited by 91
Self-citationDo Attempts to Improve Respondent Attention Increase Social Desirability Bias?
Clifford, S., & Jerit, J. (2015) · Public Opinion Quarterly · doi:10.1093/poq/nfv027 · Cited by 91
“The fourth treatment (“Feedback”) appeals to respondents’ desire for self-insight by providing feedback on their performance at the end of the questionnaire (Gosling et al. 2004).”
BackgroundThe development of personality across the lifespan
Donnellan, M. B., & Robins, R. W. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9780511596544.015 · Cited by 89
Visual Working Memory Capacity and Proactive Interference
Hartshorne, J. K. (2008) · PLoS ONE · doi:10.1371/journal.pone.0002716 · Cited by 93
“A couple studies have found that Webbased experimental results agree well with laboratory-based results [38,39].”
ResultSzymanski, D. M., & Ikizler, A. S. (2012) · Psychology of Men & Masculinity · doi:10.1037/a0027787 · Cited by 102
Ingersoll, B., Meyer, K., & Becker, M. W. (2011) · Autism Research · doi:10.1002/aur.170 · Cited by 88
Rogers, M. L., & Joiner, T. E. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2017.12.017 · Cited by 86
Menstrual Cycle and Facial Preferences Reconsidered
Harris, C. R. (2010) · Sex Roles · doi:10.1007/s11199-010-9772-8 · Cited by 89
“validity of internet testing also has been well supported in recent research (Gosling et al. 2004; Birnbaum 1999; Krantz and Dalal 2000; McGraw et al. 2000).”
ResultThe Milwaukee Inventory for Styles of Trichotillomania-Child Version (MIST-C)
Flessner, C. A., Woods, D. W., Franklin, M. E., Keuthen, N. J., Piacentini, J. C., Cashin, S. E., & Moore, P. S. (2007) · Behavior Modification · doi:10.1177/0145445507302521 · Cited by 88
Psychometric Properties and Validation of a German High Sensitive Person Scale (HSPS-G)
Konrad, S., & Herzberg, P. Y. (2017) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000411 · Cited by 108
Smerecnik, C. M. R., Schaalma, H. P., Kok, G., Meijer, S., & Poelman, J. (2010) · BMC Public Health · doi:10.1186/1471-2458-10-533 · Cited by 103
“In addition, Internet samples might be more diverse than samples in usual offline research, such as interviews and surveys [ 39 ,40].”
BackgroundResultHiggins, J. A., Hoffman, S., Graham, C. A., & Sanders, S. A. (2008) · Sexual Health · doi:10.1071/sh08021 · Cited by 88
Gender differences in weight bias internalisation and eating pathology in overweight individuals
Boswell, R. G., & White, M. A. (2015) · Advances in Eating Disorders · doi:10.1080/21662630.2015.1047881 · Cited by 88
Kennison, S., & Chan-Tin, E. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.546546 · Cited by 73
“…has grown due to studies that have compared data collected via the Internet and in face-to-face settings in which questionnaires were completed using pencil/paper methods and have concluded that the two data collection methods yield similar results (Gosling et al., 2004; Weigold et al., 2013).”
BackgroundResultObschonka, M., Tavassoli, S., Rentfrow, P. J., Potter, J., & Gosling, S. D. (2023) · Research Policy · doi:10.1016/j.respol.2023.104849 · Cited by 110
Self-citationUnderstanding General Distrust of Corporations
Adams, J. E., Highhouse, S., & Zickar, M. J. (2010) · Corporate Reputation Review · doi:10.1057/crr.2010.6 · Cited by 85
Single-Attribute Implicit Association Tests (SA-IAT) for the Assessment of Unipolar Constructs
Penke, L., Eichstaedt, J., & Asendorpf, J. B. (2006) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169.53.4.283 · Cited by 87
“This IAT was constructed closely following the procedure outlined by Greenwald et al. (1998). The target-concept discrimination was partner–stranger, and attributes were sex–conversation.”
MethodReducing aversion to side effects in preventive medical treatment decisions.
Waters, E. A., Weinstein, N. D., Colditz, G. A., & Emmons, K. M. (2007) · Journal of Experimental Psychology Applied · doi:10.1037/1076-898x.13.1.11 · Cited by 87
Gebauer, J. E., Sedikides, C., Wagner, J., Bleidorn, W., Rentfrow, P. J., Potter, J., & Gosling, S. D. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000052 · Cited by 84
Self-citationPeluso, D. L., Carleton, R. N., & Asmundson, G. J. G. (2011) · Canadian Journal of Behavioural Science / Revue canadienne des sciences du comportement · doi:10.1037/a0022624 · Cited by 81
Experiential avoidance as a mediator of relationships between cognitions and hair-pulling severity
Norberg, M. M., Wetterneck, C. T., Woods, D. W., & Conelea, C. A. (2007) · Behavior Modification · doi:10.1177/0145445506297343 · Cited by 86
“Collecting data through the Web has been criticized because Internet participants are regarded as unmotivated to take studies seriously and respond meaningfully (Gosling et al., 2004).”
BackgroundSalleh, N., Mendes, E., & Grundy, J. (2012) · Empirical Software Engineering · doi:10.1007/s10664-012-9238-4 · Cited by 92
“The selection of IPIP-NEO as the personality test used in this research was due to two major reasons: i) It was developed based on the FFM framework, and ii) It provides a Web interface for collecting and scoring calculation of personality responses, which is more efficient compared with paper-based (Buchanan et al. 2…”
MethodCullen, K. L., Dickey, J. P., Bent, L. R., Thomason, J. J., & Moens, N. M. M. (2013) · Journal of the American Veterinary Medical Association · doi:10.2460/javma.243.7.1010 · Cited by 86
Temperament and brain networks of attention
Posner, M. I., & Rothbart, M. K. (2018) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2017.0254 · Cited by 95
Can we trace back hotel online reviews’ characteristics using gamification features?
Moro, S., Ramos, P., Esmerado, J., & Jalali, S. M. J. (2018) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2018.09.015 · Cited by 86
Gander, F., Proyer, R. T., Ruch, W., & Wyss, T. (2012) · International Archives of Occupational and Environmental Health · doi:10.1007/s00420-012-0736-x · Cited by 86
Mustanski, B. S. (2007) · AIDS and Behavior · doi:10.1007/s10461-007-9335-3 · Cited by 86
Forsyth, J., & Carter, R. T. (2012) · Cultural Diversity & Ethnic Minority Psychology · doi:10.1037/a0027660 · Cited by 86
Brewster, M. E., Velez, B. L., Esposito, J., Wong, S., Geiger, E., & Keum, B. T. (2013) · Journal of Counseling Psychology · doi:10.1037/a0034748 · Cited by 86
Commitment in friends with benefits relationships: Implications for relational and safe‐sex outcomes
VanderDrift, L. E., Lehmiller, J. J., & Kelly, J. R. (2010) · Personal Relationships · doi:10.1111/j.1475-6811.2010.01324.x · Cited by 85
Using virtual communities in tourism research
Illum, S. F., Ivanov, S. H., & Liang, Y. (2009) · Tourism Management · doi:10.1016/j.tourman.2009.03.012 · Cited by 87
Weststrate, N. M., Ferrari, M., & Ardelt, M. (2016) · Personality and Social Psychology Bulletin · doi:10.1177/0146167216638075 · Cited by 85
Hammer, J. H., & Toland, M. D. (2016) · Stigma and Health · doi:10.1037/sah0000049 · Cited by 91
Marquet, R. L., Bartelds, A. I. M., van Noort, S. P., Koppeschaar, C. E., Paget, J., Schellevis, F., & van der Zee, J. (2006) · BMC Public Health · doi:10.1186/1471-2458-6-242 · Cited by 85
Carleton, R. N., Weeks, J. W., Howell, A. N., Asmundson, G. J. G., Antony, M. M., & McCabe, R. E. (2011) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2011.10.006 · Cited by 98
McCambridge, J., Mitcheson, L., WINSTOCK, A. R., & Hunt, N. (2005) · Addiction · doi:10.1111/j.1360-0443.2005.001127.x · Cited by 85
The General Factor of Personality and its relation to Self-Esteem in 628,640 Internet respondents
Erdle, S., Paul Irwing, B., Rushton, J. P., & Park, J. (2009) · Personality and Individual Differences · doi:10.1016/j.paid.2009.09.004 · Cited by 85
“Participants were 628,640 people who completed the self-report questionnaires using an interactive website on the Internet (Erdle et al., 2009; Gosling et al., 2004).”
MethodSexual Regret: Evidence for Evolved Sex Differences
Galperin, A., Haselton, M. G., Frederick, D. A., Poore, J., von Hippel, W., Buss, D. M., & Gonzaga, G. C. (2013) · Archives of Sexual Behavior · doi:10.1007/s10508-012-0019-3 · Cited by 101
Time reordered: Causal perception guides the interpretation of temporal order
Bechlivanidis, C., & Lagnado, D. A. (2015) · Cognition · doi:10.1016/j.cognition.2015.09.001 · Cited by 87
The Relationship Between Dimensions of Love, Personality, and Relationship Length
Ahmetoglu, G., Swami, V., & Chamorro‐Premuzic, T. (2009) · Archives of Sexual Behavior · doi:10.1007/s10508-009-9515-5 · Cited by 84
“Two pilot studies (Ns = 309 and 257) were carried out to test the convergent validity of the B5S in regards to another, well-established, 10-item inventory (TIPI; Gosling, Rentfrow, & Swann, 2003 ) and the 50-item IPIP Big Five, respectively (using two different, additional, samples).”
MethodInitial report of the osteogenesis imperfecta adult natural history initiative
Tosi, L. L., Oetgen, M. E., Floor, M., Huber, M. B., Kennelly, A. M., McCarter, R., Rak, M., Simmonds, B. J., Simpson, M. D., Tucker, C. A., et al. (2015) · Orphanet Journal of Rare Diseases · doi:10.1186/s13023-015-0362-2 · Cited by 87
“Although our study relied heavily on an Internet rather than a paper format, several studies have quantified the reliability of Internet research studies by comparing them to identical studies conducted with non-internet formats and have found them to be equally as reliable [48, 49].”
Falco, A., Girardi, D., Corso, L. D., Yıldırım, M., & Converso, D. (2021) · PLoS ONE · doi:10.1371/journal.pone.0257197 · Cited by 96
Moral Concerns and Policy Attitudes: Investigating the Influence of Elite Rhetoric
Clifford, S., Jerit, J., Rainey, C., & Motyl, M. S. (2015) · Political Communication · doi:10.1080/10584609.2014.944320 · Cited by 88
“Volunteerbased internet samples, such as this one, have become increasingly common in social science research and can provide high-quality survey data (Gosling et al. 2004).”
BackgroundA colonial mentality model of depression for Filipino Americans.
David, E. J. R. (2008) · Cultural Diversity & Ethnic Minority Psychology · doi:10.1037/1099-9809.14.2.118 · Cited by 84
Sexual Interest in Children Among an Online Sample of Men and Women
Wurtele, S. K., Simons, D. A., & Moreno, T. (2013) · Sexual Abuse · doi:10.1177/1079063213503688 · Cited by 84
Haase, C. M., Heckhausen, J., & Silbereisen, R. Κ. (2011) · Developmental Psychology · doi:10.1037/a0026641 · Cited by 98
Rao, M. A., & Donaldson, S. I. (2015) · Canadian Psychology/Psychologie canadienne · doi:10.1037/cap0000036 · Cited by 84
“It is unclear at this time whether this trend is consistent in other areas (for reviews, see Cassese, Huddy, Hartman, Mason, & Weber, 2013; Gosling et al., 2004).”
BackgroundResultFamily Disorganization, Sleep Hygiene, and Adolescent Sleep Disturbance
Billows, M., Gradisar, M., Dohnt, H., Johnston, A., McCappin, S., & Hudson, J. L. (2009) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374410903103635 · Cited by 86
“Online questionnaires have been shown to be comparable to traditional, pen-and-paper questionnaires (Kraut et al, 2004 ), particularly when researchers are present (Gosling, Vazire, Srivastava, & John, 2004 ).”
MethodLehmiller, J. J., VanderDrift, L. E., & Kelly, J. R. (2012) · The Journal of Sex Research · doi:10.1080/00224499.2012.719167 · Cited by 83
“In some respects, this is not surprising, given that participants in both traditional and Internet-based studies aremore likely to consist ofwomen (Gosling et al., 2004) and that many recent studies of FWBRs in particular have reported a similar gender disparity (Lehmiller et al., 2011; Mongeau et…”
ResultMathematical Ability of 10-Year-Old Boys and Girls
Kovas, Y. V., Haworth, C. M. A., Petrill, S. A., & Plomin, R. J. (2007) · Journal of Learning Disabilities · doi:10.1177/00222194070400060601 · Cited by 83
Dickson, J. M., Moberly, N. J., Marshall, Y., & Reilly, J. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.715 · Cited by 82
The roles of anxiety and depression in connecting tic severity and functional impairment.
Lewin, A., Storch, E., Conelea, C. A., Woods, D. W., Zinner, S., Budman, C., Scahill, L., Compton, S., Walkup, J., & Murphy, T. (2011) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2010.08.016 · Cited by 65
Kendler, K. S., Myers, J. R., & Reichborn‐Kjennerud, T. (2010) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2010.01653.x · Cited by 82
“Consistent with other internet samples (19), these queries suggested low levels of faked or duplicate data.”
BackgroundA positive effect of flowers rather than eye images in a large-scale, cross-cultural dictator game
Raihani, N., & Bshary, R. (2012) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2012.0758 · Cited by 89
Face emotion recognition is related to individual differences in psychosis-proneness
Germine, L. T., & Hooker, C. I. (2010) · Psychological Medicine · doi:10.1017/s0033291710001571 · Cited by 81
“…demonstrates that results from populations tested over the internet are reliable and empirically valid (McGraw et al. 2000 ; Birnbaum, 2004; Gosling et al. 2004 ; Kraut et al. 2004 ; Haworth et al. 2007 ; Wilmer et al. 2010) and of broad theoretical interest (Owen et al. 2010 ; Wilmer et…”
BackgroundPradhan, M., Chettri, A., & Maheshwari, S. (2022) · Death Studies · doi:10.1080/07481187.2020.1833384 · Cited by 81
“Following the suggestion that data collected through the internet is reliable and valid (Gosling et al., 2004), the questionnaire was prepared using Google forms and circulated via WhatsApp.”
MethodAnalyzing Big Data in Psychology: A Split/Analyze/Meta-Analyze Approach
Cheung, M. W. ‐., & Jak, S. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00738 · Cited by 83
“In a study comparing the characteristics of an Internet sample used for an online questionnaire to those of traditional samples, Gosling et al. (2004) found that Internet samples are not that different from other samples used in psychological research.”
Inquiry into the correlation between burnout and depression.
Schonfeld, I. S., Verkuilen, J., & Bianchi, R. (2019) · Journal of Occupational Health Psychology · doi:10.1037/ocp0000151 · Cited by 86
Reisenzein, R., & Weber, H. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9780511596544.007 · Cited by 84
An Internet study of prospective memory across adulthood.
Logie, R. H., & Maylor, E. A. (2009) · Psychology and Aging · doi:10.1037/a0015479 · Cited by 81
Is health anxiety a significant problem for individuals with multiple sclerosis?
Kehler, M. D., & Hadjistavropoulos, H. D. (2008) · Journal of Behavioral Medicine · doi:10.1007/s10865-008-9186-z · Cited by 77
“Based on their review of several cross-method studies, Gosling et al. (2004) found similar effects across Internet and traditional data sets, thus concluding that there is evidence that the two methodologies are comparable.”
BackgroundMapping corporate social responsibility strategies in the construction and engineering industry
Loosemore, M., & Lim, B. T. (2017) · Construction Management and Economics · doi:10.1080/01446193.2017.1326616 · Cited by 81
Rusticus, S. A., Hubley, A. M., & Zumbo, B. D. (2008) · Assessment · doi:10.1177/1073191107306805 · Cited by 80
Response option configuration of online administered Likert scales
Maeda, H. (2014) · International Journal of Social Research Methodology · doi:10.1080/13645579.2014.885159 · Cited by 79
Grey, J. A., Konstan, J. A., Iantaffi, A., Wilkerson, J. M., Galos, D. L., & Rosser, B. R. S. (2015) · AIDS and Behavior · doi:10.1007/s10461-015-1033-y · Cited by 80
“tifying multiple submissions from the same person, while cross-validation is the process of confirming that participants meet the study’s eligibility criteria [10–13].”
BackgroundCaswell, N., & Manning, J. T. (2007) · Archives of Sexual Behavior · doi:10.1007/s10508-007-9202-3 · Cited by 80
The colonial context of Filipino American immigrants’ psychological experiences.
David, E. J. R., & Nadal, K. L. Y. (2013) · Cultural Diversity & Ethnic Minority Psychology · doi:10.1037/a0032903 · Cited by 80
“…participants, are consistent with findings from studies using traditional methods, and are not adversely affected by uncontrolled administration settings (Gosling et al., 2004), future studies that are not conducted over the Internet may test the replicability of the presented results.”
ResultThe Relations Between Parental Socioeconomic Status, Personality, and Life Outcomes
Ayoub, M., Gosling, S. D., Potter, J., Shanahan, M. T., & Roberts, B. W. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617707018 · Cited by 87
“Analyses based on this data set have shown that, compared to conventional samples, Internet samples are more diverse with respect to SES, geographic region, and age (Gosling et al., 2004), and Internet findings are generally consistent with findings from traditional methods.”
ResultSelf-citationCROCUFID: A Cross-Cultural Food Image Database for Research on Food Elicited Affective Responses
Toet, A., Kaneko, D., de Kruijf, I., Ushiama, S., van Schaik, M. G., Brouwer, A.-M., Kallen, V., & van Erp, J. B. F. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00058 · Cited by 83
Physical topography is associated with human personality
Götz, F. M., Stieger, S., Gosling, S. D., Potter, J., & Rentfrow, P. J. (2020) · Nature Human Behaviour · doi:10.1038/s41562-020-0930-x · Cited by 90
Self-citationMoreira, H., Martins, T., Gouveia, M. J., & Canavarro, M. C. (2014) · Journal of Personality Assessment · doi:10.1080/00223891.2014.950377 · Cited by 122
Stimulus Characteristics Affect Humor Processing in Individuals with Asperger Syndrome
Samson, A. C., & Hegenloh, M. (2009) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-009-0885-2 · Cited by 79
Shimazu, A., Schaufeli, W. B., Kubota, K., Watanabe, K., & Kawakami, N. (2018) · PLoS ONE · doi:10.1371/journal.pone.0208684 · Cited by 97
Axelsson, E., Lindsäter, E., Ljótsson, B., Andersson, E., & Hedman-Lagerlöf, E. (2017) · JMIR Mental Health · doi:10.2196/mental.7497 · Cited by 79
“Although it has often been found that well-established scales do well regardless of administration format, online adaptions of validated scales should preferably undergo separate validation [9,10].”
Multiple Oppressions and the Mental Health of Sexual Minority Latina/o Individuals
Velez, B. L., Moradi, B., & DeBlaere, C. (2014) · The Counseling Psychologist · doi:10.1177/0011000014542836 · Cited by 77
Captured by True Crime: Why Are Women Drawn to Tales of Rape, Murder, and Serial Killers?
Vicary, A. M., & Fraley, R. C. (2010) · Social Psychological and Personality Science · doi:10.1177/1948550609355486 · Cited by 78
“Research has demonstrated that studies conducted online are of ‘‘at least as good quality as traditional paper-pencil methods’’ (Gosling, Vazire, Srivastava, & John, 2004, p. 102).”
Privacy Attitudes of Mechanical Turk Workers and the U.S. Public
Kang, R., Brown, S. L., Dabbish, L., & Kiesler, S. B. (2014) · Symposium On Usable Privacy and Security · Cited by 78
Owen‐Smith, A. A., Bent, S., Lynch, F. L., Coleman, K. J., Yau, V. M., Pearson, K. A., Massolo, M. L., Quinn, V. P., & Croen, L. (2015) · Research in Autism · doi:10.1016/j.rasd.2015.05.002 · Cited by 79
Counsellor behaviours that predict therapeutic alliance: From the client's perspective
Duff, C. T., & Bedi, R. P. (2010) · Counselling Psychology Quarterly · doi:10.1080/09515071003688165 · Cited by 102
“Internet-based studies in psychology have been shown to be an efficient, valid, and reliable alternative to laboratory-based studies, yielding results that are consistent with traditional data collection methods (eg, Buchanan & Smith, 1999 ; Gosling, Vazire, Srivastava, & John, 2004 ; Riva, Teruzzi, & Anolli, 2003 ).”
ResultWhat Do You Think of My Ink? Assessing the Effects of Body Art on Employment Chances
Timming, A. R., Nickson, D., Re, D. E., & Perrett, D. I. (2015) · Human Resource Management · doi:10.1002/hrm.21770 · Cited by 78
Men’s Help Seeking for Depression: The Efficacy of a Male-Sensitive Brochure About Counseling
Hammer, J. H., & Vogel, D. L. (2010) · The Counseling Psychologist · doi:10.1177/0011000009351937 · Cited by 119
“…larger audiences and have been shown to produce results on measures that are similar or better in terms of psychometric properties (Birnbaum, 2004; Gosling et al., 2004), there may be some biases in the sample as not all men have access to a computer, belong to the listservs, or visit the…”
BackgroundPerceived marginalization and its association with physical and psychological health
Lehmiller, J. J. (2011) · Journal of Social and Personal Relationships · doi:10.1177/0265407511431187 · Cited by 77
“In carrying out this study, best practices in online research were followed with respect to informed consent, debriefing, confidentiality, and checks for duplicate or fraudulent responding (Barchard & Williams, 2008; Gosling et al., 2004).”
MethodFrederick, D. A., Daniels, E. A., Bates, M. E., & Tylka, T. L. (2017) · Body Image · doi:10.1016/j.bodyim.2017.10.006 · Cited by 87
International Survey of Violence Against EMS Personnel: Physical Violence Report
Maguire, B. J., Browne, M., O’Neill, B. J., Dealy, M. T., Clare, D., & O'Meara, P. F. (2018) · Prehospital and Disaster Medicine · doi:10.1017/s1049023x18000870 · Cited by 77
“Limitations/Future Investigations Limitations Although open web-based surveys offer less control than face-toface surveys, research has shown that, in general, findings tend to be consistent with more traditional survey methods.(46) There were approximately 800,000 EMS personnel in the US in 2011,(35) 16,000 ambulance…”
ResultMartínez‐Martí, M. L., Theirs, C., Pascual, D. C., & Corradi, G. B. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.584567 · Cited by 80
Lifestyle factors and other health measures in a Canadian university community
Pérusse-Lachance, É., Tremblay, A., & Drapeau, V. (2010) · Applied Physiology Nutrition and Metabolism · doi:10.1139/h10-035 · Cited by 77
“Also previously demonstrated is that Web questionnaire results are comparable with traditional questionnaires results in terms of sample diversity, and that they do not appear to contain false data or repeat responders (Gosling et al. 2004).”
ResultA validation of well-being and happiness surveys for administration via the Internet
Howell, R. T., Rodzon, K. S., Kurai, M., & Sanchez, A. H. (2010) · Behavior Research Methods · doi:10.3758/brm.42.3.775 · Cited by 78
Hyland, M. E., Whalley, B., & Geraghty, A. W. A. (2007) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2006.10.006 · Cited by 81
Andreassen, C. S., Torsheim, T., & Pallesen, S. (2014) · Comprehensive Psychology · doi:10.2466/01.21.cp.3.18 · Cited by 68
Moradi, B. (2009) · Military Psychology · doi:10.1080/08995600903206453 · Cited by 77
“In a comparison of Internet and traditional data collection methods, Gosling, Vazire, Srivastava, and John (2004) concluded that Internet methods are as good as traditional methods and have a number of important advantages as well.”
BackgroundBigras, N., Daspe, M., Godbout, N., Briere, J., & Sabourin, S. (2016) · Journal of Sex & Marital Therapy · doi:10.1080/0092623x.2016.1176609 · Cited by 96
The Danish health and morbidity surveys: study design and participant characteristics
Jensen, H. A. R., Ekholm, O., Davidsen, M., & Christensen, A. I. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0733-9 · Cited by 77
The Language of Weblogs: A study of genre and individual differences
Nowson, S. (2006) · ERA · Cited by 76
Long-term effects of an internet-based treatment for posttraumatic stress
Knaevelsrud, C., & Maercker, A. (2010) · Cognitive Behaviour Therapy · doi:10.1080/16506070902999935 · Cited by 76
Dogmatism and mental health: A comparison of the religious and secular.
Moore, J. T., & Leach, M. M. (2015) · Psychology of Religion and Spirituality · doi:10.1037/rel0000027 · Cited by 78
Gray, P. B., & Frederick, D. A. (2012) · Evolutionary Psychology · doi:10.1177/147470491201000319 · Cited by 80
Torfs, K., Vancleef, K., Lafosse, C., Wagemans, J. P., & de‐Wit, L. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0382-6 · Cited by 71
The role of self-blame and responsibility in adjustment to inflammatory bowel disease.
Voth, J., & Sirois, F. M. (2009) · Rehabilitation Psychology · doi:10.1037/a0014739 · Cited by 77
Erens, B., Burkill, S. M., Couper, M. P., Conrad, F. G., Clifton, S., Tanton, C., Phelps, A., Datta, J., Mercer, C. H., Sonnenberg, P., et al. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3382 · Cited by 76
“…is likely to continue to increase in Britain and elsewhere because they purportedly allow efficient, relatively cheap, and quick data collection [14,17-20], advantages which will increasingly appeal to academic and government researchers faced with rising costs for traditional face-to-face and…”
Lewandowsky, S., Cook, J., Oberauer, K., Brophy, S., Lloyd, E. A., & Marriott, M. (2015) · Journal of Social and Political Psychology · doi:10.5964/jspp.v3i1.443 · Cited by 111
Metadata
- Authors
- Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P.
- Affiliations
- The University of Texas at Austin (US)
- Stanford University (US)
- University of California, Berkeley (US)
- Venue
- American Psychologist
- Published
- 2004
- Volume
- 59
- Issue
- 2
- Pages
- 93-104
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W1992490637
- Cited by
- 2,932
- References
- 72
- Citations by year
- 2026: 40 · 2025: 64 · 2024: 72 · 2023: 85 · 2022: 123 · 2021: 135 · 2020: 157 · 2019: 163 · 2018: 148 · 2017: 170 · 2016: 181 · 2015: 192 · 2014: 218 · 2013: 184 · 2012: 189
- FWCI
- 261.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Keywords
- online data collection, paper-and-pencil questionnaires, sample representativeness, data quality, response format effects, generalizability, self-report questionnaire
- MeSH terms
- Adult, Aged, Attitude, Female, Humans, Male, Middle Aged, Psychology, Surveys and Questionnaires, Evidence-Based Medicine, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
