The DOI matches its Crossref record; 68 of the 72 references it cites were found in a registry or an index.
Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires.
Abstract
The rapid growth of the Internet provides a wealth of new research opportunities for psychologists. Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods. Six preconceptions about Internet samples and data quality are evaluated by comparing a new large Internet sample (N = 361,703) with a set of 510 published traditional samples. Internet samples are shown to be relatively diverse with respect to gender, socioeconomic status, geographic region, and age. Moreover, Internet findings generalize across presentation formats, are not adversely affected by nonserious or repeat responders, and are consistent with findings from traditional methods. It is concluded that Internet methods can contribute to many areas of psychology.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The proportion of females (62%) to males in this study was more representative than in traditional survey methods, where women often comprise 71% to 77% of the participants [39]”
From Effects of Mock Facebook Workday Comments on Public Perception of Professional Credibility: A Field Study in Canada (2019) · cites this paper as [39]
In the citing paper
“Self-presentation is an unlikely confound in Study 1 because the motivation to self-present is absent when participants feel anonymous (Paulhus, 1984(Paulhus, , 1991) ) as they do in anonymous online studies such as the present one, where they don't provide identifying information (Gosling et al., 2004).”
From Cultural norm fulfillment, interpersonal belonging, or getting ahead? A large-scale cross-cultural test of three perspectives on the function of self-esteem. (2015) · cites this paper as Gosling et al., 2004
In the citing paper
“As described in the Appendix, the reliability and validity of internet data collection has become increasingly clear in recent years.”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“The validity of internet testing has been well supported in recent reviews (Gosling et al., 2004), with excellent correspondence between results obtained with internet samples are results obtained in the laboratory (e.g., Birnbaum, 1999;Krantz & Dalal, 2000;McGraw, Tew, & Williams, 2000;Reips, 2002).”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“Furthermore, previous research has suggested populations for online studies and Facebook are quite representative [23], [24].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [23]
In the citing paper
“Still, the sample sizes and availability of demographic information afforded by social media bring us closer to a more ideal representative sample [99].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [99]
Citations
Cites
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
(1999) · Cited by 7,995
Self-citationInternet paradox: A social technology that reduces social involvement and psychological well-being?
Kraut, R., Patterson, M., Lundmark, V., Kiesler, S., Mukophadhyay, T., & Scherlis, W. (1998) · American Psychologist · doi:10.1037/0003-066x.53.9.1017 · Cited by 4,793
Handbook of Personality : Theory and Research
Pervin, L. A. (1992) · Cited by 4,543
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Mail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070237 · Cited by 3,463
Gender differences in personality traits across cultures: Robust and surprising findings.
Costa, P. T., Terracciano, A., & McCrae, R. R. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.2.322 · Cited by 2,986
Kraut, R. E., Kiesler, S. B., Boneva, B. S., Cummings, J. N., Helgeson, V. S., & Crawford, A. M. (2002) · Journal of Social Issues · doi:10.1111/1540-4560.00248 · Cited by 2,367
Gender differences in personality: A meta-analysis.
Feingold, A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.3.429 · Cited by 2,240
Handbook of Personality Theory and Research.
Schwartz, M. L., Borgatta, E. F., & Lambert, W. W. (1970) · American Sociological Review · doi:10.2307/2093310 · Cited by 2,182
Research works printed but not linked: 7
- Azar, 2000, A web of research: They're fun, they're fast, and they save money, but do Web experiments yield quality results?, Monitor on Psychology, 31, 42
- 10.1037/0022-3514.75.3.729 · DOI · Paper page
- Dillman. 1998 · DOI
- Locke, 1995, Method of psychological assessment, self-disclosure, and experiential differences: A study of computer, questionnaire, and interview assessment formats., Journal of Social Behavior and Personality, 10, 255
- 2000, Digest of education statistics 2000.
- Skitka, (in press). Social psychological research and me Internet: The promise and the perils of a new methodological frontier.
- 2000, Population, 1
Cited by
Sorted by citations
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
“To examine how MTurk samples compare with the diversity of standard Internet samples, we compared the demographics of 3,006 MTurk participants with those in a large Internet sample (Gosling et al., 2004).”
Self-citationPositive Psychology Progress: Empirical Validation of Interventions.
Seligman, M. E. P., Steen, T. A., Park, N., & Peterson, C. (2005) · American Psychologist · doi:10.1037/0003-066x.60.5.410 · Cited by 5,947
Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
Berinsky, A. J., Huber, G. A., & Lenz, G. S. (2012) · Political Analysis · doi:10.1093/pan/mpr057 · Cited by 4,008
“Based on a comprehensive analysis, for example, Gosling et al. (2004) conclude that Internet samples tend to be diverse, are not adversely affected by nonserious or habitual responders, and produce findings consistent with traditional methods.”
ResultRunning experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767
“More importantly, as we demonstrate in Section 4, non-response error seems to be less of a concern in Mechanical Turk samples than in Internet convenience samples recruited through other means.”
BackgroundResultInfluentialDevelopment and validation of the short grit scale (grit-s)
Duckworth, A. L., & Quinn, P. D. (2009) · Journal of Personality Assessment · doi:10.1080/00223890802634290 · Cited by 3,376
“Gosling, Vazire, Srivastava, and John (2004) reviewed evidence that questionnaires completed on the Internet demonstrate psychometric properties that are very similar to those of paper-and-pencil measures.”
The international personality item pool and the future of public-domain personality measures
Goldberg, L. R., Johnson, J. A., Eber, H. W., Hogan, R., Ashton, M. C., Cloninger, C. R., & Gough, H. G. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.08.007 · Cited by 3,185
Casler, K., Bickel, L., & Hackett, E. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2013.05.009 · Cited by 1,662
Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach
Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M. E. P., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0073791 · Cited by 1,700
“demographic information afforded by social media bring us closer to a more ideal representative sample [99].”
BackgroundEvaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617
“In addition, the service has been validated as a tool for conducting survey research [3,4], one-shot decision-making research [5,6], collective behavior experiments [7,8], for norming stimuli, and conducting behavioral linguistics experiments [9,10].”
BackgroundMethodHsu, M., Ju, T., Yen, C., & Chang, C. (2006) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2006.09.003 · Cited by 1,521
Chiu, C., Wang, E. T. G., Fang, Y., & Huang, H. (2014) · Information Systems Journal · doi:10.1111/j.1365-2575.2012.00407.x · Cited by 1,332
“Samuel et al. (2004) suggest that the data provided by a self-selected internet sample are of at least as high a quality as those provided by traditional methods.”
ResultInvestigating Variation in Replicability: A “Many Labs” Replication Project
Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B., Bahník, Š., Bernstein, M. J., Bocian, K., Brandt, M. J., Brooks, B., Brumbaugh, C. C., et al. (2014) · Social Psychology · doi:10.1027/1864-9335/a000178 · Cited by 1,208
“…interesting considering that there is substantial interest and commentary about the contingency of effects on our two moderators, lab versus online (Gosling, Vazire, Srivastava, & John, 2004; Paolacci, Chandler, & Ipeirotis, 2010), and cultural variation across nations (Henrich et al., 2010).”
de Winter, J. C. F., Gosling, S. D., & Potter, J. (2016) · Psychological Methods · doi:10.1037/met0000079 · Cited by 1,201
Self-citationSoto, C. J., John, O. P., Gosling, S. D., & Potter, J. (2010) · Journal of Personality and Social Psychology · doi:10.1037/a0021717 · Cited by 1,345
Self-citationFraley, R. C., Heffernan, M. E., Vicary, A. M., & Brumbaugh, C. C. (2011) · Psychological Assessment · doi:10.1037/a0022898 · Cited by 1,198
Exploratory Factor Analysis With Small Sample Sizes
de Winter, J., Dodou, D., & Wieringa, P. A. (2009) · Multivariate Behavioral Research · doi:10.1080/00273170902794206 · Cited by 1,211
“A subsampling study was also conducted on a psychological dataset of individuals who filled in a Big Five Inventory via the Internet.”
BackgroundMethodInfluentialGo, E., & Sundar, S. S. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.01.020 · Cited by 1,089
Penke, L., & Asendorpf, J. B. (2008) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.95.5.1113 · Cited by 1,170
Allison, C., Auyeung, B., & Baron-Cohen, S. (2012) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2011.11.003 · Cited by 1,016
A tale of two sites: Twitter vs. Facebook and the personality predictors of social media usage
Hughes, D. J., Rowe, M., Batey, M., & Lee, A. (2012) · Computers in Human Behavior · doi:10.1016/j.chb.2011.11.001 · Cited by 1,011
“Online measures have been shown to attract samples that are diverse with regard to age, gender, geographic region and socio-economic status (Gosling, Vazire, Srivasta & John, 2004).”
BackgroundGender differences in personality across the ten aspects of the big five
Weisberg, Y. J., DeYoung, C. G., & Hirsh, J. B. (2011) · Frontiers in Psychology · doi:10.3389/fpsyg.2011.00178 · Cited by 947
“Though previous research has not shown significant difference in personality between these two methods (Gosling et al., 2004), we investigated whether administration method moderated gender differences in our sample.”
BackgroundResultChandler, J., Mueller, P., & Paolacci, G. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0365-7 · Cited by 950
Kosiński, M., Matz, S., Gosling, S. D., Popov, V., & Stillwell, D. J. (2015) · American Psychologist · doi:10.1037/a0039210 · Cited by 1,031
Self-citation(2007) · Cited by 926
Self-citationSteger, M. F., Oishi, S., & Kashdan, T. B. (2009) · The Journal of Positive Psychology · doi:10.1080/17439760802303127 · Cited by 1,009
“Evidence from a large-scale study suggests that Internet samples possess generally desirable sampling characteristics, although they are probably not as representative as probability samples (eg, Gosling, Vazire, Srivastava, & John, 2004 ).”
Experimental analysis of a web-based training intervention to develop positive psychological capital
Luthans, F., Avey, J. B., & Patera, J. L. (2008) · Academy of Management Learning & Education · doi:10.5465/amle.2008.32712618 · Cited by 900
Brysbaert, M. (2019) · Journal of Cognition · doi:10.5334/joc.72 · Cited by 996
Linguistic Markers of Psychological Change Surrounding September 11, 2001
Cohn, M. A., Mehl, M. R., & Pennebaker, J. W. (2004) · Psychological Science · doi:10.1111/j.0956-7976.2004.00741.x · Cited by 808
Strengths of character, orientations to happiness, and life satisfaction
Peterson, C., Ruch, W., Beermann, U., Park, N., & Seligman, M. E. P. (2007) · The Journal of Positive Psychology · doi:10.1080/17439760701228938 · Cited by 849
“Although a self-selected group, respondents are impressively numerous and certainly more diverse than the typical research sample of introductory psychology college students attending one particular college during one particular school term (Gosling, Vazire, Srivastava, & John, 2004 ).”
BackgroundAn Evaluation of Amazon’s Mechanical Turk, Its Rapid Rise, and Its Effective Use
Buhrmester, M. D., Talaifar, S., & Gosling, S. D. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691617706516 · Cited by 815
Self-citationYeager, D., Krosnick, J., Chang, L., Javitz, H., Levendusky, M., Simpser, A., & Wang, R. (2011) · Public Opinion Quarterly · doi:10.1093/poq/nfr020 · Cited by 434
Understanding Self‐directed Stigma: Development of the Weight Bias Internalization Scale
Durso, L. E., & Latner, J. (2008) · Obesity · doi:10.1038/oby.2008.448 · Cited by 709
“The ability of the Internet to provide adequately random samples has been justified in previous research (17).”
BackgroundPark, N., & Peterson, C. (2006) · Journal of Adolescence · doi:10.1016/j.adolescence.2006.04.011 · Cited by 808
Germine, L., Nakayama, K., Duchaine, B. C., Chabris, C. F., Chatterjee, G., & Wilmer, J. B. (2012) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0296-9 · Cited by 669
“Self-selected Web samples, on the other hand, tend to be much more diverse in terms of age, education, socioeconomic status, and geographic location (Gosling et al., 2004).”
BackgroundInfluentialAge and gender differences in self-esteem—A cross-cultural window.
(2015) · doi:10.1037/pspp0000078 · Cited by 684
Self-citationTracing the threads: How five moral concerns (especially Purity) help explain culture war attitudes
Koleva, S. P., Graham, J., Iyer, R., Ditto, P. H., & Haidt, J. (2012) · Journal of Research in Personality · doi:10.1016/j.jrp.2012.01.006 · Cited by 682
Budge, S. L., Adelson, J. L., & Howard, K. A. S. (2013) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0031774 · Cited by 782
Masculinity and perceived normative health behaviors as predictors of men's health behaviors
Mahalik, J. R., Burns, S. M., & Syzdek, M. (2007) · Social Science & Medicine · doi:10.1016/j.socscimed.2007.02.035 · Cited by 675
Understanding Libertarian Morality: The Psychological Dispositions of Self-Identified Libertarians
Iyer, R., Koleva, S. P., Graham, J., Ditto, P. H., & Haidt, J. (2012) · PLoS ONE · doi:10.1371/journal.pone.0042366 · Cited by 781
A Framework for the Study of Personality and Political Behaviour
MONDAK, J. J., & HALPERIN, K. D. (2008) · British Journal of Political Science · doi:10.1017/s0007123408000173 · Cited by 645
Lewandowsky, S., Oberauer, K., & Gignac, G. E. (2013) · Psychological Science · doi:10.1177/0956797612457686 · Cited by 638
Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention
Cepeda, N. J., Vul, E., Rohrer, D., Wixted, J. T., & Pashler, H. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02209.x · Cited by 631
Value Orientations and Environmental Beliefs in Five Countries
de Groot, J. I. M., & Steg, L. (2007) · Journal of Cross-Cultural Psychology · doi:10.1177/0022022107300278 · Cited by 635
“Thus, our sampling method has similar deficits to any other commonly-used sampling methods that do not yield true random samples (see Gosling et al., 2004) or that use selective samples (such as students or teachers; see for example Schwartz, 1992; Schwartz & Sagie, 2000).”
MethodAscertaining the validity of individual protocols from Web-based personality inventories
Johnson, J. A. (2004) · Journal of Research in Personality · doi:10.1016/j.jrp.2004.09.009 · Cited by 618
“This distance may give participants a sense of reduced accountability for their actions (although anonymity may sometimes encourage participants to be more open and genuine; see Gosling et al., 2004).”
BackgroundInfluentialSchaufeli, W. B., & Salanova, M. (2007) · Anxiety Stress & Coping · doi:10.1080/10615800701217878 · Cited by 681
“However, Gosling, Vazire, Srinastava, and John ( 2004 ) argued convincingly that Internet-based findings are consistent with findings based on traditional methods (e.”
ResultCrowdsourcing Consumer Research
Goodman, J. K., & Paolacci, G. (2017) · Journal of Consumer Research · doi:10.1093/jcr/ucx047 · Cited by 597
Wolters, C. A., & Daugherty, S. G. (2007) · Journal of Educational Psychology · doi:10.1037/0022-0663.99.1.181 · Cited by 586
“From this perspective, teachers’ sense of efficacy is more analogous to individuals’ self-efficacy for learning and can be defined as teachers’ judgments or beliefs of their perceived ability to accomplish critical instructional goals even among students who are difficult or unmotivated ( Gibson & Dembo, 1984; Tschann…”
BackgroundInfluentialWeinberg, J. D., Jeremy Freese, A., & McElhattan, D. (2014) · Sociological Science · doi:10.15195/v1.a19 · Cited by 582
Rentfrow, P. J., Gosling, S. D., & Potter, J. (2008) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2008.00084.x · Cited by 598
“population than most convenience samples are (Gosling et al., 2004).”
BackgroundMethodInfluentialSelf-citationBurke, M., & Kraut, R. E. (2016) · Journal of Computer-Mediated Communication · doi:10.1111/jcc4.12162 · Cited by 552
“Moreover, results for large self-selected samples of Internet users are generally comparable to participants in traditional paper-and-pencil studies (Gosling et al., 2004) and this sample is larger and more representative than surveys of college students upon which much of the literature now rests.”
ResultSampling lesbian, gay, and bisexual populations.
Meyer, I. H., & Wilson, P. A. (2009) · Journal of Counseling Psychology · doi:10.1037/a0014587 · Cited by 556
Vogel, D. L., Heimerdinger-Edwards, S. R., Hammer, J. H., & Hubbard, A. (2011) · Journal of Counseling Psychology · doi:10.1037/a0023688 · Cited by 551
A Tale of Two Sample Sources: Do Results from Online Panel Data and Conventional Data Converge?
Walter, S. L., Seibert, S. E., Goering, D. D., & O’Boyle, E. H. (2018) · Journal of Business and Psychology · doi:10.1007/s10869-018-9552-y · Cited by 593
“…suggests that OPD samples are more diverse, younger, more educated, but more poorly paid than the general US population (Paolacci et al., 2010; Gosling et al., 2004; Sprouse, 2011) and, at the same time, more diverse, older, and more work experienced than a typical undergraduate research…”
BackgroundDetecting, Preventing, and Responding to “Fraudsters” in Internet Research: Ethics and Tradeoffs
Teitcher, J. E. F., Bockting, W. O., Bauermeister, J. A., Hoefer, C. J., Miner, M. H., & Klitzman, R. (2015) · The Journal of Law Medicine & Ethics · doi:10.1111/jlme.12200 · Cited by 546
Chen, R., Sun, C., Chen, J., Jen, H., Kang, X. L., Kao, C., & Chou, K. (2020) · International Journal of Mental Health Nursing · doi:10.1111/inm.12796 · Cited by 599
“Online and confidential paper and pencil survey collection methods tend to offer anonymity favoured by participants and not adversely impacted by repeat or nonseri-ous responders (Gosling et al .”
Lin, T., & Huang, C.-C. (2008) · Information & Management · doi:10.1016/j.im.2008.06.004 · Cited by 540
“[35] S.”
BackgroundAn Intersectional Analysis of Gender and Ethnic Stereotypes
Ghavami, N., & Peplau, L. A. (2012) · Psychology of Women Quarterly · doi:10.1177/0361684312464203 · Cited by 565
Noftle, E. E., & Shaver, P. R. (2006) · Journal of Research in Personality · doi:10.1016/j.jrp.2004.11.003 · Cited by 501
Soto, C. J., John, O. P., Gosling, S. D., & Potter, J. (2008) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.94.4.718 · Cited by 501
“Compared with non-Internet samples recruited for personality and social psychology studies published in the Journal of Personality and Social Psychology (Gosling et al., 2004), the present sample was split more evenly between male and female participants and was at least as diverse in terms of ethnicity.”
BackgroundInfluentialSelf-citationCharacteristics and Concordance of Autism Spectrum Disorders Among 277 Twin Pairs
Rosenberg, R. E., Law, J. K., Yenokyan, G., McGready, J., Kaufmann, W. E., & Law, P. A. (2009) · Archives of Pediatrics & Adolescent Medicine · doi:10.1001/archpediatrics.2009.98 · Cited by 495
How Social Media Facilitates Political Protest: Information, Motivation, and Social Networks
Jost, J. T., Barberá, P., Bonneau, R., Langer, M., Metzger, M., Nagler, J., Sterling, J., & Tucker, J. A. (2018) · Political Psychology · doi:10.1111/pops.12478 · Cited by 492
Lian, H., Ferris, D. L., & Brown, D. J. (2012) · Journal of Applied Psychology · doi:10.1037/a0024610 · Cited by 489
Dewaele, J., Petrides, K. V., & Furnham, A. F. (2008) · Language Learning · doi:10.1111/j.1467-9922.2008.00482.x · Cited by 538
“Gosling et al. (2004) concluded by pointing out that the ability to collect data from large and diverse samples and motivated respondents and the ease and efficiency with which the data can be collected outweigh the methodological constraints (p. 102).”
BackgroundNumber sense across the lifespan as revealed by a massive Internet-based sample
Halberda, J., Ly, R., Wilmer, J. B., Naiman, D. Q., & Germine, L. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1200196109 · Cited by 477
Lange, K., Kühn, S., & Filevich, E. (2015) · PLoS ONE · doi:10.1371/journal.pone.0130834 · Cited by 481
“It is especially useful in cases where laboratory-based data collection is too expensive or simply not feasible, like studies of particularly large or diverse populations [3] or of micro-longitudinal data [1,4].”
BackgroundInternet Research in Psychology
Gosling, S. D., & Mason, W. (2015) · Annual Review of Psychology · doi:10.1146/annurev-psych-010814-015321 · Cited by 458
Self-citatione-Perceptions: Personality Impressions Based on Personal Websites.
Vazire, S., & Gosling, S. D. (2004) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.87.1.123 · Cited by 460
Self-citationCharacter strengths in fifty-four nations and the fifty US states
Park, N., Peterson, C., & Seligman, M. E. P. (2006) · The Journal of Positive Psychology · doi:10.1080/17439760600619567 · Cited by 455
“However, a study by Gosling, Vazire, Srivastava, and John ( 2004 ) found that Internet methods were as reliable and valid as more traditional strategies of gathering data, and furthermore that Internet samples were usually more diverse.”
BackgroundThe economic and social burden of compulsive hoarding
Tolin, D. F., Frost, R. O., Steketee, G., Gray, K. D., & Fitch, K. E. (2008) · Psychiatry Research · doi:10.1016/j.psychres.2007.08.008 · Cited by 445
“…used for mental health research (Skitka and Sargis, 2006), and several studies indicate that web-based data collection results in greater sample diversity, generalizes across presentation formats, and findings are consistent with data collected using more traditional means (Gosling et al., 2004).”
BackgroundResultInfluentialSex Differences in Romantic Attachment: A Meta-Analysis
Del Giudice, M. (2011) · Personality and Social Psychology Bulletin · doi:10.1177/0146167210392789 · Cited by 441
Gander, F., Proyer, R. T., Ruch, W., & Wyss, T. (2013) · Journal of Happiness Studies · doi:10.1007/s10902-012-9380-0 · Cited by 444
“collection methods (Gosling et al. 2004) or even superior, when sensitive information is collected (Turner et al.”
BackgroundPerceived experiences of anti-bisexual prejudice: Instrument development and evaluation.
Brewster, M. E., & Moradi, B. (2010) · Journal of Counseling Psychology · doi:10.1037/a0021116 · Cited by 433
The meaningful life in Japan and the United States: Levels and correlates of meaning in life
Steger, M. F., Kawabata, Y., Shimai, S., & Otake, K. (2007) · Journal of Research in Personality · doi:10.1016/j.jrp.2007.09.003 · Cited by 467
Internet Versus Mailed Questionnaires: A Randomized Comparison
Ritter, P., Lorig, K., Laurent, D., & Matthews, K. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.3.e29 · Cited by 427
“However, Gosling et al [19] have argued that Internet samples may actually be more representative than traditional samples.”
BackgroundInformant reports: A cheap, fast, and easy method for personality assessment
Vazire, S. (2005) · Journal of Research in Personality · doi:10.1016/j.jrp.2005.03.003 · Cited by 427
Self-citationMyers, B. J., Mackintosh, V. H., & Goin‐Kochel, R. P. (2009) · Research in Autism · doi:10.1016/j.rasd.2009.01.004 · Cited by 502
Disclosure of sensitive behaviors across self-administered survey modes: a meta-analysis
Gnambs, T., & Kaspar, K. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0533-4 · Cited by 422
Strayhorn, T. L. (2013) · Journal of African American Studies · doi:10.1007/s12111-012-9243-0 · Cited by 417
“…employed because response rates are frequently low to mailed surveys (Crawford et al. 2001), and evidence, to date, suggests that questionnaires completed online demonstrate psychometric properties that are very similar, if not superior, to those of paper-and-pencil surveys (Gosling et al. 2004).”
BackgroundSmith, S. M., Roster, C. A., Golden, L. L., & Albaum, G. (2016) · Journal of Business Research · doi:10.1016/j.jbusres.2015.12.002 · Cited by 415
Data Collection in the Digital Age: Innovative Alternatives to Student Samples1
Steelman, Z. R., Hammer, B. I., & Limayem, M. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.2.02 · Cited by 416
Fraley, R. C., Hudson, N. W., Heffernan, M. E., & Segal, N. (2015) · Journal of Personality and Social Psychology · doi:10.1037/pspp0000027 · Cited by 477
“For an in-depth comparison of Web-based samples and more commonly used undergraduate samples, please see Gosling et al. (2004).”
BackgroundPersonality Maturation Around the World
Bleidorn, W., Klimstra, T. A., Denissen, J. J. A., Rentfrow, P. J., Potter, J., & Gosling, S. D. (2013) · Psychological Science · doi:10.1177/0956797613498396 · Cited by 391
“should be noted that Internet-based samples are much more diverse and more representative than are the convenience samples commonly used in social-science research (Gosling et al., 2004), and similar results are typically obtained across Internet and non-Internet samples, especially with regard to personality variable…”
ResultSelf-citationDevelopment and Testing of an Abbreviated Numeracy Scale: A Rasch Analysis Approach
Weller, J. A., Dieckmann, N. F., Tusler, M., Mertz, C. K., Burns, W. J., & Peters, E. M. (2012) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1751 · Cited by 409
Martínez‐Martí, M. L., & Ruch, W. (2016) · The Journal of Positive Psychology · doi:10.1080/17439760.2016.1163403 · Cited by 407
Entrepreneurial intention as developmental outcome
Obschonka, M., Silbereisen, R. Κ., & Schmitt‐Rodermund, E. (2010) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2010.02.008 · Cited by 412
The structure of musical preferences: A five-factor model.
Rentfrow, P. J., Goldberg, L. R., & Levitin, D. J. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0022406 · Cited by 397
Emotion regulation in Asperger’s syndrome and high-functioning autism
Samson, A. C., Huber, O., & Gross, J. J. (2012) · Emotion · doi:10.1037/a0027975 · Cited by 368
Helicopter Parents and Landing Pad Kids: Intense Parental Support of Grown Children
Fingerman, K. L., Cheng, Y., Wesselmann, E. D., Zarit, S. H., Furstenberg, F. F., & Birditt, K. S. (2012) · Journal of Marriage and the Family · doi:10.1111/j.1741-3737.2012.00987.x · Cited by 364
Where cognitive development and aging meet: Face learning ability peaks after age 30
Germine, L. T., Duchaine, B., & Nakayama, K. (2010) · Cognition · doi:10.1016/j.cognition.2010.11.002 · Cited by 366
Transportation and Need for Affect in Narrative Persuasion: A Mediated Moderation Model
Appel, M., & Richter, T. (2010) · Media Psychology · doi:10.1080/15213261003799847 · Cited by 403
MacLean, K. A., Leoutsakos, J. S., Johnson, M. W., & Griffiths, R. R. (2012) · Journal for the Scientific Study of Religion · doi:10.1111/j.1468-5906.2012.01685.x · Cited by 405
“…not religious” when asked to choose the best single statement to define their religiousness and spirituality; the remaining participants identified as “spiritual and religious” (13.5 percent), “neither spiritual nor religious” (16 percent), or “religious but not spiritual” (less than 1 percent).”
BackgroundInfluentialHwang, W., & Goto, S. G. (2008) · Cultural Diversity & Ethnic Minority Psychology · doi:10.1037/1099-9809.14.4.326 · Cited by 395
Body Concerns In and Out of the Bedroom: Implications for Sexual Pleasure and Problems
Sanchez, D. T., & Kiefer, A. K. (2007) · Archives of Sexual Behavior · doi:10.1007/s10508-007-9205-0 · Cited by 393
“Recent studies suggest that Internet survey research is as representative as non-internet survey research, if not more diverse than traditional methods utilizing college samples ( Gosling, Vazire, & Srivastava, 2004 ).”
BackgroundRentfrow, P. J., Gosling, S. D., Jokela, M. M., Stillwell, D. J., Kosiński, M., & Potter, J. (2013) · Journal of Personality and Social Psychology · doi:10.1037/a0034434 · Cited by 382
Self-citationO'Brien, E., Konrath, S., Grühn, D., & Hagen, A. (2013) · The journals of gerontology. Series B, Psychological sciences and social sciences · doi:10.1093/geronb/gbs055 · Cited by 352
Conley, T. D., Moors, A. C., Matsick, J. L., & Ziegler, A. (2012) · Analyses of Social Issues and Public Policy · doi:10.1111/j.1530-2415.2012.01286.x · Cited by 391
Burnout and Depression: Two Entities or One?
Schonfeld, I. S., & Bianchi, R. (2016) · Journal of Clinical Psychology · doi:10.1002/jclp.22229 · Cited by 345
Steel, P., & Ferrari, J. (2013) · European Journal of Personality · doi:10.1002/per.1851 · Cited by 343
Breed differences in canine aggression
Duffy, D. L., Hsu, Y., & Serpell, J. A. (2008) · Applied Animal Behaviour Science · doi:10.1016/j.applanim.2008.04.006 · Cited by 334
“The findings also suggest that, for the purpose of obtaining information on the prevalence of behavior problems in the pet dog population, internet data collection methods provided results comparable to those obtained by more traditional paper-and-pencil surveys (Gosling et al., 2004).”
ResultKang, H. J., Shin, J., & Ponto, K. (2019) · Journal of Interactive Marketing · doi:10.1016/j.intmar.2019.07.002 · Cited by 350
“Other studies have found that online survey participants are less invested or motivated than traditional lab participants (Gosling et al. 2004).”
Background
Metadata
- Authors
- Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P.
- Affiliations
- The University of Texas at Austin (US)
- Stanford University (US)
- University of California, Berkeley (US)
- Venue
- American Psychologist
- Published
- 2004
- Volume
- 59
- Issue
- 2
- Pages
- 93-104
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W1992490637
- Cited by
- 2,932
- References
- 72
- Citations by year
- 2026: 40 · 2025: 64 · 2024: 72 · 2023: 85 · 2022: 123 · 2021: 135 · 2020: 157 · 2019: 163 · 2018: 148 · 2017: 170 · 2016: 181 · 2015: 192 · 2014: 218 · 2013: 184 · 2012: 189
- FWCI
- 261.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Keywords
- online data collection, paper-and-pencil questionnaires, sample representativeness, data quality, response format effects, generalizability, self-report questionnaire
- MeSH terms
- Adult, Aged, Attitude, Female, Humans, Male, Middle Aged, Psychology, Surveys and Questionnaires, Evidence-Based Medicine, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
