The DOI matches its Crossref record; 68 of the 72 references it cites were found in a registry or an index.
Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires.
Abstract
The rapid growth of the Internet provides a wealth of new research opportunities for psychologists. Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods. Six preconceptions about Internet samples and data quality are evaluated by comparing a new large Internet sample (N = 361,703) with a set of 510 published traditional samples. Internet samples are shown to be relatively diverse with respect to gender, socioeconomic status, geographic region, and age. Moreover, Internet findings generalize across presentation formats, are not adversely affected by nonserious or repeat responders, and are consistent with findings from traditional methods. It is concluded that Internet methods can contribute to many areas of psychology.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The proportion of females (62%) to males in this study was more representative than in traditional survey methods, where women often comprise 71% to 77% of the participants [39]”
From Effects of Mock Facebook Workday Comments on Public Perception of Professional Credibility: A Field Study in Canada (2019) · cites this paper as [39]
In the citing paper
“Self-presentation is an unlikely confound in Study 1 because the motivation to self-present is absent when participants feel anonymous (Paulhus, 1984(Paulhus, , 1991) ) as they do in anonymous online studies such as the present one, where they don't provide identifying information (Gosling et al., 2004).”
From Cultural norm fulfillment, interpersonal belonging, or getting ahead? A large-scale cross-cultural test of three perspectives on the function of self-esteem. (2015) · cites this paper as Gosling et al., 2004
In the citing paper
“As described in the Appendix, the reliability and validity of internet data collection has become increasingly clear in recent years.”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“The validity of internet testing has been well supported in recent reviews (Gosling et al., 2004), with excellent correspondence between results obtained with internet samples are results obtained in the laboratory (e.g., Birnbaum, 1999;Krantz & Dalal, 2000;McGraw, Tew, & Williams, 2000;Reips, 2002).”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“Furthermore, previous research has suggested populations for online studies and Facebook are quite representative [23], [24].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [23]
In the citing paper
“Still, the sample sizes and availability of demographic information afforded by social media bring us closer to a more ideal representative sample [99].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [99]
Citations
Cites
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
(1999) · Cited by 7,995
Self-citationInternet paradox: A social technology that reduces social involvement and psychological well-being?
Kraut, R., Patterson, M., Lundmark, V., Kiesler, S., Mukophadhyay, T., & Scherlis, W. (1998) · American Psychologist · doi:10.1037/0003-066x.53.9.1017 · Cited by 4,793
Handbook of Personality : Theory and Research
Pervin, L. A. (1992) · Cited by 4,543
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Mail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070237 · Cited by 3,463
Gender differences in personality traits across cultures: Robust and surprising findings.
Costa, P. T., Terracciano, A., & McCrae, R. R. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.2.322 · Cited by 2,986
Kraut, R. E., Kiesler, S. B., Boneva, B. S., Cummings, J. N., Helgeson, V. S., & Crawford, A. M. (2002) · Journal of Social Issues · doi:10.1111/1540-4560.00248 · Cited by 2,367
Gender differences in personality: A meta-analysis.
Feingold, A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.3.429 · Cited by 2,240
Handbook of Personality Theory and Research.
Schwartz, M. L., Borgatta, E. F., & Lambert, W. W. (1970) · American Sociological Review · doi:10.2307/2093310 · Cited by 2,182
Research works printed but not linked: 7
- Azar, 2000, A web of research: They're fun, they're fast, and they save money, but do Web experiments yield quality results?, Monitor on Psychology, 31, 42
- 10.1037/0022-3514.75.3.729 · DOI · Paper page
- Dillman. 1998 · DOI
- Locke, 1995, Method of psychological assessment, self-disclosure, and experiential differences: A study of computer, questionnaire, and interview assessment formats., Journal of Social Behavior and Personality, 10, 255
- 2000, Digest of education statistics 2000.
- Skitka, (in press). Social psychological research and me Internet: The promise and the perils of a new methodological frontier.
- 2000, Population, 1
Cited by
Sorted by citations
Items 401–500 of 1,012
Cultural mistrust and mental health help-seeking attitudes among Filipino Americans.
David, E. J. R. (2010) · Asian American Journal of Psychology · doi:10.1037/a0018814 · Cited by 135
Do moods affect programmers’ debug performance?
Khan, I. A., Brinkman, W., & Hierons, R. M. (2010) · Cognition Technology & Work · doi:10.1007/s10111-010-0164-1 · Cited by 117
“(2) Web studies have high external validity and depict original behavior (Gosling et al. 2004).”
BackgroundLewis, I. M., Watson, B. C., & White, K. M. (2008) · Australian Journal of Psychology · doi:10.1080/00049530802105865 · Cited by 114
Access to pasture for dairy cows: Responses from an online engagement
Schuppli, C. A., von Keyserlingk, M. A. G., & Weary, D. M. (2014) · Journal of Animal Science · doi:10.2527/jas.2014-7725 · Cited by 123
The use of web questionnaires in second language acquisition and bilingualism research
Wilson, R., & Dewaele, J. (2010) · Second language Research · doi:10.1177/0267658309337640 · Cited by 117
“Web-based research needs to take a balanced view, as Gosling et al. (2004) suggest; the ability to collect data from large and diverse samples and motivated respondents and the ease and efficiency with which the data can be collected is an enormous asset.”
BackgroundMethodResultInfluentialAlruwaie, M., El‐Haddadeh, R., & Weerakkody, V. (2020) · Government Information Quarterly · doi:10.1016/j.giq.2020.101485 · Cited by 141
Masculine gender role conflict and negative feelings about being gay.
Sánchez, F. J., Westefeld, J. S., Liu, W. M., & Vilain, E. J. N. (2010) · Professional Psychology Research and Practice · doi:10.1037/a0015805 · Cited by 116
Gardner, R. M., Brown, D. L., & Boice, R. (2012) · Body Image · doi:10.1016/j.bodyim.2012.06.006 · Cited by 113
Gullo, M. J., Dawe, S., Kambouropoulos, N., Staiger, P. K., & Jackson, C. J. (2010) · Alcoholism Clinical and Experimental Research · doi:10.1111/j.1530-0277.2010.01222.x · Cited by 119
“All measures were administered in an online, self-report format as there is now strong evidence supporting internet administration of self-report instruments generally (Gosling et al., 2004) and personality and alcohol use measures specifically (Brodey et al.”
BackgroundMethodBurnout is more strongly linked to neuroticism than to work-contextualized factors
Bianchi, R. (2018) · Psychiatry Research · doi:10.1016/j.psychres.2018.11.015 · Cited by 142
Omarova, L., & Jo, S. J. (2022) · Sustainability · doi:10.3390/su14042046 · Cited by 162
Jiménez, M. L. V., Chacón, F., Marzana, D., & Marta, E. (2013) · Journal of Community Psychology · doi:10.1002/jcop.21530 · Cited by 113
(2016) · doi:10.1037/pspp0000104 · Cited by 111
Self-citationYarkoni, T. (2012) · Current Directions in Psychological Science · doi:10.1177/0963721412457362 · Cited by 111
Wallace, E., Buil, I., & de Chernatony, L. (2018) · Journal of Business Ethics · doi:10.1007/s10551-018-3999-7 · Cited by 128
“MTurk offered an advantage in generalising our study beyond a student sample, as studies have found that MTurk provides a more diverse pool of participants than student samples (Behrend et al. 2011; Buhrmester et al. 2011; Gosling et al. 2004).”
BackgroundInfluentialMaylor, E. A., Reimers, S. J., Choi, J., Collaer, M. L., Peters, M., & SILVERMAN, I. W. (2007) · Archives of Sexual Behavior · doi:10.1007/s10508-006-9155-y · Cited by 117
“The relative neglect of gender in the aging literature is perhaps surprising for at least two reasons.”
BackgroundAge differences in instability, contingency, and level of self-esteem across the life span
Meier, L. L., Orth, U., Denissen, J. J. A., & Kühnel, A. (2011) · Journal of Research in Personality · doi:10.1016/j.jrp.2011.08.008 · Cited by 126
“Moreover, the available evidence suggests that data collected via the Internet are generally as reliable and valid as data collected via paper-and-pencil methods (Chuah, Drasgow, & Roberts, 2006; Denissen, Neumann, & van Zalk, 2010; Gosling et al., 2004).”
An empirical study of the effects of personality in pair programming using the five-factor model
Salleh, N., Mendes, E., Grundy, J., & Burch, G. S. J. (2009) · Proceedings of the ... ACM-IEEE International Symposium on Empirical Software Engineering and Measurement/International Symposium on Empirical Software Engineering and Measurement · doi:10.1109/esem.2009.5315997 · Cited by 111
A Practical Guide to the E-Mail Interview
Hunt, N. C., & McHale, S. (2007) · Qualitative Health Research · doi:10.1177/1049732307308761 · Cited by 111
Błachnio, A., & Przepiórka, A. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.02.018 · Cited by 123
Gratifications and Seeding Behavior of Online Adolescents
Courtois, C., Mechant, P., Marez, L. D., & Verleye, K. (2009) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2009.01496.x · Cited by 111
Consumer perceptions to support IoT based smart parcel locker logistics in China
Tang, Y. M., Chau, K. Y., Xu, D., & Liu, X. (2021) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2021.102659 · Cited by 121
Schmidt, J. A., & Lee, K. (2008) · Journal of Business and Psychology · doi:10.1007/s10869-008-9068-y · Cited by 110
“dubious effects of lower esponse rates from Internet ata collection, however, may be offset by the claim that this me hodology normally produces samples with greater diversity in terms of gender, ethnicity, and geographic region; thus, improv ng the generalizabili y of the findings (Gosling et al. 2004). Moreover, Sch…”
BackgroundParent Report of Community Psychiatric Comorbid Diagnoses in Autism Spectrum Disorders
Rosenberg, R. E., Kaufmann, W. E., Law, J. K., & Law, P. A. (2011) · Autism Research and Treatment · doi:10.1155/2011/405849 · Cited by 114
“Current research supports Web-based surveys of medical information as a reliable means of data collection [45].”
BackgroundYour Love Lifts Me Higher! The Energizing Quality of Secure Relationships
Luke, M. A., Sedikides, C., & Carnelley, K. (2012) · Personality and Social Psychology Bulletin · doi:10.1177/0146167211436117 · Cited by 110
Research Design and Tools for Internet Research
Hewson, C., & Laurent, D. (2008) · SAGE Publications Ltd eBooks · doi:10.4135/9780857020055.n4 · Cited by 110
“Such studies have reported online samples to be more diverse in various ways than traditional offline convenience samples, such as undergraduate students, commonly used in much psychological research 4 (e.g. Gosling et al., 2004).”
Does self-esteem account for the higher-order factors of the Big Five?
Erdle, S., Gosling, S. D., & Potter, J. (2009) · Journal of Research in Personality · doi:10.1016/j.jrp.2009.04.012 · Cited by 109
Self-citationZettler, I., Hilbig, B. E., & Heydasch, T. (2013) · Journal of Research in Personality · doi:10.1016/j.jrp.2013.01.012 · Cited by 114
Sex Differences in Approaching Friends with Benefits Relationships
Lehmiller, J. J., VanderDrift, L. E., & Kelly, J. R. (2010) · The Journal of Sex Research · doi:10.1080/00224491003721694 · Cited by 117
“we followed suggestions for best practices regarding psychological research conducted online (Barchard & Williams, 2008; Gosling et al., 2004; Lehmiller, 2008).”
BackgroundMethodInfluentialMoody melodies: Do they cheer us up? A study of the effect of sad music on mood
Garrido, S., & Schubert, E. (2013) · Psychology of Music · doi:10.1177/0305735613501938 · Cited by 115
Selenko, E., Batinic, B., & Paul, K. I. (2010) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317910x519360 · Cited by 120
The influence of state and trait affect on HIV risk behaviors: A daily diary study of MSM.
Mustanski, B. S. (2007) · Health Psychology · doi:10.1037/0278-6133.26.5.618 · Cited by 106
Szymanski, D. M., Gupta, A., Carr, E. R., & Stewart, D. N. (2009) · Sex Roles · doi:10.1007/s11199-009-9611-y · Cited by 139
“Self-objectification refers to the internalization of sexually objectifying experiences that occurs when women treat themselves as an object to be looked at and evaluated on the basis of appearance ( Fredrickson and Roberts 1997 ).”
BackgroundExploring the role of personality in the relationship between maximization and well-being
Purvis, A., Howell, R. T., & Iyer, R. (2010) · Personality and Individual Differences · doi:10.1016/j.paid.2010.10.023 · Cited by 113
Olatunji, B. O., Broman-Fulks, J. J., Bergman, S. M., Green, B. A., & Zlomke, K. R. (2010) · Behavior Therapy · doi:10.1016/j.beth.2009.03.001 · Cited by 105
Coutlee, C. G., Politzer, C. S., Hoyle, R., & Huettel, S. A. (2014) · Archives of Scientific Psychology · doi:10.1037/arc0000005 · Cited by 110
Marchiondo, L. A., Myers, C. G., & Kopelman, S. (2015) · The Leadership Quarterly · doi:10.1016/j.leaqua.2015.06.006 · Cited by 105
Gnambs, T., & Kaspar, K. (2016) · Assessment · doi:10.1177/1073191115624547 · Cited by 106
Testing a theory of aircraft noise annoyance: A structural equation analysis
Kroesen, M., Molin, E. J. E., & van Wee, B. (2008) · The Journal of the Acoustical Society of America · doi:10.1121/1.2916589 · Cited by 105
Stressful Experiences of Masculinity Among U.S.-Born and Immigrant Asian American Men
Lu, A., & Wong, Y. J. (2013) · Gender & Society · doi:10.1177/0891243213479446 · Cited by 104
“Compared to traditional survey data, Internet participants are equally diverse, psychologically stable, and serious about providing accurate information (Gosling et al. 2004).”
BackgroundAge Differences in Explicit and Implicit Age Attitudes Across the Life Span
Chopik, W. J., & Giasson, H. L. (2017) · The Gerontologist · doi:10.1093/geront/gnx058 · Cited by 113
Cole, M. S., Bedeian, A. G., & Feild, H. S. (2006) · Organizational Research Methods · doi:10.1177/1094428106287434 · Cited by 105
“Consequently, the present findings add to a growing body of research that suggests online instruments do not unduly influence the psychometric properties of welldeveloped paper-and-pencil measures (Gosling et al., 2004; Herrero & Meneses, in press; Potosky & Bobko, 1997).”
ResultEmojiGrid: A 2D Pictorial Scale for the Assessment of Food Elicited Emotions
Toet, A., Kaneko, D., Ushiama, S., Hoving, S., de Kruijf, I., Brouwer, A.-M., Kallen, V., & van Erp, J. B. F. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02396 · Cited by 105
The Trichotillomania Scale for Children: Development and Validation
Tolin, D. F., Diefenbach, G. J., Flessner, C. A., Franklin, M. E., Keuthen, N. J., Moore, P. S., Piacentini, J. C., Stein, D. J., & Woods, D. W. (2008) · Child Psychiatry & Human Development · doi:10.1007/s10578-007-0092-3 · Cited by 102
“The internet is increasingly being used for mental health research [40], and several studies indicate that web-based data collection results in greater sample diversity, generalizes across presentation formats, and findings are consistent with data collected using more traditional means [41].”
BackgroundThe Phenomenology of Lucid Dreaming: An Online Survey
Stumbrys, T., Erlacher, D., Johnson, M. J., & Schredl, M. (2014) · The American Journal of Psychology · doi:10.5406/amerjpsyc.127.2.0191 · Cited by 116
A Female Leadership Trust Advantage in Times of Crisis: Under What Conditions?
Post, C. A., Latu, I. M., & Belkin, L. Y. (2019) · Psychology of Women Quarterly · doi:10.1177/0361684319828292 · Cited by 113
Feasibility of recruiting a birth cohort through the Internet: the experience of the NINFEA cohort
Richiardi, L., Baussano, I., Vizzini, L., Douwes, J. E., Pearce, N. E., & Merletti, F. (2007) · European Journal of Epidemiology · doi:10.1007/s10654-007-9194-2 · Cited by 102
“Internet is well-accepted by the participants and is an efficient tool for collecting epidemiological data [15].”
MethodChildren's Vocational Development: A Research Rationale
Porfeli, E. J., Hartung, P. J., & Vondracek, F. W. (2008) · The Career Development Quarterly · doi:10.1002/j.2161-0045.2008.tb00163.x · Cited by 102
Psychological needs and virtual worlds: Case Second Life
Partala, T. (2011) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2011.07.004 · Cited by 105
“(2001) was used in a slightly different way than in their original paper, or the studies by Hassenzahl (2008), Hassenzahl et al. (2010), and Partala and Kallinen (in press). While those studies asked their participants to rate the satisfaction of different needs in the context of the single most satisfying or unsatisf…”
BackgroundResultInfluentialMore than the Big Five: Egoism and the HEXACO model of personality
de Vries, R. E., de Vries, A., Hoogh, A. H. B. D., & Feij, J. A. (2009) · European Journal of Personality · doi:10.1002/per.733 · Cited by 103
Sexual Objectification and Substance Abuse in Young Adult Women
Carr, E. R., & Szymanski, D. M. (2010) · The Counseling Psychologist · doi:10.1177/0011000010378449 · Cited by 117
Rentfrow, P. J., Jost, J. T., Gosling, S. D., & Potter, J. P. (2009) · doi:10.1093/acprof:oso/9780195320916.003.013 · Cited by 100
Self-citationExploring the relationship between video game expertise and fluid intelligence
Kokkinakis, A. V., Cowling, P., Drachen, A., & Wade, A. R. (2017) · PLoS ONE · doi:10.1371/journal.pone.0186621 · Cited by 107
Social Psychology: Research Methods
Figgou, L., & Pavlopoulos, V. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-097086-8.24028-2 · Cited by 124
“Although some of these issues have been addressed (e.g., Gosling et al., 2004), the physical distance between researcher and participant remains a major drawback and, at the same time, a distinctive advantage of Internet research.”
BackgroundHorn, A. B., & Maercker, A. R. A. (2016) · BMC Psychology · doi:10.1186/s40359-016-0159-7 · Cited by 118
“Even though doubt about how representative online studies can possibly be can be dispelled [54], it would be interesting to recruit a clinical sample and include a clinical assessment of adjustment disorder in future studies on interpersonal emotion regulation.”
BackgroundGuilmette, M., Mulvihill, K. M., Villemaire-Krajden, R., & Barker, E. T. (2019) · Learning and Individual Differences · doi:10.1016/j.lindif.2019.04.006 · Cited by 132
Tracing the Path from Personality — via Cooperativeness — to Conservation
Hilbig, B. E., Zettler, I., Moshagen, M., & Heydasch, T. (2012) · European Journal of Personality · doi:10.1002/per.1856 · Cited by 99
Maurer, T. J., Lippstreu, M., & Judge, T. A. (2007) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2007.10.010 · Cited by 102
Kovas, Y. V., Haworth, C. M. A., Harlaar, N., Petrill, S. A., Dale, P. S., & Plomin, R. J. (2007) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2007.01748..x · Cited by 99
Volunteer Participation in the Health eHeart Study: A Comparison with the US Population
Guo, X., Vittinghoff, E., Olgin, J. E., Marcus, G. M., & Pletcher, M. J. (2017) · Scientific Reports · doi:10.1038/s41598-017-02232-y · Cited by 87
Upset Over Sexual versus Emotional Infidelity Among Gay, Lesbian, Bisexual, and Heterosexual Adults
Frederick, D. A., & Fales, M. R. (2014) · Archives of Sexual Behavior · doi:10.1007/s10508-014-0409-9 · Cited by 102
von Stumm, S., Fenton‐O’Creevy, M., & Furnham, A. F. (2012) · Personality and Individual Differences · doi:10.1016/j.paid.2012.09.019 · Cited by 98
Conducting Research With LGB People of Color: Methodological Challenges and Strategies
DeBlaere, C., Brewster, M. E., Sarkees, A. M., & Moradi, B. (2010) · The Counseling Psychologist · doi:10.1177/0011000009335257 · Cited by 98
Salzman, D., & Zwinkels, R. C. J. (2017) · Journal of Real Estate Literature · doi:10.1080/10835547.2017.12090455 · Cited by 98
Humor as a character strength among the elderly
Ruch, W., Proyer, R. T., & Weber, M. (2009) · Zeitschrift für Gerontologie und Geriatrie · doi:10.1007/s00391-009-0090-0 · Cited by 98
“Though data collection via the Internet is sometimes criticized, there are empirical studies showing that Internet-based studies are usually as reliable and valid as paper–pencil based methods (more traditional strategies) and that samples collected via the Internet are usually more diverse than other samples [2].”
BackgroundChriston, L., Mackintosh, V. H., & Myers, B. J. (2009) · Research in Autism · doi:10.1016/j.rasd.2009.09.013 · Cited by 97
The personality of U.S. states: Stability from 1999 to 2015
Elleman, L. G., Condon, D. M., Russin, S. E., & Revelle, W. (2018) · Journal of Research in Personality · doi:10.1016/j.jrp.2016.06.022 · Cited by 97
“These samples, although not representative of the U.S. population, are more diverse than traditional methods of data collection (Gosling, Vazire, Srivastava, & John, 2004).”
Rodd, J. M. (2023) · Journal of Memory and Language · doi:10.1016/j.jml.2023.104472 · Cited by 117
“In the early days of online data collection, when internet access was not widespread, researchers were concerned that the web-based recruitment might oversample “ techies ” , or “ social rejects and loners with no other outlet for social contact ” (Gosling et al., 2004).”
BackgroundMurre, J. M. J., Janssen, S. M. J., Rouw, R., & Meeter, M. (2012) · Acta Psychologica · doi:10.1016/j.actpsy.2012.10.005 · Cited by 95
“doi: 10.1037/0882-7974.20.1.3 Salthouse, T. A. (2009). When does age-related cognitive decline begin? [Article].”
InfluentialThe Protective Power of Collective Action for Sexual Minority Women of Color
DeBlaere, C., Brewster, M. E., Bertsch, K. N., DeCarlo, A. L., Kegel, K., & Presseau, C. (2013) · Psychology of Women Quarterly · doi:10.1177/0361684313493252 · Cited by 114
Ways to Happiness in German-Speaking Countries
Ruch, W., Harzer, C., Proyer, R. T., Park, N., & Peterson, C. (2010) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000030 · Cited by 106
Impact of the Cost of Cancer Treatment: An Internet-Based Survey
Markman, M., & Luce, R. (2010) · Journal of Oncology Practice · doi:10.1200/jop.091074 · Cited by 97
Kowert, R., & Oldmeadow, J. A. (2013) · Computers in Human Behavior · doi:10.1016/j.chb.2013.03.003 · Cited by 111
Potoczniak, D. J., Aldea, M. A., & DeBlaere, C. (2007) · Journal of Counseling Psychology · doi:10.1037/0022-0167.54.4.447 · Cited by 95
Chuang, S., Lin, F.-M., & Tsai, C. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.01.044 · Cited by 96
Measuring the Evolutionarily Important Goals of Situations
Brown, N. A., Neel, R., & Sherman, R. A. (2015) · Evolutionary Psychology · doi:10.1177/1474704915593662 · Cited by 104
“Prior studies have found, however, that the data obtained via the Internet and in college samples are quite equivalent (Gosling et al., 2004).”
BackgroundPersonal Values and Attitudes Toward War.
Cohrs, J. C., Moschner, B., Maes, J., & Kielmann, S. (2005) · Peace and Conflict Journal of Peace Psychology · doi:10.1207/s15327949pac1103_5 · Cited by 95
Gender role attitudes and characteristics of stay-at-home and employed fathers.
Fischer, J., & Anderson, V. N. (2011) · Psychology of Men & Masculinity · doi:10.1037/a0024359 · Cited by 95
Zablotsky, B., Anderson, C., & Law, P. A. (2012) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-012-1745-z · Cited by 107
The Effect of Authority on the Persuasiveness of Mathematical Arguments
Inglis, M., & Mejía-Ramos, J. P. (2008) · Cognition and Instruction · doi:10.1080/07370000802584513 · Cited by 94
Interformat Reliability of Digital Psychiatric Self-Report Questionnaires: A Systematic Review
Alfonsson, S., Maathz, P., & Hursti, T. J. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3395 · Cited by 94
“In research on survey methodology, a number of studies have shown that data collected on the Internet can be equivalent to data collected with traditional methods [53-55].”
Anxiety and depression in a post-September 11 sample of Arabs in the USA
Amer, M. M., & Hovey, J. D. (2011) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-011-0341-4 · Cited by 94
“Although concerns with Internet research include difficulty controlling the context and quality of participant responses, Internet samples have not been found to differ from traditional samples in psychological adjustment, and research findings such as personality or self-esteem have been consistent with traditional s…”
ResultMinority Stress and Binge Eating Among Lesbian and Bisexual Women
Mason, T. B., & Lewis, R. J. (2015) · Journal of Homosexuality · doi:10.1080/00918369.2015.1008285 · Cited by 93
History of Social Psychology: Insights, Challenges, and Contributions to Theory and Application
Ross, L. D., Lepper, M. R., & Ward, A. C. (2010) · Wiley eBooks · doi:10.1002/9780470561119.socpsy001001 · Cited by 97
AI in E-Commerce: Application of the Use and Gratification Model to The Acceptance of Chatbots
Marjerison, R. K., Zhang, Y., & Zheng, H. (2022) · Sustainability · doi:10.3390/su142114270 · Cited by 105
Age Effects in Cultural Life Scripts
Janssen, S., & Rubin, D. C. (2010) · Applied Cognitive Psychology · doi:10.1002/acp.1690 · Cited by 102
Development of the Pet Bereavement Questionnaire
Hunt, M. G., & Padilla, Y. (2006) · Anthrozoös · doi:10.2752/089279306785415493 · Cited by 93
“Web-based data collection has both advantages and disadvantages, but in the final analysis appears to be an excellent way of collecting data from participants who are not upper-middle class, white, college students (see Gosling et al. 2004 for a thorough review of web-based research).”
BackgroundPollet, T. V., & Saxton, T. K. (2019) · Evolutionary Psychological Science · doi:10.1007/s40806-019-00192-2 · Cited by 89
Dewaele, J., & Wei, L. (2014) · International Journal of Multilingualism · doi:10.1080/14790718.2013.878347 · Cited by 92
“Scores of personality dimensions and patterns of socializing are comparable in internet samples and pen-and-paper samples (Gosling et al., 2004).”
BackgroundWho will be committed to an organization that provides support for employee development?
Maurer, T. J., & Lippstreu, M. (2008) · Journal of Management Development · doi:10.1108/02621710810858632 · Cited by 97
“From this point of view, a smaller response rate from a very broad population will result in a much more diverse working sample than a larger response rate from a single job, organization or student population ( Gosling et al. , 2004”
BackgroundMoritz, S., Berna, F. S., Jaeger, S., Westermann, S., & Nagel, M. (2016) · European Archives of Psychiatry and Clinical Neuroscience · doi:10.1007/s00406-016-0694-5 · Cited by 94
“However, we adopted several measures to ensure the validity and reliability of diagnostic status and to prevent sabotage [28, 31].”
MethodDenissen, J. J. A., Neumann, L., & van Zalk, M. (2010) · International Journal of Behavioral Development · doi:10.1177/0165025410383746 · Cited by 91
“Research has shown, however, that online participants are not necessarily more emotionally disturbed than participants of traditional studies (Gosling et al., 2004).”
BackgroundInfluentialFactor analysis of the Massachusetts General Hospital Hairpulling Scale.
Keuthen, N., Flessner, C., Woods, D. W., Franklin, M., Stein, D., & Cashin, S. E. (2007) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2006.12.003 · Cited by 70
Kowert, R., & Oldmeadow, J. A. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.05.004 · Cited by 97
Income security, social comparisons and materialism
Chatterjee, D., Kumar, M., & Dayma, K. K. (2019) · International Journal of Bank Marketing · doi:10.1108/ijbm-04-2018-0096 · Cited by 91
Dwyer, B. (2011) · Journal of Sport Management · doi:10.1123/jsm.25.5.445 · Cited by 95
“As a rule of thumb, Green (1991) recommended a sample size for regression analysis should equal N ≥ 50 + 8m, where m is the total number of predictor variables in the model.”
Individual Differences and Differential Psychology
Revelle, W., Wilt, J. A., & Condon, D. M. (2011) · Wiley eBooks · doi:10.1002/9781444343120.ch1 · Cited by 96
Kaźmierczak, I., Zajenkowska, A., Rogoza, R., Jonason, P. K., & Ścigała, D. (2023) · PLOS ONE · doi:10.1371/journal.pone.0281046 · Cited by 90
“Many studies show that participants with PDs demonstrate specific attentional coping styles [36] and biased attention to emotions and facial expressions [37, 38], which might interplay with all experimental procedures.”
BackgroundZucker, A. N., & Landry, L. J. (2007) · Sex Roles · doi:10.1007/s11199-006-9163-3 · Cited by 97
Hallett, J., Howat, P. A., Maycock, B. R., McManus, A., Kypri, K., & Dhaliwal, S. S. (2012) · BMC Public Health · doi:10.1186/1471-2458-12-37 · Cited by 90
Metadata
- Authors
- Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P.
- Affiliations
- The University of Texas at Austin (US)
- Stanford University (US)
- University of California, Berkeley (US)
- Venue
- American Psychologist
- Published
- 2004
- Volume
- 59
- Issue
- 2
- Pages
- 93-104
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W1992490637
- Cited by
- 2,932
- References
- 72
- Citations by year
- 2026: 40 · 2025: 64 · 2024: 72 · 2023: 85 · 2022: 123 · 2021: 135 · 2020: 157 · 2019: 163 · 2018: 148 · 2017: 170 · 2016: 181 · 2015: 192 · 2014: 218 · 2013: 184 · 2012: 189
- FWCI
- 261.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Keywords
- online data collection, paper-and-pencil questionnaires, sample representativeness, data quality, response format effects, generalizability, self-report questionnaire
- MeSH terms
- Adult, Aged, Attitude, Female, Humans, Male, Middle Aged, Psychology, Surveys and Questionnaires, Evidence-Based Medicine, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
