The DOI matches its Crossref record; 68 of the 72 references it cites were found in a registry or an index.
Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires.
Abstract
The rapid growth of the Internet provides a wealth of new research opportunities for psychologists. Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods. Six preconceptions about Internet samples and data quality are evaluated by comparing a new large Internet sample (N = 361,703) with a set of 510 published traditional samples. Internet samples are shown to be relatively diverse with respect to gender, socioeconomic status, geographic region, and age. Moreover, Internet findings generalize across presentation formats, are not adversely affected by nonserious or repeat responders, and are consistent with findings from traditional methods. It is concluded that Internet methods can contribute to many areas of psychology.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The proportion of females (62%) to males in this study was more representative than in traditional survey methods, where women often comprise 71% to 77% of the participants [39]”
From Effects of Mock Facebook Workday Comments on Public Perception of Professional Credibility: A Field Study in Canada (2019) · cites this paper as [39]
In the citing paper
“Self-presentation is an unlikely confound in Study 1 because the motivation to self-present is absent when participants feel anonymous (Paulhus, 1984(Paulhus, , 1991) ) as they do in anonymous online studies such as the present one, where they don't provide identifying information (Gosling et al., 2004).”
From Cultural norm fulfillment, interpersonal belonging, or getting ahead? A large-scale cross-cultural test of three perspectives on the function of self-esteem. (2015) · cites this paper as Gosling et al., 2004
In the citing paper
“As described in the Appendix, the reliability and validity of internet data collection has become increasingly clear in recent years.”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“The validity of internet testing has been well supported in recent reviews (Gosling et al., 2004), with excellent correspondence between results obtained with internet samples are results obtained in the laboratory (e.g., Birnbaum, 1999;Krantz & Dalal, 2000;McGraw, Tew, & Williams, 2000;Reips, 2002).”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“Furthermore, previous research has suggested populations for online studies and Facebook are quite representative [23], [24].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [23]
In the citing paper
“Still, the sample sizes and availability of demographic information afforded by social media bring us closer to a more ideal representative sample [99].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [99]
Citations
Cites
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
(1999) · Cited by 7,995
Self-citationInternet paradox: A social technology that reduces social involvement and psychological well-being?
Kraut, R., Patterson, M., Lundmark, V., Kiesler, S., Mukophadhyay, T., & Scherlis, W. (1998) · American Psychologist · doi:10.1037/0003-066x.53.9.1017 · Cited by 4,793
Handbook of Personality : Theory and Research
Pervin, L. A. (1992) · Cited by 4,543
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Mail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070237 · Cited by 3,463
Gender differences in personality traits across cultures: Robust and surprising findings.
Costa, P. T., Terracciano, A., & McCrae, R. R. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.2.322 · Cited by 2,986
Kraut, R. E., Kiesler, S. B., Boneva, B. S., Cummings, J. N., Helgeson, V. S., & Crawford, A. M. (2002) · Journal of Social Issues · doi:10.1111/1540-4560.00248 · Cited by 2,367
Gender differences in personality: A meta-analysis.
Feingold, A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.3.429 · Cited by 2,240
Handbook of Personality Theory and Research.
Schwartz, M. L., Borgatta, E. F., & Lambert, W. W. (1970) · American Sociological Review · doi:10.2307/2093310 · Cited by 2,182
Research works printed but not linked: 7
- Azar, 2000, A web of research: They're fun, they're fast, and they save money, but do Web experiments yield quality results?, Monitor on Psychology, 31, 42
- 10.1037/0022-3514.75.3.729 · DOI · Paper page
- Dillman. 1998 · DOI
- Locke, 1995, Method of psychological assessment, self-disclosure, and experiential differences: A study of computer, questionnaire, and interview assessment formats., Journal of Social Behavior and Personality, 10, 255
- 2000, Digest of education statistics 2000.
- Skitka, (in press). Social psychological research and me Internet: The promise and the perils of a new methodological frontier.
- 2000, Population, 1
Cited by
Sorted by citations
Items 901–1,000 of 1,012
Rosser, B. R. S., Gurak, L. J., Horvath, K. J., Oakes, J. M., Konstan, J. A., & Danilenko, G. P. (2009) · Journal of Computer-Mediated Communication · doi:10.1111/j.1083-6101.2009.01455.x · Cited by 47
Aversion to side effects in preventive medical treatment decisions
Waters, E. A., Weinstein, N. D., Colditz, G. A., & Emmons, K. M. (2007) · British Journal of Health Psychology · doi:10.1348/135910706x115209 · Cited by 46
From ill-being to well-being: Bipolar or bivariate?
Zhao, Y., & Tay, L. (2022) · The Journal of Positive Psychology · doi:10.1080/17439760.2022.2109204 · Cited by 55
“Last but not least, our data recruited from the internet may be more tilted toward those who want to become flourishing, but it does not mean internet participants are less likely to take the study seriously than participants in traditional samples (Gosling et al., 2004).”
BackgroundKato, T. (2015) · Psychiatry Research · doi:10.1016/j.psychres.2015.07.030 · Cited by 45
“Specifically, several researchers identified a number of methodological issues related to Internet studies (for a review, see Gosling et al., 2004).”
BackgroundThe performance appraisal congruency scale: an assessment of person‐environment fit
Whiting, H. J., Kline, T. J. B., & Sulsky, L. M. (2008) · International Journal of Productivity and Performance Management · doi:10.1108/17410400810857239 · Cited by 45
“However, there has been recent support for web based survey administration, particularly of the type used in this study (Gosling et al., 2004; Kraut et al., 2004).”
BackgroundFetzner, M. G., Peluso, D. L., & Asmundson, G. J. G. (2014) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-014-9413-6 · Cited by 43
Internet-Based Research: Providing a Foundation for Web-Design Guidelines
Spyridakis, J. H., Wei, C., Barrick, J., Cuddihy, E., & Maust, B. S. (2005) · IEEE Transactions on Professional Communication · doi:10.1109/tpc.2005.853927 · Cited by 45
“One area that we do not explore concerns the design of internet-based surveys, on which much has been written elsewhere (see [136]–[139]).”
BackgroundThe Relationship Between Coat Color and Aggressive Behaviors in the Domestic Cat
Stelow, E. A., Bain, M. J., & Kass, P. H. (2015) · Journal of Applied Animal Welfare Science · doi:10.1080/10888705.2015.1081820 · Cited by 45
Morten, A., Gatersleben, B., & Jessop, D. C. (2018) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2018.02.038 · Cited by 45
An empirical study of purchase behaviour on social platforms
Benson, V., Ezingeard, J., & Hand, C. (2018) · Information Technology and People · doi:10.1108/itp-08-2017-0267 · Cited by 54
Huber, M. Z., & Glinz, M. (2019) · Requirements Engineering · doi:10.1007/s00766-019-00314-z · Cited by 45
“With respect to age and gender, our results are also aligned with results on the demographics of participants on Mechanical Turk (turkers) [27, 50] and in Web studies [18].”
ResultGötz, F. M., Bleidorn, W., & Rentfrow, P. J. (2020) · Journal of Personality · doi:10.1111/jopy.12545 · Cited by 52
Tandler, N., Krauss, A., & Proyer, R. T. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.01931 · Cited by 61
Korman, J. V., Quaquebeke, N. V., & Tröster, C. (2021) · Journal of Business and Psychology · doi:10.1007/s10869-021-09733-8 · Cited by 56
Proyer, R. T. (2014) · Current Psychology · doi:10.1007/s12144-014-9225-6 · Cited by 50
“Collecting data over the Internet has been criticized (e.g., for potential sampling biases), but there is evidence that the data are comparable to those that have been assessed in more conventional ways (e.g., Gosling et al. 2004).”
MethodGullo, M., Ward, E., Dawe, S., Powell, J., & Jackson, C. (2011) · Journal of Research in Personality · doi:10.1016/j.jrp.2010.11.002 · Cited by 50
Griva, F., Tseferidi, S.-I., & Anagnostopoulos, F. (2014) · Psychology Health & Medicine · doi:10.1080/13548506.2014.913798 · Cited by 44
Wilson, K. L., & Sirois, F. M. (2009) · Journal of Reproductive and Infant Psychology · doi:10.1080/02646830903190946 · Cited by 44
Clinical features of olfactory reference syndrome: An internet-based study.
Greenberg, J., Shaw, A. M., Reuman, L., Schwartz, R. A., & Wilhelm, S. (2016) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2015.11.001 · Cited by 46
“Our predominantly male sample is in contrast to traditional and internet-based samples, which typically comprise primarily females [20].”
ResultEffective Proof Reading Strategies for Comprehending Mathematical Proofs
Weber, K. (2015) · International Journal of Research in Undergraduate Mathematics Education · doi:10.1007/s40753-015-0011-0 · Cited by 49
“Recent studies have examined the validity of internet-based experiments by comparing a series of internet-based studies with their laboratory equivalents (e.g., Kranz & Dalal, 2000; Gosling et al., 2004).”
BackgroundExploring hope and expectations in the youth mental health online counselling environment
Dowling, M. J., & Rickwood, D. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.08.009 · Cited by 44
Assessing Workplace Emotional Intelligence: Development and Validation of an Ability-based Measure
Krishnakumar, S., Hopkins, K., Szmerekovsky, J. G., & Robinson, M. D. (2015) · The Journal of Psychology · doi:10.1080/00223980.2015.1057096 · Cited by 53
Living in wealthy neighborhoods increases material desires and maladaptive consumption
Zhang, J. W., Howell, R. T., & Howell, C. J. (2014) · Journal of Consumer Culture · doi:10.1177/1469540514521085 · Cited by 47
“The validity of web-based surveys has been confirmed by Gosling et al. (2004) as well as Chang and Krosnick (2003).”
BackgroundTopics and techniques in clinical supervision in psychotherapy training
Weck, F., Kaufmann, Y. M., & Witthöft, M. (2017) · Cognitive Behaviour Therapy · doi:10.1017/s1754470x17000046 · Cited by 30
“However, empirical findings show that internet findings are consistent with findings from traditional assessment methods (Gosling et al., 2004).”
ResultMemory bias toward emotional information in burnout and depression
Bianchi, R., Laurent, É., Schonfeld, I. S., Bietti, L. M., & Mayor, E. (2018) · Journal of Health Psychology · doi:10.1177/1359105318765621 · Cited by 44
“Web-based studies have been shown to be methodologically viable and particularly useful to ensure satisfactory statistical power (Birnbaum, 2004; Gosling et al., 2004; Horton et al., 2011).”
BackgroundFrench, M. T., Mortensen, K., & Timming, A. R. (2018) · Human Relations · doi:10.1177/0018726718782597 · Cited by 44
Talmon, A., Horovitz, M., Shabat, N., Haramati, O. S., & Ginzburg, K. (2019) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2018.12.021 · Cited by 46
National religiosity eases the psychological burden of poverty
Berkessel, J. B., Gebauer, J. E., Joshanloo, M., Bleidorn, W., Rentfrow, P. J., Potter, J., & Gosling, S. D. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2103913118 · Cited by 42
Self-citationNostrand, D. F.-V., & Ojanen, T. J. (2012) · Self and Identity · doi:10.1080/15298868.2012.694660 · Cited by 44
Appelbaum, P. S., Scurich, N., & Raad, R. (2015) · Psychology Public Policy and Law · doi:10.1037/law0000039 · Cited by 48
Ciao, A. C., Latner, J. D., & Durso, L. E. (2012) · Eating and Weight Disorders - Studies on Anorexia Bulimia and Obesity · doi:10.1007/bf03325323 · Cited by 44
“The ability of the Internet to provide adequate random samples has been justified in previous research (12).”
BackgroundGuilty or not? A path model of women's sexual force fantasies
Shulman, J. L., & Home, S. G. (2006) · The Journal of Sex Research · doi:10.1080/00224490609552336 · Cited by 43
“The format also enabled me to access a wide range of participants who may have otherwise been hard to access (Gosling et al., 2004; Kraut et al., 2004).”
BackgroundTechnostress, anxiety, and depression among university students: A report from Paraguay
Torales, J., Torres-Romero, A. D., Di Giuseppe, M. F., Rolón-Méndez, E. R., Martínez-López, P. L., Heinichen-Mansfeld, K. V., Barrios, I., O’Higgins, M., Almirón-Santacruz, J., Melgarejo, O., et al. (2022) · International Journal of Social Psychiatry · doi:10.1177/00207640221099416 · Cited by 45
“The Internet-based survey approach has been employed taking into account the supporting evidence that responses to online surveys may provide similar findings to those reported through ‘in person’ sampling (Gosling et al., 2004; Krantz & Dalal, 2000).”
MethodCan friendships be bipartisan? The effects of political ideology on peer relationships
Poteat, V. P., Mereish, E. H., Liu, M. L., & Nam, J. S. (2011) · Group Processes & Intergroup Relations · doi:10.1177/1368430211401048 · Cited by 43
Attachment avoidance, but not anxiety, minimizes the joys of caregiving
Nelson, S. K., Borelli, J. L., & River, L. M. (2017) · Attachment & Human Development · doi:10.1080/14616734.2017.1326060 · Cited by 43
Brown, N. M. (2018) · Culture Studies ↔ Critical Methodologies · doi:10.1177/1532708617750178 · Cited by 47
Caillier, J. G. (2018) · Public Performance & Management Review · doi:10.1080/15309576.2018.1431138 · Cited by 43
“Gosling et al. (2004) found that Internet samples are diverse in regard to gender, socioeconomic status, geographical region, and age.”
BackgroundSupply Chain Sustainability during COVID-19: Last Mile Food Delivery in China
Lin, Y.-N., Marjerison, R., Choi, J., & Chae, C. (2022) · Sustainability · doi:10.3390/su14031484 · Cited by 25
“An online survey as a data collection tool offers a variety of benefits, including wide geographic coverage, anonymity for respondents, a decreased bias level compared to the pressure given by in-person interviews, and, importantly, cost-saving [83].”
BackgroundPsychometric Comparison of Automated Versus Rational Methods of Scale Abbreviation
Sandy, C. J., Gosling, S. D., & Koelkebeck, T. (2014) · Journal of Individual Differences · doi:10.1027/1614-0001/a000144 · Cited by 43
Self-citationCongenital Versus Regressive Onset of Autism Spectrum Disorders
Goin‐Kochel, R. P., & Myers, B. J. (2005) · Focus on Autism and Other Developmental Disabilities · doi:10.1177/10883576050200030501 · Cited by 43
Multiple Stakeholder Perspectives on Cultural Events: Auckland's Pasifika Festival
Buch, T., Milne, S., & Dickson, G. (2011) · Journal of Hospitality Marketing & Management · doi:10.1080/19368623.2011.562416 · Cited by 43
“While the Web is still being evaluated as a tool for scientific research, some researchers have acknowledged Web-surveying as being as reliable as paper-based surveys ( Ballard & Prine, 2002 ; Denscombe, 2006 ; Gosling, Vazire, Srivastava, & John, 2004 ).”
MethodElectronic Interests and Behaviours Associated with Gambling Problems
Phillips, J. G., Ogeil, R., & Blaszczynski, A. (2012) · International Journal of Mental Health and Addiction · doi:10.1007/s11469-011-9356-z · Cited by 49
“Although there may be concerns that an Internet sample may be biased, Gosling et al. (2004) have demonstrated that Internet surveys are more diverse and representative over a range of key demographic variables such as gender, socioeconomic status, location and age, and the findings from such…”
BackgroundWong, Y. J., & Rochlen, A. B. (2009) · Psychology of Men & Masculinity · doi:10.1037/a0015041 · Cited by 47
The Rogerian Fully Functioning Person
Proctor, C., Tweed, R. G., & Morris, D. B. (2015) · Journal of Humanistic Psychology · doi:10.1177/0022167815605936 · Cited by 60
Lifestyle factors in Croatian seafarers as relating to health and stress on board
Slišković, A., & Penezić, Z. (2017) · Work · doi:10.3233/wor-172501 · Cited by 43
“Studies which compare traditional (paper-and-pencil) and online surveys have shown that the results obtained by internet surveys do not appear to be tainted by false data or repeat responders and are, so far, consistent with results from traditional methods [43, 44].”
Between Childhood Maltreatment and Shame
Talmon, A., & Ginzburg, K. (2017) · Psychology of Women Quarterly · doi:10.1177/0361684317702503 · Cited by 48
Flessner, C. A., Woods, D. W., Franklin, M. E., Keuthen, N. J., & Piacentini, J. C. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2008.06.006 · Cited by 43
Lönnqvist, J., Walkowitz, G., Wichardt, P. C., Lindeman, M., & Verkasalo, M. (2008) · British Journal of Social Psychology · doi:10.1348/014466608x377396 · Cited by 43
Development and Validation of a Gender Expression Measure Among Sexual Minority Women
Lehavot, K., King, K. M., & Simoni, J. M. (2011) · Psychology of Women Quarterly · doi:10.1177/0361684311413554 · Cited by 43
Brummelman, E., Thomaes, S., Slagt, M., Overbeek, G., de Castro, B. O., & Bushman, B. J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065360 · Cited by 42
“Participants were 73 parents (89% mothers) from the Netherlands of a child aged 8 to 15 (53% girls) recruited online (see [24], for a review of the representativeness of online samples).”
Youth Worker Professional Development Participation, Preferences, and Agency Support
Evans, W. P., Sicafuse, L. L., Killian, E. S., Davidson, L. A., & Loesch-Griffin, D. A. (2010) · Child & Youth Services · doi:10.1080/01459350903505579 · Cited by 42
“In addition, Web-based methods allow researchers to collect data from a variety of geographic regions and typically yield more diverse samples than other methods (Gosling, Vazire, Srivastava, & John, 2004 ).”
MethodGolding, J. M., Wasarhaley, N. E., Lynch, K. R., Lippert, A. M., & Magyarics, C. L. (2015) · Behavioral Sciences & the Law · doi:10.1002/bsl.2188 · Cited by 42
Bottesi, G., Cerea, S., Razzetti, E., Sica, C., Frost, R., & Ghisi, M. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00256 · Cited by 22
“The validity of data obtained through web-based surveys has been demonstrated (e.g., Schultz, 1972; Gosling et al., 2004).”
BackgroundImportance of soil fertility for climate-resilient cropping systems: The farmer's perspective
Wolf, M. K., Wiesmeier, M., & Macholdt, J. (2023) · Soil Security · doi:10.1016/j.soisec.2023.100119 · Cited by 42
Understanding global patterns of domestic cannabis cultivation
Barratt, M. J., Bouchard, M., Decorte, T., Frank, V. A., Hakkarainen, P., Lenton, S. R., Malm, A. E., Nguyen, H., & Potter, G. (2012) · Drugs and Alcohol Today · doi:10.1108/17459261211286627 · Cited by 42
Asmundson, G., Weeks, J. W., Carleton, R., Thibodeau, M., & Fetzner, M. G. (2011) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2010.08.013 · Cited by 38
Predictions and causal estimations are not supported by the same associative structure
Vadillo, M. A., & Matute, H. (2007) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470210601002520 · Cited by 42
“The experiment was run simultaneously over the Internet and in traditional laboratory conditions (for recent reviews on Internet-based research, see Birnbaum, 2000 ; Gosling, Vazire, Srivastava, & John, 2004 ; Kraut et al, 2004 ).”
MethodCarter, R. R., DiFeo, A. V., Bogie, K. M., Zhang, G., & Sun, J. (2014) · PLoS ONE · doi:10.1371/journal.pone.0085508 · Cited by 42
“They concluded that web-questionnaire results generalize across various survey formats, do not appear to be tainted by false data or repeat responders, and are consistent with results that use good traditional methodologies [16].”
ResultCurrent Treatment Practices for Children and Adults With Trichotillomania: Consensus Among Experts
Flessner, C. A., Penzel, F., & Keuthen, N. J. (2010) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2009.10.006 · Cited by 42
“However, available research suggests that data collected from Internetsampling procedures provide results consistent with traditional methods (Gosling et al., 2004).”
ResultPatients’ Perceptions of Risky Developments During Psychotherapy
Leitner, A., Märtens, M., Koschier, A., Gerlich, K., Liegl, G., Hinterwallner, H., & Schnyder, U. (2012) · Journal of Contemporary Psychotherapy · doi:10.1007/s10879-012-9215-7 · Cited by 44
“This study was conducted in accordance with the current rules and standards of online surveys and comparable studies(Birnbaum 2004; Gosling et al. 2004) , that is, no personal data or information that could lead to the identification of a specific individual was collected.”
MethodExpanding the Margins of Identity: A Critique of Marginalization in a Globalized World
Kunst, J. R., & Sam, D. L. (2013) · International Perspectives in Psychology · doi:10.1037/ipp0000008 · Cited by 47
How uncivil customers corrode the relationship between frontline employees and retailers
Gaucher, B., & Chebat, J. (2018) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2018.09.012 · Cited by 42
Mobile-Based Experience Sampling for Behaviour Research
Pejović, V., Lathia, N., Cecilia Mascolo, C., & Musolesi, M. (2016) · Human-computer interaction series · doi:10.1007/978-3-319-31413-6_8 · Cited by 12
“show that such a sample is more representative of the actual demographics than a sample recruited through traditional means [17].”
BackgroundStam, M., Kostense, P. J., Festen, J. Μ., & Kramer, S. E. (2013) · Work · doi:10.3233/wor-131747 · Cited by 42
Assessment of the Factorial Structures of the C-BARQ in Japan
Nagasawa, M., TSUJIMURA, A., Tateishi, K., Mogi, K., Ohta, M., Serpell, J. A., & Kikusui, T. (2011) · Journal of Veterinary Medical Science · doi:10.1292/jvms.10-0208 · Cited by 43
“Moreover, the differences in the environment in which subjects responded to questionnaires may influence the results [3, 7, 9].”
BackgroundCarleton, R. N., Abrams, M. P., & Asmundson, G. J. G. (2010) · Depression and Anxiety · doi:10.1002/da.20656 · Cited by 47
“Web-based data collection has been demonstrated to be a valid approach for questionnaire-based research in North America that is comparable to other data collection methods.([47]) There was no statistically significant difference between men and women on age, t(608) 5 0.”
ResultSteenhuis, M., Serra, M., Minderaa, R. B., & Hartman, C. A. (2009) · Psychological Assessment · doi:10.1037/a0015925 · Cited by 42
Sociosexuality, Commitment, and Sexual Desire for an Attractive Person
Rodrigues, D. L., & Lopes, D. (2016) · Archives of Sexual Behavior · doi:10.1007/s10508-016-0814-3 · Cited by 42
Do Therapists Google Their Patients? A Survey Among Psychotherapists
Eichenberg, C., & Herzberg, P. Y. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.4306 · Cited by 41
“(For a discussion of the scientifically proven quality of Web-based studies, see Gosling et al [9].)”
The Relationship Between Mindfulness and Forgiveness of Infidelity
Johns, K. N., Allen, E. S., & Gordon, K. C. (2015) · Mindfulness · doi:10.1007/s12671-015-0427-2 · Cited by 46
“Although internet surveys in general appear to yield consistent results to other survey methods (Gosling et al. 2004), there may be generalizability issues relevant to the particular sample recruited for this study, a group willing to share personal experiences with researchers.”
ResultMeta-Awareness During Day and Night
Stumbrys, T., Erlacher, D., & Malinowski, P. (2015) · Imagination Cognition and Personality · doi:10.1177/0276236615572594 · Cited by 47
“…have had some effect on the quality of the responses, although comparative analyses show that data gathered via Internet are at least comparable to data gathered via traditional methods, and do not appear to be particularly affected by false responses (Gosling, Vazire, Srivastava, & John, 2004).”
Emotional intelligence and occupational stress among professional staff in New Zealand
King, M. P., & Gardner, D. H. (2006) · International journal of organizational analysis · doi:10.1108/19348830610823392 · Cited by 44
“Internet samples are diverse with respect to age, gender, socioeconomic status and geographic region ( Gosling et al. , 2004”
BackgroundEight Years of the Great Influenza Survey to Monitor Influenza-Like Illness in Flanders
Vandendijck, Y., Faes, C., & Hens, N. (2013) · PLoS ONE · doi:10.1371/journal.pone.0064156 · Cited by 41
“To determine the validity of the GIS, it is important to investigate the representativeness of the recruited population [26].”
BackgroundStief, M. C., Rieger, G., & Savin‐Williams, R. C. (2014) · Personality and Individual Differences · doi:10.1016/j.paid.2014.03.035 · Cited by 41
Revictimization and Recovery From Sexual Assault: Implications for Health Professionals
Ranjbar, V., & Speer, S. A. (2013) · Violence and Victims · doi:10.1891/0886-6708.11-00144 · Cited by 41
Pedersen, E. R., Neighbors, C., Tidwell, J., & Lostutter, T. W. (2011) · Ethics & Behavior · doi:10.1080/10508422.2011.585601 · Cited by 41
“Benefits of online research are numerous and include ease and expanded time of access, reduced cost and paperwork burden, ability to recruit a large and representative sample through e-mail and survey link invitation, and perhaps more accurate data due to greater anonymity for stigmatizing attitudes and behaviors ( Go…”
BackgroundWhen Are Monetary Policy Preferences Egocentric? Evidence from American Surveys and an Experiment
Bearce, D. H., & Tuxhorn, K. (2015) · American Journal of Political Science · doi:10.1111/ajps.12203 · Cited by 39
The Relation of Social Support to Depression in Massively Multiplayer Online Role-Playing Games
Dupuis, E. C., & Ramsey, M. A. (2011) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.2011.00821.x · Cited by 41
Subjective acceleration of time experience in everyday life across adulthood.
John, D. T., & Lang, F. R. (2015) · Developmental Psychology · doi:10.1037/dev0000059 · Cited by 43
Kimhi, S., Eshel, Y., Leykin, D., & Lahad, M. (2017) · Journal of Loss and Trauma · doi:10.1080/15325024.2017.1391943 · Cited by 44
Embeddedness and the repatriation intention of assigned and self-initiated expatriates
Meuer, J., Tröster, C., Angstmann, M., Backes‐Gellner, U., & Pull, K. (2019) · European Management Journal · doi:10.1016/j.emj.2019.03.002 · Cited by 41
Miller, R. E., Schmidt, K., Kirschbaum, C., & Enge, S. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1036-5 · Cited by 41
Lin, X., & Loi, R. C. H. (2019) · Journal of Management · doi:10.1177/0149206319870236 · Cited by 41
Towards a Model of Contemporary Parenting: The Parenting Behaviours and Dimensions Questionnaire
Reid, C., Roberts, L. D., Roberts, C. M., & Piek, J. P. (2015) · PLoS ONE · doi:10.1371/journal.pone.0114179 · Cited by 47
“Internet data collection was used in the current study as a cost-effective means of obtaining a large and diverse sample of parents as participants without affecting the nature and quality of the results [67].”
MethodThe First Challenge on Generating Instructions in Virtual Environments
Koller, A., Striegnitz, K., Byron, D. K., Cassell, J., Dale, R., Moore, J. D., & Oberlander, J. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-15573-4_16 · Cited by 41
The effects of race and racial priming on self-report of contamination anxiety
Williams, M. T., Turkheimer, E. N., Magee, E., & Guterbock, T. M. (2007) · Personality and Individual Differences · doi:10.1016/j.paid.2007.10.009 · Cited by 41
The Induction of Mood via the WWW
Göritz, A. S. (2006) · Motivation and Emotion · doi:10.1007/s11031-006-9047-4 · Cited by 41
Asmundson, G. J. G., Carleton, R. N., Bovell, C. V., & Taylor, S. J. (2008) · Journal of Cognitive Psychotherapy · doi:10.1891/0889-8391.22.2.87 · Cited by 41
Personal values and relational models
Biber, P., Hupfeld, J., & Meier, L. L. (2008) · European Journal of Personality · doi:10.1002/per.693 · Cited by 41
Nye, C. D., Allemand, M., Gosling, S. D., Potter, J., & Roberts, B. W. (2015) · Journal of Personality · doi:10.1111/jopy.12173 · Cited by 42
“Analyses based on this data set have shown that, compared to conventional samples, Internet samples are more diverse with respect to gender, socioeconomic status, geographic region, and age (Gosling et al., 2004).”
BackgroundSelf-citationManifestations of Individual Differences in Physical and Virtual Environments
Graham, L. T., Sandy, C. J., & Gosling, S. D. (2011) · Wiley eBooks · doi:10.1002/9781444343120.ch30 · Cited by 41
Self-citationA streamlined approach to online linguistic surveys
Erlewine, M. Y., & Kotek, H. (2015) · Natural Language & Linguistic Theory · doi:10.1007/s11049-015-9305-9 · Cited by 40
“…category learning tasks, classical experimental tasks drawn from the heuristics and biases literature, psychometric data, and even clinical findings (Gosling et al. 2004; Ipeirotis 2010; Ipeirotis et al. 2010; Paolacci et al. 2010; Buhrmester et al. 2011; Horton et al. 2011; Mason and Suri 2012;…”
MethodArab American Mental Health in the Post September 11 Era: Acculturation, Stress, and Coping
Amer, M. M. (2005) · OhioLink ETD Center (Ohio Library and Information Network) · Cited by 39
Mereish, E. H., & Poteat, V. P. (2014) · Journal of Applied Social Psychology · doi:10.1111/jasp.12284 · Cited by 40
Lara, D. R., Ottoni, G. L., Brunstein, M. G., Frozi, J., de Carvalho, H. W., & Bisol, L. W. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.03.011 · Cited by 40
Perceptions of stewardship in Norwegian agricultural landscapes
Sang, Å. O., & Tveit, M. S. (2012) · Land Use Policy · doi:10.1016/j.landusepol.2012.09.001 · Cited by 40
Triberti, S., Villani, D., & Riva, G. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.03.069 · Cited by 40
Przeworski, A., Cain, N. M., & Dunbeck, K. (2013) · Journal of Obsessive-Compulsive and Related Disorders · doi:10.1016/j.jocrd.2013.12.002 · Cited by 40
Binning, K. R. (2007) · Political Psychology · doi:10.1111/j.1467-9221.2007.00603.x · Cited by 40
“A variety of other studies on online samples’ generalizability suggest similar findings (see Gosling et al., 2004, for a review).”
BackgroundResultNational narcissism: Internal dimensions and international correlates
Cai, H., & Gries, P. (2013) · PsyCh Journal · doi:10.1002/pchj.26 · Cited by 52
Metadata
- Authors
- Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P.
- Affiliations
- The University of Texas at Austin (US)
- Stanford University (US)
- University of California, Berkeley (US)
- Venue
- American Psychologist
- Published
- 2004
- Volume
- 59
- Issue
- 2
- Pages
- 93-104
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W1992490637
- Cited by
- 2,932
- References
- 72
- Citations by year
- 2026: 40 · 2025: 64 · 2024: 72 · 2023: 85 · 2022: 123 · 2021: 135 · 2020: 157 · 2019: 163 · 2018: 148 · 2017: 170 · 2016: 181 · 2015: 192 · 2014: 218 · 2013: 184 · 2012: 189
- FWCI
- 261.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Keywords
- online data collection, paper-and-pencil questionnaires, sample representativeness, data quality, response format effects, generalizability, self-report questionnaire
- MeSH terms
- Adult, Aged, Attitude, Female, Humans, Male, Middle Aged, Psychology, Surveys and Questionnaires, Evidence-Based Medicine, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review