The DOI matches its Crossref record; 68 of the 72 references it cites were found in a registry or an index.
Should We Trust Web-Based Studies? A Comparative Analysis of Six Preconceptions About Internet Questionnaires.
Abstract
The rapid growth of the Internet provides a wealth of new research opportunities for psychologists. Internet data collection methods, with a focus on self-report questionnaires from self-selected samples, are evaluated and compared with traditional paper-and-pencil methods. Six preconceptions about Internet samples and data quality are evaluated by comparing a new large Internet sample (N = 361,703) with a set of 510 published traditional samples. Internet samples are shown to be relatively diverse with respect to gender, socioeconomic status, geographic region, and age. Moreover, Internet findings generalize across presentation formats, are not adversely affected by nonserious or repeat responders, and are consistent with findings from traditional methods. It is concluded that Internet methods can contribute to many areas of psychology.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The proportion of females (62%) to males in this study was more representative than in traditional survey methods, where women often comprise 71% to 77% of the participants [39]”
From Effects of Mock Facebook Workday Comments on Public Perception of Professional Credibility: A Field Study in Canada (2019) · cites this paper as [39]
In the citing paper
“Self-presentation is an unlikely confound in Study 1 because the motivation to self-present is absent when participants feel anonymous (Paulhus, 1984(Paulhus, , 1991) ) as they do in anonymous online studies such as the present one, where they don't provide identifying information (Gosling et al., 2004).”
From Cultural norm fulfillment, interpersonal belonging, or getting ahead? A large-scale cross-cultural test of three perspectives on the function of self-esteem. (2015) · cites this paper as Gosling et al., 2004
In the citing paper
“As described in the Appendix, the reliability and validity of internet data collection has become increasingly clear in recent years.”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“The validity of internet testing has been well supported in recent reviews (Gosling et al., 2004), with excellent correspondence between results obtained with internet samples are results obtained in the laboratory (e.g., Birnbaum, 1999;Krantz & Dalal, 2000;McGraw, Tew, & Williams, 2000;Reips, 2002).”
From Spacing Effects in Learning: A Temporal Ridgeline of Optimal Retention (2008) · cites this paper as Gosling et al., 2004
In the citing paper
“Furthermore, previous research has suggested populations for online studies and Facebook are quite representative [23], [24].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [23]
In the citing paper
“Still, the sample sizes and availability of demographic information afforded by social media bring us closer to a more ideal representative sample [99].”
From Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach (2013) · cites this paper as [99]
Citations
Cites
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587
(1999) · Cited by 7,995
Self-citationInternet paradox: A social technology that reduces social involvement and psychological well-being?
Kraut, R., Patterson, M., Lundmark, V., Kiesler, S., Mukophadhyay, T., & Scherlis, W. (1998) · American Psychologist · doi:10.1037/0003-066x.53.9.1017 · Cited by 4,793
Handbook of Personality : Theory and Research
Pervin, L. A. (1992) · Cited by 4,543
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Mail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070237 · Cited by 3,463
Gender differences in personality traits across cultures: Robust and surprising findings.
Costa, P. T., Terracciano, A., & McCrae, R. R. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.2.322 · Cited by 2,986
Kraut, R. E., Kiesler, S. B., Boneva, B. S., Cummings, J. N., Helgeson, V. S., & Crawford, A. M. (2002) · Journal of Social Issues · doi:10.1111/1540-4560.00248 · Cited by 2,367
Gender differences in personality: A meta-analysis.
Feingold, A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.3.429 · Cited by 2,240
Handbook of Personality Theory and Research.
Schwartz, M. L., Borgatta, E. F., & Lambert, W. W. (1970) · American Sociological Review · doi:10.2307/2093310 · Cited by 2,182
Research works printed but not linked: 7
- Azar, 2000, A web of research: They're fun, they're fast, and they save money, but do Web experiments yield quality results?, Monitor on Psychology, 31, 42
- 10.1037/0022-3514.75.3.729 · DOI · Paper page
- Dillman. 1998 · DOI
- Locke, 1995, Method of psychological assessment, self-disclosure, and experiential differences: A study of computer, questionnaire, and interview assessment formats., Journal of Social Behavior and Personality, 10, 255
- 2000, Digest of education statistics 2000.
- Skitka, (in press). Social psychological research and me Internet: The promise and the perils of a new methodological frontier.
- 2000, Population, 1
Cited by
Sorted by citations
Items 801–900 of 1,012
Entrepreneurial Orientation: Its Relationship with the Entrepreneur’s Subjective Success in SMEs
García, G. M., & Calvo, J. C. A. (2020) · Sustainability · doi:10.3390/su12114547 · Cited by 65
“Past research has shown that online questionnaires are as valid and reliable as traditional paper-and pencil questionnaires [62,63].”
BackgroundBarrios, I., Ríos-González, C. M., O’Higgins, M. G., González, I., García, Ó., Almirón‐Santacruz, J., Navarro, R. E., Melgarejo, O. J., Diáz, N. R., Castaldelli-Maia, J. M., et al. (2021) · Irish Journal of Psychological Medicine · doi:10.1017/ipm.2021.5 · Cited by 53
“The Internet-based survey approach was used taking into account that there is supporting evidence that responses to online surveys may provide similar findings to those reported through “in person” samples (Gosling et al. 2004).”
MethodQuaquebeke, N. V., Salem, M., van Dijke, M., & Wenzel, R. (2022) · Organizational Psychology Review · doi:10.1177/20413866221097571 · Cited by 75
“…employees with relatively little cost and effort (Buhrmester et al., 2011; Callegaro et al., 2014; Porter et al., 2019), thereby signi fi - cantly increasing their studies ’ statistical power (Brock et al., 2012; Casler et al., 2013; Gosling et al., 2004; Gosling & Mason, 2015; Luce et al., 2007).”
The perception of artificial-intelligence (AI) based synthesized speech in younger and older adults
Herrmann, B. (2023) · International Journal of Speech Technology · doi:10.1007/s10772-023-10027-y · Cited by 53
“, based on low performance), online research has generally been shown to lead to similar results as those from studies conducted in-person in the laboratory (Agley et al., 2022; Berinsky et al., 2014; Buchanan & Scofield, 2018; Chmielewski & Kucker, 2020; Gosling et al., 2004; Thomas & Clifford, 2017).”
ResultEvaluating a Minor Storyline onERAbout Teen Obesity, Hypertension, and 5 A Day
Valente, T. W., Murphy, S. T., Huang, G. C., Gusek, J., Greene, J., & Beck, V. (2007) · Journal of Health Communication · doi:10.1080/10810730701508385 · Cited by 53
“Our multimodal approach of three samples (two on-line, one mail) further confirm that on-line data collection findings, when nationally representative samples are not required, largely can be consistent with findings from traditional mail surveys (Gosling, Vazire, Srivastava, & John, 2004 ).”
ResultEmployee Surveys Administered Online
Thompson, L. F., & Surface, E. A. (2007) · Organizational Research Methods · doi:10.1177/1094428106/294696 · Cited by 53
van Gastel, W. A., MacCabe, J. H., Schubart, C. D., Vreeker, A., Tempelaar, W. M., Kahn, R. S., & Boks, M. P. (2013) · Psychological Medicine · doi:10.1017/s0033291713000202 · Cited by 53
“Although recent studies have shown that the internet is a suitable instrument for scientific research (Meyerson & Tryon, 2003; Gosling et al. 2004; Balter et al. 2005; Ekman et al. 2006; M. Vleeschouwer et al., unpublished observations) and potential bias is unlikely to be systematic, we cannot…”
BackgroundWorker word of mouth on the internet
González, S. M., & Bulchand‐Gidumal, J. (2016) · International Journal of Manpower · doi:10.1108/ijm-09-2014-0188 · Cited by 53
Velez, B. L., Cox, R., Polihronakis, C. J., & Moradi, B. (2018) · Journal of Counseling Psychology · doi:10.1037/cou0000274 · Cited by 68
Thorsteinsson, E., Brown, R. F., & Owens, M. T. (2019) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000000973 · Cited by 55
Predictors of gender-related barriers, work, and life satisfaction among men in nursing.
Rochlen, A. B., Good, G. E., & Carver, T. (2009) · Psychology of Men & Masculinity · doi:10.1037/a0013291 · Cited by 52
“However, conclusions about gender ideology based on use of the Bem Sex Role Inventory and the Personality Attributes Questionnaire have been widely challenged, with earlier findings generally being reinterpreted as indicating the degree to which individuals report possessing the socially desirable personality traits o…”
MethodAge Stereotypes about Emotional Resilience at Work
Rauschenbach, C., Göritz, A. S., & Hertel, G. (2012) · Educational Gerontology · doi:10.1080/03601277.2011.567187 · Cited by 57
“Web-based studies are a suitable way of gaining large samples that are more similar to the general population than samples typically gained in a university setting (eg, Gosling,Vazire, Srivastava, & John, 2004 ).”
BackgroundDewaele, J. (2015) · Journal of Pragmatics · doi:10.1016/j.pragma.2015.06.014 · Cited by 52
Sudbrack, R., Manfro, P. H., Kuhn, I. M., de Carvalho, H. W., & Lara, D. R. (2015) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2015.01.001 · Cited by 52
“methodologies even when both methods are applied anonymously (Gosling et al., 2004; Turner et al., 1998; Couper, 2000).”
MethodCognitive distortions as a problem gambling risk factor in Internet gambling
MacKay, T.-L., & Hodgins, D. C. (2012) · International Gambling Studies · doi:10.1080/14459795.2011.648652 · Cited by 57
Churchill, S., Jessop, D. C., & SPARKS, P. B. (2008) · British Journal of Social Psychology · doi:10.1348/014466608x284434 · Cited by 53
Treatment Utilization by Gender in Patients With Borderline Personality Disorder
Goodman, M. S., Patil, U., Steffel, L., Avedon, J., Sasso, S., Triebwasser, J., & Stanley, B. (2010) · Journal of Psychiatric Practice · doi:10.1097/01.pra.0000375711.47337.27 · Cited by 52
Impact of behavioral genetic evidence on the adjudication of criminal behavior.
Appelbaum, P. S., & Scurich, N. (2014) · PubMed · Cited by 52
Internet use and verbal aggression: The moderating role of parents and peers
Appel, M., Stiglbauer, B., Batinic, B., & Holtz, P. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.01.007 · Cited by 55
Asking scientists: A decade of questions analyzed by age, gender, and country
Baram-Tsabari, A., Sethi, R. J., Bry, L., & Yarden, A. (2009) · Science Education · doi:10.1002/sce.20284 · Cited by 61
Park, S. H., Lee, P. J., Yang, K.-S., & Kim, K. (2016) · The Journal of the Acoustical Society of America · doi:10.1121/1.4944034 · Cited by 52
Disentangling stereotypes from social reality: Astrological stereotypes and discrimination in China.
Lu, J. G., Liu, X. L., Liao, H., & Wang, L. (2020) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000237 · Cited by 58
Psychological resilience and the well-being of widowed women
O’Rourke, N. (2004) · Ageing International · doi:10.1007/s12126-996-1002-x · Cited by 52
“Of particular relevance to the current study, web-based study participants do not appear to differ from self-selected participants recruited by more traditional means with respect to well-being constructs (Gosling et al., 2004).”
BackgroundBailer, J., Witthöft, M., & Rist, F. (2006) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2005.11.005 · Cited by 52
“Although online versions of paper–pencil measures have been demonstrated to retain their psychometric properties [21], the protocol validity (i.”
BackgroundPersonality in cross-cultural perspective
Dragūns, J. G. (2012) · Cambridge University Press eBooks · doi:10.1017/cbo9780511596544.035 · Cited by 51
Park, I., Cho, J., & Rao, H. (2015) · Decision Sciences · doi:10.1111/deci.12176 · Cited by 53
Community Resilience of Civilians at War: A New Perspective
Eshel, Y., & Kimhi, S. (2015) · Community Mental Health Journal · doi:10.1007/s10597-015-9948-3 · Cited by 64
“…questionnaires based on paper and pencil methods, with internet sampling methods, concludes that internet-based findings are consistent with findings based on traditional methods, and that internet responders do not differ from nonusers on markers of adjustment and depression (Gosling et al. 2004).”
ResultLever, J., Grov, C., Royce, T., & Gillespie, B. J. (2008) · International Journal of Sexual Health · doi:10.1080/19317610802411532 · Cited by 51
“People with higher socioeconomic status tend to be somewhat overrepresented in Internet research, although recent Internet surveys tend to include participants from a broad range of backgrounds and geographic locations ( Gosling, Vazire, Srivastava, & John, 2004 ).”
BackgroundPositive and Negative Affect Schedule: Psychometric Properties for the Brazilian Portuguese Version
Pires, P. P., Filgueiras, A., Ribas, R. D. C., & Santana, C. M. T. (2013) · The Spanish Journal of Psychology · doi:10.1017/sjp.2013.60 · Cited by 51
“Gosling et al. (2004) informed that a total sample of 361,793 participants, obtained through 510 publications, showed that it was possible to obtain a good diversified sample considering gender, economic status, geographic region and age through the internet.”
BackgroundSolomon, D. T., McAbee, J., Asberg, K. K., & McGee, A. (2015) · Journal of Homosexuality · doi:10.1080/00918369.2015.1073032 · Cited by 60
Torres‐Marín, J., Navarro‐Carrillo, G., & Carretero‐Dios, H. (2017) · Personality and Individual Differences · doi:10.1016/j.paid.2017.08.040 · Cited by 51
Improving nature experience in cities: What are people's preferences for vegetated streets?
Bonthoux, S., Chollet, S., Balat-Restivo, I., Legay, N., & Voisin, L. (2018) · Journal of Environmental Management · doi:10.1016/j.jenvman.2018.09.056 · Cited by 57
Using CrowdFlower to Study the Relationship between Self-reported Violations and Traffic Accidents
de Winter, J., Kyriakidis, M., Dodou, D., & Happee, R. (2015) · Procedia Manufacturing · doi:10.1016/j.promfg.2015.07.514 · Cited by 51
Causal and predictive-value judgments, but not predictions, are based on cue-outcome contingency
Vadillo, M. A., Miller, R. R., & Matute, H. (2005) · Learning & Behavior · doi:10.3758/bf03196061 · Cited by 51
Anusic, I., Lucas, R. E., & Donnellan, M. B. (2011) · Journal of Research in Personality · doi:10.1016/j.jrp.2011.11.002 · Cited by 50
Appel, M., Holtz, P., Stiglbauer, B., & Batinic, B. (2012) · Journal of Adolescence · doi:10.1016/j.adolescence.2012.08.003 · Cited by 50
Prevalence and correlates of sleep paralysis in adults reporting childhood sexual abuse
Abrams, M. P., Mulligan, A. D., Carleton, R. N., & Asmundson, G. J. G. (2008) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2008.03.007 · Cited by 55
Validation of the Beneficial and Harmful Work-Related Social Media Behavioral Taxonomies
Landers, R. N., & Callan, R. C. (2014) · Social Science Computer Review · doi:10.1177/0894439314524891 · Cited by 50
Who Pays for Dates? Following Versus Challenging Gender Norms
Lever, J., Frederick, D. A., & Hertz, R. (2015) · SAGE Open · doi:10.1177/2158244015613107 · Cited by 55
Evidence of rapid changes in Lyme disease awareness in Canada
Aenishaenslin, C., Bouchard, C., Koffi, J. K., Pelcat, Y., & Ogden, N. H. (2016) · Ticks and Tick-borne Diseases · doi:10.1016/j.ttbdis.2016.09.007 · Cited by 50
Web-Based Alcohol Intervention: Study of Systematic Attrition of Heavy Drinkers
Radtke, T., Ostergaard, M., Cooke, R. W. I., & Scholz, U. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6780 · Cited by 50
“However, previous studies also reported that individuals with higher education and higher socioeconomic status are more likely to take part in psychological surveys and interventions (eg, [56,57]).”
BackgroundReineman, D. R., & Ardoin, N. M. (2017) · Journal of Sustainable Tourism · doi:10.1080/09669582.2017.1352590 · Cited by 50
“…and the following responses were removed from the initial sample: 39 duplicate responses, 44 responses from minors (under the age of 18), 216 incomplete responses, 344 nonserious responses (after Gosling et al., 2004), and 1542 responses that did not indicate surf-spots located in California.”
BackgroundXiao, L., Mi, C., Zhang, Y. E., & Ma, J. (2017) · Information Systems Frontiers · doi:10.1007/s10796-017-9815-6 · Cited by 52
“The random sampling method based on the web survey method greatly increases the generalizability of research findings (Gosling et al. 2004).”
MethodLyons, M. T., Evans, K., & Helle, S. (2019) · SAGE Open · doi:10.1177/2158244018822383 · Cited by 58
The EmojiGrid as a Tool to Assess Experienced and Perceived Emotions
Toet, A., & van Erp, J. B. F. (2019) · Psych · doi:10.3390/psych1010036 · Cited by 51
Schwaba, T., Bleidorn, W., Hopwood, C. J., Gebauer, J. E., Rentfrow, P. J., Potter, J., & Gosling, S. D. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2020104118 · Cited by 48
“Previous research has demonstrated that US GPIPP participants are broadly representative of the racial composition of the US general population: 71.7% identified as White/Caucasian whereas 9.4% identified as Black and 2.9, 8.2, 1.1, and 5.0% identified as Asian, Hispanic, Mixed, or Other (32, 33).”
BackgroundInfluentialSelf-citationSamson, A. C., Huber, O., & Ruch, W. (2013) · Humor · doi:10.1515/humor-2013-0026 · Cited by 49
“However, online studies have been shown to produce valid and trustworthy data (e.g., Gosling et al. 2004) and good results were obtained in previous data collections with autism (e.g., Samson and Hegenloh 2010).”
ResultDepressive Realism: Wiser or Quieter?
Blanco, F., Matute, H., & Vadillo, M. A. (2009) · The Psychological Record · doi:10.1007/bf03395681 · Cited by 50
O’Reilly, E., McNeill, K. G., Mavor, K. I., & Anderson, K. (2014) · Teaching and Learning in Medicine · doi:10.1080/10401334.2013.857330 · Cited by 49
Festekjian, A., Tram, S., Murray, C. B., Sy, T., & Huynh, H. P. (2013) · Journal of Leadership & Organizational Studies · doi:10.1177/1548051813486522 · Cited by 49
Political Orientation, Party Affiliation, and American Attitudes Towards China
GRIES, P. H., & Crowson, H. M. (2010) · Journal of Chinese Political Science · doi:10.1007/s11366-010-9115-1 · Cited by 49
van Eeden‐Moorefield, B., Proulx, C. M., & Pasley, K. (2008) · Journal of GLBT Family Studies · doi:10.1080/15504280802096856 · Cited by 49
“…of the Internet for research such as obtaining informed consent without a person present (Birnbaum, 2004), increased possibility of multiple responses from a single individual (Gosling et al., 2004), and participants with malicious intents (Kraunt, Olson, Banaji, Bruckman, Cohen, & Couper, 2004).”
BackgroundMethodInfluentialPolish validation of the Internet Addiction Test
Hawi, N. S., Błachnio, A., & Przepiórka, A. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.01.058 · Cited by 49
Russell, T. D., Doan, C. M., & King, A. R. (2017) · Personality and Individual Differences · doi:10.1016/j.paid.2017.02.019 · Cited by 49
Su, B., Koda, N., & Martens, P. (2018) · PLoS ONE · doi:10.1371/journal.pone.0190781 · Cited by 54
Kim, E., & Park, H. (2018) · Women s Studies International Forum · doi:10.1016/j.wsif.2018.06.006 · Cited by 49
Biolcati, R., & Passini, S. (2019) · Addictive Behaviors Reports · doi:10.1016/j.abrep.2019.100199 · Cited by 59
Secret Romantic Relationships: Consequences for Personal and Relational Well-Being
Lehmiller, J. J. (2009) · Personality and Social Psychology Bulletin · doi:10.1177/0146167209342594 · Cited by 51
Irrational health beliefs and health anxiety
Fulton, J. J., Marcus, D. K., & Merkey, T. (2011) · Journal of Clinical Psychology · doi:10.1002/jclp.20769 · Cited by 48
Claréus, B., & Renström, E. A. (2019) · Scandinavian Journal of Psychology · doi:10.1111/sjop.12545 · Cited by 50
Xu, W., Zhang, H., Sukjairungwattana, P., & Wang, T. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.962492 · Cited by 67
“These lengthy tasks, as well as the online data collection method, may result in some loss of accuracy (Gosling et al., 2004; Chetverikov and Upravitelev, 2016).”
BackgroundJiménez, M. L. V., & Chacón, F. (2013) · Journal of Applied Social Psychology · doi:10.1111/jasp.12012 · Cited by 48
Cantarelli, P., Debin, M., Turbelin, C., Poletto, C., Blanchon, T., Falchi, A., Hanslik, T., Bonmarin, I., Lévy-Bruhl, D., Micheletti, A., et al. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-984 · Cited by 47
Family transmission of work affectivity and experiences to children
Porfeli, E. J., Wang, C., & Hartung, P. J. (2008) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2008.06.001 · Cited by 52
“This possibility prompts examining if and how adults actively and/or passively transmit work information to children and if these messages influence children’s desire to learn about and engage in adult work ( Goldstein & Oldham, 1979 ).”
BackgroundInfluentialThe Message Design Logics of Responses to HIV Disclosures
Caughlin, J. P., Brashers, D. E., Ramey, M. E., Kosenko, K. A., Donovan-Kicken, E., & Bute, J. J. (2008) · Human Communication Research · doi:10.1111/j.1468-2958.2008.00336.x · Cited by 48
Birnie‐Porter, C., & Hunt, M. (2015) · The Canadian Journal of Human Sexuality · doi:10.3138/cjhs.242-a5 · Cited by 48
Shame in Physician–Patient Interactions: Patient Perspectives
Harris, C. R., & Darby, R. S. (2009) · Basic and Applied Social Psychology · doi:10.1080/01973530903316922 · Cited by 52
Correlates and Moderators of Child Pornography Consumption in a Community Sample
Ray, J. V., Kimonis, E. R., & Seto, M. C. (2013) · Sexual Abuse · doi:10.1177/1079063213502678 · Cited by 48
Briones, E. M., & Benham, G. (2017) · Behavior Research Methods · doi:10.3758/s13428-016-0710-8 · Cited by 48
Gorday, J. Y., Rogers, M. L., & Joiner, T. E. (2018) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2018.10.004 · Cited by 50
Lindeman, M., van Elk, M., Lipsanen, J. O., Marin, P., & Schjoedt, U. (2019) · International Journal for the Psychology of Religion · doi:10.1080/10508619.2019.1591140 · Cited by 50
Dissociation as a multidimensional transdiagnostic symptom.
Ellickson‐Larew, S., Stasik-O’Brien, S. M., Stanton, K. J., & Watson, D. (2020) · Psychology of Consciousness Theory Research and Practice · doi:10.1037/cns0000218 · Cited by 49
Perceived Sexist Events and Psychological Distress of Sexual Minority Women of Color
DeBlaere, C., & Bertsch, K. N. (2013) · Psychology of Women Quarterly · doi:10.1177/0361684312470436 · Cited by 51
Anti-bisexual discrimination as insidious trauma and impacts on mental and physical health.
Arnett, J. E., Frantell, K. A., Miles, J. R., & Fry, K. M. (2019) · Psychology of Sexual Orientation and Gender Diversity · doi:10.1037/sgd0000344 · Cited by 47
Pearce, J., & Langley‐Evans, S. C. (2021) · Journal of Human Nutrition and Dietetics · doi:10.1111/jhn.12947 · Cited by 47
Mock jurors' perceptions of identifications made by intoxicated eyewitnesses
Evans, J. R., & Compo, N. S. (2010) · Psychology Crime and Law · doi:10.1080/10683160802612890 · Cited by 46
“Research has shown that web-based studies find results similar to studies involving participants who come to the laboratory to complete their participation (Gosling, Vazire, Srivastava, & John, 2004 ; McGraw, Tew, & Williams, 2000 ; O'Neil, 2002 ; O'Neil & Penrod, 2002 ; Smith & Leigh, 1997 ).”
ResultPerceiving Risk in a Dangerous World: Associations between Life Experiences and Risk Perceptions
Blum, S., Silver, R. C., & Poulin, M. J. (2014) · Social Cognition · doi:10.1521/soco.2014.32.3.297 · Cited by 51
Measuring Relationship Quality in an International Study
Chonody, J. M., Gabb, J., Killian, M., & Dunk-West, P. (2016) · Research on social work practice · doi:10.1177/1049731516631120 · Cited by 45
On the comprehensibility and perceived privacy protection of indirect questioning techniques
Hoffmann, A., de Puiseau, B. W., Schmidt, A. F., & Musch, J. (2016) · Behavior Research Methods · doi:10.3758/s13428-016-0804-3 · Cited by 47
Perceived supervisor remorse, abusive supervision, and LMX
Haggard, D. L., & Park, H. M. (2018) · Journal of Organizational Behavior · doi:10.1002/job.2285 · Cited by 52
Response invalidity in empirical research: Causes, detection, and remedies
Edwards, J. R. (2019) · Journal of Operations Management · doi:10.1016/j.jom.2018.12.002 · Cited by 50
Fakunmoju, S. B., Abrefa‐Gyan, T., Maphosa, N., & Gutura, P. (2020) · Sexuality & Culture · doi:10.1007/s12119-020-09755-z · Cited by 47
Churchill, S., & Jessop, D. C. (2009) · British Journal of Health Psychology · doi:10.1348/135910709x475423 · Cited by 53
Goin-Kochel, R. P., Abbacchi, A., Constantino, J. N., & Autism Genetic Resource Exchange Consortium (2007) · Autism · doi:10.1177/1362361307076857 · Cited by 47
Benefits from Using Continuous Rating Scales in Online Survey Research.Preprint
Treiblmaier, H., & Peter Filzmoser, A. (2011) · SSRN Electronic Journal · doi:10.13140/rg.2.1.2899.6643 · Cited by 47
Towards an integrative framework of brand country of origin recognition determinants
Martín, Ó. M., & Cerviño, J. (2011) · International Marketing Review · doi:10.1108/02651331111181402 · Cited by 46
“Further, despite the potential self-selection biases typically associated with web-based questionnaires, these have been found to be quite similar to those encountered in traditional questionnaires (Gosling et al., 2004)[3].”
MethodResultHartje, J. A., Evans, W. P., Killian, E. S., & Brown, R. (2007) · Child & Youth Care Forum · doi:10.1007/s10566-007-9048-9 · Cited by 46
“... features of youth programs associated with positive developmental outcomes reveal that program environments most effective in promoting personal and social assets in youth provide physical and psychological safety; appropriate structure; supportive relationships; opportunities to belong; positive social norms; sup…”
BackgroundMethodInfluentialWomen’s weekly relationship functioning and depressive symptoms
Whitton, S. W., Stanley, S. M., Markman, H. J., & Baucom, B. (2008) · Personal Relationships · doi:10.1111/j.1475-6811.2008.00214.x · Cited by 46
Dunn, M., Mazanov, J., & Sitharthan, G. (2009) · Clinical Journal of Sport Medicine · doi:10.1097/jsm.0b013e31819d65ad · Cited by 46
Perspectives on the home advantage: A comparison of football players, fans and referees
Anderson, M. N., Wolfson, S., Neave, N., & Moss, M. C. (2011) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2011.11.012 · Cited by 46
Macholdt, J., & Honermeier, B. (2016) · Agronomy · doi:10.3390/agronomy6030040 · Cited by 46
“Furthermore, high dropout rates, non-reliable statements, and multiple entries represent a potential source of errors in online surveys [43].”
BackgroundThe emergence of recursion in human language: Mentalising predicts recursive syntax task performance
Oesch, N., & Dunbar, R. (2016) · Journal of Neurolinguistics · doi:10.1016/j.jneuroling.2016.09.008 · Cited by 49
Alam, S. S., Elwyn, G. J., Percac‐Lima, S., Grande, S. W., & Durand, M. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0384-2 · Cited by 46
“In any given Internet community, some individuals are more likely than others to complete a webbased survey [27, 28].”
BackgroundGrandparents’ Experience of Autism Spectrum Disorder: Identifying Primary Themes and Needs
Hillman, J., Wentzel, M. C., & Anderson, C. M. (2017) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-017-3211-4 · Cited by 46
A thousand studies for the price of one: Accelerating psychological science with Pushkin
Hartshorne, J. K., de Leeuw, J. R., Goodman, N. D., Jennings, M. V., & O’Donnell, T. J. (2019) · Behavior Research Methods · doi:10.3758/s13428-018-1155-z · Cited by 44
Gisch, U. A., & Warschburger, P. (2019) · Eating Behaviors · doi:10.1016/j.eatbeh.2019.02.004 · Cited by 54
Examining broad intellectual abilities obtained within an mTurk internet sample
Merz, Z. C., Lace, J. W., & Eisenstein, A. M. (2020) · Current Psychology · doi:10.1007/s12144-020-00741-0 · Cited by 52
Age trends in musical preferences in adulthood: 1. Conceptualization and empirical investigation
Bonneville‐Roussy, A., Stillwell, D. J., Kosiński, M., & Rust, J. N. (2017) · Musicae Scientiae · doi:10.1177/1029864917691571 · Cited by 46
Attachment and Parental Divorce
Fraley, R. C., & Heffernan, M. E. (2013) · Personality and Social Psychology Bulletin · doi:10.1177/0146167213491503 · Cited by 55
Relation of interest and self-efficacy occupational congruence and career choice certainty
Tracey, T. J. G. (2009) · Journal of Vocational Behavior · doi:10.1016/j.jvb.2009.10.013 · Cited by 46
Metadata
- Authors
- Gosling, S. D., Vazire, S., Srivastava, S., & John, O. P.
- Affiliations
- The University of Texas at Austin (US)
- Stanford University (US)
- University of California, Berkeley (US)
- Venue
- American Psychologist
- Published
- 2004
- Volume
- 59
- Issue
- 2
- Pages
- 93-104
- ISSN
- 0003-066X (ISSN-L)
- 1935-990X
- OpenAlex
- W1992490637
- Cited by
- 2,932
- References
- 72
- Citations by year
- 2026: 40 · 2025: 64 · 2024: 72 · 2023: 85 · 2022: 123 · 2021: 135 · 2020: 157 · 2019: 163 · 2018: 148 · 2017: 170 · 2016: 181 · 2015: 192 · 2014: 218 · 2013: 184 · 2012: 189
- FWCI
- 261.73
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Psychologist (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Sociology and Political Science › Focus Groups and Qualitative Methods
- Keywords
- online data collection, paper-and-pencil questionnaires, sample representativeness, data quality, response format effects, generalizability, self-report questionnaire
- MeSH terms
- Adult, Aged, Attitude, Female, Humans, Male, Middle Aged, Psychology, Surveys and Questionnaires, Evidence-Based Medicine, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
