Seriousness checks are useful to improve data validity in online research
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,737
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Kemp, F. (2003) · Journal of the Royal Statistical Society: Series D (The Statistician) · doi:10.1046/j.1467-9884.2003.t01-2-00383_4.x · Cited by 9,293
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Instructional manipulation checks: Detecting satisficing to increase statistical power
Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.03.009 · Cited by 3,493
Methods for dealing with reaction time outliers.
Ratcliff, R. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.3.510 · Cited by 2,123
Couper, M. P. (2000) · Public Opinion Quarterly · doi:10.1086/318641 · Cited by 2,078
Turner, C. F., Ku, L., Rogers, S. M., Lindberg, L. D., Pleck, J. H., & Sonenstein, F. L. (1998) · Science · doi:10.1126/science.280.5365.867 · Cited by 2,046
Wiltermuth, S. S., & Heath, C. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2008.02253.x · Cited by 1,717
Boneau, C. A. (2010) · The Corsini Encyclopedia of Psychology · doi:10.1002/9780470479216.corpsy0730 · Cited by 1,277
Social desirability, anonymity, and internet-based questionnaires
Joinson, A. (1999) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200723 · Cited by 812
Advantages and Disadvantages of Internet Research Surveys: Evidence from the Literature
Fricker, R. D., & Schonlau, M. (2002) · Field Methods · doi:10.1177/152582202237725 · Cited by 739
Standards for Internet-Based Experimenting
Reips, U. (2002) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1026/1618-3169.49.4.243 · Cited by 642
World-Wide Web survey research: Benefits, potential problems, and solutions
Schmidt, W. C. (1997) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204826 · Cited by 620
Standards for Internet-Based Experimenting
Reips, U.-D. (2002) · Experimental Psychology · doi:10.1026//1618-3169.49.4.243 · Cited by 554
Reips, U.-D. (2000) · Psychological Experiments on the Internet · doi:10.1016/b978-012099980-4/50005-8 · Cited by 460
Simmons, J., Nelson, L., & Simonsohn, U. (2011) · PsycEXTRA Dataset · doi:10.1037/e519702015-014 · Cited by 454
Validity of Web-Based Psychological Research
Krantz, J. H., & Dalal, R. (2000) · Psychological Experiments on the Internet · doi:10.1016/b978-012099980-4/50003-4 · Cited by 422
Completion Time and Response Order Effects in Web Surveys
Malhotra, N. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn050 · Cited by 332
On belief bias in syllogistic reasoning.
Klauer, K. C., Musch, J., & Naumer, B. (2000) · Psychological Review · doi:10.1037//0033-295x.107.4.852 · Cited by 283
Self-citationWeb-based administration of a personality questionnaire: Comparison with traditional methods
Davis, R. N. (1999) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200737 · Cited by 223
Timing accuracy of Web experiments: A case study using the WebExp software package
Keller, F., Gunasekharan, S., Mayo, N., & Corley, M. M. B. (2009) · Behavior Research Methods · doi:10.3758/brm.41.1.12 · Cited by 147
King, W. C., & Miles, E. W. (1995) · Journal of Applied Psychology · doi:10.1037//0021-9010.80.6.643 · Cited by 116
Lahl, O., Göritz, A. S., Pietrowsky, R., & Rosenberg, J. (2009) · Behavior Research Methods · doi:10.3758/brm.41.1.13 · Cited by 103
WEXTOR: A Web-based tool for generating and visualizing experimental designs and procedures
Reips, U., & Neuhaus, C. (2002) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195449 · Cited by 101
The Power of Rasch Person-Fit Statistics in Detecting Unusual Response Patterns
Li, M. F., & Olejnik, S. F. (1997) · Applied Psychological Measurement · doi:10.1177/01466216970213002 · Cited by 83
Buchanan, T., Heffernan, T. M., Parrott, A. C., Ling, J., Rodgers, J., & Scholey, A. B. (2010) · Behavior Research Methods · doi:10.3758/brm.42.3.709 · Cited by 76
Mangan, M. A., & Reips, U. (2007) · Behavior Research Methods · doi:10.3758/bf03193152 · Cited by 63
Appropriateness Fit and Criterion-Related Validity
Schmitt, N., Cortina, J. M., & Whitney, D. J. (1993) · Applied Psychological Measurement · doi:10.1177/014662169301700204 · Cited by 47
Studying Migrants with the Help of the Internet: Methods from Psychology
Reips, U., & Buffardi, L. E. (2012) · Journal of Ethnic and Migration Studies · doi:10.1080/1369183x.2012.698208 · Cited by 47
How Internet-Mediated Research Changes Science
Reips, U. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511813740.013 · Cited by 33
Continuous Measurement of Musically-Induced Emotion: A Web Experiment
Egermann, H., Nagel, F., ALTENMÜLLER, E. O., & Kopiez, R. (2009) · Publikationsdatenbank der Fraunhofer-Gesellschaft (Fraunhofer-Gesellschaft) · Cited by 33
Comparison of ability tests administered online and in the laboratory
Ihme, J. M., Lemke, F., Lieder, K., Martin, F., Müller, J. C., & Schmidt, S. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.1183 · Cited by 28
What's in a Screen Name? Attractiveness of Different Types of Screen Names Used by Online Daters
Whitty, M. T., & Buchanan, T. (2010) · Leicester Research Archive (University of Leicester) · Cited by 25
Musch, J., & Klauer, K. C. (2002) · Cited by 18
Self-citation(2003)
Cited by
Reputation as a sufficient condition for data quality on Amazon Mechanical Turk
Peer, E., Vosgerau, J., & Acquisti, A. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0434-y · Cited by 1,618
An MTurk Crisis? Shifts in Data Quality and the Impact on Study Results
Chmielewski, M., & Kucker, S. C. (2020) · Social Psychological and Personality Science · doi:10.1177/1948550619875149 · Cited by 1,027
Amazon mechanical Turk in organizational psychology: an evaluation and practical recommendations
Cheung, J. H., Burns, D. K., Sinclair, R. R., & Sliter, M. (2017) · Journal of Business and Psychology · doi:10.1007/s10869-016-9458-5 · Cited by 474
Data Collection in the Digital Age: Innovative Alternatives to Student Samples1
Steelman, Z. R., Hammer, B. I., & Limayem, M. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.2.02 · Cited by 405
The Use of Online Panel Data in Management Research: A Review and Recommendations
Porter, C. O. L. H., Outlaw, R., Gale, J. P., & Cho, T. S. (2019) · Journal of Management · doi:10.1177/0149206318811569 · Cited by 338
Metadata
- Authors
- Aust, F., Diedenhofen, B., Ullrich, S., & Musch, J.
- Venue
- Behavior Research Methods
- Published
- 2012-10-10
- Volume
- 45
- Issue
- 2
- Pages
- 527-535
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- OpenAlex
- W2074012419
- Cited by
- 524
- References
- 36
- FWCI
- 13.75
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.