The DOI matches its OpenAlex record; 4 of the 4 references it cites were found in a registry or an index.
Standards for Internet-Based Experimenting
Open accessAbstract
This article summarizes expertise gleaned from the first years of Internet-based experimental research and presents recommendations on: (1) ideal circumstances for conducting a study on the Internet; (2) what precautions have to be undertaken in Web experimental design; (3) which techniques have proven useful in Web experimenting; (4) which frequent errors and misconceptions need to be avoided; and (5) what should be reported. Procedures and solutions for typical challenges in Web experimenting are discussed. Topics covered include randomization, recruitment of samples, generalizability, dropout, experimental control, identity checks, multiple submissions, configuration errors, control of motivational confounding, and pre-testing. Several techniques are explained, including "warm-up," "high hurdle," password methods, "multiple site entry," randomization, and the use of incentives. The article concludes by proposing sixteen standards for Internet-based experimenting.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Orne, M. T. (1962) · American Psychologist · doi:10.1037/h0043424 · Cited by 4,041
Self-disclosure in computer-mediated communication: The role of self-awareness and visual anonymity
Joinson, A. N. (2001) · European Journal of Social Psychology · doi:10.1002/ejsp.36 · Cited by 1,458
World-Wide Web survey research: Benefits, potential problems, and solutions
Schmidt, W. C. (1997) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03204826 · Cited by 620
The effect of experimenter bias on the performance of the albino rat
Rosenthal, R., & Fode, K. L. (2007) · Behavioral Science · doi:10.1002/bs.3830080302 · Cited by 384
Research works printed but not linked: 41
- Bamert, T.(2002). Integration von Wahrscheinlichkeiten: Verarbeitung von zwei Wahrscheinlichkeitsinformationen. [Integration of probabilities: Processing two pieces of probability information]. Unpublished master’s thesis, University of Zurich, Switzerland.
- 10.1111/1540-4560.00247 · DOI · Paper page
- 10.3758/BF03207804 · DOI
- Birnbaum, M. H.(2001). A Web-based program of research on decision making. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 23– 55 Lengerich, Germany: Pabst Science.
- 10.1026//1618-3169.49.4.257 · DOI
- Bosnjak, M.(2001). Participation in non-restricted Web surveys: A typology and explanatory model for item non-response. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 193– 208 Lengerich, Germany: Pabst Science.
- 10.1037/0735-7028.33.2.148 · doi:10.1037/0735-7028.33.2.148 · Paper page
- Buchanan, T., Reips, U.D.(2001, October 10). Platform-dependent biases in Online Research: Do Mac users really think different? In K. J. Jonas, P. Breuer, B. Schauenburg, & M. Boos (Eds.), Perspectives on Internet Research: Concepts and Methods. Retrieved December 27, 2001, from server3.uni-psych.gwdg.de/gor/contrib/buchanan-tom.
- Chapanis, A.(1970). The relevance of laboratory studies to practical situations. In D. P. Schultz (Ed.), The science of psychology: Critical reflections. New York: Appleton Century Crofts.
- 10.5153/sro.73 · DOI · Paper page
- 10.3758/BF03195364 · DOI
- 10.1026//1618-3169.49.4.283 · DOI
- Frick, A., Bächtiger, M. T., Reips, U.D.(2001). Financial incentives, personal information, and dropout in online studies. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 209– 219 Lengerich, Germany: Pabst Science.
- 10.3758/BF03204763 · DOI · Paper page
- 10.1177/089443930202000303 · DOI
- 10.3758/BF03195346 · DOI
- 10.1086/268992 · DOI · Paper page
- 10.1037/0033-295X.107.4.852 · doi:10.1037/0033-295x.107.4.852 · Paper page
- 10.3758/BF03207787 · DOI
- Krantz, J. H.(2001). Stimulus delivery on the Web: What can be presented when calibration isn’t possible. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 113– 130 Lengerich, Germany: Pabst Science.
- 10.1016/B978-012099980-4/50003-4 · DOI · Paper page
- Laugwitz, B.(2001). A Web experiment on color harmony principles applied to computer user interface design. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 131– 145 Lengerich, Germany: Pabst Science.
- Musch, J., Klauer, K. C.(2002). Psychological experimenting on the World Wide Web: Investigating content effects in syllogistic reasoning. In B. Batinic, U.D. Reips, & M. Bosnjak (Eds.), Online Social Sciences 181– 212 Göttingen, Germany: Hogrefe & Huber.
- 10.1016/B978-012099980-4/50004-6 · DOI · Paper page
- 10.3758/BF03195369 · DOI
- 10.1026//1618-3169.49.4.270 · DOI
- 10.1177/01461672012710001 · DOI · Paper page
- Reips, U.D.(1997). Das psychologische Experimentieren im Internet [Psychological experimenting on the Internet]. In B. Batinic (Ed.), Internet für Psychologen 245– 265 Göttingen, Germany: Hogrefe.
- Reips, U.D.(1999). Online research with children. In U.D. Reips, B. Batinic, W. Bandilla, M. Bosnjak, L. Gräf, K. Moser, & A. Werner (Eds.). Current Internet science - trends, techniques, results. Aktuelle Online-Forschung - Trends, Techniken, Ergebnisse. Zürich: Online Press. Retrieved April 7, 2002 from dgof.de/tband99/.
- 10.1016/B978-012099980-4/50005-8 · DOI · Paper page
- 10.3758/BF03195366 · DOI
- Reips U.-D., 2002, Social Science Computer Review, 20, 241
- Reips, U.D.(2002b). Theory and techniques of conducting Web experiments. In B. Batinic, U.D. Reips, & M. Bosnjak (Eds.), Online Social Sciences 229– 250 Seattle: Hogrefe & Huber.
- 10.3758/BF03195449 · DOI
- 10.1002/hup.345 · DOI
- Rosenthal, R., Rosnow, R. L.(1969). Artifact in behavioral research. New York: Academic Press.
- Ruppertsberg, A. I., Givaty, G., Van Veen, H. A. H. C., Bülthoff, H.(2001). Games as research tools for visual perception over the Internet. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 147– 158 Lengerich, Germany: Pabst.
- 10.1016/B978-012099980-4/50013-7 · DOI
- 10.1037/h0083096 · DOI
- Schwarz, S., Reips, U.D.(2001). CGI versus JavaScript: A Web experiment on the reversed hindsight bias. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 75– 90 Lengerich, Germany: Pabst Science.
- Voracek, M., Stieger, S., Gindl, A.(2001). Online replication of Evolutionary Psychology evidence: Sex differences in sexual jealousy in imagined scenarios of mate’s sexual versus emotional infidelity. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 91– 112 Lengerich, Germany: Pabst Science.
Cited by
Conducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172
Evaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617
The world of emotions is not two-dimensional
Fontaine, J. R. J., Scherer, K. R., Roesch, E. B., & Ellsworth, P. C. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.02024.x · Cited by 1,179
Conducting Clinical Research Using Crowdsourced Convenience Samples
Chandler, J., & Shapiro, D. (2016) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-093623 · Cited by 1,072
The viability of crowdsourcing for survey research
Behrend, T. S., Sharek, D. J., Meade, A. W., & Wiebe, E. N. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0081-0 · Cited by 1,018
Metadata
- Authors
- Reips, U.
- Venue
- Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie)
- Publisher
- Hogrefe Publishing Group
- Published
- 2002-10
- Volume
- 49
- Issue
- 4
- Pages
- 243-256
- ISSN
- 0949-3964 (ISSN-L)
- 1618-3169
- 2190-5142
- OpenAlex
- W2140054227
- Cited by
- 642
- References
- 4
- FWCI
- 49.47
- Type
- journal article
- Language
- de
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Standards for Internet-Based Experimenting. https://app.cochat.ai/papers/10.1026/1618-3169.49.4.243
- The paper
- Reips, U. (2002). Standards for Internet-Based Experimenting. Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie). https://doi.org/10.1026/1618-3169.49.4.243
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.