Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 642

The DOI matches its OpenAlex record; 4 of the 4 references it cites were found in a registry or an index.

Standards for Internet-Based Experimenting

Open access
Ulf‐Dietrich Reips·2002·Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie)

Abstract

This article summarizes expertise gleaned from the first years of Internet-based experimental research and presents recommendations on: (1) ideal circumstances for conducting a study on the Internet; (2) what precautions have to be undertaken in Web experimental design; (3) which techniques have proven useful in Web experimenting; (4) which frequent errors and misconceptions need to be avoided; and (5) what should be reported. Procedures and solutions for typical challenges in Web experimenting are discussed. Topics covered include randomization, recruitment of samples, generalizability, dropout, experimental control, identity checks, multiple submissions, configuration errors, control of motivational confounding, and pre-testing. Several techniques are explained, including "warm-up," "high hurdle," password methods, "multiple site entry," randomization, and the use of incentives. The article concludes by proposing sixteen standards for Internet-based experimenting.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

OpenAlex · 10.1026/1618-3169.49.4.243

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 4 references

Research works printed but not linked: 41

  1. Bamert, T.(2002). Integration von Wahrscheinlichkeiten: Verarbeitung von zwei Wahrscheinlichkeitsinformationen. [Integration of probabilities: Processing two pieces of probability information]. Unpublished master’s thesis, University of Zurich, Switzerland.
  2. 10.1111/1540-4560.00247 · DOI · Paper page
  3. 10.3758/BF03207804 · DOI
  4. Birnbaum, M. H.(2001). A Web-based program of research on decision making. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 23– 55 Lengerich, Germany: Pabst Science.
  5. 10.1026//1618-3169.49.4.257 · DOI
  6. Bosnjak, M.(2001). Participation in non-restricted Web surveys: A typology and explanatory model for item non-response. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 193– 208 Lengerich, Germany: Pabst Science.
  7. 10.1037/0735-7028.33.2.148 · doi:10.1037/0735-7028.33.2.148 · Paper page
  8. Buchanan, T., Reips, U.D.(2001, October 10). Platform-dependent biases in Online Research: Do Mac users really think different? In K. J. Jonas, P. Breuer, B. Schauenburg, & M. Boos (Eds.), Perspectives on Internet Research: Concepts and Methods. Retrieved December 27, 2001, from server3.uni-psych.gwdg.de/gor/contrib/buchanan-tom.
  9. Chapanis, A.(1970). The relevance of laboratory studies to practical situations. In D. P. Schultz (Ed.), The science of psychology: Critical reflections. New York: Appleton Century Crofts.
  10. 10.5153/sro.73 · DOI · Paper page
  11. 10.3758/BF03195364 · DOI
  12. 10.1026//1618-3169.49.4.283 · DOI
  13. Frick, A., Bächtiger, M. T., Reips, U.D.(2001). Financial incentives, personal information, and dropout in online studies. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 209– 219 Lengerich, Germany: Pabst Science.
  14. 10.3758/BF03204763 · DOI · Paper page
  15. 10.1177/089443930202000303 · DOI
  16. 10.3758/BF03195346 · DOI
  17. 10.1086/268992 · DOI · Paper page
  18. 10.1037/0033-295X.107.4.852 · doi:10.1037/0033-295x.107.4.852 · Paper page
  19. 10.3758/BF03207787 · DOI
  20. Krantz, J. H.(2001). Stimulus delivery on the Web: What can be presented when calibration isn’t possible. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 113– 130 Lengerich, Germany: Pabst Science.
  21. 10.1016/B978-012099980-4/50003-4 · DOI · Paper page
  22. Laugwitz, B.(2001). A Web experiment on color harmony principles applied to computer user interface design. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 131– 145 Lengerich, Germany: Pabst Science.
  23. Musch, J., Klauer, K. C.(2002). Psychological experimenting on the World Wide Web: Investigating content effects in syllogistic reasoning. In B. Batinic, U.D. Reips, & M. Bosnjak (Eds.), Online Social Sciences 181– 212 Göttingen, Germany: Hogrefe & Huber.
  24. 10.1016/B978-012099980-4/50004-6 · DOI · Paper page
  25. 10.3758/BF03195369 · DOI
  26. 10.1026//1618-3169.49.4.270 · DOI
  27. 10.1177/01461672012710001 · DOI · Paper page
  28. Reips, U.D.(1997). Das psychologische Experimentieren im Internet [Psychological experimenting on the Internet]. In B. Batinic (Ed.), Internet für Psychologen 245– 265 Göttingen, Germany: Hogrefe.
  29. Reips, U.D.(1999). Online research with children. In U.D. Reips, B. Batinic, W. Bandilla, M. Bosnjak, L. Gräf, K. Moser, & A. Werner (Eds.). Current Internet science - trends, techniques, results. Aktuelle Online-Forschung - Trends, Techniken, Ergebnisse. Zürich: Online Press. Retrieved April 7, 2002 from dgof.de/tband99/.
  30. 10.1016/B978-012099980-4/50005-8 · DOI · Paper page
  31. 10.3758/BF03195366 · DOI
  32. Reips U.-D., 2002, Social Science Computer Review, 20, 241
  33. Reips, U.D.(2002b). Theory and techniques of conducting Web experiments. In B. Batinic, U.D. Reips, & M. Bosnjak (Eds.), Online Social Sciences 229– 250 Seattle: Hogrefe & Huber.
  34. 10.3758/BF03195449 · DOI
  35. 10.1002/hup.345 · DOI
  36. Rosenthal, R., Rosnow, R. L.(1969). Artifact in behavioral research. New York: Academic Press.
  37. Ruppertsberg, A. I., Givaty, G., Van Veen, H. A. H. C., Bülthoff, H.(2001). Games as research tools for visual perception over the Internet. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 147– 158 Lengerich, Germany: Pabst.
  38. 10.1016/B978-012099980-4/50013-7 · DOI
  39. 10.1037/h0083096 · DOI
  40. Schwarz, S., Reips, U.D.(2001). CGI versus JavaScript: A Web experiment on the reversed hindsight bias. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 75– 90 Lengerich, Germany: Pabst Science.
  41. Voracek, M., Stieger, S., Gindl, A.(2001). Online replication of Evolutionary Psychology evidence: Sex differences in sexual jealousy in imagined scenarios of mate’s sexual versus emotional infidelity. In U.D. Reips & M. Bosnjak (Eds.), Dimensions of Internet Science 91– 112 Lengerich, Germany: Pabst Science.

Cited by

See all 642

Metadata

Authors
Reips, U.
Venue
Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie)
Published
2002-10
Volume
49
Issue
4
Pages
243-256
ISSN
  • 0949-3964 (ISSN-L)
  • 1618-3169
  • 2190-5142
OpenAlex
W2140054227
Cited by
642
References
4
FWCI
49.47
Type
journal article
Language
de
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Standards for Internet-Based Experimenting. https://app.cochat.ai/papers/10.1026/1618-3169.49.4.243
The paper
Reips, U. (2002). Standards for Internet-Based Experimenting. Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie). https://doi.org/10.1026/1618-3169.49.4.243

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.