Psychophysics in a Web browser? Comparing response times collected with JavaScript and Psychophysics Toolbox in a visual search task
Open accessThe DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Brainard, D. H. (1997) · Spatial Vision · doi:10.1163/156856897x00357 · Cited by 19,702
Inference from iterative simulation using multiple sequences
Gelman, A., & Rubin, D. B. (1992) · Statistical Science · doi:10.1214/ss/1177011136 · Cited by 16,627
The weirdest people in the world?
Henrich, J., Heine, S. J., & Norenzayan, A. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0999152x · Cited by 12,641
The VideoToolbox software for visual psychophysics: transforming numbers into movies
Pelli, D. G. (1997) · Spatial Vision · doi:10.1163/156856897x00366 · Cited by 11,098
JAGS: A program for analysis of Bayesian graphical models using Gibbs sampling
Plummer, M. (2003) · Cited by 4,720
WEIRD languages have misled us, too
Majid, A., & Levinson, S. C. (2010) · Behavioral and Brain Sciences · doi:10.1017/s0140525x1000018x · Cited by 4,076
The neglected 95%: Why American psychology needs to become less American.
Arnett, J. J. (2008) · American Psychologist · doi:10.1037/0003-066x.63.7.602 · Cited by 2,019
jsPsych: A JavaScript library for creating behavioral experiments in a Web browser
de Leeuw, J. R. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0458-y · Cited by 1,778
Self-citationWhat attributes guide the deployment of visual attention and how do they do it?
Wolfe, J. M., & Horowitz, T. S. (2004) · Nature Reviews Neuroscience · doi:10.1038/nrn1411 · Cited by 1,766 · cited 1×
“…was selected as a representative psychophysics paradigm because (1)it is a highly investigated visual task using largely standardized methods (Wolfe & Horowitz, 2004); (2)it is possible to test subjects on a large number of trials, and gain a large amount of response time data, in a…”
MethodEvaluating amazon’s mechanical turk as a tool for experimental behavioral research
Crump, M. J. C., McDonnell, J. V., & Gureckis, T. M. (2013) · PLoS ONE · doi:10.1371/journal.pone.0057410 · Cited by 1,617
Harvesting implicit group attitudes and beliefs from a demonstration web site.
Nosek, B. A., Banaji, M. R., & Greenwald, A. G. (2002) · Group Dynamics: Theory, Research, and Practice · doi:10.1037/1089-2699.6.1.101 · Cited by 1,321
Who are the crowdworkers?: shifting demographics in mechanical turk
Ross, J., Irani, L., Silberman, M. S., Zaldivar, A., & Tomlinson, B. (2010) · CHI '10 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1753846.1753873 · Cited by 1,004
Philosophy and the practice of Bayesian statistics
Gelman, A., & Shalizi, C. R. (2013) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2011.02037.x · Cited by 825
Denwood, M. J. (2016) · Journal of Statistical Software · doi:10.18637/jss.v071.i09 · Cited by 731
What Can 1 Million Trials Tell Us About Visual Search?
Wolfe, J. M. (1998) · Psychological Science · doi:10.1111/1467-9280.00006 · Cited by 717
Philosophy and the practice of Bayesian statistics
Gelman, A., & Shalizi, C. R. (2010) · Cited by 709
Doing Bayesian Data Analysis: A Tutorial with R and BUGS
Barry, J. (2011) · Europe’s Journal of Psychology · doi:10.5964/ejop.v7i4.163 · Cited by 563 · cited 3×
“There are numerous reasons to prefer Bayesian data analysis techniques to null hypothesis significance testing (Kruschke, 2011).”
BackgroundMethodPsychological Experiments on the Internet
(2000) · Elsevier eBooks · doi:10.1016/b978-0-12-099980-4.x5000-x · Cited by 463
Familiarity and pop-out in visual search
Wang, Q., Cavanagh, P., & Green, M. (1994) · Perception & Psychophysics · doi:10.3758/bf03206946 · Cited by 348
A Brief History of Web Experimenting
Musch, J., & Reips, U.-D. (2000) · Psychological Experiments on the Internet · doi:10.1016/b978-012099980-4/50004-6 · Cited by 229
Revisiting Mental Simulation in Language Comprehension: Six Replication Attempts
Zwaan, R. A., & Pecher, D. (2012) · PLoS ONE · doi:10.1371/journal.pone.0051382 · Cited by 215
Presentation and response timing accuracy in Adobe Flash and HTML5/JavaScript Web experiments
Reimers, S., & Stewart, N. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0471-1 · Cited by 194
QRTEngine: An easy solution for running online reaction time experiments using Qualtrics
Barnhoorn, J. S., Haasnoot, E., Bocanegra, B. R., & van Steenbergen, H. (2015) · Behavior Research Methods · doi:10.3758/s13428-014-0530-7 · Cited by 166 · cited 4×
“This is relevant for researchers because it improves the estimate of when stimuli are actually drawn on the screen, thus removing some of the variability in response time measurements (Barnhoorn et al., 2014; Garaizar, Vadillo, & López-de-Ipiña, 2014).”
BackgroundMethodInfluentialReplication, statistical consistency, and publication bias
Francis, G. (2013) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2013.02.003 · Cited by 138
Visual search asymmetry: The influence of stimulus familiarity and low-level features
Shen, J., & Reingold, E. M. (2001) · Perception & Psychophysics · doi:10.3758/bf03194413 · Cited by 110
Collecting response times using Amazon Mechanical Turk and Adobe Flash
Simcox, T., & Fiez, J. A. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0345-y · Cited by 98
Plant, R. R., & Turner, G. (2009) · Behavior Research Methods · doi:10.3758/brm.41.3.598 · Cited by 96 · cited 1×
“The normal distributions are colored according to the same mapping as in the top part of the figure in experimental setup, such as a change in keyboard, mouse, or monitor (Lagroix, Yanko, & Spalek, 2012; Neath et al., 2011; Plant & Turner, 2009).”
BackgroundA simple and sensitive method to measure timing accuracy
Clercq, A. D., Crombez, G., Buysse, A., & Roeyers, H. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195502 · Cited by 96
Adobe Flash as a medium for online experimentation: A test of reaction time measurement capabilities
Reimers, S., & Stewart, N. (2007) · Behavior Research Methods · doi:10.3758/bf03193004 · Cited by 93
ScriptingRT: A Software Library for Collecting Response Latencies in Online Studies of Cognition
Schubert, T. W., Murteira, C., Collins, E. C., & Lopes, D. (2013) · PLoS ONE · doi:10.1371/journal.pone.0067769 · Cited by 71
Kruschke, J. K. (2013) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2012.02063.x · Cited by 64
Response time accuracy in Apple Macintosh computers
Neath, I., Earle, A., Hallett, D., & Surprenant, A. M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0069-9 · Cited by 57 · cited 8×
“The normal distributions are colored according to the same mapping as in the top part of the figure in experimental setup, such as a change in keyboard, mouse, or monitor (Lagroix, Yanko, & Spalek, 2012; Neath et al., 2011; Plant & Turner, 2009).”
BackgroundMethodResultInfluentialLagroix, H. E. P., Yanko, M. R., & Spalek, T. M. (2012) · Attention Perception & Psychophysics · doi:10.3758/s13414-012-0281-4 · Cited by 45
Conducting real-time multiplayer experiments on the web
Hawkins, R. X. D. (2014) · Behavior Research Methods · doi:10.3758/s13428-014-0515-6 · Cited by 44
Presentation Accuracy of the Web Revisited: Animation Methods in the HTML5 Era
Garaizar, P., Vadillo, M. A., & López–de–Ipiña, D. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109812 · Cited by 28
Reimers, S., & Stewart, N. (2008) · Behavior Research Methods · doi:10.3758/brm.40.4.1170 · Cited by 14
Cited by
Gorilla in our midst: An online behavioral experiment builder
Anwyl-Irvine, A. L., Massonnié, J., Flitton, A., Kirkham, N., & Evershed, J. K. (2020) · Behavior Research Methods · doi:10.3758/s13428-019-01237-x · Cited by 1,862
The timing mega-study: comparing a range of experiment generators, both lab-based and online
Bridges, D., Pitiot, A., MacAskill, M. R., & Peirce, J. W. (2020) · PeerJ · doi:10.7717/peerj.9414 · Cited by 546
Conducting perception research over the internet: A tutorial review
Woods, A. T., Velasco, C., Levitan, C. A., Wan, X., & Spence, C. (2015) · PeerJ · doi:10.7717/peerj.1058 · Cited by 301
lab.js: A free, open, online study builder
Henninger, F., Shevchenko, Y., Mertens, U. K., Kieslich, P. J., & Hilbig, B. E. (2022) · Behavior Research Methods · doi:10.3758/s13428-019-01283-5 · Cited by 294
Slavich, G. M., & Shields, G. S. (2018) · Psychosomatic Medicine · doi:10.1097/psy.0000000000000534 · Cited by 268
Metadata
- Authors
- de Leeuw, J. R., & Motz, B. A.
- Venue
- Behavior Research Methods
- Published
- 2015-03-12
- Volume
- 48
- Issue
- 1
- Pages
- 1-12
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- OpenAlex
- W1978032914
- Cited by
- 252
- References
- 36
- FWCI
- 8.67
- Type
- journal article
- Language
- en
- Open access
- bronze
- Licence
- www.springer.com/tdm (tdm)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.