Economic Games on the Internet: The Effect of $1 Stakes
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Online labor markets such as Amazon Mechanical Turk (MTurk) offer an unprecedented opportunity to run economic game experiments quickly and inexpensively. Using Mturk, we recruited 756 subjects and examined their behavior in four canonical economic games, with two payoff conditions each: a stakes condition, in which subjects' earnings were based on the outcome of the game (maximum earnings of $1); and a no-stakes condition, in which subjects' earnings are unaffected by the outcome of the game. Our results demonstrate that economic game experiments run on MTurk are comparable to those run in laboratory settings, even when using very low stakes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While decision-making experiments on MTurk allow high control over confounding variables and are comparable to those in laboratory settings, even in low-stakes scenarios (Amir et al., 2012)”
From Exploring the effects of human-centered AI explanations on trust and reliance (2023) · cites this paper as Amir et al., 2012
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
An experimental analysis of ultimatum bargaining
Güth, W., Schmittberger, R., & Schwarze, B. (1982) · Journal of Economic Behavior & Organization · doi:10.1016/0167-2681(82)90011-7 · Cited by 4,816 · cited 1×
“Therefore, we examine behavior in various previous UG experiments that used the strategy method [23–29], and compare the range of outcomes to what we observe in our data.”
MethodRunning experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767 · cited 1×
“Recent work has replicated classical findings such as framing and priming on MTurk [8–10], found a high level of test-retest reliability on Mturk [10–12], and shown quantitative agreement in behavior between MTurk and the physical laboratory [6, 8].”
ResultConducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172
Fairness and the assumptions of economics
Kahneman, D., Knetsch, J. L., & Thaler, R. H. (1986) · The Journal of Business · doi:10.1086/296367 · Cited by 2,463 · cited 1×
“Therefore, we examine behavior in various previous UG experiments that used the strategy method [23–29], and compare the range of outcomes to what we observe in our data.”
MethodFairness in Simple Bargaining Experiments
Forsythe, R., Horowitz, J. L., Savin, N. E., & Sefton, M. (1994) · Games and Economic Behavior · doi:10.1006/game.1994.1021 · Cited by 2,366 · cited 2×
“Prior work on the dictator game found that subjects became significantly less generous when going from no stakes to low stakes [13], but that going from low stakes to high stakes did not affect donations [13,14].”
BackgroundResultEngel, C. (2011) · Experimental Economics · doi:10.1007/s10683-011-9283-7 · Cited by 1,783 · cited 1×
“4% aggregated over more than 616 DG treatments as reviewed in a recent metaanalysis [21].”
BackgroundAndreoni, J. (1988) · Journal of Public Economics · doi:10.1016/0047-2727(88)90043-6 · Cited by 1,118 · cited 1×
“In the absence of a meta-analysis that breaks contributions down by MPCR, we compare the average contribution level in our experiment to the range of average contributions observed in various previous studies using the same MPCR [31–36].”
ResultCooperation in public-goods experiments: kindness or confusion?
Andreoni, J. (2002) · Market Failure or Success · doi:10.4337/1843760258.00027 · Cited by 912
Andreoni, J. (1995) · The Quarterly Journal of Economics · doi:10.2307/2118508 · Cited by 912 · cited 1×
“experiment to the range of average contributions observed in various previous studies using the same MPCR [31–36].”
Method
Research works printed but not linked: 2
- Horton J 2010 Employer expectations, peer effects and productivity: Evidence from a series of field experiments. SSRN eLibrary
- Brandts J Schram A Institute T 1996 Cooperative gains or noise in public goods experiments. Tinbergen Institute
Cited by
Items 301–364 of 364
The accuracy and meta-accuracy of personality impressions from facesPreprint
Jaeger, B., Sleegers, W. W. A., Stern, J., Penke, L., & Jones, A. L. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4x7d8 · Cited by 1
Chuyin, Z., Koh, Z. H., Gallagher, R., Nishimoto, S., & Tsuchiya, N. (2021) · doi:10.31234/osf.io/d2s38 · Cited by 1
Can Online Surveys Represent the Entire Population?Preprint
Grewenig, E., Lergetporer, P., Simon, L., Werner, K., & Woessmann, L. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3253457 · Cited by 1
Replicable quality across every channel: the Busara research agenda on methods in the Global SouthPreprint
Mughogho, W., Owsley, N. C., Wein, T., & Lab, B. L. B. (2021) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/2hn6v · Cited by 1
“…positivist social sciences when it comes to statistical analysis and interpretation after studies are completed, but much less new published work on the mechanics and reliability of the2 incentivised lab games (Amir et al, 2012) and survey outcomes (Broockman et al, 2017) that many studies employ.”
BackgroundPay for Quantity or Time? Implications for Work Speed and QualityPreprint
Deller, C., & Gallino, S. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4188671 · Cited by 1
Comprehension in Economic GamesPreprint
Koppel, L., Andersson, D., Johannesson, M., Strømland, E., & Tinghög, G. (2022) · doi:10.31234/osf.io/krzsb · Cited by 1
Paying £1 or Nothing in Dictator Games: No DifferencesPreprint
Brañas‐Garza, P., Espín, A. M., & Jorrat, D. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4723871 · Cited by 1
How People Misunderstand Growth and Inequality - and the Effects of Correcting Their BeliefsPreprint
Kaiser, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5822505 · Cited by 1
Roten, Y. S. (2019) · theses.fr (ABES) · doi:10.70675/e8d37ea2z6f63z4eeaz9d2ez17efae4d6859 · Cited by 3
Three essays on social preferences, social dilemmas and taxation
Antinyan, A. (2014) · ARCA (Università Ca' Foscari Venezia)
Essays on contract design in behavioral and development economics
de Quidt, J. (2014) · London School of Economics and Political Science Theses Online (London School of Economics and Political Science)
Who Is This About? An Exploratory Study of Erotic Self-Focus
Fertel, E. (2015) · Digital Scholarship - UNLV (University of Nevada Reno) · doi:10.34917/7645885 · Cited by 1
Effect of Empathy on Death Penalty Support in Relation to the Racial Divide and Gender Gap
Godcharles, B. D. (2015) · Digital Commons - University of South Florida (University of South Florida)
Blomster, J. K. (2015) · NVA (Nasjonalt vitenarkiv)
Klein, A. (2016) · Research Ideas and Outcomes · doi:10.3897/rio.2.e8848
“…for and used in many scientific studies, particularly in the social sciences [Paolacci et al. 2010, Horton et al. 2011, Suri and Watts 2011, Amir et al. 2012, Berinsky et al. 2012, Mason and Suri 2012, Goodman et al. 2013, Crump et al. 2013, Chandler et al. 2013] and in cognitive…”
BackgroundHow Nudge Strategies Can Backfire in Social InteractionsPreprint
Daniels, D. P., & Zlatev, J. J. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2832703
Reputation Mechanisms and the Long-Term Consequences of Cooperative Behavior
Sparks, A. M. (2015) · The Atrium (University of Guelph) · Cited by 1
Norm-Supporting Emotions: From Villages to Complex Societies
Bicchieri, C., & Thulin, E. W. (2017) · Springer eBooks · doi:10.1007/978-3-319-61070-2_13
The effects of greed and fear in symmetric and asymmetric Volunteer’s Dilemmas
Kim, B., Ullrich, J., & Krueger, J. I. (2018) · Zurich Open Repository and Archive (University of Zurich) · doi:10.5167/uzh-157458
Applications of Internet Methods in Psychology
Yang, L.-X. (2018) · Computational social sciences · doi:10.1007/978-3-319-95465-3_13
Nioche, A., Garcia, B., Boraud, T., Rougier, N. P., & Bourgeois‐Gironde, S. (2019) · Humanities and Social Sciences Communications · doi:10.1057/s41599-019-0241-x
Brunetta, F. (2018) · FIU - Digital Commons (Florida International University) · doi:10.25148/etd.fidc007000
“Economists using MTurk workers as participants in economic games have evidence to show they perform at the same level as traditional participants (Amir et al., 2012; Goodman et al., 2013; Horton et al., 2011; Paolacci et al., 2010).”
BackgroundThe Customer Is Always Right: An Experiment on Discrimination by Customers
Uchida, H. (2018) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
The Astute Communicator: Strategic Choices and Consequences of Goal-Oriented Workplace Communication
Brodsky, A. (2017) · Digital Access to Scholarship at Harvard (DASH) (Harvard University)
Essays in finance and behavioral economics
Wang, S. (2020) · Iowa State University Digital Repository (Iowa State University) · doi:10.31274/etd-20210114-157
Autonomous Systems in Ethical Dilemmas: Attitudes towards RandomizationPreprint
Bodenschatz, A., Uhl, M., & Walkowitz, G. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3742677
Inducing self-explanation: A meta-analysis and experiment
Bisra, K. (2020) · Summit (Simon Fraser University)
Fairness and Risk in Ultimatum BargainingPreprint
Hyndman, K., & Walker, M. J. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3651557
Three essays on behavioral and experimental economics
Li, Y. (2021) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/152388
Cristaldi, F. D. P., Granziol, U., Bariletti, I., Borella, E., & Mento, G. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/cn3dj · Cited by 1
Essays in Behavioral Labor Economics: Experimental Evidence from Germany and Ghana
Grosch, K. (2017) · eDiss (Georg-August-Universität Göttingen) · doi:10.53846/goediss-6589
Fairness and Risk in Ultimatum Bargaining
Hyndman, K. (2020) · AEA Randomized Controlled Trials · doi:10.1257/rct.5846-1.0
ResponseofOutputtoVaryingIncentiveStructuresonAmazonTurk
DellaVigna, S., Wheaton, B., Charpentier, D., & Welch, K. (2015) · AEA Randomized Controlled Trials · doi:10.1257/rct.714
The Neural Basis of Cooperation in Social Dilemmas
孙, 鹏. (2020) · Advances in Psychology · doi:10.12677/ap.2020.1012216
“。传统观点从经济学中关于理性自利人的假设出发,认为当面临个 人与集体利益冲突的时候,人们必然会毫不犹豫的选择维护个人利益而做出自私非合作的行为。但是, 自早期 Dawes 等人 (1980) 的研究开始,学者们却近乎一致的发现社会困境中的人们往往能够做出维护集 体利益的合作行为 (Amir et al., 2012; Fehr & Fischbacher, 2003; Fehr et al., 2002; List, 2011; Mason & Suri, 2012; Paolacci et al., 2010) 。 ) (Emonds et al., 2011, 2012; Fukui…”
Fairness and Risk in Ultimatum Bargaining
Hyndman, K. (2020) · AEA Randomized Controlled Trials · doi:10.1257/rct.5846
A Review of Cooperative Behavior in Social Dilemmas
孙, 鹏. (2020) · Advances in Psychology · doi:10.12677/ap.2020.1012235
How do people plan to negotiate?Preprint
Le, D., & Jang, D. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/hkma9
Response of Output to Varying Incentive Structures on Amazon Turk
DellaVigna, S., Welch, K., Charpentier, D., & Wheaton, B. (2015) · AEA Randomized Controlled Trials · doi:10.1257/rct.714-4.0
Demographic differences in the effect of price on giving in a diverse population
Lillehaugen, L., Ludwig, P., & Mayo, R. L. (2023) · Journal of the Economic Science Association · doi:10.1007/s40881-023-00132-8
The Role of Attention and Frames on Third-Party Punishment and Compensation PreferencesPreprint
Civai, C., Polonio, L., & Capraro, V. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4458455
Strategic Reasoning Online: Experiments on the Beauty ContestPreprint
Engelhardt, R., & Galeazzi, P. (2023) · Research Square · doi:10.21203/rs.3.rs-3604793/v1
Johnson, D. B., & Azevedo, C. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4661004
Conveniently pessimistic: manipulating beliefs to excuse selfishness in charitable giving
Samad, Z. (2024) · Frontiers in Behavioral Economics · doi:10.3389/frbhe.2024.1412437
“…yields no different results than using undergraduate students, despite the fact that compensation of MTurk workers is typically much lower than that of student participants (e.g., Horton et al., 2011; Amir et al., 2012; Arechar et al., 2018; Johnson and Ryan, 2020; Snowberg and Yariv, 2021).”
Kardoš, P., Leidner, B., & Nawalkha, S. K. (2024) · The Journal of Psychology · doi:10.1080/00223980.2024.2437380 · Cited by 2
“Importantly for our purpose, MTurk studies replicate effects found in traditional samples using bogus partner interactions (Summerville & Chartier, 2013) and also replicates results of economic game experiments conducted in the laboratory (Amir et al., 2012).”
Underweighting of rare events in strategic games
Plonsky, O., Ayoub, P., & Roth, Y. (2025) · Experimental Economics · doi:10.1017/eec.2025.3 · Cited by 2
Newsvendor stockouts and option discriminability
Leppänen, I. (2025) · European Journal of Operational Research · doi:10.1016/j.ejor.2025.04.002
Coordination with and without incentivesPreprint
Brañas‐Garza, P., Jorrat, D., & Lomas, P. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5560849
The (Statistical) Power of Incentives
Alekseev, A. (2025) · Journal of the Economic Science Association · doi:10.1017/esa.2025.10019
“…2013; Gibson et al., 2013; Balasubramanian et al., 2017) and distributional choices (El Harbi et al., 2015), on behavior in social dilemmas (Amir et al., 2012; Rousu et al., 2015; Yamagishi et al., 2016; Mengel, 2017; Leibbrandt and Lynham, 2018) and coordination games (Parravano and…”
Conducting real-time interactive experiments online: A guide for researchers
Flecke, S. L., & Bachler, S. (2025) · Journal of Behavioral and Experimental Finance · doi:10.1016/j.jbef.2025.101118
Religion, Parochialism and Intuitive CooperationPreprint
İşler, O., & Yilmaz, O. (2020) · OSF Preprints (OSF Preprints) · doi:10.17605/osf.io/fkdjz
Alekseev, A. (2022) · University of Regensburg Publication Server (University of Regensburg) · doi:10.5283/epub.53030
Online cooperation and peer production
Hergueux, J. (2014) · theses.fr (ABES) · doi:10.70675/d218793czaf40z4f3czac91z928466daf0f5
Fixed Pay for Output or Time? Implications for Work Speed and Quality
Deller, C., & Gallino, S. (2026) · Journal of Accounting Research · doi:10.1111/1475-679x.70049
Building and comparing values from different sources
Garcia, B. (2022) · theses.fr (ABES) · doi:10.70675/ee161594z13f1z47c7z99b3zf21f5415b5ca
COVID vaccination and economic game decisions: The role of analytical thinking
Zher-Wen, Z.-W., & Yu, R. (2026) · Human Vaccines & Immunotherapeutics · doi:10.1080/21645515.2026.2654307
Testing perceivers' accuracy and accuracy awareness when forming personality impressions from facesPreprint
Sleegers, W., Jones, A., Stern, J., Penke, L., & Jaeger, B. (2024) · OSF Preprints (OSF Preprints)
Experimental methods: Revisiting the commandments of experimental economics
Gneezy, U. (2026) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2026.107558 · Cited by 2
“To overcome this, some researchers have employed hypothetical stakes, allowing for arbitrarily large amounts without incurring extra costs (e.g., Amir, Rand, and Gal, 2012; Ben-Ner, Kramer, and Levy, 2008).”
Differentiating Social and Moral Norms in Perceived Internalization
Deutchman, P., & Yang, F. Y. (2026) · Behavioral Sciences · doi:10.3390/bs16050774
“While previous research has found few differences in studies conducted in lab or online (Amir et al., 2012; Horton et al., 2011), the generalizability of our findings remains uncertain.”
Ambiguity in performance pay: A real effort experiment
Cooper, D. J., & Johnson, D. B. (2026) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2026.107659
“A number of subsequent papers report similar findings when comparing lab and online studies (Suri and Watts, 2011; Amir and Rand, 2012; De Winter, Kyriakidis, Dodou, and Happee, 2015; Wang, Huang, Yao, and Chan, 2015).”
Social expectations and norm nudging in anti-coordination problems: An El Farol Bar Game experiment
Guarnieri, P., & Spadoni, L. (2026) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2026.107712
Kamijo, Y., Goto, A., & Himichi, T. (2026) · Sustainable Development · doi:10.1002/sd.71631
On emotions and cooperative behavior for wildlife conservation
Lozano, J. E. (2026) · European Journal of Wildlife Research · doi:10.1007/s10344-026-02151-2
Metadata
- Authors
- Amir, O., Rand, D. G., & Gal, Y. K.
- Affiliations
- Ben-Gurion University of the Negev (IL)
- Harvard University (US)
- Corresponding author
- Amir, Ofra
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-02-21
- Volume
- 7
- Issue
- 2
- Pages
- e31461
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3283743
- OpenAlex
- W3124416153
- Cited by
- 364
- References
- 39
- Citations by year
- 2026: 12 · 2025: 12 · 2024: 18 · 2023: 24 · 2022: 23 · 2021: 22 · 2020: 24 · 2019: 31 · 2018: 33 · 2017: 40 · 2016: 28 · 2015: 31 · 2014: 34 · 2013: 20 · 2012: 9
- FWCI
- 53.45
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- SSRN Electronic Journal (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Funders
- John Templeton Foundation
- Harvard University
- European Commission (268362)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Experimental Behavioral Economics Studies
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- Amazon Mechanical Turk, digital labour markets, financial incentives, experimental design, participant behavior
- MeSH terms
- Behavior, Economics, Games, Experimental, Humans, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
