Economic Games on the Internet: The Effect of $1 Stakes
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Online labor markets such as Amazon Mechanical Turk (MTurk) offer an unprecedented opportunity to run economic game experiments quickly and inexpensively. Using Mturk, we recruited 756 subjects and examined their behavior in four canonical economic games, with two payoff conditions each: a stakes condition, in which subjects' earnings were based on the outcome of the game (maximum earnings of $1); and a no-stakes condition, in which subjects' earnings are unaffected by the outcome of the game. Our results demonstrate that economic game experiments run on MTurk are comparable to those run in laboratory settings, even when using very low stakes.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“While decision-making experiments on MTurk allow high control over confounding variables and are comparable to those in laboratory settings, even in low-stakes scenarios (Amir et al., 2012)”
From Exploring the effects of human-centered AI explanations on trust and reliance (2023) · cites this paper as Amir et al., 2012
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Amazon's Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data?
Buhrmester, M., Kwang, T., & Gosling, S. D. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393980 · Cited by 9,996
An experimental analysis of ultimatum bargaining
Güth, W., Schmittberger, R., & Schwarze, B. (1982) · Journal of Economic Behavior & Organization · doi:10.1016/0167-2681(82)90011-7 · Cited by 4,816 · cited 1×
“Therefore, we examine behavior in various previous UG experiments that used the strategy method [23–29], and compare the range of outcomes to what we observe in our data.”
MethodRunning experiments on Amazon Mechanical Turk
Paolacci, G., Chandler, J., & Ipeirotis, P. G. (2010) · Judgment and Decision Making · doi:10.1017/s1930297500002205 · Cited by 3,767 · cited 1×
“Recent work has replicated classical findings such as framing and priming on MTurk [8–10], found a high level of test-retest reliability on Mturk [10–12], and shown quantitative agreement in behavior between MTurk and the physical laboratory [6, 8].”
ResultConducting behavioral research on Amazon’s Mechanical Turk
Mason, W., & Suri, S. (2012) · Behavior Research Methods · doi:10.3758/s13428-011-0124-6 · Cited by 3,172
Fairness and the assumptions of economics
Kahneman, D., Knetsch, J. L., & Thaler, R. H. (1986) · The Journal of Business · doi:10.1086/296367 · Cited by 2,463 · cited 1×
“Therefore, we examine behavior in various previous UG experiments that used the strategy method [23–29], and compare the range of outcomes to what we observe in our data.”
MethodFairness in Simple Bargaining Experiments
Forsythe, R., Horowitz, J. L., Savin, N. E., & Sefton, M. (1994) · Games and Economic Behavior · doi:10.1006/game.1994.1021 · Cited by 2,366 · cited 2×
“Prior work on the dictator game found that subjects became significantly less generous when going from no stakes to low stakes [13], but that going from low stakes to high stakes did not affect donations [13,14].”
BackgroundResultEngel, C. (2011) · Experimental Economics · doi:10.1007/s10683-011-9283-7 · Cited by 1,783 · cited 1×
“4% aggregated over more than 616 DG treatments as reviewed in a recent metaanalysis [21].”
BackgroundAndreoni, J. (1988) · Journal of Public Economics · doi:10.1016/0047-2727(88)90043-6 · Cited by 1,118 · cited 1×
“In the absence of a meta-analysis that breaks contributions down by MPCR, we compare the average contribution level in our experiment to the range of average contributions observed in various previous studies using the same MPCR [31–36].”
ResultCooperation in public-goods experiments: kindness or confusion?
Andreoni, J. (2002) · Market Failure or Success · doi:10.4337/1843760258.00027 · Cited by 912
Andreoni, J. (1995) · The Quarterly Journal of Economics · doi:10.2307/2118508 · Cited by 912 · cited 1×
“experiment to the range of average contributions observed in various previous studies using the same MPCR [31–36].”
Method
Research works printed but not linked: 2
- Horton J 2010 Employer expectations, peer effects and productivity: Evidence from a series of field experiments. SSRN eLibrary
- Brandts J Schram A Institute T 1996 Cooperative gains or noise in public goods experiments. Tinbergen Institute
Cited by
Items 101–200 of 364
Capraro, V. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2965067 · Cited by 43
Can internet surveys represent the entire population? A practitioners’ analysis
Grewenig, E., Lergetporer, P., Simon, L., Werner, K., & Woessmann, L. (2023) · European Journal of Political Economy · doi:10.1016/j.ejpoleco.2023.102382 · Cited by 55
Your Loss Is My Gain: A Recruitment Experiment with Framed Incentives
de Quidt, J. (2017) · Journal of the European Economic Association · doi:10.1093/jeea/jvx016 · Cited by 59
Anticipating moral hazard undermines climate mitigation in an experimental geoengineering game
Andrews, T. M., Delton, A. W., & Kline, R. (2022) · Ecological Economics · doi:10.1016/j.ecolecon.2022.107421 · Cited by 49
Taxing the Disposition Effect: The Impact of Tax Awareness on Investor Behavior
Bazley, W. J., Moore, J., & Vosse, M. M. (2019) · Journal of Financial and Quantitative Analysis · doi:10.1017/s0022109022000564 · Cited by 46
TurkServer: Enabling Synchronous and Longitudinal Online Experiments
Mao, A., Parkes, D., Chen, Y., Procaccia, A. D., Gajos, K. Z., & Zhang, H. (2012) · Cited by 41
The Cooperative PhenotypePreprint
Peysakhovich, A., Nowak, M. A., & Rand, D. G. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2426473 · Cited by 47
Self-citationExperimental platforms for behavioral experiments on social-ecological systems
Janssen, M. A., Lee, A., & Waring, T. M. (2014) · Ecology and Society · doi:10.5751/es-06895-190420 · Cited by 52
When Punishment Doesn’t Pay: Cold Glow and Decisions to Punish
Ouss, A., & Peysakhovich, A. (2015) · The Journal of Law and Economics · doi:10.1086/684229 · Cited by 40
“They find that behavior on AMT matches well with standard laboratory results on economics games (Amir et al. (2012)) (Rand et al. (in Press)), and are based on samples that are more representative of the general population (Horton et al. (2011), Paolacci et al. (2010)).”
InfluentialHigh-risk high-reward investments to mitigate climate change
Andrews, T. M., Delton, A. W., & Kline, R. (2018) · Nature Climate Change · doi:10.1038/s41558-018-0266-y · Cited by 47
Imagine being a nice guy: A note on hypothetical vs. incentivized social preferences
Bühren, C., & Kundt, T. (2015) · Judgment and Decision Making · doi:10.1017/s1930297500003946 · Cited by 47
On the priming of risk preferences: The role of fear and general affect
Alempaki, D., Starmer, C., & Tufano, F. (2019) · Journal of Economic Psychology · doi:10.1016/j.joep.2018.12.011 · Cited by 46
Nováková, J., & Jaroslav Flegr, A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0060966 · Cited by 49
“[36] found that stakes of $1, compared to zero stakes, significantly”
BackgroundSpillover bias in diversity judgment
Daniels, D. P., Neale, M. A., & Greer, L. L. (2017) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2016.12.005 · Cited by 49
What Does a Job Candidate's Age Signal to Employers?
Borm, H. V., Burn, I., & Baert, S. (2021) · Labour Economics · doi:10.1016/j.labeco.2021.102003 · Cited by 65
Intuitive Cooperation and the Social Heuristics Hypothesis: Evidence from 15 Time Constraint StudiesPreprint
Rand, D. G., Peysakhovich, A., Kraft‐Todd, G., Newman, G. E., Wurzbacher, O., Greene, J. D., & Nowak, M. A. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2222683 · Cited by 49
Self-citationThe Effect of Stake Size in Experimental Bargaining and Distribution Games: A Survey
Karagözoğlu, E., & Urhan, Ü. B. (2016) · Group Decision and Negotiation · doi:10.1007/s10726-016-9490-x · Cited by 36
Being “good” or “good enough”: Prosocial risk and the structure of moral self-regard.
Zlatev, J. J., Kupor, D. M., Laurin, K., & Miller, D. T. (2020) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000175 · Cited by 40
Punishment is strongly motivated by revenge and weakly motivated by inequity aversion
Deutchman, P., Bračič, M., Raihani, N., & McAuliffe, K. (2020) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2020.06.001 · Cited by 33
Another avenue for anatomy of income comparisons: Evidence from hypothetical choice experiments
Yamada, K., & Satō, M. (2013) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2013.03.001 · Cited by 41
Jordan, M. R., Jordan, J., & Rand, D. G. (2016) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2016.07.005 · Cited by 34
“Across four studies, we recruited 2828 participants from Amazon's Mechanical Turk (Amir & Rand, 2012; Horton, Rand, & Zeckhauser, 2011) (53%male, mean age= 34 years).”
Self-citationDetecting Prejudice From Egalitarianism: Why Black Americans Don’t Trust White Egalitarians’ Claims
Rosenblum, M., Jacoby-Senghor, D. S., & Brown, N. D. (2022) · Psychological Science · doi:10.1177/09567976211054090 · Cited by 30
“Prior work with economic games has found no difference in results when large rewards (i.e., $10) or smaller stakes (i.e., < $1) are used (Amir et al., 2012; Engle-Warnick & Slonim, 2004; Rand et al., 2013, 2015).”
BackgroundChen, H., Zeng, Z., & Ma, J. (2020) · PLoS ONE · doi:10.1371/journal.pone.0229510 · Cited by 30
“when the incentive is small than when it is large [21].”
BackgroundReligion, parochialism and intuitive cooperation
İşler, O., Yılmaz, O., & Maule, A. J. (2021) · Nature Human Behaviour · doi:10.1038/s41562-020-01014-3 · Cited by 37
A study of computational and human strategies in revelation games
Peled, N., Gal, K., & Kraus, S. (2014) · Autonomous Agents and Multi-Agent Systems · doi:10.1007/s10458-014-9253-5 · Cited by 28
“There are several works dupicating lab studies using MTurk showing similar patterns of behavior [1].”
BackgroundVolunteer Science: An Online Laboratory for Experiments in Social Psychology
Radford, J. P., Pilny, A., Reichelmann, A. V., Keegan, B., Welles, B. F., Hoye, J., Ognyanova, K., Meleis, W. M., & Lazer, D. M. J. (2016) · Social Psychology Quarterly · doi:10.1177/0190272516675866 · Cited by 39
Turkers of the World Unite: Multilevel In-Group Bias Among Crowdworkers on Amazon Mechanical Turk
Almaatouq, A., Krafft, P. M., Dunham, Y. C., Rand, D. G., & Pentland, A. (2019) · Social Psychological and Personality Science · doi:10.1177/1948550619837002 · Cited by 31
Self-citationDo truth-telling oaths improve honesty in crowd-working?
Jacquemet, N., James, A. G., Luchini, S., Murphy, J. J., & Shogren, J. F. (2021) · PLoS ONE · doi:10.1371/journal.pone.0244958 · Cited by 33
Another Avenue for Anatomy of Income Comparisons: Evidence from Hypothetical Choice Experiments
Yamada, K., & Satō, M. (2016) · Springer eBooks · doi:10.1007/978-4-431-55402-8_14 · Cited by 26
On the Transportability of Laboratory Results
Bader, F., Baumeister, B., Berger, R. D., & Keuschnigg, M. (2019) · Sociological Methods & Research · doi:10.1177/0049124119826151 · Cited by 28
“Prior evidence from laboratory (e.g., Camerer and Hogarth 1999; Carpenter, Verhoogen, and Burks 2005) and online studies (e.g., Amir et al. 2012; Keuschnigg, Bader, and Bracher 2016), however, indicates that—although monetary stakes increase selfishness compared to unincentivized games—differences…”
BackgroundCommunicating Climate Change: Probabilistic Expressions and Concrete Events
Joslyn, S. L., & Demnitz, R. (2019) · Weather Climate and Society · doi:10.1175/wcas-d-18-0126.1 · Cited by 23
Instrumenting Beliefs in Threshold Public Goods
de Oliveira, A. C. M., Spraggon, J. M., & Denny, M. J. (2016) · PLoS ONE · doi:10.1371/journal.pone.0147043 · Cited by 24
“[30] find relative parity between lab and AMT experiments, even when the stakes are very small in the online setting.”
BackgroundQianchen, L., Gallagher, R. M., & Tsuchiya, N. (2022) · Royal Society Open Science · doi:10.1098/rsos.210394 · Cited by 21
Situational Strength Cues from Social Sources at Work: Relative Importance and Mediated Effects
Alaybek, B., Dalal, R. S., Sheng, Z., Morris, A. G., Tomassetti, A. J., & Holland, S. J. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01512 · Cited by 24
“In recent years, MTurk has become an increasingly popular recruitment tool among social scientists (Amir et al., 2012; Fast et al., 2012; Crump et al., 2013; Giacopelli et al., 2013) because it provides instant access to a respondent pool with wide demographic diversity (Ipeirotis, 2010; Casler et al.”
BackgroundChatGPT: More Human-Like Than Computer-Like, but Not Necessarily in a Good Way
Azaria, A. (2023) · IEEE International Conference on Tools with Artificial Intelligence (ICTAI) · doi:10.1109/ictai59109.2023.00074 · Cited by 33
“However, in practice, the majority of human proposers offer between 40% to 50% of the total sum, and most people reject low offers [4], [22].”
BackgroundTrust toward a group of strangers as a function of stereotype-based social identification
Kong, D. T. (2017) · Personality and Individual Differences · doi:10.1016/j.paid.2017.03.031 · Cited by 27
People Make the Same Bayesian Judgment They Criticize in Others
Cao, J., Kleiman-Weiner, M., & Banaji, M. R. (2018) · Psychological Science · doi:10.1177/0956797618805750 · Cited by 25
Getting policy-makers to listen to field experiments
Dolan, P. J., & Galizzi, M. M. (2014) · Oxford Review of Economic Policy · doi:10.1093/oxrep/gru035 · Cited by 28
What is in a Name? Mutual Fund Flows When Managers Have Foreign Sounding NamesPreprint
Kumar, A., Niessen‐Ruenzi, A., & Spalt, O. G. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.1951524 · Cited by 21
Dunham, Y. C., Arechar, A. A., & Rand, D. G. (2019) · Judgment and Decision Making · doi:10.1017/s193029750000440x · Cited by 20
Self-citationIncreasing altruistic and cooperative behaviour with simple moral nudgesPreprint
Capraro, V., Jagfeld, G., Klein, R., Mul, M., & van de Pol, I. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/tbhqa · Cited by 22
The Dark Side of Embodiment - Teaming Up With Robots VS Disembodied Agents
Correia, F., Gomes, S., Mascarenhas, S. F., Melo, F. S., & Paiva, A. (2020) · Robotics: Science and Systems · doi:10.15607/rss.2020.xvi.010 · Cited by 26
“Furthermore, several experimental studies analysed the validity of comparing MTurk with laboratory subjects [43, 30, 6], even for economic games [2], showing comparable results in these two samples.”
ResultNationality dominates gender in decision-making in the Dictator and Prisoner’s Dilemma Games
Kumar, M. M., Tsoi, L., Lee, M. S., Cone, J., & McAuliffe, K. (2021) · PLoS ONE · doi:10.1371/journal.pone.0244568 · Cited by 26
“In other work, contributions of 43.8% were reported for economic games where payoffs were hypothetical, and so did not depend on decisions in the game (i.e., no-stakes games), and 33.2% for incentivized games [86].”
InfluentialDeVito, A. N., Calamia, M., Roye, S., Bernstein, J. P. K., & Castagna, P. (2019) · Journal of Psychopathology and Behavioral Assessment · doi:10.1007/s10862-018-9705-3 · Cited by 18
Estimating utility values for vesicoureteral reflux in the general public using an online tool
Lloyd, J. C., Yen, T., Pietrobon, R. S., Wiener, J. S., Ross, S. S., Kokorowski, P. K., Nelson, C. P., & Routh, J. C. (2014) · Journal of Pediatric Urology · doi:10.1016/j.jpurol.2014.02.014 · Cited by 18
Yamagishi, T., Li, Y., Matsumoto, Y., & Kiyonari, T. (2016) · Scientific Reports · doi:10.1038/srep27824 · Cited by 20
Exploring the Motivations for Punishment: Framing and Country-Level Effects
Bone, J. E., McAuliffe, K., & Raihani, N. (2016) · PLoS ONE · doi:10.1371/journal.pone.0159769 · Cited by 22
“In general, however, these small stakes do not seem to meaningfully affect behaviour (at least compared to what is observed in the lab (see [26, 53, 54]).”
BackgroundFrom dictators to avatars: Furthering social and personality psychology through game methods
Freedman, G., & Flanagan, M. (2017) · Social and Personality Psychology Compass · doi:10.1111/spc3.12368 · Cited by 23
Weippert, M., Rickler, M., Kluck, S., Behrens, K., Bastian, M., Mau‐Moeller, A., Bruhn, S., & Lischke, A. (2018) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2018.00268 · Cited by 20
“Although hypothetical reasoning and decision-making does not necessarily have to mirror real reasoning and decision-making (Amir et al., 2012; FeldmanHall et al., 2012), the dilemma task was the only possible task that allowed us to test our hypotheses about life and death decisions in an ethical way.”
BackgroundApplicability of the Investment Model Scale in a natural‐fertility population
Winking, J., Eastwick, P. W., Smith, L. K., & Koster, J. (2018) · Personal Relationships · doi:10.1111/pere.12257 · Cited by 20
Choice architects reveal a bias toward positivity and certainty
Daniels, D. P., & Zlatev, J. J. (2017) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2018.12.004 · Cited by 19
Samson, K., & Zaleśkiewicz, T. (2020) · European Journal of Social Psychology · doi:10.1002/ejsp.2648 · Cited by 19
Gender differences in the trade-off between objective equality and efficiency
Capraro, V. (2020) · Judgment and Decision Making · doi:10.1017/s1930297500007476 · Cited by 21
The role of costly commitment signals in assorting cooperators during intergroup conflict
Lang, M., Chvaja, R., & Purzycki, B. G. (2024) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2024.01.003 · Cited by 24
Lessons Learned from Crowdsourcing Complex Engineering Tasks
Staffelbach, M., Sempolinski, P., Kijewski-Correa, T. L., Thain, D., Wei, D., Kareem, A., & Madey, G. R. (2015) · PLoS ONE · doi:10.1371/journal.pone.0134978 · Cited by 15
“Mechanical Turk is a useful tool for conducting many types of research including behavioral research [6][7], survey research [8][9], economic game experiments [10], collective behavior experiments [11], exploring public knowledge gaps [12], and psychonomic research [13].”
BackgroundIncentive Magnitude Effects in Experimental Games: Bigger is not Necessarily Better
Pulford, B. D., Colman, A. M., & Loomes, G. (2018) · Games · doi:10.3390/g9010004 · Cited by 15
“Amir, Rand, and Gal [29] studied four types of games (Dictator Game, Trust Game, Ultimatum Game, and Public Goods Game), and concluded that $1 stakes produced results that were consistent with those when there were no stakes, and that the results from online experiments were consistent with those from in-person testin…”
ResultKamijo, Y., Tamura, T., & Hizen, Y. (2020) · Futures · doi:10.1016/j.futures.2020.102569 · Cited by 23
Who Cooperates in Repeated GamesPreprint
Dreber, A., Fudenberg, D., & Rand, D. G. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1752366 · Cited by 35
Self-citationCommon knowledge promotes cooperation in the threshold public goods game by reducing uncertainty
Deutchman, P., Amir, D., Jordan, M. R., & McAuliffe, K. (2021) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2021.12.003 · Cited by 23
Thielmann, I., & Hilbig, B. E. (2016) · Journal of Behavioral Decision Making · doi:10.1002/bdm.1962 · Cited by 16
Experimental evidence for a pure collaboration effect
McGrath, M. C., & Gerber, A. S. (2019) · Nature Human Behaviour · doi:10.1038/s41562-019-0530-9 · Cited by 14
Using crowdsourced online experiments to study context-dependency of behavior
Keuschnigg, M., Bader, F., & Bracher, J. (2016) · Social Science Research · doi:10.1016/j.ssresearch.2016.04.014 · Cited by 17
“Others have posed similar research questions before (Amir et al., 2012; Raihani et al., 2013), and recent studies systematically compared results from crowdsourced online experiments and behavioral games in the laboratory (e.”
MethodResultInfluentialThe threat premium in economic bargaining
Geniole, S. N., MacDonell, E. T., & McCormick, C. M. (2016) · Evolution and Human Behavior · doi:10.1016/j.evolhumbehav.2016.12.004 · Cited by 16
Gender Differences in Altruism on Mechanical Turk: Expectations and Actual BehaviourPreprint
Brañas‐Garza, P., Capraro, V., & Ramirez, E. G. R. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2796221 · Cited by 24
Ponsi, G., Panasiti, M. S., Aglioti, S. M., & Liuzza, M. T. (2017) · PLoS ONE · doi:10.1371/journal.pone.0190142 · Cited by 22
Testing Theories about Ethnic Markers: Ingroup Accent Facilitates Coordination, Not Cooperation
Jensen, N. H., Petersen, M. B., Høgh‐Olesen, H., & Ejstrup, M. (2015) · Human Nature · doi:10.1007/s12110-015-9229-4 · Cited by 15
“…have found that individuals are somewhat more prosocial and trusting with hypothetical rather than actual incentives (e.g. Forsythe et al. 1994; see Amir et al. 2012 for mixed findings), but other studies do not find significant differences (e.g. Ben-Ner et al. 2008, 2009; Gillis and Hettler 2007).”
ResultZhao, K., Kashima, Y., & Smillie, L. D. (2018) · Games · doi:10.3390/g9020030 · Cited by 15
“Although these stake sizes may seem somewhat low relative to standard practices in economics, they were considered appropriate in light of evidence that stake sizes have little to no effect on allocations in dictator games [4,56,57].”
Enhancing Central Bank Communications with Behavioural InsightsPreprint
Bholat, D. M., Broughton, N., Parker, A., Meer, J. T., & Walczak, E. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3233695 · Cited by 16
Conducting Interactive Experiments OnlinePreprint
Arechar, A. A., Gächter, S., & Molleman, L. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2884409 · Cited by 13
Effectively communicating the removal of fossil energy subsidies: Evidence from Latin America
Vieites, Y., Andretti, B., Weiss, M., Jacob, J., & Hallack, M. (2023) · Global Environmental Change · doi:10.1016/j.gloenvcha.2023.102690 · Cited by 15
Comprehension in economic games
Koppel, L., Andersson, D., Johannesson, M., Strømland, E., & Tinghög, G. (2025) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2025.107039 · Cited by 21
Nockur, L., Arndt, L., Keller, J., & Pfattheicher, S. (2020) · Scientific Reports · doi:10.1038/s41598-020-67757-1 · Cited by 16
How reputation does (and does not) drive people to punish without looking
Jordan, J., & Kteily, N. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2302475120 · Cited by 13
Autonomous Systems in Ethical Dilemmas: Attitudes towards Randomization
Bodenschatz, A., Uhl, M., & Walkowitz, G. (2020) · Computers in Human Behavior Reports · doi:10.1016/j.chbr.2021.100145 · Cited by 17
Are those who believe in God really more prosocial?
Stagnaro, M. N., Arechar, A. A., & Rand, D. G. (2019) · Religion Brain & Behavior · doi:10.1080/2153599x.2019.1695656 · Cited by 13
“Furthermore, Amir et al. (2012) find that the small stakes on AMT produce levels of giving comparable to those observed in higher stake offline laboratory settings.”
BackgroundSelf-citationPatience predicts cooperative synergy: The roles of ingroup bias and reciprocity
Espín, A. M., Correa, M., & Ruiz‐Villaverde, A. (2019) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2019.101465 · Cited by 17
Staffelbach, M., Sempolinski, P., Hachen, D. S., Kareem, A., Kijewski-Correa, T. L., Thain, D., Wei, D., & Madey, G. R. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1406.7588 · Cited by 12
“…research including behavioral research (Mason and Suri 2012, Crump et al. 2013), survey research (Buhrmester et al. 2011, Gosling et al. 2004), economic game experiments (Amir et al. 2012), collective behavior experiments (Suri and Watts 2011), and psychonomic research (Jasmin and Casasanto 2012).”
BackgroundAhl, R. E., Hannan, K., Amir, D., Baker, A., Sheskin, M., & McAuliffe, K. (2023) · Cognitive Development · doi:10.1016/j.cogdev.2023.101313 · Cited by 12
Risk attitudes: The central tendency bias
Akbari, K., Eigruber, M., & Vetschera, R. (2023) · EURO Journal on Decision Processes · doi:10.1016/j.ejdp.2023.100042 · Cited by 19
Andreassen, G. L., Kallbekken, S., & Rosendahl, K. E. (2024) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2024.103010 · Cited by 14
Differences Attract: An Experimental Study of Focusing in Economic Choice
Andersson, O., Carlson, J. I., & Wengström, E. (2021) · The Economic Journal · doi:10.1093/ej/ueab032 · Cited by 12
“11 MTurk has previously been used for conducting economic experiments and has proved to replicate behaviour from traditional lab experiments successfully (see, e.g., Horton et al., 2011; Suri and Watts, 2011; Amir and Rand, 2012; Dreber et al., 2013; Beranek et al., 2015; DellaVigna and Pope, 2017; 2018).”
BackgroundMethodThe role of trust in the social heuristics hypothesis
Montealegre, A., & Jiménez‐Leal, W. (2019) · PLoS ONE · doi:10.1371/journal.pone.0216329 · Cited by 12
“online economic experiments using low stakes have found similar results to lab studies [37].”
ResultJacobsen, G. D. (2019) · Policy Sciences · doi:10.1007/s11077-019-09353-3 · Cited by 11
“While uncertainty remains regarding the extent to which results from mTurk can be generalized to the broader population, there is growing evidence that the results from studies performed on mTurk are similar to the results obtained in conventional laboratory or field settings (Horton et al. 2011; Amir et al. 2012; Goo…”
A Cross-Cultural Study of Playing Simple Economic Games Online with Humans and Virtual Humans
Nouri, E., & Traum, D. R. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39262-7_30 · Cited by 12
Your Loss Is My Gain: A Recruitment Experiment with Framed IncentivesPreprint
de Quidt, J. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2418218 · Cited by 14
“(2011) and Amir et al. (2012) replicate some classic experimental results with MTurk workers.”
Strategic Self-Interest Motivates Seemingly 'Fair' Offers in the Ultimatum GamePreprint
Wells, J. S., & Rand, D. G. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2136707 · Cited by 11
Self-citationWhat Does a Job Candidate's Age Signal to Employers?Preprint
Borm, H. V., & Baert, S. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3513691 · Cited by 11
Voting Sustains Intergenerational Cooperation, Even When the Tipping Point Threshold is Ambiguous
Balmford, B., Marino, M., & Hauser, O. (2023) · Environmental and Resource Economics · doi:10.1007/s10640-023-00817-y · Cited by 10
Fanghella, V., Faure, C., Guetlein, M.-C., & Schleich, J. E. (2023) · Journal of Economic Psychology · doi:10.1016/j.joep.2023.102605 · Cited by 11
Tappin, B. M., & McKay, R. (2018) · Social Psychological and Personality Science · doi:10.1177/1948550617750736 · Cited by 13
Market-based policies, public opinion, and information
Jacobsen, G. D. (2020) · Economics Letters · doi:10.1016/j.econlet.2020.109018 · Cited by 10
Tejwani, R., Wang, H. S., Lloyd, J. C., Kokorowski, P. K., Nelson, C. P., & Routh, J. C. (2016) · The Journal of Urology · doi:10.1016/j.juro.2016.09.119 · Cited by 10
“Prior studies have found the AMT population to be more diverse and nationally representative than those from other widely used convenience samples, such as United States undergraduates, although not as representative as other (and costlier than) online probability samples.(12,13,26) Additional limitations must also be…”
Risk Taking Begets Risk Taking: Evidence from Casino Openings and Investor Portfolios
Liao, C. (2015) · Financial Review · doi:10.1111/fire.12315 · Cited by 13
The role of payoff parameters for cooperation in the one-shot Prisoner's Dilemma
Gächter, S., Lee, K., Sefton, M., & Weber, T. O. (2024) · European Economic Review · doi:10.1016/j.euroecorev.2024.104753 · Cited by 16
Andrews, T. M., Delton, A. W., & Kline, R. (2021) · Political Behavior · doi:10.1007/s11109-021-09700-2 · Cited by 12
Chuyin, Z., Koh, Z. H., Gallagher, R., Nishimoto, S., & Tsuchiya, N. (2022) · F1000Research · doi:10.12688/f1000research.75364.1 · Cited by 13
Development of the FDA Tobacco Credibility Scale (FDA-TCS)
Schmidt, A. M., Ranney, L. M., Noar, S. M., & Goldstein, A. O. (2016) · Tobacco Regulatory Science · doi:10.18001/trs.3.1.5 · Cited by 9
Determinants of financial loss aversion: The influence of prenatal androgen exposure (2D:4D)
Hermann, D. (2017) · Personality and Individual Differences · doi:10.1016/j.paid.2017.06.016 · Cited by 14
Peysakhovich, A., & Rand, D. G. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2908978 · Cited by 12
Self-citationSocial Versus Moral Preferences in the Ultimatum Game: A Theoretical Model and an ExperimentPreprint
Capraro, V. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3155257 · Cited by 9
Metadata
- Authors
- Amir, O., Rand, D. G., & Gal, Y. K.
- Affiliations
- Ben-Gurion University of the Negev (IL)
- Harvard University (US)
- Corresponding author
- Amir, Ofra
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2012-02-21
- Volume
- 7
- Issue
- 2
- Pages
- e31461
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3283743
- OpenAlex
- W3124416153
- Cited by
- 364
- References
- 39
- Citations by year
- 2026: 12 · 2025: 12 · 2024: 18 · 2023: 24 · 2022: 23 · 2021: 22 · 2020: 24 · 2019: 31 · 2018: 33 · 2017: 40 · 2016: 28 · 2015: 31 · 2014: 34 · 2013: 20 · 2012: 9
- FWCI
- 53.45
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- SSRN Electronic Journal (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Edinburgh Research Explorer (University of Edinburgh) (submittedVersion, cc-by)
- Funders
- John Templeton Foundation
- Harvard University
- European Commission (268362)
- Topics
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Experimental Behavioral Economics Studies
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Social Sciences › Decision Sciences › General Decision Sciences › Decision-Making and Behavioral Economics
- Keywords
- Amazon Mechanical Turk, digital labour markets, financial incentives, experimental design, participant behavior
- MeSH terms
- Behavior, Economics, Games, Experimental, Humans, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
