The DOI matches its Crossref record; 84 of the 84 references it cites were found in a registry or an index.
Experimenting with Measurement Error: Techniques with Applications to the Caltech Cohort Study
Abstract
Measurement error is ubiquitous in experimental work. It leads to imperfect statistical controls, attenuated estimated effects of elicited behaviors, and biased correlations between characteristics. We develop statistical techniques for handling experimental measurement error. These techniques are applied to data from the Caltech Cohort Study, which conducts repeated incentivized surveys of the Caltech student body. We replicate three classic experiments, demonstrating that results change substantially when measurement error is accounted for. Collectively, these results show that failing to properly account for measurement error may cause a field-wide bias leading scholars to identify “new” phenomena.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
Knight, F. H. (1921) · Cited by 13,740
Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties
Fan, J., & Li, R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501753382273 · Cited by 8,900
The proof and measurement of association between two things
Spearman, C. (1904) · The American Journal of Psychology · doi:10.2307/1412159 · Cited by 8,039
“Risk, Ambiguity, and the Savage Axioms.”
Ellsberg, D. (1961) · The Quarterly Journal of Economics · doi:10.2307/1884324 · Cited by 7,891
Risk Aversion and Incentive Effects
Holt, C. A., & Laury, S. K. (2002) · American Economic Review · doi:10.1257/000282802762024700 · Cited by 5,939
Gender Differences in Preferences
Croson, R., & Gneezy, U. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.2.448 · Cited by 5,694
Cognitive Reflection and Decision Making
Frederick, S. (2005) · Journal of Economic Perspectives · doi:10.1257/089533005775196732 · Cited by 5,256
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
INDIVIDUAL RISK ATTITUDES: MEASUREMENT, DETERMINANTS, AND BEHAVIORAL CONSEQUENCES
Dohmen, T., Falk, A., Huffman, D., Sunde, U., Schupp, J., & Wagner, G. G. (2011) · Journal of the European Economic Association · doi:10.1111/j.1542-4774.2011.01015.x · Cited by 3,896
Gender differences in risk taking: a meta-analysis
Byrnes, J. P., Miller, D. C., & Schafer, W. D. (1999) · Psychological Bulletin · doi:10.1037/0033-2909.125.3.367 · Cited by 3,723
The Estimation of Economic Relationships using Instrumental Variables
Sargan, J. D. (1958) · Econometrica · doi:10.2307/1907619 · Cited by 3,377
Do Women Shy Away From Competition? Do Men Compete Too Much?
Niederle, M., & Vesterlund, L. (2007) · The Quarterly Journal of Economics · doi:10.1162/qjec.122.3.1067 · Cited by 3,186
A domain‐specific risk‐attitude scale: measuring risk perceptions and risk behaviors
Weber, E. U., Blais, A., & Betz, N. E. (2002) · Journal of Behavioral Decision Making · doi:10.1002/bdm.414 · Cited by 2,936
Quantal Response Equilibria for Normal Form Games
McKelvey, R. D., & Palfrey, T. R. (1995) · Games and Economic Behavior · doi:10.1006/game.1995.1023 · Cited by 2,545
Straightforward Statistics for the Behavioral Sciences.
Wuensch, K. L., & Evans, J. D. (1996) · Journal of the American Statistical Association · doi:10.2307/2291607 · Cited by 2,409
The trouble with overconfidence.
Moore, D. A., & Healy, P. J. (2008) · Psychological Review · doi:10.1037/0033-295x.115.2.502 · Cited by 2,358
Angrist, J. D., & Krueger, A. B. (2001) · Journal of Economic Perspectives · doi:10.1257/jep.15.4.69 · Cited by 2,355
Performance in competitive environments: gender differences
Gneezy, U., Niederle, M., & Rustichini, A. (2003) · The Quarterly Journal of Economics · doi:10.1162/00335530360698496 · Cited by 1,997
Handbook of the Economics of FinancePreprint
Constantinides, G. M., Harris, M., & Stulz, R. M. (2013) · RePEc: Research Papers in Economics · Cited by 1,932
Engel, C. (2011) · Experimental Economics · doi:10.1007/s10683-011-9283-7 · Cited by 1,783
Inference on Treatment Effects after Selection among High-Dimensional Controls
Belloni, A., Chernozhukov, V., & Hansen, C. (2014) · The Review of Economic Studies · doi:10.1093/restud/rdt044 · Cited by 1,508
Unraveling in Guessing Games: An Experimental Study
Nagel, R. (2007) · American Economic Review · Cited by 1,414
Do People Mean What They Say? Implications for Subjective Survey Data
Bertrand, M., & Mullainathan, S. (2001) · American Economic Review · doi:10.1257/aer.91.2.67 · Cited by 1,391
An Experiment on Risk Taking and Evaluation Periods
Gneezy, U., & Potters, J. (1997) · The Quarterly Journal of Economics · doi:10.1162/003355397555217 · Cited by 1,288
Durbin, J. (1954) · Revue de l'Institut International de Statistique / Review of the International Statistical Institute · doi:10.2307/1401917 · Cited by 1,269
An introduction to instrumental variables for epidemiologists
Greenland, S. (2000) · International Journal of Epidemiology · doi:10.1093/ije/29.4.722 · Cited by 1,156
Sex differences and statistical stereotyping in attitudes toward financial risk
Eckel, C. C., & Grossman, P. J. (2002) · Evolution and Human Behavior · doi:10.1016/s1090-5138(02)00097-1 · Cited by 1,014
The Fitting of Straight Lines if Both Variables are Subject to Error
Wald, A. (1940) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177731868 · Cited by 900
Forecasting risk attitudes: An experimental study using actual and forecast gamble choices
Eckel, C. C., & Grossman, P. J. (2008) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2008.04.006 · Cited by 839
Gender, Competitiveness, and Career Choices *
Buser, T., Niederle, M., & Oosterbeek, H. (2014) · The Quarterly Journal of Economics · doi:10.1093/qje/qju009 · Cited by 800
Experimental methods: Eliciting risk preferences
Charness, G., Gneezy, U., & Imas, A. (2013) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2012.12.023 · Cited by 791
The Behavior of Individual Investors
Barber, B. M., & Odean, T. (2013) · Handbook of the Economics of Finance · doi:10.1016/b978-0-44-459406-8.00022-6 · Cited by 750
Small Telescopes: Detectability and the Evaluation of Replication Results
Simonsohn, U. (2015) · Psychological Science · doi:10.1177/0956797614567341 · Cited by 742
Handbook of Experimental Economic Results
Plott, C. R., & Smith, V. L. (2008) · RePEc: Research Papers in Economics · Cited by 708
MODEL SELECTION AND INFERENCE: FACTS AND FICTION
Leeb, H., & Pötscher, B. M. (2005) · Econometric Theory · doi:10.1017/s0266466605050036 · Cited by 701
Men, Women and Risk Aversion: Experimental Evidence
Eckel, C. C., & Grossman, P. J. (2008) · Cited by 662
Mismeasured Variables in Econometric Analysis: Problems from the Right and Problems from the Left
Hausman, J. (2001) · Journal of Economic Perspectives · doi:10.1257/jep.15.4.57 · Cited by 652
Square-root lasso: pivotal recovery of sparse signals via conic programming
Belloni, A., Chernozhukov, V., & Wang, L. (2011) · Biometrika · doi:10.1093/biomet/asr043 · Cited by 635
Ellsberg Revisited: An Experimental Study
Halevy, Y. (2007) · Econometrica · doi:10.1111/j.1468-0262.2006.00755.x · Cited by 609
Relationship between obesity, insulin resistance, and coronary heart disease risk
Abbasi, F., Brown, B. W., Lamendola, C., McLaughlin, T., & Reaven, G. M. (2002) · Journal of the American College of Cardiology · doi:10.1016/s0735-1097(02)02051-x · Cited by 573
Eliciting risk preferences: When is simple better?
Dave, C., Eckel, C. C., Johnson, C. A., & Rojas, C. (2010) · Journal of Risk and Uncertainty · doi:10.1007/s11166-010-9103-z · Cited by 498
Dhrymes, P. J. (1988) · International Journal of Forecasting · doi:10.1016/0169-2070(88)90090-8 · Cited by 462
The Ellsberg Paradox and Risk Aversion: An Anticipated Utility Approach
Segal, U. (1987) · International Economic Review · doi:10.2307/2526866 · Cited by 434
Condon, D. M., & Revelle, W. (2014) · Intelligence · doi:10.1016/j.intell.2014.01.004 · Cited by 433
Measurement Error: Models, Methods, and Applications
Buonaccorsi, J. P. (2010) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420066586 · Cited by 424
Testing When a Parameter is on the Boundary of the Maintained Hypothesis
Andrews, D. W. K. (2001) · Econometrica · doi:10.1111/1468-0262.00210 · Cited by 421
Two-Stage Lotteries without the Reduction Axiom
Segal, U. (1990) · Econometrica · doi:10.2307/2938207 · Cited by 379
Overconfidence in Political Behavior
Ortoleva, P., & Snowberg, E. (2015) · American Economic Review · doi:10.1257/aer.20130921 · Cited by 355
Self-citationAdcock, R. J. (1878) · The Analyst · doi:10.2307/2635758 · Cited by 316
Estimating ambiguity aversion in a portfolio choice experiment
Ahn, D., Choi, S., Gale, D., & Kariv, S. (2014) · Quantitative Economics · doi:10.3982/qe243 · Cited by 303
Measurement Error: Models, Methods, and Applications
Buonaccorsi, J. P. (2010) · Thammasat University Digital Collections · Cited by 272
Assessment of risk taking behavior.
Slovic, P. (1964) · Psychological Bulletin · doi:10.1037/h0043608 · Cited by 244
DO LAB EXPERIMENTS MISREPRESENT SOCIAL PREFERENCES? THE CASE OF SELF-SELECTED STUDENT SAMPLES
Falk, A., Meier, S., & Zehnder, C. (2013) · Journal of the European Economic Association · doi:10.1111/jeea.12019 · Cited by 243
Are risk preferences stable? Comparing an experimental measure with a validated survey-based measure
Anderson, L. R., & Mellor, J. M. (2009) · Journal of Risk and Uncertainty · doi:10.1007/s11166-009-9075-z · Cited by 222
Confluence Analysis by Means of Lag Moments and Other Methods of Confluence Analysis
Reiersol, O. (1941) · Econometrica · doi:10.2307/1907171 · Cited by 220
Statistical Power Analysis for the Behavioral Sciences
(2010) · Encyclopedia of Research Design · doi:10.4135/9781412961288.n443 · Cited by 217
Do We Follow Others when We Should? A Simple Test of Rational Expectations
Weizsäcker, G. (2010) · American Economic Review · doi:10.1257/aer.100.5.2340 · Cited by 194
Risk attitudes, randomization to treatment, and self-selection into experiments
Harrison, G. W., Lau, M. I., & Elisabet Rutström, E. (2009) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2008.02.011 · Cited by 168
The psychometric and empirical properties of measures of risk preferences
Beauchamp, J. P., Cesarini, D., & Johannesson, M. (2017) · Journal of Risk and Uncertainty · doi:10.1007/s11166-017-9261-3 · Cited by 161
Friedman, D., Isaac, R. M., James, D., & Sunder, S. (2014) · Routledge eBooks · doi:10.4324/9781315819891 · Cited by 144
A TEST OF CONSUMER DEMAND THEORY USING OBSERVATIONS OF INDIVIDUAL CONSUMER PURCHASES
Battalio, R. C., Kagel, J. H., Winkler, R. C., Fisher, E. B., BASMANN, R. L., & Krasner, L. (1973) · Economic Inquiry · doi:10.1111/j.1465-7295.1973.tb00972.x · Cited by 133
Hey, J. D. (2017) · WORLD SCIENTIFIC eBooks · doi:10.1142/10872 · Cited by 128
Theory of the Consumption Function
Friedman, M. (2018) · Princeton University Press eBooks · doi:10.2307/j.ctv39x7zh · Cited by 116
Endogeneity in high dimensions
Fan, J., & Liao, Y. (2014) · The Annals of Statistics · doi:10.1214/13-aos1202 · Cited by 109
Belief updating and the demand for information
Ambuehl, S., & Li, S. (2017) · Games and Economic Behavior · doi:10.1016/j.geb.2017.11.009 · Cited by 109
Carroll, R. J., & Stefanski, L. A. (1994) · Statistics in Medicine · doi:10.1002/sim.4780131208 · Cited by 90
Risky Curves: On the Empirical Failure of Expected UtilityPreprint
Friedman, D., Isaac, R. M., James, D., et al. (2014) · RePEc: Research Papers in Economics · Cited by 89
Is there selection bias in laboratory experiments? The case of social and risk preferences
Cleave, B. L., Nikiforakis, N., & Slonim, R. L. (2012) · Experimental Economics · doi:10.1007/s10683-012-9342-8 · Cited by 89
Control of spurious association and the reliability of the controlled variable.
Kahneman, D. J. (1965) · Psychological Bulletin · doi:10.1037/h0022529 · Cited by 84
The strengths and limitations of parental heights as a predictor of attained height
Wright, C. M., & Cheetham, T. D. (1999) · Archives of Disease in Childhood · doi:10.1136/adc.81.3.257 · Cited by 84
A Paradox for the ''Smooth Ambiguity'' Model of Preference
(2010) · Econometrica · doi:10.3982/ecta8689 · Cited by 74
Measuring Individual Risk Attitudes when Preferences are Imprecise
Loomes, G., & Pogrebna, G. (2014) · The Economic Journal · doi:10.1111/ecoj.12143 · Cited by 73
Towards the Development of an Evolutionarily Valid Domain-Specific Risk-Taking Scale
Kruger, D. J., Wang, X. T., & Wilke, A. (2007) · Evolutionary Psychology · doi:10.1177/147470490700500306 · Cited by 71
Evidence of a new violation of the independence axiom
Loomes, G. (1991) · Journal of Risk and Uncertainty · doi:10.1007/bf00057888 · Cited by 68
Measuring Risk Attitudes Controlling for Personality TraitsPreprint
DECK, C. A., Lee, J., Reyes, J. A., & Rosen, C. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1148521 · Cited by 60
The precision of subjective data and the explanatory power of economic models
Drerup, T. H., Enke, B., & von Gaudecker, H. (2017) · Journal of Econometrics · doi:10.1016/j.jeconom.2017.06.017 · Cited by 60
Quantal Response Equilibrium: A Stochastic Theory of Games
Goeree, J. K., Holt, C. A., & Palfrey, T. R. (2016) · UNSWorks (UNSW Sydney) · Cited by 44
Collusion through communication in auctions
Agranov, M., & Yariv, L. (2017) · Games and Economic Behavior · doi:10.1016/j.geb.2017.10.021 · Cited by 43
Self-citationPriming under Fire: Reverse Causality and the Classic Media Priming Hypothesis
Hart, A. R., & Middleton, J. A. (2014) · The Journal of Politics · doi:10.1017/s0022381613001539 · Cited by 27
Fong, C. M., & Luttmer, E. F. P. (2009) · National Bureau of Economic Research · doi:10.3386/w15064 · Cited by 25
A survey of some applications of the idea of ambiguity aversion in economics
Mukerji, S. (2000) · International Journal of Approximate Reasoning · doi:10.1016/s0888-613x(00)00036-0 · Cited by 20
Measuring the Measurement Error: A Method to Qualitatively Validate Survey DataPreprint
Blattman, C., Jamison, J., Koroknay-Palicz, T., Rodrigues, K., & Sheridan, M. A. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2449048 · Cited by 5
Cited by
Designing Information Provision Experiments
Haaland, I., Roth, C., & Wohlfart, J. (2023) · Journal of Economic Literature · doi:10.1257/jel.20211658 · Cited by 541
Five Facts about Beliefs and Portfolios
Giglio, S., Maggiori, M., Stroebel, J., & Utkus, S. (2021) · American Economic Review · doi:10.1257/aer.20200243 · Cited by 509
Falk, A., Becker, A., Dohmen, T., Huffman, D., & Sunde, U. (2023) · Management Science · doi:10.1287/mnsc.2022.4455 · Cited by 477
Female political representation and substantive effects on policies: A literature review
Hessami, Z., & da Fonseca, M. L. (2020) · European Journal of Political Economy · doi:10.1016/j.ejpoleco.2020.101896 · Cited by 306
Testing the Waters: Behavior across Participant Pools
Snowberg, E., & Yariv, L. (2021) · American Economic Review · doi:10.1257/aer.20181065 · Cited by 273
Self-citation
Metadata
- Authors
- Gillen, B., Snowberg, E., & Yariv, L.
- Venue
- Journal of Political Economy
- Publisher
- University of Chicago Press
- Published
- 2019-08
- Volume
- 127
- Issue
- 4
- Pages
- 1826-1863
- ISSN
- 0022-3808 (ISSN-L)
- 1537-534X
- OpenAlex
- W1568882873
- Cited by
- 350
- References
- 84
- FWCI
- 64.36
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.