CoChat
Sign Up
Cited by 354Survey Methodology and NonresponseSurvey Sampling and Estimation TechniquesEconomic and Environmental Valuation

The DOI matches its Crossref record; 3 of the 3 references it cites were found in a registry or an index.

How to Run Surveys: A Guide to Creating Your Own Identifying Variation and Revealing the Invisible

Open access
Stantcheva, Stefanie·2023·Annual Review of Economics
DOI 10.1146/annurev-economics-091622-010157
Open this paper in CoChat — free accountOpen PDF

Abstract

Surveys are an essential approach for eliciting otherwise invisible factors such as perceptions, knowledge and beliefs, attitudes, and reasoning. These factors are critical determinants of social, economic, and political outcomes. Surveys are not merely a research tool. They are also not only a way of collecting data. Instead, they involve creating the process that will generate the data. This allows the researcher to create their own identifying and controlled variation. Thanks to the rise of mobile technologies and platforms, surveys offer valuable opportunities either to study broadly representative samples or to focus on specific groups. This article offers guidance on the complete survey process, from the design of the questions and experiments to the recruitment of respondents and the collection of data to the analysis of survey responses. It covers issues related to the sampling process, selection and attrition, attention and carelessness, survey question design and measurement, response biases, and survey experiments.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1146/annurev-economics-091622-010157

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 3 references

Research works printed but not linked: 50

  1. 2021, Perceptions of racial gaps, their causes, and ways to reduce them
  2. 2023, Immigration and redistribution, Rev. Econ. Stud., 90, 1, 10.1093/restud/rdac011 · DOI
  3. 2018, Intergenerational mobility and preferences for redistribution, Am. Econ. Rev., 108, 521, 10.1257/aer.20162015 · DOI
  4. 2015, Evaluating behaviorally motivated policy: experimental evidence from the lightbulb market, Am. Econ. Rev., 105, 2501, 10.1257/aer.20131564 · DOI
  5. 2006, Priming effects in complex information environments: reassessing the impact of news discourse on presidential approval, J. Politics, 68, 960, 10.1111/j.1468-2508.2006.00483.x · DOI
  6. 2018, The number of choice tasks and survey satisficing in conjoint experiments, Political Anal, 26, 112, 10.1017/pan.2017.40 · DOI
  7. 2014, The mind in the middle: a practical guide to priming and automaticity research, 311
  8. 2008, Testing the stability of an acquiescence style factor behind two interrelated substantive variables in a panel design, Sociol. Methods Res., 36, 542, 10.1177/0049124107313901 · DOI
  9. 2000, Modeling acquiescence in measurement models for two balanced sets of items, Struct. Equ. Model., 7, 608, 10.1207/S15328007SEM0704_5 · DOI
  10. 2016, Response biases in standardised surveys
  11. 2022, Choosing your pond: location choices and relative income, Rev. Econ. Stat., 104, 1010, 10.1162/rest_a_00991 · DOI
  12. 2008, What triggers public opposition to immigration? Anxiety, group cues, and immigration threat, Am. J. Political Sci., 52, 959, 10.1111/j.1540-5907.2008.00353.x · DOI · Paper page
  13. 1993, The Phantom Respondents: Opinion Surveys and Political Representation
  14. 1989, Multigroup comparisons and the assumption of equivalent construct validity across groups: methodological and substantive issues, Multivar. Behav. Res., 24, 503, 10.1207/s15327906mbr2404_7 · DOI
  15. 1989, Testing for the equivalence of factor covariance and mean structures: the issue of partial measurement invariance, Psychol. Bull., 105, 456, 10.1037/0033-2909.105.3.456 · DOI
  16. 2000, Assessing extreme and acquiescence response sets in cross-cultural research using structural equations modeling, J. Cross-Cult. Psychol., 31, 187, 10.1177/0022022100031002003 · DOI
  17. 2021, Increasing precision without altering treatment effects: repeated measures designs in survey experiments, Am. Political Sci. Rev., 115, 1048, 10.1017/S0003055421000241 · DOI
  18. 2015, Evidence for countercyclical risk aversion: an experiment with financial professionals, Am. Econ. Rev., 105, 860, 10.1257/aer.20131314 · DOI
  19. 2016, Priming in economics, Curr. Opin. Psychol., 12, 17, 10.1016/j.copsyc.2016.04.019 · DOI
  20. 2008, Using item response theory to measure extreme response style in marketing research: a global investigation, J. Market. Res., 45, 104, 10.1509/jmkr.45.1.104 · DOI
  21. 2022, Fighting climate change: international attitudes toward climate policies
  22. 2014, Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method
  23. 2020, Time discounting and wealth inequality, Am. Econ. Rev., 110, 1177, 10.1257/aer.20181096 · DOI
  24. 2018, Time varying risk aversion, J. Financ. Econ., 128, 403, 10.1016/j.jfineco.2018.02.007 · DOI
  25. 2020, Labor market concerns and support for immigration, J. Public Econ., 191, 104256, 10.1016/j.jpubeco.2020.104256 · DOI
  26. 2023, Beliefs about racial discrimination and support for pro-Black policies, Rev. Econ. Stat., 105, 40, 10.1162/rest_a_01036 · DOI
  27. 2020, Designing information provision experiments
  28. 2015, Validating vignette and conjoint survey experiments against real-world behavior, PNAS, 112, 2395, 10.1073/pnas.1416587112 · DOI · Paper page
  29. 2020, A comparison of different online sampling approaches for generating national samples
  30. 2021, Social position and fairness views
  31. 2014, Using priming manipulations to affect time preferences and risk aversion: an experimental study, J. Behav. Exp. Econ., 53, 36, 10.1016/j.socec.2014.08.006 · DOI
  32. 2005, The relation between culture and response styles: evidence from 19 countries, J. Cross-Cult. Psychol., 36, 264, 10.1177/0022022104272905 · DOI
  33. 2005, Structural equation modeling with ordinal variables using LISREL
  34. 2017, Richer (and holier) than thou? The effect of relative income improvements on demand for redistribution, Rev. Econ. Stat., 99, 201, 10.1162/REST_a_00623 · DOI
  35. 1999, Survey research, Annu. Rev. Psychol., 50, 537, 10.1146/annurev.psych.50.1.537 · DOI · Paper page
  36. 1996, Satisficing in surveys: initial evidence, New Dir. Eval., 70, 29
  37. 2015, How elastic are preferences for redistribution? Evidence from randomized survey experiments, Am. Econ. Rev., 105, 1478, 10.1257/aer.20130360 · DOI
  38. 2022, Information frictions among firms and households
  39. 2013, Illegal,” “undocumented,” or “unauthorized”: equivalency frames, issue frames, and public opinion on immigration, Perspect. Politics, 11, 789, 10.1017/S1537592713002077 · DOI
  40. 2011, Dealing with extreme response style in cross-cultural research: a restricted latent class factor analysis approach, Sociol. Methodol., 41, 13, 10.1111/j.1467-9531.2011.01238.x · DOI
  41. 2010, Optimizing survey questionnaire design in political science: insights from psychology, 27
  42. 2022, Writing survey questions, Pew Research Center
  43. 2000, Agenda-setting, priming, and framing revisited: another look at cognitive effects of political communication, Mass Commun. Soc., 3, 297
  44. 2009, “How many cases do I need?” On science and the logic of case selection in field-based research, Ethnography, 10, 5, 10.1177/1466138108099586 · DOI · Paper page
  45. 2021, Understanding tax policy: How do people reason?, Q. J. Econ., 136, 2309, 10.1093/qje/qjab033 · DOI
  46. 2022, Understanding of trade
  47. 2017, Designing valid and reliable vignette experiments for survey research: a case study on the fair gender income gap, J. Methods Measur. Soc. Sci., 7, 52
  48. 2019, Counting the hard to count in a census: select topics in international censuses
  49. 2022, The subjective inflation expectations of households and firms: measurement, determinants, and implications, J. Econ. Perspect., 36, 157, 10.1257/jep.36.3.157 · DOI
  50. 2003, Adjustment for acquiescence in the assessment of the construct equivalence of Likert-type score items, J. Cross-Cult. Psychol., 34, 702, 10.1177/0022022103257070 · DOI

Cited by

Sorted by citations

See all 354

Metadata

Authors
Stantcheva, S.
Affiliations
National Bureau of Economic Research (US)
Corresponding author
Stantcheva, Stefanie
Venue
Annual Review of Economics
Publisher
Annual Reviews
Published
2023-09-13
Volume
15
Issue
1
Pages
205-234
ISSN
  • 1941-1383 (ISSN-L)
  • 1941-1391
DOI
10.1146/annurev-economics-091622-010157
OpenAlex
W4360992037
Cited by
354
References
3
Citations by year
2026: 97 · 2025: 130 · 2024: 80 · 2023: 30
FWCI
16.92
Type
journal article
Language
en
Open access
Licence
Locations
Annual Review of Economics (publishedVersion, cc-by)
Topics
  • Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
  • Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Economic and Environmental Valuation
Keywords
survey design, survey experiment, participant recruitment, sampling, respondent attrition, response bias, question design, measurement, survey data collection, mobile surveys, attitudes and beliefs

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: How to Run Surveys: A Guide to Creating Your Own Identifying Variation and Revealing the Invisible. https://app.cochat.ai/papers/10.1146/annurev-economics-091622-010157
The paper
Stantcheva, S. (2023). How to Run Surveys: A Guide to Creating Your Own Identifying Variation and Revealing the Invisible. Annual Review of Economics. https://doi.org/10.1146/annurev-economics-091622-010157