The DOI matches its Crossref record.
Survey Questions: Handcrafting the Standardized Questionnaire
Abstract
This book reviews the experimental literature on how survey questions behave as well as the lore of professional experience and culls from them those guiding principles and specific findings that have implications for writing survey questions. Mindful that the findings of experiments cannot be applied mechanically and that survey questions cannot be mass-produced they have suggested a number of ways in which to make pilot and pretest work more fruitful. The authors have arranged ideas about writing questions in 3 classes or concentric circles which progressively narrow to the specific design task and the book is written in 3 chapters to match. Chapter 1 bears on general strategies culled from examples or experience of question-crafters and the findings of empirical researchers. This material is a litany of cautions offering more general perspectives than specific procedures. Chapter 2 focuses on specific empirical findings. In recent years there has been renewed research into question design and question effects and much has been learned about how some questions tend to behave. But the implications of this research for actual practice are not always clear. Chapter 3 tries to zero in on the actual task at hand. It discusses pilot work pretesting and making use of the advice of experts--critics colleagues and especially interviewers. It is commonplace that all survey questions must be pretested but there is no commonly shared tradition about how to go about it. The authors are most familiar with questionnaires designed for use with the broad American public--national cross-sections drawn by the Institute for Social Research or samples of the greater Detroit metropolitan area by the Detroit Area Study so some of the cautions urged in chapter 1 may not apply to surveying the well educated or intensely motivated such as college students legislators social scientists political activists and medical patients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
KESSLER, R. C., ANDREWS, G., COLPE, L. J., HIRIPI, E., MROCZEK, D. K., NORMAND, S.-L. T., WALTERS, E. E., & ZASLAVSKY, A. M. (2002) · Psychological Medicine · doi:10.1017/s0033291702006074 · Cited by 10,327
Desimone, L. M. (2009) · Educational Researcher · doi:10.3102/0013189x08331140 · Cited by 4,862
Scale Development Research: A Content Analysis and Recommendations for Best Practices
Worthington, R. L., & Whittaker, T. A. (2006) · The Counseling Psychologist · doi:10.1177/0011000006288127 · Cited by 4,087
MacKenzie, S. B., Podsakoff, P. M., & Podsakoff, N. P. (2011) · MIS Quarterly · doi:10.2307/23044045 · Cited by 3,165
Marsden, P. V. (1990) · Annual Review of Sociology · doi:10.1146/annurev.so.16.080190.002251 · Cited by 2,176
Empirical research methods in operations management
Flynn, B. B., Sakakibara, S., Schroeder, R. G., Bates, K. A., & Flynn, E. J. (1990) · Journal of Operations Management · doi:10.1016/0272-6963(90)90098-x · Cited by 1,634
Research synthesis: the practice of cognitive interviewing
Beatty, P. C., & Willis, G. B. (2007) · Public Opinion Quarterly · doi:10.1093/poq/nfm006 · Cited by 1,615
Survey research in operations management: a process‐based perspective
Forza, C. (2002) · International Journal of Operations & Production Management · doi:10.1108/01443570210414310 · Cited by 1,610
An Empirical Investigation of the Factors Affecting Data Warehousing Success1
Wixom, B. H., & Watson, H. J. (2001) · MIS Quarterly · doi:10.2307/3250957 · Cited by 1,438
Assessing dimensions of perceived visual aesthetics of web sites
Lavie, T., & Tractinsky, N. (2004) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2003.09.002 · Cited by 1,335
Criteria for Scale Selection and Evaluation
Robinson, J. P., Shaver, P. R., & Wrightsman, L. S. (1991) · Measures of Personality and Social Psychological Attitudes · doi:10.1016/b978-0-12-590241-0.50005-8 · Cited by 1,229
Research Report: Empirical Test of an EDI Adoption Model
Chwelos, P., Benbasat, I., & Dexter, A. S. (2001) · Information Systems Research · doi:10.1287/isre.12.3.304.9708 · Cited by 1,157
The World Health Organization Health and Work Performance Questionnaire (HPQ)
Kessler, R. C., Barber, C., Beck, A., Berglund, P., Cleary, P. D., McKenas, D., Pronk, N., Simon, G., Stang, P., Ustun, T. B., et al. (2003) · Journal of Occupational and Environmental Medicine · doi:10.1097/01.jom.0000052967.43131.51 · Cited by 1,148
Vallerand, R. J. (1989) · Canadian Psychology / Psychologie canadienne · doi:10.1037/h0079856 · Cited by 1,113
Methods for Testing and Evaluating Survey Questionnaires
(2004) · doi:10.1002/0471654728 · Cited by 855
Weijters, B., Cabooter, E., & Schillewaert, N. (2010) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2010.02.004 · Cited by 801
Sample size for pre-tests of questionnaires
Perneger, T. V., Courvoisier, D. S., Hudelson, P. M., & Gayet-Ageron, A. (2015) · Quality of Life Research · doi:10.1007/s11136-014-0752-2 · Cited by 639
The Science of Asking Questions
Schaeffer, N. C., & Presser, S. (2003) · Annual Review of Sociology · doi:10.1146/annurev.soc.29.110702.110112 · Cited by 621
Self-citationKONRAD, A. M., & LINNEHANLinnehan, F. (1995) · Academy of Management Journal · doi:10.2307/256746 · Cited by 614
e-Government Adoption Model (GAM): Differing service maturity levels
Shareef, M. A., Kumar, V., Kumar, U., & Dwivedi, Y. K. (2011) · Government Information Quarterly · doi:10.1016/j.giq.2010.05.006 · Cited by 581
Hu, S., & Kuh, G. D. (2002) · Research in Higher Education · doi:10.1023/a:1020114231387 · Cited by 565
The Impact of “No Opinion” Response Options on Data Quality
Krosnick, J. A., Holbrook, A. L., Berent, M. K., Carson, R. T., Hanemann, W. M., Kopp, R. J., Mitchell, R. C., Presser, S., Ruud, P. A., Smith, V. K., et al. (2001) · Public Opinion Quarterly · doi:10.1086/341394 · Cited by 546
Self-citationSprangers, M. A. G., Cull, A., Bjordal, K., Groenvold, M., Aaronson, N. K., & EORTC Study Group on Quality of Life (1993) · Quality of Life Research · doi:10.1007/bf00434800 · Cited by 514
Constructing Effective Questionnaires
Peterson, R. (2000) · Sage eBooks · doi:10.4135/9781483349022 · Cited by 499
The Fallacy of Formative Measurement
Edwards, J. R. (2011) · Organizational Research Methods · doi:10.1177/1094428110378369 · Cited by 495
Design and Analysis of Quality of Life Studies in Clinical Trials
Fairclough, D. L. (2002) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420035438 · Cited by 461
Parental attitudes toward child rearing: Instruments, issues, and implications.
Holden, G. W., & Edwards, L. A. (1989) · Psychological Bulletin · doi:10.1037//0033-2909.106.1.29 · Cited by 420
Optimal recall periods for patient-reported outcomes: challenges and potential solutions
Stull, D. E., Leidy, N. K., Parasuraman, B., & Chassany, O. (2009) · Current Medical Research and Opinion · doi:10.1185/03007990902774765 · Cited by 404
Designing and Conducting Health Surveys
Aday, L. A. (1998) · Journal For Healthcare Quality · doi:10.1097/01445442-199805000-00015 · Cited by 391
McHorney, C. A., Bricker, D. E., Kramer, A. E., Rosenbek, J. C., Robbins, J., Chignell, K. A., Logemann, J. A., & Clarke, C. (2000) · Dysphagia · doi:10.1007/s004550010012 · Cited by 371
The lens of personhood: Viewing the self and others in a multicultural society.
Oyserman, D. (1993) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.65.5.993 · Cited by 369
National Comorbidity Survey Replication Adolescent Supplement (NCS-A): I. Background and Measures
Merikangas, K. R., Avenevoli, S., Costello, E. J., Koretz, D., & Kessler, R. C. (2009) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/chi.0b013e31819996f1 · Cited by 351
Neighborhood Context and Residential Mobility
Lee, B. A., Oropesa, R. S., & Kanan, J. W. (1994) · Demography · doi:10.2307/2061885 · Cited by 349
Diversity Experiences and College Student Learning and Personal Development
Hu, S., & Kuh, G. D. (2003) · Journal of College Student Development · doi:10.1353/csd.2003.0026 · Cited by 348
Questionnaires in Second Language Research
(2009) · Questionnaires in Second Language Research · doi:10.4324/9780203864739-1 · Cited by 334
Effects of Work Hour Reduction on Residents’ Lives: A Systematic Review
Fletcher, K. E., Underwood, W., Davis, S. Q., Mangrulkar, R. S., McMahon, L. F., & Saint, S. (2005) · JAMA · doi:10.1001/jama.294.9.1088 · Cited by 328
Prados, J. W., Peterson, G. D., & Lattuca, L. R. (2005) · Journal of Engineering Education · doi:10.1002/j.2168-9830.2005.tb00836.x · Cited by 320
Methodological considerations in the refinement of clinical assessment instruments.
Smith, G. T., & McCarthy, D. M. (1995) · Psychological Assessment · doi:10.1037//1040-3590.7.3.300 · Cited by 311
Explanatory Variables for EFL Students' Expository Writing
Sasaki, M., & Hirose, K. (1996) · Language Learning · doi:10.1111/j.1467-1770.1996.tb00643.x · Cited by 308
Decomposing Audience Costs: Bringing the Audience Back into Audience Cost Theory
Kertzer, J. D., & Brutger, R. (2016) · American Journal of Political Science · doi:10.1111/ajps.12201 · Cited by 305
A Typology of Student Engagement for American Colleges and Universities
Pike, G. R., & Kuh, G. D. (2005) · Research in Higher Education · doi:10.1007/s11162-004-1599-0 · Cited by 303
Assessing what to address in science communication
Bruine de Bruin, W., & Bostrom, A. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1212729110 · Cited by 290
Mixed method data collection strategies
(2007) · Choice Reviews Online · doi:10.5860/choice.44-6909 · Cited by 278
Testa, M., VanZile-Tamsen, C., Livingston, J. A., & Koss, M. P. (2004) · Psychology of Women Quarterly · doi:10.1111/j.1471-6402.2004.00143.x · Cited by 278
Sprangers, M. A. G., Cull, A., Groenvold, M., Bjordal, K., Blazeby, J. M., & Aaronson, N. K. (1998) · Quality of Life Research · doi:10.1023/a:1024977728719 · Cited by 277
Survey Pretesting: Do Different Methods Produce Different Results?
Presser, S., & Blair, J. (1994) · Sociological Methodology · doi:10.2307/270979 · Cited by 274
Self-citationMcHorney, C. A., Bricker, D. E., Robbins, J., Kramer, A. E., Rosenbek, J. C., & Chignell, K. A. (2000) · Dysphagia · doi:10.1007/s004550010013 · Cited by 269
Secondary transfer effects of intergroup contact: Alternative accounts and underlying processes.
Tausch, N., Hewstone, M., Kenworthy, J. B., Psaltis, C., Schmid, K., Popan, J. R., Cairns, E., & Hughes, J. (2010) · Journal of Personality and Social Psychology · doi:10.1037/a0018553 · Cited by 260
College Student Responses to Web and Paper Surveys: Does Mode Matter?
Carini, R. M., Hayek, J. C., Kuh, G. D., Kennedy, J. M., & Ouimet, J. A. (2003) · Research in Higher Education · doi:10.1023/a:1021363527731 · Cited by 252
A Summary of Survey Methodology Best Practices for Security and Privacy Researchers
Redmiles, E. M., Acar, Y., Fahl, S., & Mazurek, M. L. (2017) · Digital Repository at the University of Maryland · doi:10.13016/m22k2w · Cited by 50
Rafiaani, P., Dikopoulou, Z., Van Dael, M., Kuppens, T., Azadi, H., Lebailly, P., & Van Passel, S. (2020) · Social Indicators Research · doi:10.1007/s11205-019-02154-4 · Cited by 41
Schiele, J. J., & McCue, C. P. (2011) · Journal of Public Procurement · doi:10.1108/jopp-11-02-2011-b003 · Cited by 32
Managers’ Motivation Profiles: Measurement and Application
Andersen, J. A. (2018) · Sage Open · doi:10.1177/2158244018771732 · Cited by 30
Metadata
- Authors
- Quarm, D., Converse, J. M., & Presser, S.
- Venue
- Teaching Sociology
- Publisher
- SAGE Publications
- Published
- 1988-07
- Volume
- 16
- Issue
- 3
- Pages
- 314
- ISSN
- 0092-055X (ISSN-L)
- OpenAlex
- W1991425471
- Cited by
- 766
- References
- 0
- FWCI
- 41.37
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.