Methods for Testing and Evaluating Survey Questions

Presser, S.; Couper, M. P.; Lessler, J. T.; Martin, E.; Martin, J.; Rothgeb, J. M.; Singer, E.

doi:10.1093/poq/nfh008

Cited by 550Survey Methodology and NonresponseSurvey Sampling and Estimation TechniquesPsychometric Methodologies and Testing

Methods for Testing and Evaluating Survey Questions

Presser, S., Couper, M. P., Lessler, J. T., Martin, E., Martin, J., Rothgeb, J. M., Singer, E.·2004·Public Opinion Quarterly

DOI 10.1093/poq/nfh008

Open this paper in CoChat — free account

Abstract

An examination of survey pretesting reveals a paradox. On the one hand, pretesting is the only way to evaluate in advance whether a questionnaire causes problems for interviewers or respondents. Consequently, both elementary textbooks and experienced researchers declare pretesting indispensable. On the other hand, most textbooks offer minimal, if any, guidance about pretesting methods, and published survey reports usually provide no information about whether questionnaires were pretested and, if so, how, and with what results. Moreover, until recently there was relatively little methodological research on pretesting. Thus pretesting’s universally acknowledged importance has been honored more in the breach than in the practice, and not a great deal is known about many aspects of pretesting, including the extent to which pretests serve their intended purpose and lead to improved questionnaires. Pretesting dates to the founding of the modern sample survey in the mid-1930s or shortly thereafter. The earliest references in scholarly journals are from 1940, by which time pretests apparently were well established. In that year Katz reported, “The American Institute of Public Opinion [i.e., Gallup] and Fortune [i.e., Roper] pretest their questions to avoid phrasings which will be unintelligible to the public and to avoid issues unknown to the man on the street” (Katz 1940, p. 279).

Integrity signals

Registry

Crossref · 10.1093/poq/nfh008

Cites

7 of 7 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Using quantitative and qualitative methods is a widely recommended practice in survey-development and questionnaire evaluation.
“Data were collected using quantitative and qualitative methods, which is a widely recommended practice in survey-development and questionnaire evaluation [20].”
From Optimizing household survey methods to monitor the Sustainable Development Goals targets 6.1 and 6.2 on drinking water, sanitation and hygiene: A mixed-methods field-test in Belize (2017) · cites this paper as [20]
The PRO field generally has not taken full advantage of decades of knowledge in survey research psychology to construct items and responses that most clearly depict the experience of a symptom or an impact of a treatment or a condition.
“In addition, the PRO field generally has not taken full advantage of the decades of knowledge in the field of survey research psychology to construct items and responses that most clearly depict the experience of a symptom or an impact of a treatment or a condition [9–11].”
From PRO development: rigorous qualitative research as the crucial foundation (2010) · cites this paper as [9]

Convergent and discriminant validation by the multitrait-multimethod matrix.
Campbell, D. T., & Fiske, D. W. (1959) · Psychological Bulletin · doi:10.1037/h0046016 · Cited by 17,116 · see citing works
Untitled work
Ericsson (1993) · doi:10.1037/0033-295x.87.3.215 · Cited by 4,539 · see citing works
The Science of Asking Questions
Schaeffer, N. C., & Presser, S. (2003) · Annual Review of Sociology · doi:10.1146/annurev.soc.29.110702.110112 · Cited by 625 · see citing works
Self-citation
The Pretest in Survey Research: Issues and Preliminary Findings
Hunt, S. D., Sparkman, R. D., & Wilcox, J. B. (1982) · Journal of Marketing Research · doi:10.2307/3151627 · Cited by 478 · see citing works
Construct Validity and Error Components of Survey Measures: A Structural Modeling Approach
Andrews, F. M. (1984) · Public Opinion Quarterly · doi:10.1086/268840 · Cited by 419 · see citing works
Pretesting of Questionnaires
Sletto, R. F. (1940) · American Sociological Review · doi:10.2307/2083634 · Cited by 63 · see citing works
Three Criteria: Knowledge, Conviction, and Significance
Katz, D. M. (1940) · Public Opinion Quarterly · doi:10.1086/265403 · Cited by 11 · see citing works

Flagged first, then by citations

Sorted by citations

Contemporary Guidance for Stated Preference Studies
Johnston, R. J., Boyle, K., Adamowicz, W., Bennett, J., Brouwer, R., Cameron, T. A., Hanemann, W. M., Hanley, N. D., Ryan, M., Riccardo Scarpa, A., et al. (2017) · Journal of the Association of Environmental and Resource Economists · doi:10.1086/691697 · Cited by 1,458 · see citing works
Content Validity—Establishing and Reporting the Evidence in Newly Developed Patient-Reported Outcomes (PRO) Instruments for Medical Product Evaluation: ISPOR PRO Good Research Practices Task Force Report: Part 2—Assessing Respondent Understanding
Patrick, D. L., Burke, L. B., Gwaltney, C. J., Leidy, N. K., Martin, M. L., Molsen, E., & Ring, L. (2011) · Value in Health · doi:10.1016/j.jval.2011.06.013 · Cited by 1,135 · see citing works
E‐mail interviewing in qualitative research: A methodological discussion
Meho, L. I. (2006) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.20416 · Cited by 751 · see citing works
Sample size for pre-tests of questionnaires
Perneger, T., Courvoisier, D. S., Hudelson, P. M., & Gayet‐Ageron, A. (2014) · Quality of Life Research · doi:10.1007/s11136-014-0752-2 · Cited by 645 · see citing works
PRO development: rigorous qualitative research as the crucial foundation
Lasch, K. E., Marquis, P., Vigneux, M., Abetz, L., Arnould, B., Bayliss, M., Crawford, B., & Rosa, K. (2010) · Quality of Life Research · doi:10.1007/s11136-010-9677-6 · Cited by 461 · see citing works
SMEs internationalization: The role of product innovation, market intelligence, pricing and marketing communication capabilities as drivers of SMEs’ international performance
Falahat, M., Ramayah, T., Soto‐Acosta, P., & Lee, Y.-Y. (2020) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2020.119908 · Cited by 350 · see citing works
Cognitive Interviewing for Item Development: Validity Evidence Based on Content and Response Processes
Peterson, C. H., Peterson, N. A., & Powell, K. G. (2017) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2017.1339564 · Cited by 336 · see citing works
Workplace happiness: work engagement, career satisfaction, and subjective well-being
Joo, B.-K. B., & Lee, I. (2017) · Evidence-based HRM a Global Forum for Empirical Scholarship · doi:10.1108/ebhrm-04-2015-0011 · Cited by 320 · see citing works
Revisiting the theoretical and methodological foundations of depression measurement
Fried, E. I., Flake, J. K., & Robinaugh, D. J. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00050-2 · Cited by 285 · see citing works
Linking social norms to efficient conservation investment in payments for ecosystem services
Chen, X., Frank Lupi, B., He, G., & Liu, J. (2009) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0809980106 · Cited by 248 · see citing works
Composite International Diagnostic Interview screening scales for DSM-IV anxiety and mood disorders
Kessler, R. C., Calabrese, J. R., Farley, P. A., Gruber, M. J., Jewell, M. A., Katon, W. J., Keck, P. E., Nierenberg, A. A., Sampson, N. A., Shear, M. K., et al. (2012) · Psychological Medicine · doi:10.1017/s0033291712002334 · Cited by 218 · see citing works
Monitoring the health of transgender and other gender minority populations: Validity of natal sex and gender identity survey items in a U.S. national cohort of young adults
Reisner, S. L., Conron, K. J., Tardiff, L. A., Steele, S. J., Gordon, A. R., & Austin, S. B. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-1224 · Cited by 198 · see citing works
Developing a Measure of Scientific Literacy for Middle School Students
Fives, H., Huebner, W. W., Birnbaum, A. S., & Nicolich, M. J. (2014) · Science Education · doi:10.1002/sce.21115 · Cited by 197 · see citing works
Interviewing to develop Patient-Reported Outcome (PRO) measures for clinical research: eliciting patients’ experience
Brédart, A., Marrel, A., Abetz-Webb, L., Lasch, K., & Acquadro, C. (2014) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-12-15 · Cited by 195 · see citing works
A perspective on scale development in entrepreneurship research
Slavec, A., & Drnovšek, M. (2012) · Economic and business review · doi:10.15458/2335-4216.1203 · Cited by 184 · see citing works
Cross-Cultural Cognitive Interviewing
Willis, G., & Miller, K. R. (2011) · Field Methods · doi:10.1177/1525822x11416092 · Cited by 160 · see citing works
Using Cognitive Interviews to Develop Surveys in Diverse Populations
Nápoles‐Springer, A. M., Santoyo‐Olsson, J., Brien, H. O., & Stewart, A. L. (2006) · Medical Care · doi:10.1097/01.mlr.0000245425.65905.1d · Cited by 160 · see citing works
Examining customer channel selection intention in the omni-channel retail environment
Xu, X., & Jackson, J. E. (2018) · International Journal of Production Economics · doi:10.1016/j.ijpe.2018.12.009 · Cited by 159 · see citing works
Building competences for new customer value creation: An exploratory study
Berghman, L., Matthyssens, P., & Vandenbempt, K. (2006) · Industrial Marketing Management · doi:10.1016/j.indmarman.2006.04.006 · Cited by 157 · see citing works
Wiki Surveys: Open and Quantifiable Social Data Collection
Salganik, M., & Levy, K. E. C. (2015) · PLoS ONE · doi:10.1371/journal.pone.0123483 · Cited by 164 · see citing works
The importance of pretesting questionnaires: a field research example of cognitive pretesting the Exercise referral Quality of Life Scale (ER-QLS)
Hilton, C. E. (2015) · International Journal of Social Research Methodology · doi:10.1080/13645579.2015.1091640 · Cited by 148 · see citing works
Survey Questionnaire Survey Pretesting Method: An Evaluation of Survey Questionnaire via Expert Reviews Technique
Ikart, E. M. (2019) · Asian Journal of Social Science Studies · doi:10.20849/ajsss.v4i2.565 · Cited by 140 · see citing works
Developing and validating a nutrition knowledge questionnaire: key methods and considerations
Trakman, G., Forsyth, A. K., Hoye, R., & Belski, R. (2017) · Public Health Nutrition · doi:10.1017/s1368980017001471 · Cited by 140 · see citing works
The Effects of Frame of Reference on Responses to Questions About Sexual Assault Victimization and Perpetration
Abbey, A., Parkhill, M. R., & Koss, M. P. (2005) · Psychology of Women Quarterly · doi:10.1111/j.1471-6402.2005.00236.x · Cited by 135 · see citing works
Using a web-based survey tool to undertake a Delphi study: Application for nurse education research
Gill, F. J., Leslie, G. D., Grech, C., & Latour, J. M. (2013) · Nurse Education Today · doi:10.1016/j.nedt.2013.02.016 · Cited by 133 · see citing works
Smart governance for heritage tourism destinations: Contextual factors and destination management organization perspectives
Mandić, A., & Kennell, J. S. (2021) · Tourism Management Perspectives · doi:10.1016/j.tmp.2021.100862 · Cited by 156 · see citing works
Measuring corporate social responsibility: A critical review of survey instruments
Latif, K. F., & Sajjad, A. (2018) · Corporate Social Responsibility and Environmental Management · doi:10.1002/csr.1630 · Cited by 127 · see citing works
Survey Research in HCI
Müller, H., Sedley, A., & Nunge, E. (2014) · Springer eBooks · doi:10.1007/978-1-4939-0378-8_10 · Cited by 123 · see citing works
How corruption investigations undermine regime support: evidence from China
Wang, Y., & Dickson, B. J. (2021) · Political Science Research and Methods · doi:10.1017/psrm.2021.27 · Cited by 114 · see citing works
How to measure a latent construct: Psychometric principles for the development and validation of measurement instruments
El‐Den, S., Schneider, C. R., Mirzaei, A., & Carter, S. (2020) · International Journal of Pharmacy Practice · doi:10.1111/ijpp.12600 · Cited by 125 · see citing works
Effects of gamification on participation and data quality in a real-world market research domain
Cechanowicz, J., Gutwin, C., Brownell, B., & Goodfellow, L. (2013) · Proceedings of the First International Conference on Gameful Design, Research, and Applications · doi:10.1145/2583008.2583016 · Cited by 103 · see citing works
Socially Assigned Gender Nonconformity: A Brief Measure for Use in Surveillance and Investigation of Health Disparities
Wylie, S. A., Corliss, H. L., Boulanger, V., Prokop, L. A., & Austin, S. B. (2010) · Sex Roles · doi:10.1007/s11199-010-9798-y · Cited by 107 · see citing works
The relationship between employee satisfaction and organisational performance: Evidence from a South African government department
Mafini, C., & Pooe, D. R. I. (2013) · SA Journal of Industrial Psychology · doi:10.4102/sajip.v39i1.1090 · Cited by 94 · see citing works
The impact of packaging, price and brand awareness on brand loyalty: Evidence from the paint retailing industry
Dhurup, M. R., Mafini, C., & Dumasi, T. (2014) · Acta Commercii · doi:10.4102/ac.v14i1.194 · Cited by 89 · see citing works
Team Design Thinking, Product Innovativeness, and the Moderating Role of Problem Unfamiliarity
Nagaraj, V., Berente, N., Lyytinen, K., & Gaskin, J. E. (2020) · Journal of Product Innovation Management · doi:10.1111/jpim.12528 · Cited by 91 · see citing works
Role of Cognitive Testing in the Development of the CAHPS® Hospital Survey
Levine, R. E., Fowler, F. J., & Brown, J. A. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00472.x · Cited by 89 · see citing works
Challenging the Construct Validity of Mindfulness Assessment—a Cognitive Interview Study of the Freiburg Mindfulness Inventory
Belzer, F., Schmidt, S., Lucius-Hoene, G., Schneider, J. F., Orellana-Rios, C. L., & Sauer, S. (2013) · Mindfulness · doi:10.1007/s12671-012-0165-7 · Cited by 88 · see citing works
The association between “Brain‐Age Score” ( BAS ) and traditional neuropsychological screening tools in Alzheimer's disease
Beheshti, I., Maikusa, N., & Matsuda, H. (2018) · Brain and Behavior · doi:10.1002/brb3.1020 · Cited by 86 · see citing works
Exploring a theoretical model of climate change action for youth
Busch, K. C., Ardoin, N. M., Grühn, D., & Stevenson, K. T. (2019) · International Journal of Science Education · doi:10.1080/09500693.2019.1680903 · Cited by 86 · see citing works
Designing Effective Interview Chatbots: Automatic Chatbot Profiling and Design Suggestion Generation for Chatbot Debugging
Han, X., Zhou, M., Turner, M. J., & YEH, T. P. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445569 · Cited by 89 · see citing works
User adaptation to interactive advertising formats: The effect of previous exposure, habit and time urgency on ad skipping behaviors
Belanche, D., Flavián, C., & Pérez-Rueda, A. (2017) · Telematics and Informatics · doi:10.1016/j.tele.2017.04.006 · Cited by 86 · see citing works
Comparing Cognitive Interviewing and Psychometric Methods to Evaluate a Racial/Ethnic Discrimination Scale
Reeve, B. B., Willis, G., Shariff-Marco, S. N., Breen, N., Williams, D. R., Gee, G. C., Alegría, M., Takeuchi, D. T., Stapleton, M., & Levin, K. Y. (2011) · Field Methods · doi:10.1177/1525822x11416564 · Cited by 81 · see citing works
Underlying barriers to referral to paediatric palliative care services
Twamley, K., Craig, F., Kelly, P., Hollowell, D. R., Mendoza, P., & Bluebond‐Langner, M. (2013) · Journal of Child Health Care · doi:10.1177/1367493512468363 · Cited by 83 · see citing works
Cognitive Interviewing and Think Aloud Methods
Padilla, J., & Leighton, J. P. (2017) · Social indicators research series · doi:10.1007/978-3-319-56129-5_12 · Cited by 81 · see citing works
Evaluating a Constructivist and Culturally Responsive Approach to Environmental Education for Diverse Audiences
Stern, M. J., Powell, R. B., & Ardoin, N. M. (2010) · The Journal of Environmental Education · doi:10.1080/00958961003796849 · Cited by 79 · see citing works
Current practices and barriers impairing physicians’ and nurses’ adherence to analgo-sedation recommendations in the intensive care unit - a national survey
Sneyers, B., Laterre, P., Perreault, M. M., Wouters, D., & Spinewine, A. (2014) · Critical Care · doi:10.1186/s13054-014-0655-1 · Cited by 74 · see citing works
Survey Development for Adolescents Aged 11–16 Years: A Developmental Science Based Guide
Omrani, A., Scurr, J., Smith, J., & Brown, N. (2018) · Adolescent Research Review · doi:10.1007/s40894-018-0089-0 · Cited by 73 · see citing works
Encouraging Vietnamese Household Recycling Behavior: Insights and Implications
Nguyen, N., Nguyễn, H. V., Lobo, A., & Dao, S. T. (2017) · Sustainability · doi:10.3390/su9020179 · Cited by 75 · see citing works
Growing up in Bradford: protocol for the age 7–11 follow up of the Born in Bradford birth cohort
Bird, P. K., McEachan, R., Mon-Williams, M. A., Small, N., West, J., Whincup, P. H., Wright, J., Andrews, E., Barber, S., Hill, L. J. B., et al. (2019) · BMC Public Health · doi:10.1186/s12889-019-7222-2 · Cited by 69 · see citing works
Reviewing the quality of awareness support in collaborative applications
Antunes, P. A., Herskovic, V., Ochoa, S. F., & Pino, J. A. (2013) · Journal of Systems and Software · doi:10.1016/j.jss.2013.11.1078 · Cited by 69 · see citing works
Development and validation of scales to measure environmental responsibility, character development, and attitudes toward school
Powell, R. B., Stern, M. J., Krohn, B. D., & Ardoin, N. M. (2011) · Environmental Education Research · doi:10.1080/13504621003692891 · Cited by 66 · see citing works
An empirical investigation of determinants of effectual and causal decision logics in online and high-tech start-up firms
Frese, T., Geiger, I., & Dost, F. (2019) · Small Business Economics · doi:10.1007/s11187-019-00147-8 · Cited by 69 · see citing works
Exploring self-rated health among adolescents: a think-aloud study
Joffer, J., Jerdén, L., Öhman, A., & Flacking, R. (2016) · BMC Public Health · doi:10.1186/s12889-016-2837-z · Cited by 68 · see citing works
Rigor in social life cycle assessment: improving the scientific grounding of SLCA
Grubert, E. A. (2016) · The International Journal of Life Cycle Assessment · doi:10.1007/s11367-016-1117-6 · Cited by 66 · see citing works
Work Cognition and Psychological Well-Being: The Role of Cognitive Engagement as a Partial Mediator
Joo, B.-K. B., Zigarmi, D., Nimon, K., & Shuck, B. (2017) · The Journal of Applied Behavioral Science · doi:10.1177/0021886316688780 · Cited by 67 · see citing works
Empowering leadership and employee creativity: the mediating roles of work engagement and knowledge sharing
Joo, B.-K. B., Yim, J., Jin, Y. S., & Han, S. J. (2022) · European journal of training and development · doi:10.1108/ejtd-02-2022-0016 · Cited by 87 · see citing works
The importance of public risk perception for the effective management of pluvial floods in urban areas: A case study from Germany
Netzel, L., Heldt, S., Engler, S., & Denecke, M. (2021) · Journal of Flood Risk Management · doi:10.1111/jfr3.12688 · Cited by 64 · see citing works
Quantitative Research Methods
Kazanskaia, A. N. (2025) · doi:10.64357/quantitative-research-methods-2025 · Cited by 67 · see citing works
Willingness to pay, borrow, and work for rural water service improvements in developing countries
Abramson, A., Becker, N., Garb, Y., & Lazarovitch, N. (2011) · Water Resources Research · doi:10.1029/2010wr010147 · Cited by 64 · see citing works
Conducting Cognitive Interviews in Cross-National Settings
Lee, J. (2012) · Assessment · doi:10.1177/1073191112436671 · Cited by 64 · see citing works
Development and validation of the Movement Imagery Questionnaire for Children (MIQ-C)
Martini, R., Carter, M. J., Yoxon, E., Cumming, J., & Ste‐Marie, D. M. (2015) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2015.08.008 · Cited by 61 · see citing works
Interpersonal and Personal Factors Influencing Sexual Debut Among Mexican-American Young Women in the United States
Gilliam, M. L., Berlin, A., Kozloski, M., Hernandez, M., & Grundy, M. E. (2007) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2007.05.009 · Cited by 60 · see citing works
Applied Bayesian Modeling and Causal Inference from Incomplete Data Perspectives
Dialsingh, I. (2005) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2005.00368_7.x · Cited by 59 · see citing works
Reporting on first sexual experience
Poulin, M. J. (2010) · Demographic Research · doi:10.4054/demres.2010.22.11 · Cited by 58 · see citing works
Fairness: the hidden challenge for competency-based postgraduate medical education programs
Colbert, C. Y., French, J. C., Herring, M. E., & Dannefer, E. F. (2017) · Perspectives on Medical Education · doi:10.1007/s40037-017-0359-8 · Cited by 58 · see citing works
Measuring positive mental health and flourishing in Denmark: validation of the mental health continuum-short form (MHC-SF) and cross-cultural comparison across three countries
Santini, Z. I., Torres-Sahli, M., Hinrichsen, C., Meilstrup, C., Madsen, K. R., Rayce, S. B., Baker, M. M., ten Have, M., Schotanus-Dijkstra, M., & Koushede, V. (2020) · Health and Quality of Life Outcomes · doi:10.1186/s12955-020-01546-2 · Cited by 60 · see citing works
Cognitive Interviewing: A Qualitative Tool for Improving Questionnaires in Sport Science
Dietrich, H., & Ehrlenspiel, F. (2010) · Measurement in Physical Education and Exercise Science · doi:10.1080/10913670903455025 · Cited by 57 · see citing works
The value of cognitive interviewing for optimizing a patient experience survey
Buers, C., Triemstra, M., Bloemendal, E., Zwijnenberg, N. C., Hendriks, M. C. P., & Delnoij, D. M. J. (2013) · International Journal of Social Research Methodology · doi:10.1080/13645579.2012.750830 · Cited by 56 · see citing works
Designing Alternative Representations of Confusion Matrices to Support Non-Expert Public Understanding of Algorithm Performance
Shen, H., Jin, H., Cabrera, Á. A., Perer, A., Zhu, H., & Hong, J. (2020) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3415224 · Cited by 57 · see citing works
Methods for Testing and Evaluating Survey Questionnaires
Campanelli, P. (2005) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2005.00368_13.x · Cited by 53 · see citing works
Improvement of teacher’s professional competency in strengthening learning methods to maximize curriculum implementation
Prasetyono, H., Abdillah, A., Djuhartono, T., Ramdayana, I. P., & Desnaranti, L. (2021) · International Journal of Evaluation and Research in Education (IJERE) · doi:10.11591/ijere.v10i2.21010 · Cited by 51 · see citing works
Examining how rural ecological contexts influence children’s early learning opportunities
Iruka, I. U., DeKraai, M., Walther, J., Sheridan, S. M., & Abdel-Monem, T. (2020) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2019.09.005 · Cited by 51 · see citing works
Students' mindset to adopt AI chatbots for effectiveness of online learning in higher education
Rahman, M. K., Ismail, N. A., Hossain, D., & Hossen, M. S. (2025) · Future Business Journal · doi:10.1186/s43093-025-00459-0 · Cited by 75 · see citing works
Collecting survey-based social network information in work organizations
Agneessens, F., & Labianca, G. (2021) · Social Networks · doi:10.1016/j.socnet.2021.04.003 · Cited by 50 · see citing works
Identifying and developing crosscutting environmental education outcomes for adolescents in the twenty-first century (EE21)
Powell, R. B., Stern, M. J., Frensley, B. T., & Moore, D. D. (2019) · Environmental Education Research · doi:10.1080/13504622.2019.1607259 · Cited by 49 · see citing works
How well do physical activity questions perform? A European cognitive testing study
Finger, J. D., Gisle, L., Mimilidis, H., Santos-Hoevener, C., Kruusmaa, E., Matsi, A., Oja, L., Balarajan, M., Gray, M., Kratz, A. L., et al. (2015) · Archives of Public Health · doi:10.1186/s13690-015-0109-5 · Cited by 46 · see citing works
Infant formula and toddler milk marketing and caregiver's provision to young children
Romo‐Palafox, M. J., Pomeranz, J. L., & Harris, J. L. (2020) · Maternal and Child Nutrition · doi:10.1111/mcn.12962 · Cited by 48 · see citing works
E-learning in Higher Educational Institutions in Kuwait: Experiences and Challenges
Mubarak, M., & Ghinea, G. (2013) · International Journal of Advanced Computer Science and Applications · doi:10.14569/ijacsa.2013.040401 · Cited by 47 · see citing works
Vignette question design for the assessment of graduate sustainability learning outcomes
Sandri, O. J., Holdsworth, S., & Thomas, I. (2016) · Environmental Education Research · doi:10.1080/13504622.2016.1263280 · Cited by 47 · see citing works
Designing Experiments and Analyzing Data: a Model Comparison Perspective, 2nd edn
Bailey, R. A. (2005) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2005.00368_9.x · Cited by 47 · see citing works
Optimizing household survey methods to monitor the Sustainable Development Goals targets 6.1 and 6.2 on drinking water, sanitation and hygiene: A mixed-methods field-test in Belize
Khan, S. M., Bain, R. E. S., Lunze, K., Unalan, T., Beshanski-Pedersen, B., Slaymaker, T., Johnston, R., & Hancioglu, A. (2017) · PLOS ONE · doi:10.1371/journal.pone.0189089 · Cited by 46 · see citing works
Same Question But Different Answer: Experimental Evidence on Questionnaire Design's Impact on Poverty Measured by Proxies
Kilic, T., & Sohnesen, T. P. (2017) · Review of Income and Wealth · doi:10.1111/roiw.12343 · Cited by 46 · see citing works
Evaluating Item-Sort Task Methods: The Presentation of a New Statistical Significance Formula and Methodological Best Practices
Howard, M. C., & Melloy, R. C. (2016) · Journal of Business and Psychology · doi:10.1007/s10869-015-9404-y · Cited by 45 · see citing works
Small but powerful: The importance of French community gardens for residents
Torres, A. C., Prévot, A., & Nadot, S. (2018) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2018.08.005 · Cited by 44 · see citing works
Successful implementation of cognitive interviews in special populations
DeMuro, C., Lewis, S. A., DiBenedetti, D. B., Price, M. A., & Fehnel, S. E. (2012) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/erp.11.103 · Cited by 43 · see citing works
The Use of Client-side Paradata in Analyzing the Effects of Visual Layout on Changing Responses in Web Surveys
Stern, M. J. (2008) · Field Methods · doi:10.1177/1525822x08320421 · Cited by 42 · see citing works
Qualitative Versus Quantitative Methods in Psychiatric Research
Razafsha, M., Behforuzi, H., Azari, H., Zhang, Z., Wang, K., Kobeissy, F. H., & Gold, M. S. (2011) · Methods in molecular biology · doi:10.1007/978-1-61779-458-2_3 · Cited by 41 · see citing works
Analysis of Nonequivalent Assessments Across Different Linguistic Groups Using a Mixed Methods Approach
Benítez, I., & Padilla, J. (2013) · Journal of Mixed Methods Research · doi:10.1177/1558689813488245 · Cited by 41 · see citing works
Are Nonprobability Surveys Fit for Purpose?
Jerit, J., & Barabas, J. (2023) · Public Opinion Quarterly · doi:10.1093/poq/nfad037 · Cited by 40 · see citing works
Pre-test of questions on health-related resource use and expenditure, using behaviour coding and cognitive interviewing techniques
Chernyak, N., Ernsting, C., & Icks, A. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-303 · Cited by 40 · see citing works
Use of cognitive interviews in the development of the PLUS-M item bank
Morgan, S. J., Amtmann, D., Abrahamson, D. C., Kajlich, A. J., & Hafner, B. J. (2014) · Quality of Life Research · doi:10.1007/s11136-013-0618-z · Cited by 40 · see citing works
Home nursing for children with home mechanical ventilation in the United States: Key informant perspectives
Sobotka, S. A., Dholakia, A. V., Berry, J. G., Brenner, M., Graham, R. J., Goodman, D. M., & Agrawal, R. (2020) · Pediatric Pulmonology · doi:10.1002/ppul.25078 · Cited by 40 · see citing works
Getting back to the basics of survey research
Umbach, P. D. (2005) · New Directions for Institutional Research · doi:10.1002/ir.157 · Cited by 40 · see citing works
Mixed Methods and Causal Analysis
Harding, D. J., & Seefeldt, K. S. (2013) · Handbooks of sociology and social research · doi:10.1007/978-94-007-6094-3_6 · Cited by 39 · see citing works
Response Process Validity Evidence in Chemistry Education Research
Deng, J. M., Streja, N., & Flynn, A. B. (2021) · Journal of Chemical Education · doi:10.1021/acs.jchemed.1c00749 · Cited by 39 · see citing works
Familial, Cultural and Psychosocial Influences of Use of Effective Methods of Contraception among Mexican-American Adolescents and Young Adults
Gilliam, M. L., Neustadt, A. B., Whitaker, A. K., & Kozloski, M. (2010) · Journal of Pediatric and Adolescent Gynecology · doi:10.1016/j.jpag.2010.10.002 · Cited by 39 · see citing works
What the Resident Meant to Say: Use of Cognitive Interviewing Techniques to Develop Questionnaires for Nursing Home Residents
Housen, P., Shannon, G. R., Simon, B. F., Edelen, M. O., Cadogan, M. P., Sohn, L., Jones, M., Buchanan, J. L., & Saliba, D. (2008) · The Gerontologist · doi:10.1093/geront/48.2.158 · Cited by 39 · see citing works
How to interpret surveys in medical research: A practical approach
Colbert, C. Y., Diaz‐Guzman, E., Myers, J., & Arroliga, A. C. (2013) · Cleveland Clinic Journal of Medicine · doi:10.3949/ccjm.80a.12122 · Cited by 38 · see citing works
The Malay version of the Early Childhood Oral Health Impact Scale (Malay-ECOHIS) – assessing validity and reliability
Hashim, A. N., Yusof, Z. Y. M., & Esa, R. (2015) · Health and Quality of Life Outcomes · doi:10.1186/s12955-015-0386-2 · Cited by 38 · see citing works
Pre-testing Semi-structured Interview Questions Using Expert Review and Cognitive Interview Methods
Bhalla, S., Bahar, N., & Kanapathy, K. (2023) · International Journal of Business and Management · doi:10.26666/rmp.ijbm.2023.5.2 · Cited by 42 · see citing works

Authors: Presser, S., Couper, M. P., Lessler, J. T., Martin, E., Martin, J., Rothgeb, J. M., & Singer, E.
Affiliations: University of Maryland, College Park (US)
University of Michigan (US)
RTI International (US)
United States Census Bureau (US)
Office for National Statistics (GB)
ORCID: Couper, M. P.
Venue: Public Opinion Quarterly
Publisher: Oxford University Press (OUP)
Published: 2004-03-01
Volume: 68
Issue: 1
Pages: 109-130
ISSN: 0033-362X (ISSN-L)
1537-5331
DOI: 10.1093/poq/nfh008
OpenAlex: W4238241388
Cited by: 546
References: 7
Citations by year: 2026: 48 · 2025: 37 · 2024: 46 · 2023: 36 · 2022: 41 · 2021: 59 · 2020: 32 · 2019: 38 · 2018: 29 · 2017: 23 · 2016: 21 · 2015: 19 · 2014: 21 · 2013: 17 · 2012: 17
FWCI: 26.60
Type: journal article
Language: en
Open access: closed
Locations: Public Opinion Quarterly (publishedVersion)
Topics: Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Keywords: questionnaire evaluation, questionnaire development, respondent comprehension, history of survey research

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Methods for Testing and Evaluating Survey Questions

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks