Design Effects in the Transition to Web-Based Surveys
Abstract
Innovation within survey modes should always be mitigated by concerns about survey quality and in particular sampling, coverage, nonresponse, and measurement error. This is as true today with the development of web surveying as it was in the 1970s when telephone surveying was being developed. This paper focuses on measurement error in web surveys. Although Internet technology provides significant opportunities for innovation in survey design, systematic research has yet to be conducted on how most of the possible innovations might affect measurement error, leaving many survey designers "out in the cold." This paper summarizes recent research to provide an overview of how choosing the web mode affects the asking and answering of questions. It starts with examples of how question formats used in other survey modes perform differently in the web mode. It then provides examples of how the visual design of web surveys can influence answers in unexpected ways and how researchers can strategically use visual design to get respondents to provide their answers in a desired format. Finally, the paper concludes with suggested guidelines for web survey design.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The DAWBA interview has generated realistic prevalence estimates of mental disorders when used in public health services.
“it has generated realistic prevalence estimates of mental disorders when used in public health services [32,45].”
From Mental disorders in foster children: a study of prevalence, comorbidity and risk factors (2013) · cites this paper as [45]
Cites
Grice, H. P. (1975) · Speech Acts · doi:10.1163/9789004368811_003 · Cited by 23,221 · see citing works
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587 · see citing works
Self-citationMail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070232 · Cited by 3,240 · see citing works
Nielsen, J. (1999) · University of Maribor digital library (University of Maribor) · Cited by 1,620 · see citing works
To mix or not to mix data collection modes in surveys.
de Leeuw, E. D. (2005) · Journal of Official Statistics · Cited by 808 · see citing works
Web Survey Design and Administration
Couper, M. P., Traugott, M. W., & Lamias, M. J. (2001) · Public Opinion Quarterly · doi:10.1086/322199 · Cited by 785 · see citing works
Cognition and Communication: Judgmental Biases, Research Methods, and the Logic of Conversation
Schwarz, N. (2014) · Medical Entomology and Zoology · Cited by 537 · see citing works
Survey Measurement and Process Quality
Ziegel, E. R., Lyberg, L. E., Biemer, P. P., Collins, M., de Leeuw, E. D., Dippo, C. S., Schwartz, N., & Trewin, D. (1998) · Technometrics · doi:10.2307/1271416 · Cited by 427 · see citing works
Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions
Tourangeau, R. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh035 · Cited by 404 · see citing works
Data Quality in Mail, Telephone and Face to Face Surveys.
Leeuw, D., & de Leeuw, E. D. (1992) · Cited by 393 · see citing works
Surveys by Telephone: A National Comparison with Personal Interviews.
Ferree, G. D., Groves, R. M., & Kahn, R. L. (1982) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2066654 · Cited by 371 · see citing works
Wright, D. L., Aquilino, W. S., & Supple, A. J. (1998) · Public Opinion Quarterly · doi:10.1086/297849 · Cited by 205 · see citing works
Comparing Check-All and Forced-Choice Question Formats in Web Surveys
Smyth, J. D. (2006) · Public Opinion Quarterly · doi:10.1093/poq/nfj007 · Cited by 201 · see citing works
Self-citationTowards a Theory of Self‐Administered Questionnaire Design
Jenkins, C. R., & Dillman, D. A. (1997) · Wiley series in probability and statistics · doi:10.1002/9781118490013.ch7 · Cited by 193 · see citing works
Self-citationRESEARCH ON SURVEY DATA QUALITY
Groves, R. M. (1987) · Public Opinion Quarterly · doi:10.1093/poq/51.4_part_2.s156 · Cited by 184 · see citing works
Christian, L. M., & Dillman, D. A. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh004 · Cited by 167 · see citing works
Self-citationSurveys by Telephone: A National Comparison with Personal Interviews
Wiseman, F., Groves, R. M., & Kahn, R. L. (1980) · Journal of Marketing Research · doi:10.2307/3150518 · Cited by 144 · see citing works
Survey Measurement and Process Quality
(1998) · Technometrics · doi:10.1080/00401706.1998.10485505 · Cited by 125 · see citing works
Picture This!: Exploring Visual Effects in Web Surveys
Couper, M. P. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh013 · Cited by 124 · see citing works
Christian, L. M., Dillman, D. A., & Smyth, J. D. (2007) · Public Opinion Quarterly · doi:10.1093/poq/nfl039 · Cited by 106 · see citing works
Self-citationBest, S. J., & Krueger, B. S. (2004) · Sage eBooks · doi:10.4135/9781412984553 · Cited by 95 · see citing works
(2018) · Springer Publishing Company eBooks · doi:10.1891/9780826170620.0008 · Cited by 91 · see citing works
FORMAL FEATURES OF RATING SCALES AND THE INTERPRETATION OF QUESTION MEANING
Schwarz, N., Grayson, C. E., & Knaüper, B. (1998) · International Journal of Public Opinion Research · doi:10.1093/ijpor/10.2.177 · Cited by 84 · see citing works
Applying Web-Based Survey Design Standards
Crawford, S. D., McCabe, S. E., & Pope, D. (2005) · Journal of Prevention & Intervention in the Community · doi:10.1300/j005v29n01_04 · Cited by 61 · see citing works
Does "Yes or No" on the Telephone Mean the Same as "Check-All-That-Apply" on the Web?
Smyth, J. D., Christian, L. M., & Dillman, D. A. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn005 · Cited by 54 · see citing works
Self-citationEffects of Using Visual Design Principles to Group Response Options in Web Surveys
Smyth, J. D., Dillman, D. A., Christian, L. M., & Stern, M. (2006) · Lincoln (University of Nebraska) · Cited by 51 · see citing works
Self-citationAchieving Usability in Establishment Surveys Through the Application of Visual Design Principles
Dillman, D. A., Mahon-Haft, T., & Gertseva, A. (2005) · Journal of Official Statistics · Cited by 46 · see citing works
Self-citationResearch on Survey Data Quality
Groves, R. M. (1987) · Public Opinion Quarterly · doi:10.1086/269077 · Cited by 42 · see citing works
The influence of visual layout on scalar questions in web surveys
Christian, L. M. (2003) · Research Exchange (Washington State University) · Cited by 20 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Factors affecting response rates of the web survey: A systematic review
Fan, W., & Yan, Z. (2009) · Computers in Human Behavior · doi:10.1016/j.chb.2009.10.015 · Cited by 1,535 · see citing works
Web-based Questionnaires: The Future in Epidemiology?
van Gelder, M. M. H. J., Bretveld, R. W., & Roeleveld, N. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq291 · Cited by 581 · see citing works
Saleh, A., & Bista, K. (2017) · Journal of MultiDisciplinary Evaluation · doi:10.56645/jmde.v13i29.487 · Cited by 493 · see citing works
Designing Effective Web Surveys
Couper, M. P. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511499371 · Cited by 472 · see citing works
Advantages and limitations of web-based surveys: evidence from a child mental health survey
Heiervang, E., & Goodman, R. (2011) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-009-0171-9 · Cited by 263 · see citing works
Mental disorders in foster children: a study of prevalence, comorbidity and risk factors
Lehmann, S., Havik, O. E., Havik, T., & Heiervang, E. R. (2013) · Child and Adolescent Psychiatry and Mental Health · doi:10.1186/1753-2000-7-39 · Cited by 236 · see citing works
Are Internet surveys an alternative to face-to-face interviews in contingent valuation?
Lindhjem, H., & Ståle Navrud, A. (2011) · Ecological Economics · doi:10.1016/j.ecolecon.2011.04.002 · Cited by 236 · see citing works
eHealth Evaluation and Dissemination Research
Glasgow, R. E. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.023 · Cited by 220 · see citing works
Ansu‐Mensah, P. (2021) · Future Business Journal · doi:10.1186/s43093-021-00094-5 · Cited by 205 · see citing works
Davies, H. T. O., Powell, A. E., & Nutley, S. (2015) · Health Services and Delivery Research · doi:10.3310/hsdr03270 · Cited by 157 · see citing works
Going web or staying paper? The use of web-surveys among older people
Kelfve, S., Kivi, M., Johansson, B. E. A., & Lindwall, M. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01138-0 · Cited by 114 · see citing works
Staffing and structure of infection prevention and control programs
Stone, P. W., Dick, A. W., Pogorzelska‐Maziarz, M., Horan, T. C., Furuya, E. Y., & Larson, E. (2009) · American Journal of Infection Control · doi:10.1016/j.ajic.2008.11.001 · Cited by 106 · see citing works
Baik, S., Davis, A. L., Park, J. W., Sirinterlikci, S., & Morgan, M. G. (2020) · Nature Energy · doi:10.1038/s41560-020-0581-1 · Cited by 93 · see citing works
Medical and Nursing Students' Television Viewing Habits: Potential Implications for Bioethics
Czarny, M. J., Faden, R., Nolan, M. T., Bodensiek, E., & Sugarman, J. (2008) · The American Journal of Bioethics · doi:10.1080/15265160802559153 · Cited by 89 · see citing works
Concerns of developing countries and the sustainable development goals: case for India
Khalid, A. M., Sharma, S., & Dubey, A. K. (2020) · International Journal of Sustainable Development & World Ecology · doi:10.1080/13504509.2020.1795744 · Cited by 82 · see citing works
mHealth self-care interventions: managing symptoms following breast cancer treatment
Fu, M. R., Axelrod, D., Guth, A. A., Rampertaap, K., El-Shammaa, N., Hiotis, K. L., Scagliola, J., Yu, G., & Wang, Y. (2016) · mHealth · doi:10.21037/mhealth.2016.07.03 · Cited by 77 · see citing works
Schwepker, C. H., & Ingram, T. N. (2016) · Journal of Business and Industrial Marketing · doi:10.1108/jbim-07-2015-0136 · Cited by 73 · see citing works
Survey Development for Adolescents Aged 11–16 Years: A Developmental Science Based Guide
Omrani, A., Scurr, J., Smith, J., & Brown, N. (2018) · Adolescent Research Review · doi:10.1007/s40894-018-0089-0 · Cited by 73 · see citing works
Hicks, C. M., Bandiera, G. W., & Denny, C. J. (2008) · Academic Emergency Medicine · doi:10.1111/j.1553-2712.2008.00185.x · Cited by 71 · see citing works
Development of a Web‐based alcohol intervention for university students: Processes and challenges
Hallett, J., Maycock, B. R., Kypri, K., Howat, P. A., & McManus, A. (2009) · Drug and Alcohol Review · doi:10.1111/j.1465-3362.2008.00008.x · Cited by 70 · see citing works
Gagliardi, A. R., Brouwers, M. C., & Bhattacharyya, O. K. (2014) · Implementation Science · doi:10.1186/s13012-014-0098-8 · Cited by 65 · see citing works
Moral Judgment and its Impact on Business-to-Business Sales Performance and Customer Relationships
Schwepker, C. H., & Good, D. J. (2010) · Journal of Business Ethics · doi:10.1007/s10551-010-0641-8 · Cited by 62 · see citing works
Schwepker, C. H. (2015) · Journal of Personal Selling and Sales Management · doi:10.1080/08853134.2015.1106769 · Cited by 61 · see citing works
Schwepker, C. H., & Good, D. J. (2012) · The Journal of Marketing Theory and Practice · doi:10.2753/mtp1069-6679200406 · Cited by 55 · see citing works
Pogorzelska‐Maziarz, M., Stone, P. W., & Larson, E. (2012) · American Journal of Infection Control · doi:10.1016/j.ajic.2011.10.002 · Cited by 58 · see citing works
Critical Issues in eHealth Research
Atienza, A. A., Hesse, B. W., Baker, T. B., Abrams, D. B., Rimer, B. K., Croyle, R. T., & Volckmann, L. N. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.02.013 · Cited by 54 · see citing works
Gardner, Z., Mooney, P., Sabbata, S. D., & Dowthwaite, L. (2019) · GeoJournal · doi:10.1007/s10708-019-10035-z · Cited by 53 · see citing works
Mirarchi, F. L., Doshi, A. A., Zerkle, S. W., & Cooney, T. E. (2015) · Journal of Patient Safety · doi:10.1097/pts.0000000000000165 · Cited by 51 · see citing works
Eliciting Personal Network Data in Web Surveys through Participant-generated Sociograms
Tubaro, P., Casilli, A. A., & Mounier, L. (2013) · Field Methods · doi:10.1177/1525822x13491861 · Cited by 47 · see citing works
van den Berg, M. H., Overbeek, A., van der Pal, H. J. H., Versluys, B. A. B., Bresters, D., van Leeuwen, F. E., Lambalk, C. B., Kaspers, G. J. L., & Broeder, E. V. D. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1707 · Cited by 47 · see citing works
Rees, V. W., Kreslake, J. M., Cummings, K. M., O’Connor, R. J., Hatsukami, D. K., Parascandola, M. J., Shields, P. G., & Connolly, G. N. (2009) · Cancer Epidemiology Biomarkers & Prevention · doi:10.1158/1055-9965.epi-09-0946 · Cited by 47 · see citing works
Lomotan, E., Michel, G., Lin, Z., & Shiffman, R. (2010) · BMJ Quality & Safety · doi:10.1136/qshc.2009.032565 · Cited by 46 · see citing works
A Primer for Conducting Survey Research using MTurk
Chambers, S., Nimon, K., & Anthony-McMann, P. E. (2016) · International Journal of Adult Vocational Education and Technology · doi:10.4018/ijavet.2016040105 · Cited by 41 · see citing works
Cragun, D. L., Weidner, A. E., Kechik, J., & Pal, T. (2019) · Genetic Testing and Molecular Biomarkers · doi:10.1089/gtmb.2018.0253 · Cited by 39 · see citing works
Conducting Rapid, Relevant Research
Glasgow, R. E., Kessler, R. S., Ory, M. G., Roby, D. H., Gorin, S. S., & Krist, A. H. (2014) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2014.03.007 · Cited by 37 · see citing works
Caesar, L. D. (2023) · Sustainability · doi:10.3390/su16010239 · Cited by 34 · see citing works
Sparud‐Lundin, C., Ranerup, A., & Berg, M. (2011) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-11-49 · Cited by 34 · see citing works
Self-reported data in environmental health studies: mail vs. web-based surveys
Cantuaria, M. L., & Blanes‐Vidal, V. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0882-x · Cited by 33 · see citing works
How to assess a survey in surgery
Thoma, A. (2011) · Canadian Journal of Surgery · doi:10.1503/cjs.025910 · Cited by 33 · see citing works
Schwepker, C. H., & Good, D. J. (2013) · Journal of Business and Industrial Marketing · doi:10.1108/jbim-06-2011-0077 · Cited by 38 · see citing works
Mabardy, R. A., Waldbusser, G. G., Conway, F. D. L., & Olsen, C. S. (2015) · Journal of Shellfish Research · doi:10.2983/035.034.0241 · Cited by 31 · see citing works
Survey Says? A Primer on Web-Based Survey Design and Distribution
Oppenheimer, A. J., Pannucci, C. J., Kasten, S. J., & Haase, S. C. (2011) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0b013e3182174413 · Cited by 32 · see citing works
Expatriate family adjustment: How organisational support on international assignments matters
Shah, D., de Oliveira, R. T., Barker, M. C., Moeller, M., & Nguyen, T. T. (2021) · Journal of International Management · doi:10.1016/j.intman.2021.100880 · Cited by 31 · see citing works
Reaching Emergency Medical Services Providers: Is One Survey Mode Better than Another?
Schmuhl, P., Duker, H. V., Gurley, K. L., Webster, A., & Olson, L. M. (2010) · Prehospital Emergency Care · doi:10.3109/10903121003760184 · Cited by 30 · see citing works
Patient-Centered Care for Women: Delphi Consensus on Evidence-Derived Recommendations
Filler, T., Foster, A. M., Grace, S. L., Stewart, D. E., Straus, S. E., & Gagliardi, A. R. (2020) · Value in Health · doi:10.1016/j.jval.2020.03.017 · Cited by 30 · see citing works
Payne, J. S. (2012) · Journal of the Society for Social Work and Research · doi:10.5243/jsswr.2012.11 · Cited by 30 · see citing works
The feasibility of Web-based surveys as a data collection tool: a process evaluation
Chizawsky, L. L. K., Estabrooks, C. A., & Sales, A. E. (2009) · Applied Nursing Research · doi:10.1016/j.apnr.2009.03.006 · Cited by 29 · see citing works
Fischer, L. M., Woo, M. Y., Lee, A. C., Wiss, R., Socransky, S., & Frank, J. R. (2015) · Canadian Journal of Emergency Medicine · doi:10.2310/8000.2013.131205 · Cited by 29 · see citing works
Chen, Y., Guo, Y., & Hu, X. (2022) · Cross Cultural & Strategic Management · doi:10.1108/ccsm-12-2021-0227 · Cited by 30 · see citing works
Khalid, A. M. (2023) · Sustainability · doi:10.3390/su151713137 · Cited by 31 · see citing works
Turner‐Bowker, D. M., Saris-Baglama, R. N., Smith, K. J., DeRosa, M. A., Paulsen, C. A., & Hogue, S. J. (2011) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2010.0114 · Cited by 27 · see citing works
Guidelines for Surveys of the American Pediatric Surgical Association
Goldin, A. B., LaRiviere, C. A., Arca, M. J., Cassidy, L. D., Abdullah, F., Lee, S. L., Islam, S., Huang, E. Y., Downard, C. D., Cowles, R. A., et al. (2011) · Journal of Pediatric Surgery · doi:10.1016/j.jpedsurg.2011.05.016 · Cited by 26 · see citing works
Nahm, E., Bausell, B., Resnick, B. M., Covington, B., Brennan, P. F., Mathews, R., & Park, J. H. (2009) · Applied Nursing Research · doi:10.1016/j.apnr.2009.09.004 · Cited by 24 · see citing works
Kastner, M., Makarski, J., Hayden, L., Lai, Y., Chan, J., Treister, V., Harris, K., Munce, S., Holroyd-Leduc, J. M., Graham, I. D., et al. (2020) · Implementation Science Communications · doi:10.1186/s43058-020-00031-7 · Cited by 24 · see citing works
How to Design, Implement, and Analyse a Survey
Arundel, A. V. (2023) · Edward Elgar Publishing eBooks · doi:10.4337/9781800376175 · Cited by 25 · see citing works
Rivara, F. P., Koepsell, T. D., Wang, J., Durbin, D. R., Jaffe, K. M., Vavilala, M. S., Dorsch, A. M., Roper-Caldbeck, M., Houseknecht, E., & Temkin, N. R. (2011) · Health Services Research · doi:10.1111/j.1475-6773.2010.01236.x · Cited by 23 · see citing works
The influence of organizational learning on performance in Indonesian SMEs
Sampe, F. (2012) · Cross Connect (Southern Cross University) · Cited by 23 · see citing works
Varelas, S., Karvela, P., & Georgopoulos, N. B. (2021) · Sustainability · doi:10.3390/su13158543 · Cited by 22 · see citing works
Providing services for acute low-back pain: A survey of Australian physiotherapists
Keating, J. L., McKenzie, J. E., O’Connor, D. A., French, S., Walker, B. F., Charity, M. J., Page, M. J., & Green, S. (2015) · Manual Therapy · doi:10.1016/j.math.2015.11.005 · Cited by 21 · see citing works
Stone, P. W., Pogorzelska‐Maziarz, M., Graham, D. H., Jia, H., Uchida, M., & Larson, E. (2011) · Policy Politics & Nursing Practice · doi:10.1177/1527154411416129 · Cited by 20 · see citing works
The stage of change approach for implementing ergonomics advice – Translating research into practice
Rothmore, P., Aylward, P., Oakman, J., Tappin, D., Gray, J., & Karnon, J. D. (2016) · Applied Ergonomics · doi:10.1016/j.apergo.2016.08.033 · Cited by 20 · see citing works
Archibald, M. M., Wittmeier, K. D. M., Gale, M. R., Ricci, M. F., Russell, K. F., & Woodgate, R. L. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-041530 · Cited by 19 · see citing works
Korayim, D., Bodhi, R., Badghish, S., Yaqub, M. Z., & Bianco, R. (2025) · Journal of Intellectual Capital · doi:10.1108/jic-09-2024-0295 · Cited by 22 · see citing works
Broering, J. M., Paciorek, A. T., Carroll, P. R., Wilson, L., Litwin, M. S., & Miaskowski, C. A. (2013) · Quality of Life Research · doi:10.1007/s11136-013-0493-7 · Cited by 17 · see citing works
Single-item electronic administration of the SF-36v2 Health Survey
Turner‐Bowker, D. M., Saris-Baglama, R. N., & DeRosa, M. A. (2012) · Quality of Life Research · doi:10.1007/s11136-012-0169-8 · Cited by 17 · see citing works
Kuru, K., Girgin, S., Arda, K., & Bozlar, U. (2012) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2012.05.019 · Cited by 17 · see citing works
Woo, M. Y., Frank, J. R., & Lee, A. C. (2014) · Canadian Journal of Emergency Medicine · doi:10.2310/8000.2013.131243 · Cited by 17 · see citing works
Larsen, P., Sanstad, A. H., LaCommare, K. H., & Eto, J. H. (2019) · Lawrence Berkeley National Laboratory · doi:10.2172/1506399 · Cited by 17 · see citing works
van Heerden, A. C. (2014) · University of the Witwatersrand, Johannesburg Institutional Repository on DSpace (University of the Witwatersrand, Johannesburg) · Cited by 15 · see citing works
Sales, J. W., Bulloch, B., & Hostetler, M. A. (2011) · Canadian Journal of Emergency Medicine · doi:10.2310/8000.2011.110290 · Cited by 15 · see citing works
Treatment choices for patients with invasive lobular breast cancer: a doctor survey
Jacobs, C. M., Ibrahim, M. F. K., Clemons, M. J., Hutton, B., Simos, D., Caudrelier, J., Graham, I. D., Smith, S. R., Addison, C., & Arnaout, A. (2015) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12379 · Cited by 14 · see citing works
Andreeva, V. A., Galan, P., Julia, C., Castetbon, K., Kesse‐Guyot, E., & Herçberg, S. (2014) · American Journal of Epidemiology · doi:10.1093/aje/kwt431 · Cited by 14 · see citing works
Mapping modern kinship networks: First results from the KINMATRIX survey
Léopold, T., Raab, M., Becker, C. C., Büyükkeçeci, Z., & Çineli, B. (2024) · Journal of Marriage and the Family · doi:10.1111/jomf.13049 · Cited by 16 · see citing works
Behaviour analysis of internet survey completion using decision trees
Lin, C., Yang, H., & Kuo, L. (2009) · Online Information Review · doi:10.1108/14684520910944427 · Cited by 13 · see citing works
Evidence on the Comparison of Telephone and Internet Surveys for Respondent Recruitment
Potoglou, D., Kanaroglo, P. S., & Robinson, N. (2012) · The Open Transportation Journal · doi:10.2174/1874447801206010011 · Cited by 13 · see citing works
Muri, K., & Valle, P. (2012) · Animal Welfare · doi:10.7120/09627286.21.4.547 · Cited by 13 · see citing works
An Experiment to Test the Feasibility and Quality of a Web-Based Questionnaire of Teachers
Jacob, R. T. (2011) · Evaluation Review · doi:10.1177/0193841x11399376 · Cited by 13 · see citing works
Understanding the use of travel and restaurant platforms through the UTAUT2 model
Sebastián, M. G. D. B., Azuara-Grande, A., & Guede, J. R. S. (2023) · British Food Journal · doi:10.1108/bfj-07-2023-0636 · Cited by 9 · see citing works
KINMATRIX: A new data resource for studies of families and kinship
Léopold, T., Becker, C. C., Büyükkeçeci, Z., Çineli, B., & Raab, M. (2024) · Demographic Research · doi:10.4054/demres.2024.51.25 · Cited by 12 · see citing works
Conducting Survey Research Using MTurk
Chambers, S., & Nimon, K. (2018) · Advances in library and information science (ALIS) book series · doi:10.4018/978-1-5225-5164-5.ch016 · Cited by 11 · see citing works
National consensus recommendations on patient-centered care for ductal carcinoma in situ
Gagliardi, A. R., Wright, F. C., Hong, N. J. L., Groot, G., Helyer, L. K., Meiers, P., Quan, M. L., Urquhart, R., & Warburton, R. (2019) · Breast Cancer Research and Treatment · doi:10.1007/s10549-019-05132-z · Cited by 11 · see citing works
Atherton, H., Oakeshott, P., Aghaizu, A., Hay, P., & Kerry, S. (2010) · Journal of Epidemiology & Community Health · doi:10.1136/jech.2009.098830 · Cited by 11 · see citing works
Iziduh, S., Abbaticchio, A., Theodorlis, M., Ahluwalia, V., Battistella, M., Borkhoff, C. M., Hazlewood, G. S., Lofters, A., MacKay, C., Marshall, D. A., et al. (2024) · BMJ Open · doi:10.1136/bmjopen-2023-080301 · Cited by 10 · see citing works
Comprehensive Transportation Data Collection: Case Study in the Greater Golden Horseshoe, Canada
Roorda, M. J., Shalaby, A. S., & Saneinejad, S. (2011) · Journal of Urban Planning and Development · doi:10.1061/(asce)up.1943-5444.0000055 · Cited by 10 · see citing works
Partin, M. R., Powell, A. A., Burgess, D. J., Haggstrom, D. A., Gravely, A. A., Halek, K., Bangerter, A. K., Shaukat, A., & Nelson, D. B. (2013) · Evaluation & the Health Professions · doi:10.1177/0163278713513586 · Cited by 10 · see citing works
Professional development for teaching in higher education: Faculty perceptions and attitudes
Pesce, J. R. (2015) · Cited by 9 · see citing works
Alkherayf, F. A., Xu, Y., Westwick, H. J., Moldovan, I. D., & Wells, P. S. (2017) · Clinical Neurology and Neurosurgery · doi:10.1016/j.clineuro.2017.01.006 · Cited by 10 · see citing works
Hu, S., Gentzke, A. S., Jamal, A., Homa, D. M., & Neff, L. J. (2020) · Preventing Chronic Disease · doi:10.5888/pcd17.190294 · Cited by 10 · see citing works
Development of the National Prehospital Pediatric Readiness Project assessment
Kothari, K. M., Shah, M. I., Genovesi, A. L., Gausche‐Hill, M., Owusu‐Ansah, S., Hewes, H. A., Moore, B. R., & Remick, K. (2024) · Academic Emergency Medicine · doi:10.1111/acem.15012 · Cited by 9 · see citing works
Choosing Wisely: An idea worth sustaining
Kastner, M., Makarski, J., Mossman, K., Harris, K., Hayden, L., Giraldo, M., Sharma, D., Asalya, M., Jussaume, L., Eisen, D., et al. (2021) · Health Services Research · doi:10.1111/1475-6773.13917 · Cited by 11 · see citing works
Patrick, M. E., Pang, Y. C., Terry‐McElrath, Y. M., Laetz, V. B., & Couper, M. P. (2022) · Drug and Alcohol Dependence Reports · doi:10.1016/j.dadr.2022.100089 · Cited by 9 · see citing works
Women’s Willingness to Accept Risks of Medication for Inflammatory Bowel Disease During Pregnancy
Kushner, T., Fairchild, A. O., Johnson, F. R., Sands, B. E., Mahadevan, U., Subramanian, S., Ananthakrishnan, A. N., Ha, C. Y., & Bewtra, M. (2021) · Patient · doi:10.1007/s40271-021-00561-9 · Cited by 8 · see citing works
Advanced Practice Nurses and Their Roles in Swiss Cancer Care: A Cross-Sectional Study
Geese, F., Bryant‐Lukosius, D., Zwakhalen, S. M. G., & Hahn, S. (2024) · Seminars in Oncology Nursing · doi:10.1016/j.soncn.2024.151626 · Cited by 8 · see citing works
Factors causing stress in postgraduate dental students during COVID-19 pandemic
Juneja, R., Sikka, N., Kumar, V., Chahal, S., Arora, M., Middha, M., & Singhal, R. (2021) · Dental Research Journal · doi:10.4103/1735-3327.330873 · Cited by 8 · see citing works
Usefulness of Internet Surveys to Identify People with Disabilities: A Cautionary Tale
Houtenville, A. J., Phillips, K. G., & Sundar, V. (2021) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smaa045 · Cited by 7 · see citing works
Conducting online web-based surveys at the time of COVID-19 pandemic
Kumar, A., Chandran, S., & Somani, A. (2021) · Archives of Mental Health · doi:10.4103/amh.amh_44_20 · Cited by 7 · see citing works
Cardenal, A. S., Mas, M. V., Majó-Vázquez, S., & Lacasa-Mas, I. (2022) · Political Communication · doi:10.1080/10584609.2022.2090038 · Cited by 7 · see citing works
Detecting Local Item Dependence in Polytomous Adaptive Data
Mislevy, J. L., Rupp, A. A., & Harring, J. R. (2012) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2012.00165.x · Cited by 7 · see citing works
Bogossian, F. E. (2009) · Women and Birth · doi:10.1016/j.wombi.2009.11.001 · Cited by 7 · see citing works
Lysine Analogue Use during Cancer Surgery: A Survey from a Canadian Tertiary Care Centre
Montroy, J. R., Hutton, B., Fergusson, D. A., Tinmouth, A. T., Lavallée, L. T., Cagiannos, I., MORASH, C. G., Flaman, A. S., & Breau, R. H. (2020) · Current Oncology · doi:10.3747/co.27.6613 · Cited by 6 · see citing works
- Authors
- Dillman, D. A., & Smyth, J. D.
- Affiliations
- Washington State University (US)
- Corresponding author
- Dillman, Don A.
- ORCID
- Smyth, Jolene D.
- Venue
- American Journal of Preventive Medicine
- Publisher
- Elsevier BV
- Published
- 2007-05
- Volume
- 32
- Issue
- 5
- Pages
- S90-S96
- ISSN
- 0749-3797 (ISSN-L)
- OpenAlex
- W2042687462
- Cited by
- 194
- References
- 29
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 9 · 2023: 10 · 2022: 11 · 2021: 12 · 2020: 12 · 2019: 12 · 2018: 6 · 2017: 8 · 2016: 4 · 2015: 16 · 2014: 10 · 2013: 10 · 2012: 16
- FWCI
- 30.38
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- American Journal of Preventive Medicine (publishedVersion)
- PubMed (publishedVersion)
- Lincoln (University of Nebraska) (submittedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Physical Sciences › Mathematics › Statistics and Probability › Survey Sampling and Estimation Techniques
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Keywords
- online surveys, measurement error, survey mode effects, question format, visual design, web survey design
- MeSH terms
- Data Collection, Medical Informatics, United States, User-Computer Interface, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review