The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Straightlining: Overview of Measurement, Comparison of Indicators, and Effects in Mail–Web Mixed-Mode Surveys
Abstract
Straightlining occurs when survey respondents give identical (or nearly identical) answers to items in a battery of questions using the same response scale, which may reduce data quality. Despite its potential importance, research examining straightlining does not use a standard measurement technique. Further, while mixed-mode studies are increasing in prevalence, few studies compare straightlining behavior in mail versus web surveys. Our article has the following goals: (1) describe and evaluate methods for detecting straightlining and (2) examine effects of education and mode of administration on straightlining in two mail/web mixed-mode surveys. Data for Study 1 are from a 2010 survey of alcohol beliefs and consumption in which 7,200 young adults were sampled from driver’s license records in Wisconsin and randomly assigned to mail–web (mail followed by web) or web–mail (web followed by mail) treatments. Data for Study 2 are from a 2013 survey about a public university and its affiliated health organizations that used an address-based sample and randomly assigned households to one of the three experimental groups: mail-only, web-only, and web–mail. We identify and examine five methods for measuring straightlining: simple nondifferentiation, mean root of pairs, maximum identical rating, standard deviation of battery, and scale point variation. The overall results replicate previously reported findings of a negative association between education and straightlining behaviors except for the standard deviation of battery measure in Study 1. Controlling for gender, race/ethnicity, and education, mode of administration was not significantly related to straightlining for any of the measures, suggesting straightlining behavior is stable across mail and web forms of self-administration.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Regression Models for Categorical Dependent Variables Using Stata
Guzmán, J. (2013) · Puerto Rico health sciences journal · Cited by 5,304
The Psychology of Survey Response
Tourangeau, R., Rips, L. J., & Rasinski, K. (2000) · doi:10.1017/cbo9780511819322 · Cited by 4,734
Internet, Phone, Mail, and Mixed‐Mode Surveys: The Tailored Design Method
Dillman, D. A., Smyth, J. D., & Christian, L. M. (2014) · Wiley eBooks · doi:10.1002/9781394260645 · Cited by 4,460
Mail and Internet Surveys: The Tailored Design Method
CHISNALL, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070237 · Cited by 3,435
Response strategies for coping with the cognitive demands of attitude measures in surveys
Krosnick, J. A. (1991) · Applied Cognitive Psychology · doi:10.1002/acp.2350050305 · Cited by 2,460
Prejudice, Discrimination and Racism
(2005) · Understanding Critical Social Psychology · doi:10.4135/9781446217566.n6 · Cited by 1,774
National Surveys Via Rdd Telephone Interviewing Versus the Internet
Chang, L., & Krosnick, J. A. (2009) · Public Opinion Quarterly · doi:10.1093/poq/nfp075 · Cited by 955
Telephone versus Face-to-Face Interviewing of National Probability Samples with Long Questionnaires
Holbrook, A. L., Green, M. C., & Krosnick, J. A. (2003) · Public Opinion Quarterly · doi:10.1086/346010 · Cited by 916
Dillman, D. A., Phelps, G., Tortora, R., Swift, K., Kohrell, J., Berck, J., & Messer, B. L. (2009) · Social Science Research · doi:10.1016/j.ssresearch.2008.03.007 · Cited by 850
Web Survey Design and Administration
COUPER, M. P., TRAUGOTT, M. W., & LAMIAS, M. J. (2001) · Public Opinion Quarterly · doi:10.1086/322199 · Cited by 776
Research synthesis: AAPOR report on online panels
Prepared for the AAPOR Executive Council by a Task Force operating under the auspices of the AAPOR Standards Committee, W. M. I., Baker, R., Blumberg, S. J., Brick, J. M., Couper, M. P., Courtright, M., Dennis, J. M., Dillman, D., Frankel, M. R., Garland, P., et al. (2010) · Public Opinion Quarterly · doi:10.1093/poq/nfq048 · Cited by 584
Stimson, R. J. (2014) · Handbook of Research Methods and Applications in Spatially Integrated Social Science · doi:10.4337/9780857932976.00016 · Cited by 484
An Experimental Comparison of Web and Telephone Surveys
Fricker, S. (2005) · Public Opinion Quarterly · doi:10.1093/poq/nfi027 · Cited by 445
Spacing, Position, and Order: Interpretive Heuristics for Visual Features of Survey Questions
Tourangeau, R. (2004) · Public Opinion Quarterly · doi:10.1093/poq/nfh035 · Cited by 400
Effects of Questionnaire Length on Response Quality
Herzog, A. R., & Bachman, J. G. (1981) · Public Opinion Quarterly · doi:10.1086/268687 · Cited by 392
Heerwegh, D., & Loosveldt, G. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn045 · Cited by 367
Completion Time and Response Order Effects in Web Surveys
Malhotra, N. (2008) · Public Opinion Quarterly · doi:10.1093/poq/nfn050 · Cited by 332
Speeding in Web Surveys: The tendency to answer very fast and its association with straightlining
Zhang, C., & Conrad, F. G. (2012) · Survey research methods · doi:10.18148/srm/2014.v8i2.5453 · Cited by 271
Comparing Oral Interviewing with Self-Administered Computerized QuestionnairesAn Experiment
Chang, L., & Krosnick, J. A. (2010) · Public Opinion Quarterly · doi:10.1093/poq/nfp090 · Cited by 218
Krosnick, J. A., & Alwin, D. F. (1988) · Public Opinion Quarterly · doi:10.1086/269128 · Cited by 199
Towards a Theory of Self‐Administered Questionnaire Design
Jenkins, C. R., & Dillman, D. A. (1997) · Wiley Series in Probability and Statistics · doi:10.1002/9781118490013.ch7 · Cited by 191
Messer, B. L., & Dillman, D. A. (2011) · Public Opinion Quarterly · doi:10.1093/poq/nfr021 · Cited by 176
The Measurement of Personal Values in Survey Research
McCarty, J. A., & Shrum, L. J. (2000) · Public Opinion Quarterly · doi:10.1086/317989 · Cited by 170
Smyth, J. D., Dillman, D. A., Christian, L. M., & O'Neill, A. C. (2010) · American Behavioral Scientist · doi:10.1177/0002764210361695 · Cited by 168
The Design of Grids in Web Surveys
Couper, M. P., Tourangeau, R., Conrad, F. G., & Zhang, C. (2013) · Social Science Computer Review · doi:10.1177/0894439312469865 · Cited by 138
Response Rates and Data Quality in Web and Mail Surveys Administered to PhD Holders
Barrios, M., Villarroya, A., Borrego, A., & Ollé, C. (2010) · Social Science Computer Review · doi:10.1177/0894439310368031 · Cited by 124
Measurement Effects of Survey Mode on the Equivalence of Attitudinal Rating Scale Questions
Klausch, T. L. T., Hox, J. J., & Schouten, B. (2013) · Sociological Methods & Research · doi:10.1177/0049124113500480 · Cited by 84
Telephone and Web: Mixed‐Mode Challenge
Greene, J., Speizer, H., & Wiitala, W. (2007) · Health Services Research · doi:10.1111/j.1475-6773.2007.00747.x · Cited by 81
Item-by-item Versus Matrix Questions: A Web Survey Experiment
Liu, M., & Cernat, A. (2016) · Social Science Computer Review · doi:10.1177/0894439316674459 · Cited by 50
Achieving Usability in Establishment Surveys Through the Application of Visual Design Principles
Dillman, D. A., Mahon-Haft, T., & Gertseva, A. (2005) · Journal of Official Statistics · Cited by 46
Millar, M. M., & Dillman, D. A. (2012) · Survey Practice · doi:10.29115/sp-2012-0011 · Cited by 30
Roberts, C., & Jäckle, A. (2006) · IRIS · Cited by 13
Introduction to Special Issue of Survey Practice on Item Nonresponse
Dillman, D. A. (2012) · Survey Practice · doi:10.29115/sp-2012-0013 · Cited by 8
Cited by
Data quality of platforms and panels for online behavioral research
Peer, E., Rothschild, D., Gordon, A., Evernden, Z., & Damer, E. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01694-3 · Cited by 1,718
Web Versus Other Survey Modes: An Updated and Extended Meta-Analysis Comparing Response Rates
Daikeler, J., Bošnjak, M., & Lozar Manfreda, K. (2020) · Journal of Survey Statistics and Methodology · doi:10.1093/jssam/smz008 · Cited by 411
Wullenkord, M. C., Tröger, J., Hamann, K. R. S., Loy, L. S., & Reese, G. (2021) · Climatic Change · doi:10.1007/s10584-021-03234-6 · Cited by 344
“, anxiety, sorrow, loss) to be a predictor of pro-environmentalism (Kleres & Wettergren 2017; Reser et al. 2012). This may indicate that the reported impairment (and possible underlying climate anxiety) is not pathological but adaptive (Verplanken et al. 2020). It may be a practical anxiety (Kurth 2018)—an activating…”
ResultEnsuring survey research data integrity in the era of internet bots
Griffin, M., Martino, R. J., LoSchiavo, C., Comer-Carruthers, C., Krause, K. D., Stults, C. B., & Halkitis, P. N. (2022) · Quality & Quantity · doi:10.1007/s11135-021-01252-1 · Cited by 314
Missing data in surveys: Key concepts, approaches, and applications
Mirzaei, A., Carter, S. R., Patanwala, A. E., & Schneider, C. R. (2022) · Research in Social and Administrative Pharmacy · doi:10.1016/j.sapharm.2021.03.009 · Cited by 264
Metadata
- Authors
- Kim, Y., Dykema, J., Stevenson, J., Black, P., & Moberg, D. P.
- Venue
- Social Science Computer Review
- Publisher
- SAGE Publications
- Published
- 2018-02-20
- Volume
- 37
- Issue
- 2
- Pages
- 214-233
- ISSN
- 0894-4393 (ISSN-L)
- 1552-8286
- OpenAlex
- W2793051279
- Cited by
- 258
- References
- 33
- FWCI
- 27.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.