The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
When to Use Web-based Surveys
Open accessAbstract
Even in this randomized trial era, surveys of patients and professionals remain an important epidemiologic technique for capturing cross-sectional or longitudinal data, providing fundamental insights about health and disease.1 There are several alternative methods for collecting such data, which include conducting face-to-face or telephone interviews; circulating a questionnaire by mail, fax, or e-mail; and eliciting responses to a survey posted on an open Web site. Other methods that are currently less widely exploited include digital interactive television; use of a software package to capture survey data, either by mailed floppy disks or as a Java applet over the Web; and automatic telephone menu systems. The preceding article by Schleyer and Forrest2 explores some of the issues arising from a Web survey, but it may be useful first to consider the range of survey methods that are available. Two major features define a survey method: how participants are identified and the data capture technique. Let us consider these features and their implications in turn. How participants are identified determines how much control the investigators exert over their selection. For complete control, eligible participants are selected according to specific characteristics.3 We can check characteristics from an existing database or mailing list, including an e-mail discussion list, or carry out a preliminary mailing or interview to capture the necessary eligibility data. If, instead, we wish only a modest degree of control, we can distribute copies of the survey to a group known to us and ask them in turn to send it out to their contacts—the “snowball” technique (e.g., Forsstrom et al.4). With this method we have much less control over who receives a copy of the survey, and it makes sending reminders or follow-up surveys more difficult, too. We often do not even know how many copies of the survey have been sent out, making it impossible to calculate a response rate. Thus, generalizing results from a snowball survey is difficult. Finally, there are occasions when we want to encourage anyone and everyone to complete our survey, with no control over the type of participants. We can distribute the survey on the street, in a newspaper, or by random mail shots or we can e-mail it to random members of a general mailing list or place it on a public-access Web site. Such techniques mean that follow-up and reminders are usually impossible and response rates hard to calculate. Schleyer and Forrest used the Web but still retained control over who could respond by issuing passwords by e-mail, allowing selected participants to gain one-off access to a closed Web site. Passwords can also be issued by mail or telephone. The second key feature is how the data are captured. Many conventional paper questionnaires are designed to capture free-form text, which is usually transcribed. Face-to-face or telephone interviews can be tape-recorded and transcribed, but this is a lengthy process. Such qualitative data can then be analyzed using appropriate software tools such as nud*ist or martin to extract recurrent themes.5 Data analysis is easier, faster, and more accurate if data can be captured electronically at source, for example, using specially designed forms and optical character or optical mark recognition, which are increasingly used in clinical trials.6 Often the special OCR/OMR forms are faxed to a data center, speeding return of data.7 Other techniques for capturing electronic data include telephone voice menu systems, e-mailed text, Web forms, and mailed interactive software packages. As well as speeding data analysis and reducing transcription errors8 the choice of data capture method also determines how much control the researchers have over the order of question completion and the time to be allowed. For example, with a paper or e-mailed questionnaire, there is little, if any, control—the participant can leaf back and forth before answering the first question. Even standard HTML forms allow little control over question order or the time allotted, as devious participants can work through the survey answering obligatory questions randomly, then go back to alter their responses. This makes it hard to conduct experiments such as eliciting a diagnosis on a simulated case before and after receiving the output of a decision support system.9 On the other hand, face-to-face or telephone interviews, interactive software, and Java applets delivered via the Web allow complete control over the time participants are allowed and the ordering of questions. The combination of these two features determines three further significant issues: The type of data that can be collected: responses only (postal, e-mail, Web—because of variable delays), responses and time taken to respond (automatic phone system, software, recorded interview), responses and observer comments (face-to-face encounters like a conventional job interview) The overall survey cost: hig
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Questionnaire Design, Interviewing and Attitude Measurement
Albuam, G., & Oppenheim, A. N. (1993) · Journal of Marketing Research · doi:10.2307/3172892 · Cited by 4,971
The American Journal of Gastroenterology
(2003) · The American Journal of Gastroenterology · doi:10.1111/j.1572-0241.2003.80003397.x · Cited by 2,196
The SF36 health survey questionnaire: an outcome measure suitable for routine use within the NHS?
Garratt, A. M., Ruta, D. A., Abdalla, M. I., Buckingham, J. K., & Russell, I. T. (1993) · BMJ · doi:10.1136/bmj.306.6890.1440 · Cited by 1,141
Evaluation Methods in Medical Informatics
Friedman, C. P., & Wyatt, J. C. (1997) · Computers and Medicine · doi:10.1007/978-1-4757-2685-5 · Cited by 448
Self-citationSackett, D. L., & Wennberg, J. E. (1997) · BMJ · doi:10.1136/bmj.315.7123.1636 · Cited by 368
Methods for the Design and Administration of Web-based Surveys
Schleyer, T. K. L., & Forrest, J. L. (2000) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2000.0070416 · Cited by 304
Friedman, C. P., Elstein, A. S., Wolf, F. M., Murphy, G. C., Franz, T. M., Heckerling, P. S., Fine, P. L., Miller, T. M., & Abraham, V. (1999) · JAMA · doi:10.1001/jama.282.19.1851 · Cited by 217
Are high response rates essential to valid surveys?
Leslie, L. L. (1972) · Social Science Research · doi:10.1016/0049-089x(72)90080-4 · Cited by 192
Coste, J., Fermanian, J., & Alain Venot, A. (1995) · Statistics in Medicine · doi:10.1002/sim.4780140402 · Cited by 148
Maintaining the Confidentiality of Medical Records Shared over the Internet and the World Wide Web
Rind, D. M., Kohane, I. S., Peter Szolovits, B., Safran, C., Chueh, H. C., & Barnett, G. O. (1997) · Annals of Internal Medicine · doi:10.7326/0003-4819-127-2-199707150-00008 · Cited by 107
Cited by
Using the Internet for Surveys and Health Research
Eysenbach, G., & Wyatt, J. (2002) · Journal of Medical Internet Research · doi:10.2196/jmir.4.2.e13 · Cited by 790
Self-citationUnderstanding COVID-19 vaccine demand and hesitancy: A nationwide online survey in China
Lin, Y., Hu, Z., Zhao, Q., Alias, H., Danaee, M., & Wong, L. P. (2020) · PLOS Neglected Tropical Diseases · doi:10.1371/journal.pntd.0008961 · Cited by 688
Web-based Questionnaires: The Future in Epidemiology?
van Gelder, M. M. H. J., Bretveld, R. W., & Roeleveld, N. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq291 · Cited by 580
Online Data Collection: Strategies for Research
Granello, D. H., & Wheaton, J. E. (2004) · Journal of Counseling & Development · doi:10.1002/j.1556-6678.2004.tb00325.x · Cited by 540
Using the Internet to conduct surveys of health professionals: a valid alternative?
Braithwaite, D., Emery, J., de Lusignan, S., & Sutton, S. (2003) · Family Practice · doi:10.1093/fampra/cmg509 · Cited by 474
Representativeness of the Patient-Reported Outcomes Measurement Information System Internet panel
Liu, H., Cella, D., Gershon, R., Shen, J., Morales, L. S., Riley, W., & Hays, R. D. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.11.021 · Cited by 446
National Community Prevalence of Overactive Bladder in the United States Stratified by Sex and Age
Coyne, K. S., Sexton, C. C., Vats, V., Thompson, C., Kopp, Z. S., & Milsom, I. (2011) · Urology · doi:10.1016/j.urology.2010.08.039 · Cited by 370
Time perspective, personality and smoking, body mass, and physical activity: An empirical study
Adams, J., & Nettle, D. (2009) · British Journal of Health Psychology · doi:10.1348/135910708x299664 · Cited by 317
Adams, A. M., Serrano, D., Buse, D. C., Reed, M. L., Marske, V., Fanning, K. M., & Lipton, R. B. (2015) · Cephalalgia · doi:10.1177/0333102414552532 · Cited by 305
Coyne, K. S., Sexton, C. C., Bell, J. A., Thompson, C. L., Dmochowski, R., Bavendam, T., Chen, C., & Quentin Clemens, J. (2013) · Neurourology and Urodynamics · doi:10.1002/nau.22295 · Cited by 263
Schnall, R., Cho, H., & Liu, J. (2018) · JMIR mHealth and uHealth · doi:10.2196/mhealth.8851 · Cited by 239
Volunteer Participation in the Health eHeart Study: A Comparison with the US Population
Guo, X., Vittinghoff, E., Olgin, J. E., Marcus, G. M., & Pletcher, M. J. (2017) · Scientific Reports · doi:10.1038/s41598-017-02232-y · Cited by 87
Payne, K. A., Varon, S. F., Kawata, A. K., Yeomans, K., Wilcox, T. K., Manack, A., Buse, D. C., Lipton, R. B., Goadsby, P. J., & Blumenfeld, A. M. (2011) · Cephalalgia · doi:10.1177/0333102411410610 · Cited by 74
Weymann, N., Dirmaier, J., von Wolff, A., Kriston, L., & Härter, M. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3904 · Cited by 73
Jacobs, T., Geysemans, B., Van Hal, G., Glazemakers, I., Fog-Poulsen, K., Vermandel, A., De Wachter, S., & De Win, G. (2021) · JMIR Public Health and Surveillance · doi:10.2196/32542 · Cited by 55
Metadata
- Authors
- Wyatt, J. C.
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2000-07-01
- Volume
- 7
- Issue
- 4
- Pages
- 426-430
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- OpenAlex
- W2120378754
- Cited by
- 264
- References
- 20
- FWCI
- 13.98
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.