Developing Valid and Reliable Online Survey Instruments Using Commercial Software Programs
Abstract
The increased popularity and ease of creating online surveys may allow for professionals with little knowledge of appropriate study design and psychometrics to develop instruments with questionable methodological rigor. The present study provides one example of developing an online survey instrument using appropriate survey design. This article will provide health sciences librarians with a resource in the development of a valid and reliable survey instrument using SurveyMonkey.com. Recommendations for future research include surveying health sciences librarians and other professionals to gain a better understanding of the need for education on this topic.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Studies have shown the validity of using SurveyMonkey to conduct surveys used in academic research.
“Studies have shown the validity of using this platform to conduct surveys used in academic research, in addition to the numerous studies which use such platforms for conducting surveys globally56–60.”
From Perception, performance, and detectability of conversational artificial intelligence across 32 university courses (2023) · cites this paper as [59]
Cites
(2001) · Cited by 25,534 · see citing works
Mail and internet surveys : the tailored design method
Dillman, D. A. (2007) · Cited by 9,587 · see citing works
Mail and Internet Surveys: The Tailored Design Method
Chisnall, P. M. (2007) · Journal of Advertising Research · doi:10.2501/s0021849907070232 · Cited by 3,240 · see citing works
(2004) · City Research Online (City University London) · Cited by 1,385 · see citing works
Nutrition care process and model: ADA adopts road map to quality care and outcomes management
Lacey, K., & Pritchett, E. (2003) · Journal of the American Dietetic Association · doi:10.1016/s0002-8223(03)00971-4 · Cited by 467 · see citing works
Basic Research Methods for Librarians
Buttlar, L. J., & Powell, R. R. (1992) · Journal of Education for Library and Information Science · doi:10.2307/40323264 · Cited by 430 · see citing works
Basic Research Methods for Librarians
Stirling, K. H., & Powell, R. L. (1986) · Journal of Education for Library and Information Science · doi:10.2307/40323280 · Cited by 159 · see citing works
Empirical research methods reported in high-profile LIS journal literature
Hider, P. M., & Pymm, B. (2008) · Library & Information Science Research · doi:10.1016/j.lisr.2007.11.007 · Cited by 126 · see citing works
Basic Research Methods for Librarians, 3rd Edition
Powell, R. R., & Connaway, L. S. (1997) · Cited by 81 · see citing works
Kieselhorst, K., Skates, J. J., & Pritchett, E. (2005) · Journal of the American Dietetic Association · doi:10.1016/j.jada.2005.02.039 · Cited by 46 · see citing works
McConnell, H. W. (2002) · eHealth International · doi:10.1186/1476-3591-1-1 · Cited by 9 · see citing works
Flagged first, then by citations
1 of the 12 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Ibrahim, H., Liu, F., Asim, R., Battu, B., Benabderrahmane, S., Alhafni, B., Adnan, W., Alhanai, T., AlShebli, B., Baghdadi, R., et al. (2023) · Scientific Reports · doi:10.1038/s41598-023-38964-3 · Cited by 154 · see citing works
Morrissey, F. (2020) · Ethics Medicine and Public Health · doi:10.1016/j.jemep.2019.100410 · Cited by 20 · see citing works
Jonikas, J. A., Cook, J. Α., Swarbrick, M. A., Nemec, P. B., Steigman, P. J., Boss, K. A., & Brice, G. H. (2021) · Translational Behavioral Medicine · doi:10.1093/tbm/ibab013 · Cited by 15 · see citing works
Yayusman, M. S., Yaumidin, U. K., & Mulyasari, P. N. (2023) · Journal of Ethnic Foods · doi:10.1186/s42779-023-00207-1 · Cited by 21 · see citing works
Sampson, G., Pugh, J. N., Morton, J. P., & Areta, J. L. (2021) · Sport Sciences for Health · doi:10.1007/s11332-021-00799-8 · Cited by 10 · see citing works
Menon, D. (2024) · Journal of Creative Communications · doi:10.1177/09732586241240392 · Cited by 8 · see citing works
Cook, J. Α., Swarbrick, M. A., Boss, K. A., Steigman, P. J., Nemec, P. B., Jonikas, J. A., Brice, G. H., & Aranda, F. (2021) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000499 · Cited by 8 · see citing works
Big Tech Dominance Despite Global Mistrust
Ibrahim, H., Debicki, M., Rahwan, T., & Zaki, Y. (2024) · IEEE Transactions on Computational Social Systems · doi:10.1109/tcss.2023.3339183 · Cited by 7 · see citing works
Paynter, M., Sharpe, W. H., Halabi, A. K., Reimers, V., Ma, H., & Johnstone, C. (2023) · International Journal of Intercultural Relations · doi:10.1016/j.ijintrel.2023.101867 · Cited by 7 · see citing works
Technology-Assisted Student-Centered Learning for Civil Engineering Students
Rollakanti, C. R., Naidu, V. R., Manchiryal, R. K., & Poloju, K. K. (2020) · Advances in Science, Technology & Innovation/Advances in science, technology & innovation · doi:10.1007/978-3-030-32922-8_18 · Cited by 6 · see citing works
A User's Participatory Selecting Model: Librarians Point of Views
Osorio, N. L. (2011) · E-LIS Repository (University of Naples Federico II) · Cited by 6 · see citing works
Questionnaire layout and national culture in online psychometrics
van Schaik, P., Wong, S. L., & Teo, T. P. (2014) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2014.08.005 · Cited by 6 · see citing works
A Survey Exploring the Perceptions of Academic Librarians as Researchers
Babb, M. N. (2019) · Canadian Journal of Academic Librarianship · doi:10.33137/cjal-rcbu.v5.29919 · Cited by 6 · see citing works
Australian Rural Accountants’ Views on How Locally Provided CPD Compares with City-based Provision
Halabi, A. K. (2015) · Accounting Education · doi:10.1080/09639284.2015.1087321 · Cited by 5 · see citing works
Social Networks as Enablers of Enterprise Creativity: Evidence from Portuguese Firms and Users
Fernandes, S., & Belo, A. (2016) · Journal of technology management & innovation · doi:10.4067/s0718-27242016000200008 · Cited by 5 · see citing works
Akpan, I. J., Warner, T., Cardona, T. L. C., Schlosser, N., & Hennis, B. (2024) · European Early Childhood Education Research Journal · doi:10.1080/1350293x.2024.2305410 · Cited by 4 · see citing works
Cardona, T. L. C., Akpan, I. J., Schlosser, N., & Hennis, B. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4134481 · Cited by 4 · see citing works
Zammit, D., Tomaselli, G., Garg, L., Buttiġieġ, S. C., & Macassa, G. (2025) · Journal of Public Health Research · doi:10.1177/22799036251361425 · Cited by 2 · see citing works
How Individuals with Mental Health Challenges Coped During the COVID-19 Pandemic
Richardson, D., Aranda, F., Cook, J. Α., & Swarbrick, M. A. (2024) · Clinical Nursing Research · doi:10.1177/10547738241273294 · Cited by 2 · see citing works
Social Networks' Users: Profiles and Motivations
Belo, A., Fernandes, S., & Castela, G. (2014) · Journal of Tourism, Sustainability and Well-being · Cited by 1 · see citing works
Marino, R. C. (2011) · ScholarWorks @ The University of New Orleans (The University of New Orleans) · Cited by 1 · see citing works
A World with Two Moons: An Analysis of Reader Identification
Watson, P. J. (2010) · Digital Commons (Liberty University)
Factors Associated with School Counselors' Use of a Family Systems Perspective.
Martin, D. M. (2013) · ScholarWorks @ The University of New Orleans (The University of New Orleans)
Examining the Underrepresentation of Women Leadership within the Securities Brokerage Industry
Weitz, L. A. L. (n.d.) · ProQuest Demo Repository
MacCárthaigh, L. (2019) · TRAP@NCI (National College of Ireland)
Sentiment analysis of employees and COVID-19 vaccine hesitancy at workplacePreprint
Akpan, I. J., Warner, T., & Peters, M. (2025) · medRxiv · doi:10.1101/2025.01.30.25321414
From Heritage to Experience: Architectural Mediation and Meaning-Making in Bahrain’s Historic Sites
Saffar, M. A., & Aoul, K. A. T. (2025) · Architecture · doi:10.3390/architecture5040127
Halabi, A. K. (2014) · Australian and International Journal of Rural Education · doi:10.47381/aijre.v24i2.687
- Authors
- Evans, R. R., Burnett, D. O., Kendrick, O. W., Macrina, D. M., Snyder, S. W., Roy, J. P. L., & Stephens, B. C.
- Affiliations
- University of Alabama at Birmingham (US)
- University of Alabama (US)
- Lindsey Wilson College (US)
- Corresponding author
- Evans, Retta R.
- Venue
- Journal of Consumer Health On the Internet
- Publisher
- Informa UK Limited
- Published
- 2009-02-12
- Volume
- 13
- Issue
- 1
- Pages
- 42-52
- ISSN
- 1539-8285 (ISSN-L)
- 1539-8293
- OpenAlex
- W1966666768
- Cited by
- 30
- References
- 12
- Citations by year
- 2025: 3 · 2024: 4 · 2023: 3 · 2022: 3 · 2021: 3 · 2020: 3 · 2019: 2 · 2016: 1 · 2015: 1 · 2014: 3 · 2013: 1
- FWCI
- 3.23
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Consumer Health on the Internet (publishedVersion)
- Topics
- Social Sciences › Sociology and Political Science › Survey Methodology and Nonresponse
- Social Sciences › Education › Health Education and Validation
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- online survey instrument, questionnaire development, survey validity, survey reliability, survey design, psychometrics, SurveyMonkey, health sciences librarians
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
