Electronic Survey Methodology: A Case Study in Reaching Hard-to-Involve Internet Users

Abstract

Using the Internet to conduct quantitative research presents challenges not found in conventional research. Paper-based survey quality criteria cannot be completely adapted to electronic formats. Electronic surveys have distinctive technological, demographic, and response characteristics that affect their design, use, and implementation. Survey design, participant privacy and confidentiality, sampling and subject solicitation, distribution methods and response rates, and survey piloting are critical methodological components that must be addressed. In this article, quality criteria for electronic survey design and use based on an investigation of recent electronic survey literature are presented. The application of these criteria to reach a hard-to-involve online population-nonpublic participants of online communities (also known as "lurkers")-and survey them on their community participation, a topic not salient to the purpose of their online communities is demonstrated in a case study. The results show that a hard-to-reach audience can be reached using the quality criteria that are most important for reaching these types of audiences. The results suggest how the use of some criteria may conflict and what researchers may experience when conducting electronic surveys in an online culture in which people are not tolerant of intrusions into online lives.