Factors influencing healthcare provider respondent fatigue answering a globally administered in-app survey
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
Background: Respondent fatigue, also known as survey fatigue, is a common problem in the collection of survey data. Factors that are known to influence respondent fatigue include survey length, survey topic, question complexity, and open-ended question type. There is a great deal of interest in understanding the drivers of physician survey responsiveness due to the value of information received from these practitioners. With the recent explosion of mobile smartphone technology, it has been possible to obtain survey data from users of mobile applications (apps) on a question-by-question basis. The author obtained basic demographic survey data as well as survey data related to an anesthesiology-specific drug called sugammadex and leveraged nonresponse rates to examine factors that influenced respondent fatigue. Methods: Primary data were collected between December 2015 and February 2017. Surveys and in-app analytics were collected from global users of a mobile anesthesia calculator app. Key independent variables were user country, healthcare provider role, rating of importance of the app to personal practice, length of time in practice, and frequency of app use. Key dependent variable was the metric of respondent fatigue. Results: Provider role and World Bank country income level were predictive of the rate of respondent fatigue for this in-app survey. Importance of the app to the provider and length of time in practice were moderately associated with fatigue. Frequency of app use was not associated. This study focused on a survey with a topic closely related to the subject area of the app. Respondent fatigue rates will likely change dramatically if the topic does not align closely. Discussion: Although apps may serve as powerful platforms for data collection, responses rates to in-app surveys may differ on the basis of important respondent characteristics. Studies should be carefully designed to mitigate fatigue as well as powered with the understanding of the respondent characteristics that may have higher rates of respondent fatigue.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2008.08.010 · Cited by 51,384 · cited 2×
“, via REDCap (Harris et al., 2009) or via SurveyMonkey (SurveyMonkey, Inc, San Mateo, CA, USA)) rather than in-app surveys.”
MethodMobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233
Physician response to surveys A review of the literature
Kellerman, S. (2001) · American Journal of Preventive Medicine · doi:10.1016/s0749-3797(00)00258-0 · Cited by 956 · cited 1×
“There is a great deal of interest in understanding the drivers of physician survey responsiveness due to the value of information received from these practitioners (Kellerman, 2001; Cull et al., 2005; Nicholls et al., 2011; Glidewell et al., 2012; Cook et al., 2016).”
BackgroundThe Smartphone in Medicine: A Review of Current and Potential Use Among Physicians and Students
Ozdalga, E., Ozdalga, A., & Ahuja, N. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1994 · Cited by 654
rworldmap : a new R package for mapping global data
South, A. (2011) · The R Journal · doi:10.32614/rj-2011-006 · Cited by 482
Response Rates and Response Bias for 50 Surveys of Pediatricians
Cull, W. L., O'Connor, K. G., Sharp, S., & Tang, S. S. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.00350.x · Cited by 421 · cited 2×
“There is a great deal of interest in understanding the drivers of physician survey responsiveness due to the value of information received from these practitioners (Kellerman, 2001; Cull et al., 2005; Nicholls et al., 2011; Glidewell et al., 2012; Cook et al., 2016).”
BackgroundStatus and trends of mobile-health applications for iOS devices: A developer's perspective
Liu, C., Zhu, Q., Holroyd, K. A., & Seng, E. K. (2011) · Journal of Systems and Software · doi:10.1016/j.jss.2011.06.049 · Cited by 313 · cited 2×
“(Akter & Ray, 56 2010; Liu et al., 2011; Ozdalga, Ozdalga & Ahuja, 2012) mHealth is an established MeSH entry 57 term that broadly describes efforts in the area of mobile-based health information delivery, 58 although a reasonable argument can be made that it includes the collection of analytics…”
BackgroundmHealth - an Ultimate Platform to Serve the Unserved
Akter, S., & Ray, P. (2010) · Yearbook of Medical Informatics · doi:10.1055/s-0038-1638697 · Cited by 241
Internet Versus Mailed Questionnaires: A Controlled Comparison (2)
Leece, P., Bhandari, M., Sprague, S., Swiontkowski, M. F., Schemitsch, E. H., Tornetta, P., Devereaux, P., & Guyatt, G. H. (2004) · Journal of Medical Internet Research · doi:10.2196/jmir.6.4.e39 · Cited by 216 · cited 2×
“(Tran & Dilley, 2010) 187 Interestingly, there have been mixed findings as to the utility of Web-based methods over paper188 and-pencil methods (Leece et al., 2004; Nicholls et al., 2011) although it is likely that the much 189 older 2004 study from Leece et al reflects a different era of…”
BackgroundCook, D. A., Wittich, C. M., Daniels, W. L., West, C. P., Harris, A. M., & Beebe, T. J. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6318 · Cited by 203
The jsonlite Package: A Practical and Consistent Mapping Between JSON Data and R Objects
Ooms, J. C. L. (2014) · arXiv (Cornell University) · doi:10.48550/arxiv.1403.2805 · Cited by 172
Methods for Evaluating Respondent Attrition in Web-Based Surveys
Hochheimer, C. J., Sabo, R. T., Krist, A. H., Day, T., Cyrus, J., & Woolf, S. H. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.6342 · Cited by 97 · cited 6×
“(Whelan; Ben-Nun, 2008; Hochheimer et al., 2016) This may be detected when 73 there is straight-line answering, where the respondent chooses e.g. the first option of a multiple 74 choice survey for multiple question in a row.”
BackgroundMethodInfluentialGlidewell, L., Thomas, R. E., MacLennan, G., Bonetti, D. L., Johnston, M., Eccles, M., Edlin, R. P., Pitts, N. B., Clarkson, J., Steen, N., et al. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-250 · Cited by 63 · cited 1×
“(Kellerman, 85 2001; Cull et al., 2005; Nicholls et al., 2011; Glidewell et al., 2012; Cook et al., 2016) These 86 studies typically looked at overall response rate rather than respondent fatigue.”
BackgroundEnhancing Response Rates in Physician Surveys: The Limited Utility of Electronic Options
Nicholls, K., Chapman, K., Shaw, T., Perkins, A., Sullivan, M. M., Crutchfield, S., & Reed, E. (2011) · Health Services Research · doi:10.1111/j.1475-6773.2011.01261.x · Cited by 61
O’Reilly-Shah, V. N., & Mackey, S. (2016) · JMIR mhealth and uhealth · doi:10.2196/mhealth.5397 · Cited by 24
Self-citationAssessing the global reach and value of a provider-facing healthcare app using large-scale analytics
O’Reilly-Shah, V. N., Easton, G., & Gillespie, S. E. (2017) · BMJ Global Health · doi:10.1136/bmjgh-2017-000299 · Cited by 23 · cited 1×
“(O’Reilly-Shah, 2016; O’Reilly-Shah et al., 2017) 117 Raw data from the DynamoDB database were downloaded and processed using CRAN R 118 (R Core Team, Vienna, Austria) v3.”
MethodSelf-citationSensus: A Cross-Platform, General-Purpose System for Mobile Crowdsensing in Human-Subject StudiesPreprint
Xiong, H., Huang, Y., Barnes, L. E., & Gerber, M. S. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/uste8 · Cited by 15
Antecedents of anonymity perceptions in web-based surveys
Whelan, T. (2008) · PsycEXTRA Dataset · doi:10.1037/e518442013-442 · Cited by 15
Achieving a high response rate with a health care provider survey, Washington State, 2006.
Tran, N., & Dilley, J. A. (2010) · Preventing Chronic Disease · Cited by 7
Cited by
Survey Fatigue During the COVID-19 Pandemic: An Analysis of Neurosurgery Survey Response Rates
de Koning, R., Egiz, A., Kotecha, J., Ciuculete, A. C., Ooi, S. Z. Y., Bankole, N. D. A., Erhabor, J., Higginbotham, G., Khan, M., Dalle, D. U., et al. (2021) · Frontiers in Surgery · doi:10.3389/fsurg.2021.690680 · Cited by 339
Metadata
- Authors
- O’Reilly-Shah, V. N.
- Venue
- PeerJ
- Publisher
- PeerJ
- Published
- 2017-09-12
- Volume
- 5
- Pages
- e3785
- ISSN
- 2167-8359 (ISSN-L)
- OpenAlex
- W2615834213
- Cited by
- 169
- References
- 20
- FWCI
- 21.66
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.