Towards a measurement instrument for determinants of innovations
Open accessAbstract
OBJECTIVE: To develop a short instrument to measure determinants of innovations that may affect its implementation. DESIGN: We pooled the original data from eight empirical studies of the implementation of evidence-based innovations. The studies used a list of 60 potentially relevant determinants based on a systematic review of empirical studies and a Delphi study among implementation experts. Each study used similar methods to measure both the implementation of the innovation and determinants. Missing values in the final data set were replaced by plausible values using multiple imputation. We assessed which determinants predicted completeness of use of the innovation (% of recommendations applied). In addition, 22 implementation experts were consulted about the results and about implications for designing a short instrument. SETTING: Eight innovations introduced in Preventive Child Health Care or schools in the Netherlands. PARTICIPANTS: Doctors, nurses, doctor's assistants and teachers; 1977 respondents in total. RESULTS: The initial list of 60 determinants could be reduced to 29. Twenty-one determinants were based on the pooled analysis of the eight studies, seven on the theoretical expectations of the experts consulted and one new determinant was added on the basis of the experts' practical experience. CONCLUSIONS: The instrument is promising and should be further validated. We invite researchers to use and explore the instrument in multiple settings. The instrument describes how each determinant should preferably be measured (questions and response scales). It can be used both before and after the introduction of an innovation to gain an understanding of the critical change objectives.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Existing literature shows that several contextual factors, including HP practices of teachers and parents, HP elements in the school, dominating organisational issues, perceived barriers, and characteristics of the student population, might be of direct importance in the decision to participate and the further process of change.
“Existing literature shows that in this decision and the further process of change, several contextual factors might be of direct importance, e.g., HP practices of teachers and parents; HP elements in the school (school routine, policy, education, and environment); dominating organisational issues (e.g., staff turnover); innovation-, implementers-, organisation-, and socio-political context-related”
From The Healthy Primary School of the Future: A Contextual Action-Oriented Research Approach (2018) · cites this paper as [31]
The barrier questionnaire used is based on the Measurement Instrument for Determinants of Innovations (MIDI), a Dutch validated questionnaire developed by Fleuren et al. and used in several Dutch studies.
“The used questionnaire was based on the Measurement Instrument for Determinants of Innovations (MIDI), a Dutch validated questionnaire developed by Fleuren et al. [31] and used in several Dutch studies [37,38].”
From The Healthy Primary School of the Future: A Contextual Action-Oriented Research Approach (2018) · cites this paper as [31]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Rogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · Routledge eBooks · doi:10.4324/9780203710753-35 · Cited by 37,557 · see citing works
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701 · see citing works
<b>mice</b>: Multivariate Imputation by Chained Equations in<i>R</i>
Buuren, S. V., & Groothuis-Oudshoorn, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i03 · Cited by 13,870 · see citing works
Self-citationDiffusion of Innovations in Service Organizations: Systematic Review and Recommendations
GREENHALGH, T., ROBERT, G., MACFARLANE, F., BATE, P., & KYRIAKIDOU, O. (2004) · The Milbank Quarterly · doi:10.1111/j.0887-378x.2004.00325.x · Cited by 7,448 · see citing works
Sterne, J. A. C., White, I. R., Carlin, J. B., Spratt, M., Royston, P., Kenward, M. G., Wood, A. M., & Carpenter, J. R. (2009) · BMJ · doi:10.1136/bmj.b2393 · Cited by 7,299 · see citing works
Evaluating the public health impact of health promotion interventions: the RE-AIM framework.
Glasgow, R. E., Vogt, T. M., & Boles, S. M. (1999) · American Journal of Public Health · doi:10.2105/ajph.89.9.1322 · Cited by 7,217 · see citing works
(2005) · Cited by 3,748 · see citing works
Multiple imputation of discrete and continuous data by fully conditional specification
van Buuren, S. (2007) · Statistical Methods in Medical Research · doi:10.1177/0962280206074463 · Cited by 2,827 · see citing works
A comparison of inclusive and restrictive strategies in modern missing data procedures.
Collins, L. M., Schafer, J. L., & Kam, C.-M. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.330 · Cited by 2,389 · see citing works
Planning health promotion programs an intervention mapping approach
Bartholomew, L. K., Parcel, G. S., Kok, G., & Gottlieb, N. (2006) · Cited by 2,038 · see citing works
Flexible Imputation of Missing Data
van Buuren, S. (2012) · doi:10.1201/b11826 · Cited by 2,022 · see citing works
Self-citationFlottorp, S. A., Oxman, A. D., Krause, J., Musila, N. R., Wensing, M., Godycki-Cwirko, M., Baker, R., & Eccles, M. P. (2013) · Implementation Science · doi:10.1186/1748-5908-8-35 · Cited by 1,138 · see citing works
Lee, K. J., & Carlin, J. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwp425 · Cited by 787 · see citing works
Determinants of innovation within health care organizations: Literature review and Delphi study
Fleuren, M. (2004) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzh030 · Cited by 732 · see citing works
Self-citationEvidence of self-report bias in assessing adherence to guidelines
Adams, A., Soumerai, S., Lomas, J., & Ross-Degnan, D. (1999) · International Journal for Quality in Health Care · doi:10.1093/intqhc/11.3.187 · Cited by 679 · cited 1× · see citing works
“There is sometimes a large discrepancy between self-report and objective measurements [25].”
Toward Evidence-Based Quality Improvement.
Grimshaw, J., Eccles, M., Thomas, R. E., MacLennan, G., Ramsay, C. R., Fraser, C. M., & Vale, L. D. (2006) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2006.00357.x · Cited by 639 · see citing works
Improving Patient Care: The Implementation of Change in Clinical Practice
Grol, R. P. T. M., Wensing, M., Eccles, M., Davis, D., & Wensign, M. (2005) · Cited by 553 · see citing works
Prior, M., Guerin, M., & Grimmer, K. A. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2008.01014.x · Cited by 509 · see citing works
Wiefferink, C. H., Poelman, J., Linthorst, M. M., et al. (2004) · Health Education Research · doi:10.1093/her/cyg120 · Cited by 48 · see citing works
Sustainability of the Prevention of Passive Infant Smoking Within Well-Baby Clinics
Crone, M. R., Verlaan, M. L., Willemsen, M. C., van Soelen, P., Reijneveld, S. A., Sing, R. A. H., & Paulussen, T. G. (2006) · Health Education & Behavior · doi:10.1177/1090198105276296 · Cited by 22 · see citing works
Self-citationFrom news to everyday use: the difficult art of implementation.
Guldbrandsson, K. (2008) · Cited by 20 · see citing works
Fleuren, M. A. H., Verlaan, M. L., van Velzen-Mol, H. W. M., et al. (2006) · TNO Repository · Cited by 7 · see citing works
Self-citationMultiple imputation of missing blood pressure covariates in survival analysis
van Buuren, S., Boshuizen, H. C., & Knook, D. L. (1999) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19990330)18:6
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- [7]Rogers EM Diffusion of Innovations 2003 New York Free press
Cited by
Sorted by citations
Vis, C., Mol, M., Kleiboer, A., Bührmann, L., Finch, T., Smit, J., & Riper, H. (2018) · JMIR Mental Health · doi:10.2196/mental.9769 · Cited by 183 · see citing works
Barriers and facilitators to the implementation of a paediatric palliative care team
Verberne, L. M., Kars, M. C., Schepers, S. A., Schouten-van Meeteren, A. Y. N., Grootenhuis, M. A., & van Delden, J. J. M. (2018) · BMC Palliative Care · doi:10.1186/s12904-018-0274-8 · Cited by 92 · see citing works
“To develop tailored implementation strategies for improving PPC in the intramural and home settings [26, 27, 30], in this study we identified HCP-reported barriers and facilitators to implementing the PPCT.”
Vis, C., Kleiboer, A., Prior, R., Bønes, E., Cavallo, M., Clark, S. A., Dozeman, E., Ebert, D., Etzelmueller, A., Favaretto, G., et al. (2015) · Internet Interventions · doi:10.1016/j.invent.2015.10.002 · Cited by 71 · see citing works
The Healthy Primary School of the Future: A Contextual Action-Oriented Research Approach
Bartelink, N. H. M., Van Assema, P., Jansen, M. W. J., Savelberg, H. H. C. M., Willeboordse, M., & Kremers, S. P. J. (2018) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph15102243 · Cited by 39 · see citing works
Bossen, D., Kloek, C., Snippe, H. W., Dekker, J., de Bakker, D., & Veenhof, C. (2016) · JMIR Research Protocols · doi:10.2196/resprot.5049 · Cited by 30 · see citing works
Konijnendijk, A. A. J., Boere-Boonekamp, M. M., Fleuren, M. A. H., Haasnoot, M. E., & Need, A. (2016) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2015.11.006 · Cited by 28 · see citing works
Self-citationMalham, S. A., Smithman, M.-A., Touati, N., Brousselle, A., Loignon, C., Dubois, C.-A., Nour, K., Boivin, A., & Breton, M. (2019) · Journal of Health Organization and Management · doi:10.1108/jhom-10-2018-0303 · Cited by 9 · see citing works
- Authors
- Fleuren, M. A. H., Paulussen, T. G. W. M., Van Dommelen, P., & Van Buuren, S.
- Affiliations
- Netherlands Organisation for Applied Scientific Research (NL)
- Corresponding author
- Fleuren, Margot A.H.
- Venue
- International Journal for Quality in Health Care
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-06-20
- Volume
- 26
- Issue
- 5
- Pages
- 501-510
- ISSN
- 1353-4505 (ISSN-L)
- 1464-3677
- PMC
- PMC4195468
- OpenAlex
- W2151996204
- Cited by
- 365
- References
- 23
- Citations by year
- 2026: 21 · 2025: 27 · 2024: 40 · 2023: 48 · 2022: 58 · 2021: 46 · 2020: 36 · 2019: 40 · 2018: 19 · 2017: 11 · 2016: 10 · 2015: 6 · 2014: 2
- FWCI
- 17.50
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc-nd
- Locations
- International Journal for Quality in Health Care (publishedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- VU Research Portal (publishedVersion, other-oa)
- TNO Repository (submittedVersion, cc-by-nc-nd)
- Utrecht University Repository (Utrecht University) (submittedVersion)
- Repository hosted by TU Delft Library (TU Delft) (submittedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion, other-oa)
- Funders
- ZonMw (20040008)
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
- Health Sciences › Health Professions › General Health Professions › Health Sciences Research and Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Clinical practice guidelines implementation
- Keywords
- innovation implementation, evidence-based innovation, innovation drivers, scale development, preventive child health care, school-based intervention, healthcare workers, teachers, instrument validation
- MeSH terms
- Child, Child Health Services, Data Collection, Diffusion of Innovation, Health Personnel, Humans, Netherlands, Preventive Health Services, Reproducibility of Results, Practice Guidelines as Topic, Evidence-Based Practice
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
