Making sense of evidence in management decisions: the role of research-based knowledge on innovation adoption and implementation in health care
Open accessThe DOI matches its Crossref record; 13 of the 13 references it cites were found in a registry or an index.
Abstract
Background: Although innovation can improve patient care, implementing new ideas is often challenging. Previous research found that professional attitudes, shaped in part by health policies and organisational cultures, contribute to differing perceptions of innovation ‘evidence’. However, we still know little about how evidence is empirically accessed and used by organisational decision-makers when innovations are introduced. Aims and objectives: We aimed to investigate the use of different sources and types of evidence in innovation decisions to answer the following questions: how do managers make sense of evidence? What role does evidence play in management decision-making when adopting and implementing innovations in health care? How do wider contextual conditions and intraorganisational capacity influence research use and application by health-care managers? Methods: Our research design comprised multiple case studies with mixed methods. We investigated technology adoption and implementation in nine acute-care organisations across England. We employed structured survey questionnaires, in-depth interviews and documentary analysis. The empirical setting was infection prevention and control. Phase 1 focused on the espoused use of evidence by 126 non-clinical and clinical hybrid managers. Phase 2 explored the use of evidence by managers in specific technology examples: (1) considered for adoption; (2) successfully adopted and implemented; and (3) rejected or discontinued. Findings: (1) Access to, and use of, evidence types and sources varied greatly by profession. Clinicians reported a strong preference for science-based, peer-reviewed, published evidence. All groups called upon experiential knowledge and expert opinion. Nurses overall drew upon a wider range of evidence sources and types. Non-clinical managers tended to sequentially prioritise evidence on cost from national-level sources, and local implementation trials. (2) A sizeable proportion of professionals from all groups, including experienced staff, reported difficulty in making sense of evidence. Lack of awareness of existing implementation literature, lack of knowledge on how to translate information into current practice, and lack of time and relevant skills were reported as key reasons for this. (3) Infection outbreaks, financial pressures, performance targets and trusted relationships with suppliers seemed to emphasise a pragmatic and less rigorous approach in sourcing for evidence. Trust infrastructure redevelopment projects, and a strong emphasis on patient safety and collaboration, appeared to widen scope for evidence use. (4) Evidence was continuously interpreted and (re)constructed by professional identity, organisational role, team membership, audience and organisational goals. (5) Doctors and non-clinical managers sourced evidence plausible to self. Nursing staff also sought acceptance of evidence from other groups. (6) We found diverse ‘evidence templates’ in use: ‘biomedical-scientific’, ‘practice-based’, ‘rational-policy’. These represented shared cognitive models which defined what constituted acceptable and credible evidence in decisions. Nurses drew on all diverse ‘templates’ to make sense of evidence and problems; non-clinical managers drew mainly on the practice-based and rational-policy templates; and doctors drew primarily on the biomedical-scientific template. Conclusions: An evidence-based management approach that inflexibly applies the principles of evidence-based medicine, our findings suggest, neglects how evidence is actioned in practice and how codified research knowledge inter-relates with other ‘evidence’ also valued by decision-makers. Local processes and professional and microsystem considerations played a significant role in adoption and implementation. This has substantial implications for the effectiveness of large-scale projects and systems-wide policy. Funding: The National Institute for Health Research Health Services and Delivery Research programme.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Organizing and the process of sensemaking
Weick, K. E., Sutcliffe, K. M., & Obstfeld, D. (2005) · Organization Science · doi:10.1287/orsc.1050.0133 · Cited by 6,943
Qualitative Data Analysis for Health Services Research: Developing Taxonomy, Themes, and Theory
Bradley, E. H., Curry, L. A., & Devers, K. J. (2007) · Health Services Research · doi:10.1111/j.1475-6773.2006.00684.x · Cited by 3,437
Managing the Rivalry of Competing Institutional Logics
Reay, T., & Hinings, C. R. (2009) · Organization Studies · doi:10.1177/0170840609104803 · Cited by 1,821
Damanpour, F., & Schneider, M. (2006) · British Journal of Management · doi:10.1111/j.1467-8551.2006.00498.x · Cited by 1,296
Qualitative research methods in health technology assessment: a review of the literature.
Murphy, Dingwall, Greatbatch, Parker, & Watson (1998) · Health Technology Assessment · doi:10.3310/hta2160 · Cited by 1,107
Gabbay, J., & May, A. L. (2004) · BMJ · doi:10.1136/bmj.329.7473.1013 · Cited by 986
Determinants of innovation within health care organizations: Literature review and Delphi study
Fleuren, M. (2004) · International Journal for Quality in Health Care · doi:10.1093/intqhc/mzh030 · Cited by 732
CareTrack: assessing the appropriateness of health care delivery in Australia
Runciman, W. B., Hunt, T. D., Hannaford, N. A., Hibbert, P. D., Westbrook, J. I., Coiera, E. W., Day, R. O., Hindmarsh, D. M., McGlynn, E. A., & Braithwaite, J. (2012) · Medical Journal of Australia · doi:10.5694/mja12.10510 · Cited by 436
Examining the Role of Health Services Research in Public Policymaking
Lavis, J. N., Ross, S. E., & Hurley, J. E. (2002) · The Milbank Quarterly · doi:10.1111/1468-0009.00005 · Cited by 402
Cited by
Adams, R. J., Smart, P., & Huff, A. S. (2017) · International Journal of Management Reviews · doi:10.1111/ijmr.12102 · Cited by 995
Aarons, G. A., Ehrhart, M. G., & Farahnak, L. R. (2014) · Implementation Science · doi:10.1186/1748-5908-9-45 · Cited by 559
Aarons, G. A., Ehrhart, M. G., Farahnak, L. R., & Hurlburt, M. S. (2015) · Implementation Science · doi:10.1186/s13012-014-0192-y · Cited by 435
Metadata
- Authors
- Kyratsis, Y., Ahmad, R., Hatzaras, K., Iwami, M., & Holmes, A.
- Venue
- Health Services and Delivery Research
- Published
- 2014-03
- Volume
- 2
- Issue
- 6
- Pages
- 1-192
- ISSN
- 2050-4349 (ISSN-L)
- 2050-4357
- OpenAlex
- W2054271469
- Cited by
- 38
- References
- 13
- FWCI
- 8.71
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.