Providing education on evidence-based practice improved knowledge but did not change behaviour: a before and after study
Open accessThe DOI matches its Crossref record; 40 of the 40 references it cites were found in a registry or an index.
Abstract
Background: Many health professionals lack the skills to find and appraise published research. This lack of skills and associated knowledge needs to be addressed, and practice habits need to change, for evidence-based practice to occur. The aim of this before and after study was to evaluate the effect of a multifaceted intervention on the knowledge, skills, attitudes and behaviour of allied health professionals. Methods: 114 self-selected occupational therapists were recruited. The intervention included a 2-day workshop combined with outreach support for eight months. Support involved email and telephone contact and a workplace visit. Measures were collected at baseline, post-workshop, and eight months later. The primary outcome was knowledge, measured using the Adapted Fresno Test of Evidence-Based Practice (total score 0 to 156). Secondary outcomes were attitude to evidence-based practice (% reporting improved skills and confidence; % reporting barriers), and behaviour measured using an activity diary (% engaging/not engaging in search and appraisal activities), and assignment completion. Results: Post-workshop, there were significant gains in knowledge which were maintained at follow-up. The mean difference in the Adapted Fresno Test total score was 20.6 points (95% CI, 15.6 to 25.5). The change from post-workshop to follow-up was small and non-significant (mean difference 1.2 points, 95% CI, -6.0 to 8.5). Fewer participants reported lack of searching and appraisal skills as barriers to evidence-based practice over time (searching = 61%, 53%, 24%; appraisal 60%, 65%, 41%). These differences were statistically significant (p = 0.0001 and 0.010 respectively). Behaviour changed little. Pre-workshop, 6% engaged in critical appraisal increasing to 18% post-workshop and 18% at follow-up. Nearly two thirds (60%) were not reading any research literature at follow-up. Twenty-three participants (20.2%) completed their assignment. Conclusion: Evidence-based practice skills and knowledge improved markedly with a targetted education intervention and outreach support. However, changes in behaviour were small, based on the frequency of searching and appraisal activities. Allied health educators should focus more on post-workshop skill development, particularly appraisal, and help learners to establish new routines and priorities around evidence-based practice. Learners also need to know that behaviour change of this nature may take months, even years.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
O'Brien, M. A., Oxman, A. D., Davis, D., Haynes, R. B., Freemantle, N., & Harvey, E. (1998) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000260 · Cited by 123
RetractedRogers, E. M., Singhal, A., & Quinlan, M. M. (2019) · An Integrated Approach to Communication Theory and Research · doi:10.4324/9780203710753-35 · Cited by 37,322
Kytle, J., & Bandura, A. (1978) · Contemporary Sociology · doi:10.2307/2065952 · Cited by 25,422
Pierce, W. D., & Bandura, A. (1977) · Canadian Journal of Sociology / Cahiers canadiens de sociologie · doi:10.2307/3340496 · Cited by 9,650
Audit and feedback: effects on professional practice and healthcare outcomes
Ivers, N., Jamtvedt, G., Flottorp, S., Young, J. M., Odgaard-Jensen, J., French, S. D., O'Brien, M. A., Johansen, M., Grimshaw, J., & Oxman, A. D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000259.pub3 · Cited by 5,485
Transtheoretical therapy: Toward a more integrative model of change.
Prochaska, J. O., & DiClemente, C. C. (1982) · Psychotherapy: Theory, Research & Practice · doi:10.1037/h0088437 · Cited by 3,922
Gluesing, J. C. (2012) · Leadership in Science and Technology: A Reference Handbook · doi:10.4135/9781412994231.n14 · Cited by 3,210
The Adult Learner: The Definitive Classic in Adult Education and Human Resource Development
Knowles, M. S., Holton, E. F., Robinson, P. A., & Caraccioli, C. (2005) · Civil War Book Review · Cited by 2,860
Stages of change and decisional balance for 12 problem behaviors.
Prochaska, J. O., Velicer, W. F., Rossi, J. S., Goldstein, M. G., Marcus, B. H., Rakowski, W., Fiore, C., Harlow, L. L., Redding, C. A., Rosenbloom, D., et al. (1994) · Health Psychology · doi:10.1037//0278-6133.13.1.39 · Cited by 2,469
The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis
Hoenig, J. M., & Heisey, D. M. (2001) · The American Statistician · doi:10.1198/000313001300339897 · Cited by 2,046
Forsetlund, L., Bjørndal, A., Rashidian, A., Jamtvedt, G., O'Brien, M. A., Wolf, F. M., Davis, D., Odgaard-Jensen, J., & Oxman, A. D. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030.pub2 · Cited by 1,849
The Cochrane Database of Systematic Reviews
Handoll, H. H., Howe, T. E., & Madhok, R. (2002) · Physiotherapy · doi:10.1016/s0031-9406(05)60709-2 · Cited by 1,497
Educational outreach visits: effects on professional practice and health care outcomes
O'Brien, M. A., Rogers, S., Jamtvedt, G., Oxman, A. D., Odgaard-Jensen, J., Kristoffersen, D. T., Forsetlund, L., Bainbridge, D., Freemantle, N., Davis, D., et al. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000409.pub2 · Cited by 1,279 · cited 1×
“These collective strategies are often referred to as a 'multifaceted' intervention, where 'champions' of evidence-based practice market concepts to the profession, links are maintained with learners after training, and reminders and feedback are used to encourage behaviour change [10-14].”
Local opinion leaders: effects on professional practice and health care outcomes
Flodgren, G., Parmelli, E., Doumit, G., Gattellari, M., O'Brien, M. A., Grimshaw, J., & Eccles, M. P. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125.pub4 · Cited by 1,070
Coomarasamy, A., & Khan, K. S. (2004) · BMJ · doi:10.1136/bmj.329.7473.1017 · Cited by 715 · cited 1×
“These findings are consistent with systematic reviews on the effectiveness of teaching evidence-based medicine and critical appraisal skills [7-9].”
Validation of the Fresno test of competence in evidence based medicine
Ramos, K. D., Schafer, S., & Tracz, S. M. (2003) · BMJ · doi:10.1136/bmj.326.7384.319 · Cited by 390 · cited 4×
“The 8-page questionnaire was developed from existing instruments [3,23-25].”
InfluentialO'Brien, M. A., Freemantle, N., Oxman, A. D., Wolfe, F., Davis, D., & Herrin, J. (2001) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003030 · Cited by 336
Getting Evidence into Practice: Perspectives on Rationality
Sanderson, I. (2004) · Evaluation · doi:10.1177/1356389004048283 · Cited by 313
Perceptions of evidence‐based practice: A survey of Australian occupational therapists
Bennett, S., Tooth, L., McKenna, K., Rodger, S., Strong, J., Ziviani, J., Mickan, S., & Gibson, L. (2003) · Australian Occupational Therapy Journal · doi:10.1046/j.1440-1630.2003.00341.x · Cited by 253 · cited 2×
“The 8-page questionnaire was developed from existing instruments [3,23-25].”
Barriers to Implementing the Evidence Base in Four NHS Therapies
Metcalfe, C., Lewin, R., Wisher, S., Perry, S., Bannigan, K., & Moffett, J. K. (2001) · Physiotherapy · doi:10.1016/s0031-9406(05)65462-4 · Cited by 248 · cited 1×
“The primary barriers reported by allied health professionals for not using research in practice are a perceived lack of time, and lack of skills and knowledge when searching for and appraising research [1-5].”
Teaching critical appraisal skills in healthcare settings
Horsley, T., Hyde, C., Santesso, N., Parkes, J., Milne, R., & Stewart, R. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001270.pub2 · Cited by 247
A systematic review of the effectiveness of critical appraisal skills training for clinicians
Taylor, R., Reeves, B., Ewings, P., Binns, S., Keast, J., & Mears, R. (2000) · Medical Education · doi:10.1046/j.1365-2923.2000.00574.x · Cited by 182 · cited 1×
“These findings are consistent with systematic reviews on the effectiveness of teaching evidence-based medicine and critical appraisal skills [7-9].”
Learning from the problems of problem-based learning
Epstein, R. J. (2004) · BMC Medical Education · doi:10.1186/1472-6920-4-1 · Cited by 161
McCluskey, A. (2003) · Australian Occupational Therapy Journal · doi:10.1046/j.1440-1630.2003.00303.x · Cited by 158 · cited 1×
“The primary barriers reported by allied health professionals for not using research in practice are a perceived lack of time, and lack of skills and knowledge when searching for and appraising research [1-5].”
Self-citationLocal opinion leaders: effects on professional practice and health care outcomes
O'Brien, M., Oxman, A., Haynes, R., Davis, D., Freemantle, N., & Harvey, E. (1999) · The Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000125 · Cited by 156
O’Brien, M. A., Freemantle, N., Oxman, A., Wolf, F. M., Davis, D., & Herrin, J. S. (2001) · BMC News and views · doi:10.1186/2048-4623-1-s3-pc118 · Cited by 153
Teaching critical appraisal skills in health care settings
Parkes, J., Hyde, C., Deeks, J. J., & Milne, R. (2001) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd001270 · Cited by 146 · cited 1×
“These findings are consistent with systematic reviews on the effectiveness of teaching evidence-based medicine and critical appraisal skills [7-9].”
Stevenson, K., Lewis, M., & Hay, E. (2004) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2003.00479.x · Cited by 134 · cited 1×
“In addition to Taylor and colleagues [6], Stevenson, Lewis and Hay completed another randomised controlled trial involving education and training of British physiotherapists [15].”
Taylor, R. S., Reeves, B. C., Ewings, P., & Taylor, R. J. (2004) · BMC Medical Education · doi:10.1186/1472-6920-4-30 · Cited by 130
Educational outreach visits: effects on professional practice and health care outcomes
O'Brien, M., Oxman, A., Davis, D., Haynes, R., Freemantle, N., & Harvey, E. (1997) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000409 · Cited by 129
Barriers to achieving evidence-based stroke rehabilitation
Pollock, A., Legg, L. A., Langhorne, P., & Sellars, C. (2000) · Clinical Rehabilitation · doi:10.1191/0269215500cr369oa · Cited by 115 · cited 1×
“The primary barriers reported by allied health professionals for not using research in practice are a perceived lack of time, and lack of skills and knowledge when searching for and appraising research [1-5].”
Perceived barriers to research utilization: a survey of four therapies
Closs, S. J., & Lewin, B. (1998) · British Journal of Therapy and Rehabilitation · doi:10.12968/bjtr.1998.5.3.14095 · Cited by 90 · cited 1×
“The primary barriers reported by allied health professionals for not using research in practice are a perceived lack of time, and lack of skills and knowledge when searching for and appraising research [1-5].”
Forsetlund, L., Bradley, P., Forsén, L., Nordheim, L. V., Jamtvedt, G., & Bjørndal, A. (2003) · BMC Medical Education · doi:10.1186/1472-6920-3-2 · Cited by 82
Getting evidence into practice: Needs the right resources and the right organisation
Godlee, F. (1998) · BMJ · doi:10.1136/bmj.317.7150.6 · Cited by 68
O'Brien, M., Ad, O., Davis, D. A., Haynes, R. B., Freemantle, N., & Harvey, E. (2005) · UCL Discovery (University College London) · Cited by 68
The role of strategy and redundancy in diagnostic reasoning
Blöch, R., Hofer, D., Feller, S., & Hodel, M. (2003) · BMC Medical Education · doi:10.1186/1472-6920-3-1 · Cited by 47
Clinical effectiveness and EBP: design of a questionnaire
Upton, D., & Lewis, B. K. (1998) · British Journal of Therapy and Rehabilitation · doi:10.12968/bjtr.1998.5.12.14028 · Cited by 35 · cited 1×
“The 8-page questionnaire was developed from existing instruments [3,23-25].”
Turner, P. A., & Mjolne, I. (2001) · Physiotherapy Research International · doi:10.1002/pri.224 · Cited by 30 · cited 1×
“When confidence intervals are reported in this way, a post-hoc power analysis is redundant [ 27 ].”
Bradley, P., Nordheim, L. V., Harpe, D. V. D. L., Innvær, S., & Thompson, C. A. (2005) · Learning in Health and Social Care · doi:10.1111/j.1473-6861.2005.00095.x · Cited by 28
Setting up a multidisciplinary journal club in learning disability
Hunt, C., & Topham, L. (2002) · British Journal of Nursing · doi:10.12968/bjon.2002.11.10.688 · Cited by 10 · cited 1×
“A recent study of physiotherapy departments [28] found that journal clubs existed in 42% of responding departments in England, but only 19% of those surveyed in Australia.”
Research works printed but not linked: 4
- Effective Health Care: Getting evidence into practice. 1999, York, England , University of York, National Health Service Centre for Reviews and Dissemination, 5 (1): 1-16.
- Bishop B, McCluskey A: The reliability of the Adapted Fresno Test of Evidence-Based Practice: In OT-Australia 22nd National Conference Proceedings: 7 April 2003: Melbourne. 2003.
- Dingle J, Hooper L: Establishing a journal club in an occupational therapy service: One service's experience. British Journal of Occupational Therapy. 2000, 63: 554-556. · doi:10.1177/030802260006301109
- OT-Australia New South Wales: Annual report 2002-3003. 2003, Newington, Sydney, New South Wales , Author
Cited by
Zubala, A., MacGillivray, S., Frost, H., Kroll, T., Skelton, D. A., Gavine, A., Gray, N. M., Toma, M., & Morris, J. (2017) · PLOS ONE · doi:10.1371/journal.pone.0180902 · Cited by 411
Systematic review of knowledge translation strategies in the allied health professions
Scott, S. D., Albrecht, L., O’Leary, K., Ball, G. D., Hartling, L., Hofmeyer, A., Jones, C. A., Klassen, T. P., Burns, K. K., Newton, A. S., et al. (2012) · Implementation Science · doi:10.1186/1748-5908-7-70 · Cited by 331
A hierarchy of effective teaching and learning to acquire competence in evidenced-based medicine
Khan, K. S., & Coomarasamy, A. (2006) · BMC Medical Education · doi:10.1186/1472-6920-6-59 · Cited by 263
Evidence-Based Practice: The Psychology of EBP Implementation
Rousseau, D. M., & Gunia, B. C. (2016) · Annual Review of Psychology · doi:10.1146/annurev-psych-122414-033336 · Cited by 212
Evidence based practice in postgraduate healthcare education: A systematic review
Flores-Mateo, G., & Argimon, J. M. (2007) · BMC Health Services Research · doi:10.1186/1472-6963-7-119 · Cited by 175
Metadata
- Authors
- McCluskey, A., & Lovarini, M.
- Venue
- BMC Medical Education
- Published
- 2005-12
- Volume
- 5
- Issue
- 1
- Pages
- 40-40
- ISSN
- 1472-6920 (ISSN-L)
- OpenAlex
- W2117877292
- Cited by
- 247
- References
- 40
- FWCI
- 10.06
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.