The DOI matches its Crossref record; 251 of the 252 references it cites were found in a registry or an index.
Design, delivery and effectiveness of health practitioner regulation systems: an integrative review
Open accessPublished version of a preprint
Abstract
BACKGROUND: Health practitioner regulation (HPR) systems are increasingly recognized as playing an important role in supporting health workforce availability, accessibility, quality, and sustainability, while promoting patient safety. This review aimed to identify evidence on the design, delivery and effectiveness of HPR to inform policy decisions. METHODS: We conducted an integrative analysis of literature published between 2010 and 2021. Fourteen databases were systematically searched, with data extracted and synthesized based on a modified Donabedian framework. FINDINGS: This large-scale review synthesized evidence from a range of academic (n = 410) and grey literature (n = 426) relevant to HPR. We identified key themes and findings for a series of HPR topics organized according to our structures-processes-outcomes conceptual framework. Governance reforms in HPR are shifting towards multi-profession regulators, enhanced accountability, and risk-based approaches; however, comparisons between HPR models were complicated by a lack of a standardized HPR typology. HPR can support government workforce strategies, despite persisting challenges in cross-border recognition of qualifications and portability of registration. Scope of practice reform adapted to modern health systems can improve access and quality. Alternatives to statutory registration for lower-risk health occupations can improve services and protect the public, while standardized evaluation frameworks can aid regulatory strengthening. Knowledge gaps remain around the outcomes and effectiveness of HPR processes, including continuing professional development models, national licensing examinations, accreditation of health practitioner education programs, mandatory reporting obligations, remediation programs, and statutory registration of traditional and complementary medicine practitioners. CONCLUSION: We identified key themes, issues, and evidence gaps valuable for governments, regulators, and health system leaders. We also identified evidence base limitations that warrant caution when interpreting and generalizing the results across jurisdictions and professions. Themes and findings reflect interests and concerns in high-income Anglophone countries where most literature originated. Most studies were descriptive, resulting in a low certainty of evidence. To inform regulatory design and reform, research funders and governments should prioritize evidence on regulatory outcomes, including innovative approaches we identified in our review. Additionally, a systematic approach is needed to track and evaluate the impact of regulatory interventions and innovations on achieving health workforce and health systems goals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Figures















Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“These authors report the literature base to be diffuse, primarily descriptive, and insufficient for drawing strong conclusions about the effects of various regulatory approaches, policies, and practices on patient safety, the health workforce, and health system outcomes [17,18].”
From Nursing regulation in Canada: Insights from a scoping review (2025) · cites this paper as [18]
The cited source says what the claim attributes to it.
In the citing paper
“Although mandatory continuing professional development is an approach that is used widely by professional regulators globally, existing evidence about the design and outcomes of CCPs is mixed [18,247–251].”
From Nursing regulation in Canada: Insights from a scoping review (2025) · cites this paper as [18]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
Guidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472
The cochrane database of systematic reviews
Geddes, J. R. (1996) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(96)90063-x · Cited by 5,988
Frenk, J., Chen, L., Bhutta, Z. A., Cohen, J., Crisp, N., Evans, T., Fineberg, H., Garcia, P., Ke, Y., Kelley, P., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)61854-5 · Cited by 5,960
The Future of Nursing: Leading Change, Advancing Health
(2011) · Choice Reviews Online · doi:10.5860/choice.48-5720 · Cited by 2,105
A scoping review of rapid review methods
Tricco, A. C., Antony, J., Zarin, W., Strifler, L., Ghassemi, M., Ivory, J., Perrier, L., Hutton, B., Moher, D., & Straus, S. E. (2015) · BMC Medicine · doi:10.1186/s12916-015-0465-6 · Cited by 1,146
Hong, Q. N., Pluye, P., Bujold, M., & Wassef, M. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0454-2 · Cited by 754 · cited 2×
“…various contexts and perspectives, providing the opportunity to examine a range of evidence (arising from qualitative, quantitative, correlation, economic, policy, regulatory, and other sources) to summarize the global literature on HPR at practitioner, organizational, and societal levels [15–17].”
BackgroundMethodMethodological guidance for the conduct of mixed methods systematic reviews
Stern, C., Lizarondo, L. M., Carrier, J., Godfrey, C. M., Rieger, K. L., Salmond, S. W., Apóstolo, J., Kirkpatrick, P., & Loveday, H. P. (2020) · JBI Evidence Synthesis · doi:10.11124/jbisrir-d-19-00169 · Cited by 747
International Confederation of Midwives
Woodville, L. (1964) · Bulletin of the American College of Nurse-Midwifery · doi:10.1111/j.1542-2011.1964.tb00484.x · Cited by 537
(2006) · PubMed · Cited by 485
Research works printed but not linked: 13
- Carlton A-L. Review of the Allied Health Professions Act 2016: Final report for the Malaysian Ministry of Health on establishing an effective regulatory framework for the allied health professions - findings and recommendations from WHO consultancy conducted September 2020 - July 2021. World Health Organization Western Pacific Region (WHO WPR); 2021 Oct p. 1–114.
- Pearson A, White H, Bath-Hextall F, Salmond S, Apostolo J, Kirkpatrick P. A mixed-methods approach to systematic reviews. JBI Evid Implement. 2015;13:121.
- Covidence. Covidence: Better systematic review management. Covidence. https://www.covidence.org/
- PSA. A new approach to how we review the regulators: 2021 consultations [Internet]. UK Professional Standards Authority for Health and Social Care. 2021. https://www.professionalstandards.org.uk/what-we-do/improving-regulation/consultation/consultation-on-performance-reviews
- Snowball K. Independent Review of the National Registration and Accreditation Scheme for health professions. Australian Health Ministers’ Advisory Council (AHMAC); 2014 Dec.
- COAG Health Council. Review of Governance of the National Registration and Accreditation Scheme (NRAS). COAG Health Council; 2017 Nov p. 1–26.
- Besançon LJR, Rockey P, van Zanten M. Regulation of health professions: disparate worldwide approaches are a challenge to harmonization. Globalization. 2012;1:3.
- Yam HK. Fit for purpose: Do Hong Kong’s current assessment and monitoring systems for medical practice meet modern day needs? Dissertation Abstracts International: Section B: The Sciences and Engineering. 2018;79:No Pagination Specified.
- Woods M. Australia’s Health Workforce: strengthening the education foundation | Independent Review of Accreditation Systems within the National Registration and Accreditation Scheme for health professions. Australian Health Ministers’ Advisory Council, COAG Health Council; 2017 Nov.
- Benton DC, George J. Regulating the Regulators? Official Journal of the World Medical Association, Inc. 2018;64:3–8.
- Archer J, Lynn N, Roberts M, Coombes L, Gale T, de Bere SR. A Systematic review on the impact of licensing examinations for doctors in countries comparable to the UK. 2015 May p. 1–52. https://www.gmc-uk.org/-/media/documents/A_systematic_review_on_the_impact_of_licensing_examinations__for_doctors_in_countries_comparable_to_the_UK.pdf_61103496.pdf
- Ying X, Kannan V, Greener E, Smith JA, Brasch J, Johnson BA, et al. Full scope-of-practice regulation is associated with higher supply of nurse practitioners in rural and primary care health professional shortage counties. J Nurs Regul. 2018;8:5–13. · DOI
- Bullock A, Browne J, Poletti C, Dorottya C& E. Review of research into health and care professional regulation. Professional Standards Authority. 2020. https://www.professionalstandards.org.uk/publications/detail/review-of-research-into-health-and-care-professional-regulation
Cited by
Sorted by citations
Global Strategy on Human Resources for Health: Workforce 2030—A Five-Year Check-In
McIsaac, M., Buchan, J., Abu-Agla, A., Kawar, R., & Campbell, J. (2024) · Human Resources for Health · doi:10.1186/s12960-024-00940-x · Cited by 78
Limoges, J., Puddester, R., Gretchev, A., Chiu, P., Calzone, K., Leslie, K., Pike, A. D., & Letourneau, N. L. (2024) · Current Oncology · doi:10.3390/curroncol32010014 · Cited by 15
Self-citationSriram, V. M., Brophy, S. A., Sharma, K., Elias, M. A., & Mishra, A. (2023) · BMJ Global Health · doi:10.1136/bmjgh-2023-012661 · Cited by 13
Nursing regulation in Canada: Insights from a scoping review
Chiu, P., Thiessen, N. J., Idrees, S., Leslie, K., & Kung, J. Y. (2025) · PLOS ONE · doi:10.1371/journal.pone.0323716 · Cited by 12
“Although mandatory continuing professional development is an approach that is used widely by professional regulators globally, existing evidence about the design and outcomes of CCPs is mixed [18,247–251].”
InfluentialSelf-citationLeslie, K., Myles, S., Schiller, C. J., Alraja, A. A., Nelson, S., & Adams, T. L. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000163 · Cited by 12
Self-citation
Metadata
- Authors
- Leslie, K., Bourgeault, I. L., Carlton, A.-L., Balasubramanian, M., Mirshahi, R., Short, S. D., Carè, J., Cometto, G., & Lin, V.
- Affiliations
- Athabasca University (CA)
- University of Ottawa (CA)
- RMIT University (AU)
- The University of Sydney (AU)
- University of Technology Sydney (AU)
- World Health Organization (CH)
- University of Hong Kong (HK)
- Corresponding author
- Leslie, Kathleen
- ORCID
- Venue
- Human Resources for Health
- Published
- 2023-09-04
- Volume
- 21
- Issue
- 1
- Pages
- 72-72
- ISSN
- 1478-4491 (ISSN-L)
- PMC
- PMC10478314
- OpenAlex
- W4386423345
- Cited by
- 38
- References
- 252
- Citations by year
- 2026: 13 · 2025: 13 · 2024: 9 · 2023: 3
- FWCI
- 2.35
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- Human Resources for Health (publishedVersion, cc-by)
- Research Square (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- uO Research (University of Ottawa) (submittedVersion, public-domain)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- Funders
- World Health Organization
- Topics
- Social Sciences › Law › Occupational and Professional Licensing Regulation
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Regulation
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Global Health Workforce Issues
- Keywords
- health practitioner regulation, healthcare workers, statutory registration, risk-based regulation, continuing professional development, licensing examinations, mandatory reporting, remedial programme, patient safety, health workforce policy
- MeSH terms
- Accreditation, Government, Government Programs, Health Education, Humans, Databases, Factual
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review