Performance measurement and evaluation of health practitioner regulation: A scoping review protocol
Open accessThe DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Abstract
Health practitioner regulation plays a fundamental role in public protection by overseeing and governing healthcare professionals to ensure they deliver safe health services. It also serves as a strategic lever to strengthen broader health system goals such as improving the accessibility of services, the sustainability of health workforces, and health system resilience. Although the goals of health practitioner regulation are easily articulated, achieving and evaluating these goals are far more challenging. Performance measurement and evaluation of professional regulators and regulatory systems are critical to improving regulatory processes and functions. This is especially important where there is rising government, public, and professional skepticism and mistrust of the effectiveness and efficiency of regulators across global jurisdictions. Although there is evidence that some health practitioner regulators and regulatory systems engage in performance measurement and evaluation, the similarities and differences remain unclear. The objective of this scoping review is to explore the nature, extent, and range of scholarship related to health practitioner regulatory performance measurement and evaluation. It will explore existing performance measurement and evaluation frameworks; the key principles and areas of focus of these frameworks; and the indicators, metrics and outcomes used to evaluate performance. The review will be conducted in accordance with the JBI guidelines for scoping reviews and will be reported following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews. Database searches will include Ovid MEDLINE, Ovid EMBASE, CINAHL, Scopus, and Web of Science Core Collection. Gray literature will be identified through leading regulatory organizations, consortiums, and think tanks. Two independent reviewers will screen titles and abstracts followed by full-text and disagreements will be resolved by a third reviewer. Data will be analyzed using descriptive statistics and conventional content analysis. Results will be presented using evidence tables and a narrative summary. Open Science Framework Registration: https://doi.org/10.17605/OSF.IO/WABTF
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601 · cited 1×
“We will use conventional content analysis [37] to analyze the extracted data as it will allow for the development of broader categories based on coded data.”
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223 · cited 1×
“We developed this protocol using the reporting guidelines in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Protocols (PRISMA-P) [32,33] as they apply to scoping reviews [33] (see S1 Appendix: PRISMA-P Checklist).”
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120
Peters, M. D., Godfrey, C., McInerney, P., Munn, Z., Tricco, A. C., & Khalil, H. (2024) · JBI Manual for Evidence Synthesis · doi:10.46658/jbimes-24-09 · Cited by 1,044
Design, delivery and effectiveness of health practitioner regulation systems: an integrative review
Leslie, K., Bourgeault, I. L., Carlton, A.-L., Balasubramanian, M., Mirshahi, R., Short, S. D., Carè, J., Cometto, G., & Lin, V. (2023) · Human Resources for Health · doi:10.1186/s12960-023-00848-y · Cited by 38
Self-citationAdams, T. L. (2020) · Human Resources for Health · doi:10.1186/s12960-020-00501-y · Cited by 34
Self-citationRecent research into healthcare professions regulation: a rapid evidence assessment
Browne, J., Bullock, A., Poletti, C., & Cserző, D. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-06946-8 · Cited by 29 · cited 1×
“Studies emphasize the importance of regulatory bodies and systems being proactive rather than reactive, suggesting that regulatory approaches must evolve with healthcare innovations and societal shifts to remain relevant and effective in their protective role [8].”
Health practitioner regulation and national health goals
Mahat, A., Dhillon, I. S., Benton, D., Fletcher, M., & Wafula, F. (2023) · Bulletin of the World Health Organization · doi:10.2471/blt.21.287728 · Cited by 27 · cited 4×
“The global landscape of HPR is characterized by its diversity across different jurisdictions, shaped significantly by each country’s legal traditions, political economy, and colonial history [2].”
Influentialvan der Gaag, A., Jago, R., Gallagher, A., Stathis, K., Webster, M., & Austin, Z. (2023) · Journal of Nursing Regulation · doi:10.1016/s2155-8256(23)00087-x · Cited by 23
Occupational Regulation, Institutions, and Migrants’ Labor Market Outcomes
Koumenta, M., Pagliero, M., & Rostam‐Afschar, D. (2022) · Labour Economics · doi:10.1016/j.labeco.2022.102250 · Cited by 22 · cited 1×
“Professional regulation, in a broad sense, refers to legally defined rules governing entry into specific occupations and the conduct within them [1].”
Leslie, K., Myles, S., Schiller, C. J., Alraja, A. A., Nelson, S., & Adams, T. L. (2023) · PLOS Digital Health · doi:10.1371/journal.pdig.0000163 · Cited by 18
Self-citationLeslie, K., Myles, S., Alraja, A. A., Chiu, P., Schiller, C. J., Nelson, S., & Adams, T. L. (2024) · PLoS ONE · doi:10.1371/journal.pone.0303192 · Cited by 18
Self-citationAnalysis of a global random stratified sample of nurse legislation
Benton, D., Fernández‐Fernández, M. P., Jurado, M. A. G., & Beneit‐Montesinos, J. V. (2015) · International Nursing Review · doi:10.1111/inr.12171 · Cited by 15 · cited 2×
“…to ensure those entering the workforce are prepared to meet entry-level competencies; granting licensure to professionals who meet regulatory requirements; enforcing professional standards and ongoing professional development; and addressing complaints related to professional misconduct [3,4].”
Major regulatory reform comes to Canada
Durcan, R., Richler, E., & Steinecke, R. (2023) · Journal of Nursing Regulation · doi:10.1016/s2155-8256(23)00091-1 · Cited by 9
An Examination of Self-Employed Nursing Regulation in Three Canadian Provinces
Thiessen, N. J., Leslie, K., & Stephens, J. M. L. (2023) · Policy Politics & Nursing Practice · doi:10.1177/15271544231175472 · Cited by 8 · cited 1×
“Generational differences in work-life balance are also creating new ways of engaging in professional work such as the shift towards self-employment [23].”
Self-citationRegulation of Wicked Problems: Opportunities, Responsibilities, and Threats
Austin, Z., & Háji, A. (2023) · Journal of Medical Regulation · doi:10.30770/2572-1852-109.3.6 · Cited by 7 · cited 1×
“The integration of new technologies and artificial intelligence is posing new social, legal, and technological threats to public safety [17–22].”
Durai, P. (2024) · CRC Press eBooks · doi:10.1201/9781032622736-12 · Cited by 5
GMC regrets failure to act on police warning about gynaecologist
Dyer, O. (2004) · BMJ · doi:10.1136/bmj.328.7447.1035 · Cited by 4 · cited 1×
“For example, several highly publicized professional conduct cases across jurisdictions have illustrated significant shortcomings of regulatory systems compromising public confidence [9–12].”
Enhancing the Relationship Between Regulators and Their Profession
Austin, Z. (2017) · A Nudge Too Far? A Nudge at All? On Paying People to Be Healthy · doi:10.12927/hcpap.2017.25200 · Cited by 3 · cited 1×
“The literature also suggests that many regulated professionals, irrespective of profession or jurisdiction, perceive their regulators as ineffective, bureaucratic, and costly institutions that they must navigate to avoid trouble [13].”
Chamberlain, J. M. (2019) · Cited by 1
Research works printed but not linked: 8
- 10. Government of Ontario. Public inquiry into the safety and security of residents in the long-term care homes system. Toronto: Government of Ontario; 2023. Available from: https://www.ontario.ca/page/public-inquiry-safety-and-security-residents-long-term-care-homes-system
- 15. Professional Standards Authority. Who are we? London: Professional Standards Authority; [date unknown]. Available from: https://www.professionalstandards.org.uk/about-us
- 22. Austin Z, Háji A. Regulation of wicked problems: opportunities, responsibilities, and threats. Journal of Medical Regulation. 2023;109(3):6–11. doi: 10.30770/2572-1852-109.3.6 · DOI
- 25. Professional Standards Authority. Read our performance reviews of regulators. London: Professional Standards Authority; [date unknown]. Available from: https://www.professionalstandards.org.uk/what-we-do/our-work-with-regulators/read-performance-reviews.
- 26. New Zealand Treasury. Regulatory management system: overview. Wellington: New Zealand Treasury; 2024. May 1 [cited 2024 Oct 3]. Available from: https://www.treasury.govt.nz/information-and-services/regulation/regulatory-management-system-overview
- 28. Government of Ontario. College performance measurement framework (CPMF). Toronto: Government of Ontario; 2024. Oct 4. Available from: https://www.ontario.ca/document/college-performance-measurement-framework-cpmf
- 34. Covidence systematic review software. Veritas Health Innovation, Melbourne, Australia; 2023. Available from: https://www.covidence.org
- 35. Zotero [Internet]. Version 7.0.7. New York: Corporation for Digital Scholarship; 2022. [cited 2024 Oct 4]. Available from: https://www.zotero.org/Zotero.
Cited by
Nursing regulation in Canada: Insights from a scoping review
Chiu, P., Thiessen, N. J., Idrees, S., Leslie, K., & Kung, J. Y. (2025) · PLOS ONE · doi:10.1371/journal.pone.0323716 · Cited by 12
“Given the growing emphasis on performance measurement and accountability [5,12,46,113,115,117,198,205,224] we argue that future research should go beyond comparing or describing structures and processes and prioritize evaluating the impact of regulation to inform improvements.”
Self-citationDeveloping a pan-Canadian nursing regulation research agenda
Chiu, P., Leslie, K., Myles, S., Ben-Ahmed, H. E., & Jang, G. (2025) · Journal of Nursing Regulation · doi:10.1016/j.jnr.2025.09.001 · Cited by 4
Self-citationChiu, P., Thiessen, N. J., Alostaz, N., Li, R., Hermosisima, A., Nelson, S., Bourgeault, I. L., Salami, B. O., Iduye, D., Ben-Ahmed, H. E., et al. (2026) · Health Policy · doi:10.1016/j.healthpol.2026.105708 · Cited by 3
Self-citationChipofya, E. (2025) · African Journal of Laboratory Medicine · doi:10.4102/ajlm.v14i1.2941
Chiu, P., Thiessen, N. J., Adams, T. L., Wenghofer, E. F., Myles, S., Leslie, K., & Bourgeault, I. L. (2026) · Journal of Nursing Regulation · doi:10.1016/j.jnr.2026.02.004
Self-citation
Metadata
- Authors
- Chiu, P., Leslie, K., Jang, G., Adams, T. L., Thiessen, N., & Kung, J. Y.
- Affiliations
- University of Alberta (CA)
- Athabasca University (CA)
- Western University (CA)
- Corresponding author
- Chiu, Patrick
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2025-03-17
- Volume
- 20
- Issue
- 3
- Pages
- e0319507
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC11913261
- OpenAlex
- W4408520572
- Cited by
- 5
- References
- 21
- Citations by year
- 2026: 2 · 2025: 3
- FWCI
- 3.93
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Regulation
- Social Sciences › Law › Occupational and Professional Licensing Regulation
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Quality and Management
- Keywords
- health practitioner regulation, professional regulation, performance measurement, performance evaluation (human resources), regulatory regimes, public protection, health workforce sustainability, health system resilience
- MeSH terms
- Scoping Reviews as Topic, Scoping Review as Topic, Delivery of Health Care, Health Personnel, Humans
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.