The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Performance measurement and evaluation of health practitioner regulation: A scoping review protocol
Open accessAbstract
Health practitioner regulation plays a fundamental role in public protection by overseeing and governing healthcare professionals to ensure they deliver safe health services. It also serves as a strategic lever to strengthen broader health system goals such as improving the accessibility of services, the sustainability of health workforces, and health system resilience. Although the goals of health practitioner regulation are easily articulated, achieving and evaluating these goals are far more challenging. Performance measurement and evaluation of professional regulators and regulatory systems are critical to improving regulatory processes and functions. This is especially important where there is rising government, public, and professional skepticism and mistrust of the effectiveness and efficiency of regulators across global jurisdictions. Although there is evidence that some health practitioner regulators and regulatory systems engage in performance measurement and evaluation, the similarities and differences remain unclear. The objective of this scoping review is to explore the nature, extent, and range of scholarship related to health practitioner regulatory performance measurement and evaluation. It will explore existing performance measurement and evaluation frameworks; the key principles and areas of focus of these frameworks; and the indicators, metrics and outcomes used to evaluate performance. The review will be conducted in accordance with the JBI guidelines for scoping reviews and will be reported following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews. Database searches will include Ovid MEDLINE, Ovid EMBASE, CINAHL, Scopus, and Web of Science Core Collection. Gray literature will be identified through leading regulatory organizations, consortiums, and think tanks. Two independent reviewers will screen titles and abstracts followed by full-text and disagreements will be resolved by a third reviewer. Data will be analyzed using descriptive statistics and conventional content analysis. Results will be presented using evidence tables and a narrative summary. Open Science Framework Registration: https://doi.org/10.17605/OSF.IO/WABTF
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Three Approaches to Qualitative Content Analysis
Hsieh, H.-F., & Shannon, S. E. (2005) · Qualitative Health Research · doi:10.1177/1049732305276687 · Cited by 44,601 · cited 1×
“We will use conventional content analysis [37] to analyze the extracted data as it will allow for the development of broader categories based on coded data.”
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
PRISMA-P Group, Moher, D., Shamseer, L., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., & Stewart, L. A. (2015) · Systematic Reviews · doi:10.1186/2046-4053-4-1 · Cited by 26,223 · cited 1×
“We developed this protocol using the reporting guidelines in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Protocols (PRISMA-P) [32,33] as they apply to scoping reviews [33] (see S1 Appendix: PRISMA-P Checklist).”
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120
Peters, M. D., Godfrey, C., McInerney, P., Munn, Z., Tricco, A. C., & Khalil, H. (2024) · JBI Manual for Evidence Synthesis · doi:10.46658/jbimes-24-09 · Cited by 1,044
Design, delivery and effectiveness of health practitioner regulation systems: an integrative review
Leslie, K., Bourgeault, I. L., Carlton, A.-L., Balasubramanian, M., Mirshahi, R., Short, S. D., Carè, J., Cometto, G., & Lin, V. (2023) · Human Resources for Health · doi:10.1186/s12960-023-00848-y · Cited by 38
Self-citationAdams, T. L. (2020) · Human Resources for Health · doi:10.1186/s12960-020-00501-y · Cited by 34
Self-citationRecent research into healthcare professions regulation: a rapid evidence assessment
Browne, J., Bullock, A., Poletti, C., & Cserző, D. (2021) · BMC Health Services Research · doi:10.1186/s12913-021-06946-8 · Cited by 29 · cited 1×
“Studies emphasize the importance of regulatory bodies and systems being proactive rather than reactive, suggesting that regulatory approaches must evolve with healthcare innovations and societal shifts to remain relevant and effective in their protective role [8].”
van der Gaag, A., Jago, R., Gallagher, A., Stathis, K., Webster, M., & Austin, Z. (2023) · Journal of Nursing Regulation · doi:10.1016/s2155-8256(23)00087-x · Cited by 23
Occupational Regulation, Institutions, and Migrants’ Labor Market Outcomes
Koumenta, M., Pagliero, M., & Rostam‐Afschar, D. (2022) · Labour Economics · doi:10.1016/j.labeco.2022.102250 · Cited by 22 · cited 1×
“Professional regulation, in a broad sense, refers to legally defined rules governing entry into specific occupations and the conduct within them [1].”
Research works printed but not linked: 15
- World Health Organization, 2024, Health practitioner regulation: design, reform and implementation guidance
- R Thomas, 2024, Lucy Letby arrest exposed nursing regulator loophole, secret review shows, The Independent [Internet]
- Government of Ontario, 2023, Public inquiry into the safety and security of residents in the long-term care homes system
- S Lintern, 2021, New victims of rogue surgeon prompt private hospital to create £22m fund, The Independent [Internet]
- Professional Standards Authority, Who are we?
- Australian Health Practitioner Regulation Agency (AHPRA), 2024, Regulating Australia’s health practitioners
- Australian Government Department of Health, 2024, Consultation paper 1: Review of complexity in the national registration and accreditation scheme
- Z Austin, 2023, Regulation of wicked problems: opportunities, responsibilities, and threats, Journal of Medical Regulation, 109, 6, 10.30770/2572-1852-109.3.6 · DOI
- Professional Standards Authority, Read our performance reviews of regulators
- New Zealand Treasury, 2024, Regulatory management system: overview
- Australian Government Department of Health, 2024, Independent review of complexity in the National Registration and Accreditation Scheme: Terms of reference
- Government of Ontario, 2024, College performance measurement framework (CPMF)
- International Labour Organization., 2024, Classification of occupation: Concepts and definitions
- Zotero, 2022, Version 7.0.7
- RK Ao, 2023, Independent review of health practitioner regulatory settings: Final report
Cited by
Nursing regulation in Canada: Insights from a scoping review
Chiu, P., Thiessen, N. J., Idrees, S., Leslie, K., & Kung, J. Y. (2025) · PLOS ONE · doi:10.1371/journal.pone.0323716 · Cited by 12
“Given the growing emphasis on performance measurement and accountability [5,12,46,113,115,117,198,205,224] we argue that future research should go beyond comparing or describing structures and processes and prioritize evaluating the impact of regulation to inform improvements.”
Self-citationDeveloping a pan-Canadian nursing regulation research agenda
Chiu, P., Leslie, K., Myles, S., Ben-Ahmed, H. E., & Jang, G. (2025) · Journal of Nursing Regulation · doi:10.1016/j.jnr.2025.09.001 · Cited by 3
Self-citationChiu, P., Thiessen, N. J., Alostaz, N., Li, R., Hermosisima, A., Nelson, S., Bourgeault, I. L., Salami, B. O., Iduye, D., Ben-Ahmed, H. E., et al. (2026) · Health Policy · doi:10.1016/j.healthpol.2026.105708 · Cited by 2
Self-citationChipofya, E. (2025) · African Journal of Laboratory Medicine · doi:10.4102/ajlm.v14i1.2941
Chiu, P., Thiessen, N. J., Adams, T. L., Wenghofer, E. F., Myles, S., Leslie, K., & Bourgeault, I. L. (2026) · Journal of Nursing Regulation · doi:10.1016/j.jnr.2026.02.004
Self-citation
Metadata
- Authors
- Chiu, P., Leslie, K., Jang, G., Adams, T. L., Thiessen, N., & Kung, J. Y.
- Affiliations
- University of Alberta (CA)
- Athabasca University (CA)
- Western University (CA)
- Corresponding author
- Chiu, Patrick
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2025-03-17
- Volume
- 20
- Issue
- 3
- Pages
- e0319507
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC11913261
- OpenAlex
- W4408520572
- Cited by
- 5
- References
- 21
- Citations by year
- 2026: 2 · 2025: 3
- FWCI
- 3.93
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Regulation
- Social Sciences › Law › Occupational and Professional Licensing Regulation
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Healthcare Quality and Management
- Keywords
- health practitioner regulation, professional regulation, performance measurement, performance evaluation (human resources), regulatory regimes, public protection, health workforce sustainability, health system resilience
- MeSH terms
- Scoping Reviews as Topic, Scoping Review as Topic, Delivery of Health Care, Health Personnel, Humans
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Performance measurement and evaluation of health practitioner regulation: A scoping review protocol. https://app.cochat.ai/papers/10.1371/journal.pone.0319507
- The paper
- Chiu, P., Leslie, K., Jang, G., Adams, T. L., Thiessen, N., & Kung, J. Y. (2025). Performance measurement and evaluation of health practitioner regulation: A scoping review protocol. PLOS ONE. https://doi.org/10.1371/journal.pone.0319507
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.