The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Applying the balanced scorecard to local public health performance measurement: deliberations and decisions
Open accessAbstract
BACKGROUND: All aspects of the heath care sector are being asked to account for their performance. This poses unique challenges for local public health units with their traditional focus on population health and their emphasis on disease prevention, health promotion and protection. Reliance on measures of health status provides an imprecise and partial picture of the performance of a health unit. In 2004 the provincial Institute for Clinical Evaluative Sciences based in Ontario, Canada introduced a public-health specific balanced scorecard framework. We present the conceptual deliberations and decisions undertaken by a health unit while adopting the framework. DISCUSSION: Posing, pondering and answering key questions assisted in applying the framework and developing indicators. Questions such as: Who should be involved in developing performance indicators? What level of performance should be measured? Who is the primary intended audience? Where and how do we begin? What types of indicators should populate the health status and determinants quadrant? What types of indicators should populate the resources and services quadrant? What type of indicators should populate the community engagement quadrant? What types of indicators should populate the integration and responsiveness quadrants? Should we try to link the quadrants? What comparators do we use? How do we move from a baseline report card to a continuous quality improvement management tool? SUMMARY: An inclusive, participatory process was chosen for defining and creating indicators to populate the four quadrants. Examples of indicators that populate the four quadrants of the scorecard are presented and key decisions are highlighted that facilitated the process.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Only five papers include explicitly also BSC review [41,47,74,75,80,94].”
From The Evolution of Balanced Scorecard in Healthcare: A Systematic Review of Its Design, Implementation, Use, and Review (2022) · cites this paper as [80]
The cited source says what the claim attributes to it.
In the citing paper
“Regarding the last phase of BSC adoption, i.e., BSC review, only a few papers explicitly mentioned it [41,47,74,75,80,94].”
From The Evolution of Balanced Scorecard in Healthcare: A Systematic Review of Its Design, Implementation, Use, and Review (2022) · cites this paper as [80]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1994) · Journal of the American Dietetic Association · doi:10.1016/0002-8223(94)92216-0 · Cited by 45,910
Using the balanced scorecard as a strategic management system
Kaplan, R. S., & Norton, D. P. (1996) · Harvard business review · Cited by 5,015
Cheng, S. M., & Thompson, L. J. (2006) · Journal of Health Organization and Management · doi:10.1108/14777260610680131 · Cited by 24
Robinson, V., Hunter, D., & Shortt, S. E. D. (2003) · Canadian Journal of Public Health · doi:10.1007/bf03403569 · Cited by 22
Self-citationEvaluating the Balanced Scorecard at the University Health Network: An Impact Assessment
Young, J. C., Bell, R., Khalfan, A., & Lindquist, E. A. (2008) · Healthcare Quarterly · doi:10.12927/hcq.2008.19616 · Cited by 9 · cited 2×
“These finding are quite similar to the results reported by the Toronto-based University Health Network in the early phases of implementing their BSC [7].”
MethodResultThe Social Determinants of Health: an imperative for Canadian public health.
Paradis, G. (2008) · PubMed · doi:10.17269/cjph.99.1601 · Cited by 3 · cited 1×
“Multiple factors determine public health outcomes [1], such as socio-economic factors, lifestyle, gender and genetics, yet only a few Published: 8 May 2009”
BackgroundThe Social Determinants of Health: An Imperative for Canadian Public Health
Paradis, G. (2008) · Canadian Journal of Public Health · doi:10.1007/bf03405449 · Cited by 3
Research works printed but not linked: 5
- Ontario Program Standards Technical Review Committee (April 2008) Ontario public health standards, Ontario Ministry of Health and Long-term Care. [ http://www.health.gov.on.ca/english/providers/program/pubhealth/oph_standards/ophs_mn.html ]
- York Region Health Services Department: York Region health status report 2002: a measure of health. 2002, Newmarket, Ontario. The Regional Municipality of York, [ http://www.york.ca/Publications/News/2003/February+20,+2003+York+Region+releases+Health+Status+Report.htm ]
- Hospital Report Research Collaborative: Hospital Report 2007: Acute Care, A joint initiative of the Ontario Hospital Association and the Government of Ontario. 2007, [ http://www.hospitalreport.ca/ ]
- Woodward G, Manuel D, Goel V: Developing a balanced scorecard for public health. 2004, Toronto: Institute for Clinical Evaluative Sciences, [ http://www.ices.on.ca/file/Scorecard_report_final.pdf ]
- Ontario. Capacity Review Committee: Revitalizing Ontario's public health capacity: The final report of the Capacity review Committee. 2006, (Toronto), Ontario Ministry of Health and Long-Term Care, [ http://www.health.gov.on.ca/english/public/pub/ministry_reports/capacity_review06/capacity_review06.html ]
Cited by
EVALUATING COMMUNITY ENGAGEMENT IN RESEARCH: QUANTITATIVE MEASURE DEVELOPMENT
Goodman, M. S., Thompson, V. L. S., Arroyo, C., Gennarelli, R. L., Drake, B. F., Bajwa, P., Witherspoon, M., & Bowen, D. J. (2016) · Journal of Community Psychology · doi:10.1002/jcop.21828 · Cited by 127
Edward, A., Kumar, B., Kakar, F., Salehi, A. S., Burnham, G., & Peters, D. H. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1001066 · Cited by 119
“The national quality assurance committee in Afghanistan, has been instrumental, in prioritizing performance deficiencies identified from routinely obtained health management information and supervision systems, as well as the NHSPA, in order to identify and address management constraints [30].”
BackgroundHyshka, E., Anderson-Baron, J. T., Karekezi, K., Belle‐Isle, L., Elliott, R., Pauly, B., Strıke, C., Asbridge, M., Dell, C. A., McBride, K., et al. (2017) · Harm Reduction Journal · doi:10.1186/s12954-017-0177-7 · Cited by 98
Measuring environmental performance in hospitals: A practical approach
Blass, A. P., da Costa, S. E. G., de Lima, E. P., & Borges, L. A. (2016) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2016.07.213 · Cited by 95
Tashobya, C. K., da Silveira, V., Ssengooba, F., Nabyonga‐Orem, J., Macq, J., & Criel, B. (2014) · Globalization and Health · doi:10.1186/1744-8603-10-5 · Cited by 73
Metadata
- Authors
- Weir, E., d'Entremont, N., Stalker, S., Kurji, K., & Robinson, V.
- Affiliations
- York Region Public Health (CA)
- University of Toronto (CA)
- Corresponding author
- Weir, Erica
- Venue
- BMC Public Health
- Published
- 2009-05-08
- Volume
- 9
- Issue
- 1
- Pages
- 127-127
- ISSN
- 1471-2458 (ISSN-L)
- PMC
- PMC2684743
- OpenAlex
- W1987622004
- Cited by
- 74
- References
- 7
- Citations by year
- 2025: 2 · 2024: 3 · 2023: 4 · 2022: 5 · 2021: 5 · 2020: 2 · 2019: 5 · 2018: 2 · 2017: 7 · 2016: 6 · 2015: 6 · 2014: 5 · 2013: 7 · 2012: 5
- FWCI
- 9.08
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- creativecommons.org/licenses/by/2.0 (tdm)
- Locations
- BMC Public Health (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- TSpace (University of Toronto) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Public Health Agency of Canada
- Ontario Ministry of Health and Long-Term Care
- University of Toronto
- Canadian Institutes of Health Research
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Public Health Policies and Education
- Social Sciences › Business, Management and Accounting › Accounting › Accounting and Organizational Management
- Social Sciences › Public Administration › Public Policy and Administration Research
- Keywords
- balanced scorecard, performance measurement, performance indicators, indicator development, participatory processes, community participation, quality improvement, Ontario
- MeSH terms
- Community Participation, Health Status Indicators, Humans, Management Audit, Ontario, Public Health, Public Health Administration, Quality Assurance, Health Care, Staff Development
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Applying the balanced scorecard to local public health performance measurement: deliberations and decisions. https://app.cochat.ai/papers/10.1186/1471-2458-9-127
- The paper
- Weir, E., d'Entremont, N., Stalker, S., Kurji, K., & Robinson, V. (2009). Applying the balanced scorecard to local public health performance measurement: deliberations and decisions. BMC Public Health. https://doi.org/10.1186/1471-2458-9-127
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
