Clinical Scores in Veterinary Medicine: What Are the Pitfalls of Score Construction, Reliability, and Validation? A General Methodological Approach Applied in Cattle
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
Clinical scores are commonly used for cattle. They generally contain a mix of categorical and numerical variables that need to be assessed by scorers, such as farmers, animal caretakers, scientists, and veterinarians. This article examines the key concepts that need to be accounted for when developing the test for optimal outcomes. First, the target condition or construct that the scale is supposed to measure should be defined, and if possible, an adequate proxy used for classification should be determined. Then, items (e.g., clinical signs) of interest that are either caused by the target condition (reflective items) or that caused the target condition (formative items) are listed, and reliable items (inter and intra-rater reliability) are kept for the next step. A model is then developed to determine the relative weight of the items associated with the target condition. A scale is then built after validating the model and determining the optimal threshold in terms of sensitivity (ability to detect the target condition) and specificity (ability to detect the absence of the target condition). Its robustness to various scenarios of the target condition prevalence and the impact of the relative cost of false negatives to false positives can also be assessed to tailor the scale used based on specific application conditions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
![Figure 1 Treemap of the relative weights of different clinical signs included in various scoring systems used to detect bovine respiratory disease complex in calves. The size of the square is proportional to the specific clinical sign weight in the Wisconsin calf respiratory score (A) [7], California score (B) [8], Québec modified California score (C) [9], and Québec veal calf respiratory score (D) [10]. The map clearly shows the variable signs included and the relative impact on the total score of the same clinical sign.](https://figures.cochat.ai/paper-figures/95fb038eec00443f81f6cfacf02f6bb0/clinical-scores-in-veterinary-medicine-what-are-the-pitfalls-of-score-figure-1.jpg)


![Figure 4 Determination of the optimal threshold based on a specific score. This figure represents the California respiratory score threshold for detecting ultrasonographic lung consolidation (target condition defined as a maximal consolidation depth ≥ 1 cm) in 608 pre-weaned calves from 39 different dairy herds [9]. The accuracy of the score is presented in the y-axis with the sum of sensitivity (Se) and specificity (Sp) of the score depending on the threshold (≥ threshold to define a positive score, < for a negative score). The dots represent the observed value of the score, and the 95% confidence interval band was obtained after 1000 bootstrap estimates. Even though the threshold of ≥ 4 is numerically associated with the highest accuracy (dashed blue line), there is no evidence that this threshold is better than any threshold between 2 and 7 (dotted red lines) due to the confidence interval width.](https://figures.cochat.ai/paper-figures/b26bd54f2e754e359618c4dedb304706/clinical-scores-in-veterinary-medicine-what-are-the-pitfalls-of-score-figure-4.jpg)

Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Current diagnostic practices are largely dependent on observing clinical signs by skilled personnel [20,21].”
From Strategies for Bovine Respiratory Disease (BRD) Diagnosis and Prognosis: A Comprehensive Overview (2024) · cites this paper as [21]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This complicates the establishment of an accurate standard reference diagnostic test that could prevent misclassification of the disease [21].”
From Strategies for Bovine Respiratory Disease (BRD) Diagnosis and Prognosis: A Comprehensive Overview (2024) · cites this paper as [21]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398 · cited 2×
“Cohen’s kappa [24] is by far the most commonly reported agreement parameter in veterinary medicine and many other medical fields.”
BackgroundMethodA guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709 · cited 3×
“This family of reliability parameters is also called intra-class correlation (ICC) measures [33].”
BackgroundMethodInfluentialBoateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018) · Frontiers in Public Health · doi:10.3389/fpubh.2018.00149 · Cited by 5,925
Clinical Prediction Models: A Practical Approach to Development, Validation, and Updating
Steyerberg, E. W. (2019) · Statistics for Biology and Health · doi:10.1007/978-3-030-16399-0 · Cited by 3,281
Measurement in Medicine: A Practical Guide
de Vet, H. C. W., Terwee, C. B., Mokkink, L. B., & Knol, D. L. (2011) · doi:10.1017/cbo9780511996214 · Cited by 2,321
The Statistical Evaluation of Medical Tests for Classification and Prediction
Pepe, M. S. (2003) · doi:10.1093/oso/9780198509844.001.0001 · Cited by 2,198
Roche, J. R., Friggens, N. C., Kay, J. K., Fisher, M. W., Stafford, K. J., & Berry, D. P. (2009) · Journal of Dairy Science · doi:10.3168/jds.2009-2431 · Cited by 1,254 · cited 1×
“Other scoring systems exist, for example, to determine calf diarrhea [7], lameness [11], body condition [12], and pain [13].”
BackgroundGuidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed
Kottner, J., Audige, L., Brorson, S., Donner, A., Gajewski, B. J., Hróbjartsson, A., Roberts, C., Shoukri, M., & Streiner, D. L. (2011) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2011.01.016 · Cited by 997
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · British Journal of Surgery · doi:10.1002/bjs.9736 · Cited by 889
Disease Management of Dairy Calves and Heifers
McGuirk, S. M. (2008) · Veterinary Clinics of North America: Food Animal Practice · doi:10.1016/j.cvfa.2007.10.003 · Cited by 629 · cited 2×
“The size of the square is proportional to the specific clinical sign weight in the Wisconsin calf respiratory score (A) [7], California score (B) [8], Québec modified California score (C) [9], and Québec veal calf respiratory score (D) [10].”
BackgroundMethod
Research works printed but not linked: 1
- Harrell, F.E. (2019). Regression Modeling Strategies: With Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis, Springer. [2nd ed.].
Cited by
Strategies for Bovine Respiratory Disease (BRD) Diagnosis and Prognosis: A Comprehensive Overview
Kamel, M. S., Davidson, J. L., & Verma, M. S. (2024) · Animals · doi:10.3390/ani14040627 · Cited by 76
“This complicates the establishment of an accurate standard reference diagnostic test that could prevent misclassification of the disease [21].”
BackgroundO’Donoghue, S., Waters, S. M., Morris, D. W., & Earley, B. (2025) · Veterinary Sciences · doi:10.3390/vetsci12080778 · Cited by 58
“Clinical scoring is used in the monitoring and diagnostic of a range of animal health applications across a range of different cohorts [126].”
Clinical Scoring Systems in the Newborn Calf: An Overview
Probo, M., & Veronesi, M. C. (2022) · Animals · doi:10.3390/ani12213013 · Cited by 42
“A valuable tool in this purpose is represented by scoring systems, which enable the scorers (farmers, technicians, and veterinarians) to adopt a systematic approach in this regard [9].”
BackgroundA Novel Scoring System for Humane Endpoints in Mice with Cecal Ligation and Puncture-Induced Sepsis
Ferguson, L. T., RASHIED, A. A., Liang, Z., Yumoto, T., Anyalebechi, J. C., Swift, D. A., Hernandes, M. S., Krafty, R. T., Coopersmith, C. M., & Lee, V. K. (2023) · Comparative Medicine · doi:10.30802/aalas-cm-22-000124 · Cited by 14
Buczinski, S., Ollivett, T. L., & Pardon, B. (2025) · Journal of Dairy Science · doi:10.3168/jds.2025-26764 · Cited by 9
Self-citation
Metadata
- Authors
- Buczinski, S., Boccardo, A., & Pravettoni, D.
- Affiliations
- Université de Montréal (CA)
- University of Milan (IT)
- Corresponding author
- Buczinski, Sébastien
- Venue
- Animals
- Publisher
- MDPI AG
- Published
- 2021-11-13
- Volume
- 11
- Issue
- 11
- Pages
- 3244
- ISSN
- 2076-2615 (ISSN-L)
- PMC
- PMC8614512
- OpenAlex
- W3212240198
- Cited by
- 15
- References
- 38
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 2 · 2023: 4 · 2022: 1
- FWCI
- 0.35
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Animals (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Archivio Istituzionale della Ricerca (Universita Degli Studi Di Milano) (submittedVersion, other-oa)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Life Sciences › Agricultural and Biological Sciences › Animal Science and Zoology › Animal health and immunology
- Life Sciences › Agricultural and Biological Sciences › Animal Science and Zoology › Animal Behavior and Welfare Studies
- Keywords
- clinical scoring systems, cattle, scale development, reliability statistics, validation, inter-rater reliability, intra-rater reliability, item weighting, sensitivity and specificity, threshold optimization, prevalence
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Clinical Scores in Veterinary Medicine: What Are the Pitfalls of Score Construction, Reliability, and Validation? A General Methodological Approach Applied in Cattle. https://app.cochat.ai/papers/10.3390/ani11113244
- The paper
- Buczinski, S., Boccardo, A., & Pravettoni, D. (2021). Clinical Scores in Veterinary Medicine: What Are the Pitfalls of Score Construction, Reliability, and Validation? A General Methodological Approach Applied in Cattle. Animals. https://doi.org/10.3390/ani11113244
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.