The DOI matches its Crossref record; 19 of the 19 references it cites were found in a registry or an index.
Evaluation of inter-observer agreement when using a clinical respiratory scoring system in pre-weaned dairy calves
Open accessAbstract
AIM: To determine inter-observer agreement for a clinical scoring system for the detection of bovine respiratory disease complex in calves, and the impact of classification of calves as sick or healthy based on different cut-off values. METHODS: Two third-year veterinary students (Observer 1 and 2) and one post-graduate student (Observer 3) received 4 hours of training on scoring dairy calves for signs of respiratory disease, including rectal temperature, cough, eye and nasal discharge, and ear position. Observers 1 and 2 scored 40 pre-weaning dairy calves 24 hours apart (80 observations) over three visits to a calf-rearing facility, and Observers 1, 2 and 3 scored 20 calves on one visit. Inter-observer agreement was assessed using percentage of agreement (PA) and Kappa statistics for individual clinical signs, comparing Observers 1 and 2. Agreement between the three observers for total clinical score was assessed using cut-off values of ≥4, ≥5 and ≥6 to indicate unhealthy calves. RESULTS: Inter-observer PA for rectal temperature was 0.68, for cough 0.78, for nasal discharge 0.62, for eye discharge 0.63, and for ear position 0.85. Kappa values for all clinical signs indicated slight to fair agreement (<0.4), except temperature that had moderate agreement (0.6). The Fleiss' Kappa for total score, using cut-offs of ≥4, ≥5 and ≥6 to indicate unhealthy calves, was 0.35, 0.06 and 0.13, respectively, indicating slight to fair agreement. CONCLUSIONS AND CLINICAL RELEVANCE: There was important inter-observer discrepancies in scoring clinical signs of respiratory disease, using relatively inexperienced observers. These disagreements may ultimately mean increased false negative or false positive diagnoses and incorrect treatment of cases. Visual assessment of clinical signs associated with bovine respiratory disease needs to be thoroughly validated when disease monitoring is based on the use of a clinical scoring system.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Current diagnostic practices are largely dependent on observing clinical signs by skilled personnel [20,21].”
From Strategies for Bovine Respiratory Disease (BRD) Diagnosis and Prognosis: A Comprehensive Overview (2024) · cites this paper as [20]
In the citing paper
“While various methodologies have been developed to evaluate multiple clinical indicators, they still require expert interpretation and often fail to detect all cases of BRD [20,22,23,24,25].”
From Strategies for Bovine Respiratory Disease (BRD) Diagnosis and Prognosis: A Comprehensive Overview (2024) · cites this paper as [20]
In the citing paper
“Clinical signs of BRD can vary among observers and are often transient [20].”
From Strategies for Bovine Respiratory Disease (BRD) Diagnosis and Prognosis: A Comprehensive Overview (2024) · cites this paper as [20]
Citations
Cites
The kappa statistic in reliability studies: use, interpretation, and sample size requirements
Sim, J., & Wright, C. C. (2005) · Physical Therapy · doi:10.1093/ptj/85.3.257 · Cited by 4,093 · cited 1×
“The PI helps to better understand the limitations of κ values despite apparent high PA, and the BI can be used to assess if disagreements occur in both sides, or if one observer is more commonly attributing higher scores (Sim and Wright 2005).”
BackgroundVeterinary Epidemiologic Research
Dohoo, I. R., Martin, S. W., & Stryhn, H. (2009) · Medical Entomology and Zoology · Cited by 3,034
Byrt, T., Bishop, J., & Carlin, J. B. (1993) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(93)90018-v · Cited by 2,179 · cited 1×
“One of the challenges to assess reliability is that it is influenced by the uneven distribution of abnormal scores which may cause problems for interpretation (Byrt et al. 1993; de Vet et al. 2013; Shankar and Bangdiwala 2014).”
BackgroundGuidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed
Kottner, J., Audigé, L., Brorson, S., Donner, A., Gajewski, B. J., Hróbjartsson, A., Roberts, C., Shoukri, M., & Streiner, D. L. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.03.002 · Cited by 2,174
Disease Management of Dairy Calves and Heifers
McGuirk, S. M. (2008) · Veterinary Clinics of North America: Food Animal Practice · doi:10.1016/j.cvfa.2007.10.003 · Cited by 629
Windeyer, M. C., Leslie, K. E., Godden, S. M., Hodgins, D. C., Lissemore, K. D., & LeBlanc, S. J. (2014) · Preventive Veterinary Medicine · doi:10.1016/j.prevetmed.2013.10.019 · Cited by 541
Clinicians are right not to like Cohen's
de Vet, H. C. W., Mokkink, L. B., Terwee, C. B., Hoekstra, O. S., & Knol, D. L. (2013) · BMJ · doi:10.1136/bmj.f2125 · Cited by 250
Calf Respiratory Disease and Pen Microenvironments in Naturally Ventilated Calf Barns in Winter
Lago, A., McGuirk, S. M., Bennett, T. B., Cook, N. B., & Nordlund, K. V. (2006) · Journal of Dairy Science · doi:10.3168/jds.s0022-0302(06)72445-6 · Cited by 238
Love, W. J., Lehenbauer, T. W., Kass, P. H., Van Eenennaam, A. L., & Aly, S. S. (2014) · PeerJ · doi:10.7717/peerj.238 · Cited by 228
Buczinski, S., Forté, G., Francoz, D., & Bélanger, A.-M. (2014) · Journal of Veterinary Internal Medicine · doi:10.1111/jvim.12251 · Cited by 174
Self-citation
Research works printed but not linked: 1
- *Ollivett TL, 2011, Annual Convention of the American Association of Bovine Practitioners, 2, 148
Cited by
Pathogen-specific risk factors in acute outbreaks of respiratory disease in calves
Pardon, B., Callens, J., Maris, J., Allais, L., Praet, W. V., Deprez, P. R., & Ribbens, S. (2020) · Journal of Dairy Science · doi:10.3168/jds.2019-17486 · Cited by 107
Bovine Respiratory Disease Diagnosis
Buczinski, S., & Pardon, B. (2020) · Veterinary Clinics of North America: Food Animal Practice · doi:10.1016/j.cvfa.2020.03.004 · Cited by 89
Self-citationStrategies for Bovine Respiratory Disease (BRD) Diagnosis and Prognosis: A Comprehensive Overview
Kamel, M. S., Davidson, J. L., & Verma, M. S. (2024) · Animals · doi:10.3390/ani14040627 · Cited by 76
“While various methodologies have been developed to evaluate multiple clinical indicators, they still require expert interpretation and often fail to detect all cases of BRD [20,22–25].”
BackgroundMethodWelfare of cattle during transport
(AHAW), E. P. O. A. H. A. W., Nielsen, S. S., Alvarez, J., Bicout, D. J., Calistri, P., Canali, E., Drewe, J. A., Garin‐Bastuji, B., Gonzales Rojas, J. L., Gortázar Schmidt, C., et al. (2022) · EFSA Journal · doi:10.2903/j.efsa.2022.7442 · Cited by 64
Ferraro, S., Fecteau, G., Dubuc, J., Francoz, D., Rousseau, M., Roy, J.-P., & Buczinski, S. (2021) · Journal of Dairy Science · doi:10.3168/jds.2020-19471 · Cited by 51
Self-citation
Metadata
- Authors
- Buczinski, S., Faure, C., Jolivet, S., & Abdallah, A.
- Affiliations
- Université de Montréal (CA)
- École Nationale Vétérinaire de Toulouse (FR)
- Zagazig University (EG)
- Corresponding author
- Buczinski, S
- Venue
- New Zealand Veterinary Journal
- Publisher
- Informa UK Limited
- Published
- 2016-03-02
- Volume
- 64
- Issue
- 4
- Pages
- 243-247
- ISSN
- 0048-0169 (ISSN-L)
- 1176-0710
- OpenAlex
- W2281201983
- Cited by
- 39
- References
- 19
- Citations by year
- 2026: 3 · 2025: 5 · 2024: 7 · 2023: 6 · 2022: 5 · 2021: 3 · 2020: 5 · 2019: 2 · 2018: 2 · 2016: 1
- FWCI
- 2.56
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Licence
- cc-by-nc-nd
- Locations
- New Zealand Veterinary Journal (publishedVersion)
- PubMed (publishedVersion)
- Figshare (submittedVersion, cc-by-nc-nd)
- Figshare
- Funders
- Merck Animal Health Canada (AH86-ZUPR-M-2013)
- Topics
- Life Sciences › Agricultural and Biological Sciences › Animal Science and Zoology › Animal health and immunology
- Life Sciences › Immunology and Microbiology › Microbiology › Microbial infections and disease research
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Keywords
- interobserver agreement, clinical scoring systems, bovine respiratory disease, preweaned dairy calves, clinical signs, rectal temperature, cough, rhinorrhea, ocular discharge, ear position, cut-off values, disease detection, observer training
- MeSH terms
- Animals, Body Temperature, Cattle, Cattle Diseases, Cough, Humans, Mucus, Respiratory Tract Diseases, Observer Variation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluation of inter-observer agreement when using a clinical respiratory scoring system in pre-weaned dairy calves. https://app.cochat.ai/papers/10.1080/00480169.2016.1153439
- The paper
- Buczinski, S., Faure, C., Jolivet, S., & Abdallah, A. (2016). Evaluation of inter-observer agreement when using a clinical respiratory scoring system in pre-weaned dairy calves. New Zealand Veterinary Journal. https://doi.org/10.1080/00480169.2016.1153439
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.