The DOI matches its Crossref record.
Evaluation of the confusion matrix method in the validation of an automated system for measuring feeding behaviour of cattle
Open accessAbstract
The aim of the present study was to evaluate empirically confusion matrices in device validation. We compared the confusion matrix method to linear regression and error indices in the validation of a device measuring feeding behaviour of dairy cattle. In addition, we studied how to extract additional information on classification errors with confusion probabilities. The data consisted of 12 h behaviour measurements from five dairy cows; feeding and other behaviour were detected simultaneously with a device and from video recordings. The resulting 216 000 pairs of classifications were used to construct confusion matrices and calculate performance measures. In addition, hourly durations of each behaviour were calculated and the accuracy of measurements was evaluated with linear regression and error indices. All three validation methods agreed when the behaviour was detected very accurately or inaccurately. Otherwise, in the intermediate cases, the confusion matrix method and error indices produced relatively concordant results, but the linear regression method often disagreed with them. Our study supports the use of confusion matrix analysis in validation since it is robust to any data distribution and type of relationship, it makes a stringent evaluation of validity, and it offers extra information on the type and sources of errors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Ibrahim, D. M., Elshennawy, N. M., & Sarhan, A. M. (2021) · Computers in Biology and Medicine · doi:10.1016/j.compbiomed.2021.104348 · Cited by 401
Using X-ray images and deep learning for automated detection of coronavirus disease
El Asnaoui, K., & Chawki, Y. (2021) · Journal of Biomolecular Structure and Dynamics · doi:10.1080/07391102.2020.1767212 · Cited by 360
A Hybrid Deep Learning-Based Approach for Brain Tumor Classification
Raza, A., Ayub, H., Khan, J. A., Ahmad, I., S. Salama, A., Daradkeh, Y. I., Javeed, D., Ur Rehman, A., & Hamam, H. (2022) · Electronics · doi:10.3390/electronics11071146 · Cited by 354
Deep Learning for Monitoring of Human Gait: A Review
Alharthi, A. S., Yunas, S. U., & Ozanyan, K. B. (2019) · IEEE Sensors Journal · doi:10.1109/jsen.2019.2928777 · Cited by 175
A Novel Compensatory Motion Detection Method Using Multiple Signals and Machine Learning
Xu, P., Xia, D., Zheng, B., Huang, L., & Xie, L. (2022) · IEEE Sensors Journal · doi:10.1109/jsen.2022.3190503 · Cited by 12
Metadata
- Authors
- Ruuska, S., Hämäläinen, W., Kajava, S., Mughal, M., Matilainen, P., & Mononen, J.
- Venue
- Behavioural Processes
- Publisher
- Elsevier BV
- Published
- 2018-03
- Volume
- 148
- Pages
- 56-62
- ISSN
- 0376-6357 (ISSN-L)
- OpenAlex
- W2782620387
- Cited by
- 246
- References
- 0
- FWCI
- 16.79
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evaluation of the confusion matrix method in the validation of an automated system for measuring feeding behaviour of cattle. https://app.cochat.ai/papers/10.1016/j.beproc.2018.01.004
- The paper
- Ruuska, S., Hämäläinen, W., Kajava, S., Mughal, M., Matilainen, P., & Mononen, J. (2018). Evaluation of the confusion matrix method in the validation of an automated system for measuring feeding behaviour of cattle. Behavioural Processes. https://doi.org/10.1016/j.beproc.2018.01.004
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.