The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index.
Metrics for Offline Evaluation of Prognostic Performance
Open accessAbstract
Prognostic performance evaluation has gained significant attention in the past few years.*Currently, prognostics concepts lack standard definitions and suffer from ambiguous and inconsistent interpretations. This lack of standards is in part due to the varied end-user requirements for different applications, time scales, available information, domain dynamics, etc. to name a few. The research community has used a variety of metrics largely based on convenience and their respective requirements. Very little attention has been focused on establishing a standardized approach to compare different efforts. This paper presents several new evaluation metrics tailored for prognostics that were recently introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. These metrics have the capability of incorporating probabilistic uncertainty estimates from prognostic algorithms. In addition to quantitative assessment they also offer a comprehensive visual perspective that can be used in designing the prognostic system. Several methods are suggested to customize these metrics for different applications. Guidelines are provided to help choose one method over another based on distribution characteristics. Various issues faced by prognostics and its performance evaluation are discussed followed by a formal notational framework to help standardize subsequent developments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Probability and Statistics for Engineering and the Sciences.
Devore, J. L. (1991) · Biometrics · doi:10.2307/2532427 · Cited by 2,503
Understanding robust and exploratory data analysis
Hoaglin, D. C., Mosteller, F. C., & Tukey, J. W. (1983) · Wiley eBooks · Cited by 1,906
Metrics for evaluating performance of prognostic techniques
Saxena, A., Celaya, J., Balaban, E., Goebel, K., Saha, B., Saha, S., & Schwabacher, M. (2008) · 2008 International Conference on Prognostics and Health Management · doi:10.1109/phm.2008.4711436 · Cited by 518
Self-citationA particle-filtering approach for on-line fault diagnosis and failure prognosis
Orchard, M. E., & Vachtsevanos, G. J. (2009) · Transactions of the Institute of Measurement and Control · doi:10.1177/0142331208092026 · Cited by 463
Modeling Li-ion Battery Capacity Depletion in a Particle Filtering Framework
Saha, B., & Goebel, K. (2009) · Annual Conference of the PHM Society · Cited by 330
Self-citationA Survey of Data-Driven Prognostics
Schwabacher, M. (2005) · Infotech@Aerospace · doi:10.2514/6.2005-7002 · Cited by 280
Prognostics, the real issues involved with predicting life remaining
Engel, S. J., Gilmartin, B. J., Bongort, K., & Hess, A. (2002) · 2000 IEEE Aerospace Conference. Proceedings (Cat. No.00TH8484) · doi:10.1109/aero.2000.877920 · Cited by 263
A Survey of Artificial Intelligence for Prognostics.
Schwabacher, M., & Goebel, K. (2007) · National Conference on Artificial Intelligence · Cited by 224
Self-citationA framework for understanding uncertainty and its mitigation and exploitation in complex systems
McManus, H., & Hastings, D. (2006) · IEEE Engineering Management Review · doi:10.1109/emr.2006.261384 · Cited by 219
Standardizing research methods for prognostics
Uckun, S., Goebel, K., & Lucas, P. (2008) · International Conference on Prognostics and Health Management (PHM) · doi:10.1109/phm.2008.4711437 · Cited by 134
Self-citation
Cited by
Machinery health prognostics: A systematic review from data acquisition to RUL prediction
Lei, Y., Li, N., Guo, L., Li, N., Yan, T., & Lin, J. (2018) · Mechanical Systems and Signal Processing · doi:10.1016/j.ymssp.2017.11.016 · Cited by 2,634
A Hybrid Prognostics Approach for Estimating Remaining Useful Life of Rolling Element Bearings
Wang, B., Lei, Y., Li, N., & Li, N. (2020) · IEEE Transactions on Reliability · doi:10.1109/tr.2018.2882682 · Cited by 1,917
Zio, E. (2022) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2021.108119 · Cited by 714
An Improved Exponential Model for Predicting Remaining Useful Life of Rolling Element Bearings
Li, N., Lei, Y., Lin, J., & Ding, S. X. (2015) · IEEE Transactions on Industrial Electronics · doi:10.1109/tie.2015.2455055 · Cited by 686
Li, X., Zhang, W., & Ding, Q. (2019) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2018.11.011 · Cited by 582
Metadata
- Authors
- Saxena, A., Celaya, J., Saha, B., Saha, S., & Goebel, K.
- Venue
- International Journal of Prognostics and Health Management
- Publisher
- PHM Society
- Published
- 2021-03-22
- Volume
- 1
- Issue
- 1
- ISSN
- 2153-2648 (ISSN-L)
- OpenAlex
- W1556459174
- Cited by
- 449
- References
- 15
- FWCI
- 26.31
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Metrics for Offline Evaluation of Prognostic Performance. https://app.cochat.ai/papers/10.36001/ijphm.2010.v1i1.1336
- The paper
- Saxena, A., Celaya, J., Saha, B., Saha, S., & Goebel, K. (2021). Metrics for Offline Evaluation of Prognostic Performance. International Journal of Prognostics and Health Management. https://doi.org/10.36001/ijphm.2010.v1i1.1336
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.