Cited by 2,997Machine Fault Diagnosis TechniquesFault Detection and Control SystemsReliability and Maintenance Optimization

Applications of machine learning to machine fault diagnosis: A review and roadmap

Open access
Lei, Yaguo, Yang, Bin, Jiang, Xinwei, Jia, Feng, Li, Naipeng, Nandi, Asoke K.·2020·Mechanical Systems and Signal Processing

Abstract

This paper presents a review and roadmap to systematically cover the development of intelligent fault diagnosis following the progress of machine learning theories and offer a future perspective.

AI snapshot

Written from the paper’s full text.

TL;DR

This review traces intelligent fault diagnosis through three eras—traditional machine learning, deep learning, and transfer learning—and proposes a roadmap toward machine health management. It argues that transfer learning is the key future direction for applying diagnosis models in engineering settings where labeled fault data are scarce.

Key findings

  • The authors divide intelligent fault diagnosis into three periods: traditional machine learning before the 2010s, which relied on handcrafted features; deep learning since the 2010s, which enables end-to-end feature learning; and transfer learning as the future direction for cross-task and cross-domain diagnosis.
  • Publication counts from Web of Science show rapid growth since the 2010s, with output from 2017 to 2019 nearly matching the total from before 2017.
  • Among the transfer-learning studies reviewed, most address transfer within the same machine (TIM), while only four publications target transfer across different machines (TDM).
  • The roadmap highlights future challenges including data quality and cleaning, imbalanced health states, streaming data analytics, negative transfer and source-domain selection, and interpretability of deep diagnosis models.

Methods

  • Narrative literature review and roadmap, not an experimental study. It organizes intelligent fault diagnosis by three periods and by method families: expert systems, ANN, SVM, kNN, PGM, and decision trees; stacked AE, DBN, CNN, and ResNet; and transfer-learning categories.
  • Uses Web of Science search results to count publications and motivate the periodization, then reviews representative applications across bearings, gears, motors, engines, and other machines.
  • For transfer learning, it defines domains and tasks, distinguishes TIM from TDM scenarios, and categorizes approaches as feature-based, GAN-based, instance-based, and parameter-based.

Limitations

  • The paper states no limitations of its own review; the following are evident from the text.
  • Evident: no formal systematic-review protocol, search strings, inclusion/exclusion criteria, or quality appraisal are reported, and the publication-counting procedure is described only briefly.
  • Evident: the roadmap and future directions are conceptual and perspective-based rather than empirically tested in the paper.
  • Evident: coverage is selective and organized around the authors’ three-period framework, so it may not exhaustively capture all intelligent fault diagnosis literature.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1016/j.ymssp.2019.106587

Cites

460 of 460 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

3 of 65 cited sources checked · 3 supported · 0 flagged

  • Premisereasoning

    Signal processing methods are employed to preprocess 1D data to convert to time-frequency domain so CNN can handle 2D time-frequency spectrum.

    “First, the signal processing methods, such as the wavelet packet [369][370][371], the continue wavelet transform [372,373], the dual-tree complex wavelet transform [374,375], and the synchrosqueezing transform [376], are employed to preprocess the input 1D data, which are expected to convert the signals from the time domain to the time-frequency domain.”
    Quote in the paperNot a substantial claim3 of 5 sources checked
    • cites [369][370][371]

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [372] 372. S. Guo, T. Yang, W. Gao, C. Zhang, A novel fault diagnosis method for rotating machinery based on a convolutional neural network, Sensors 18 (2018) 1429. source
    • cites [373] 373. S. Guo, T. Yang, W. Gao, C. Zhang, Y. Zhang, An intelligent fault diagnosis method for bearings with variable rotating speed based on pythagorean spatial pyramid pooling CNN, Sensors 18 (2018) 3857. source
    • cites [374] 374. W. Sun, B. Yao, N. Zeng, B. Chen, Y. He, X. Cao, W. He, An intelligent gear fault diagnosis methodology using a complex wavelet enhanced convolutional neural network, Materials 10 (2017) 790. source
    • cites [375] 375. X. Cao, B. Chen, B. Yao, W. He, Combining translation-invariant wavelet frames and convolutional neural network for intelligent tool wear state identification, Comput. Ind. 106 (2019) 71-84. source
  • Findingown data

    The number of publications from 2017 to 2019 almost approaches the total number of publications before 2017.

    “As shown in Fig. 1, the number of publications from 2017 to 2019 almost approaches to the total of that before 2017.”
    Quote in the paperSubstantial claim
  • Findingown data

    The majority of transfer learning studies focus on TIM scenarios.

    “Furthermore, majority of studies focus on TIM scenarios, and only four 8 publications aim at TDM scenarios.”
    Quote in the paperNot a substantial claim
  • Findingown data

    Among transfer learning approaches, feature-based approaches account for the largest proportion of studies.

    “Among them, the studies about feature-based approaches account for the 7 largest proportion.”
    Quote in the paperNot a substantial claim
  • Findingnone given

    Only four publications aim at TDM scenarios.

    “Furthermore, majority of studies focus on TIM scenarios, and only four 8 publications aim at TDM scenarios.”
    Quote in the paperNot a substantial claim
  • The quote only partly states this claim. 1
  • May combine two claims. 47
  • Classified as probably not a substantial claim. 52
  • The quote only partly states this claim.

    Findingown data

    The number of publications about intelligent fault diagnosis has rapidly increased since the 2010s.

    “According to the results on the topic of machine fault diagnosis by using machine learning, the number of publications has rapidly increased since the 2010s.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingcitation

    Tong et al. employed JDA for bearings in motor and belt conveyor idler and achieved better diagnosis accuracy than TCA-based models.

    “With regard to fault diagnosis, Tong et al. [420,421] employed JDA to complete the diagnosis tasks of bearings respectively used in the motor and the belt conveyor idler, and achieve better diagnosis accuracy than TCA-based diagnosis models.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [420] 420. Z. Tong, W. Li, B. Zhang, F. Jiang, G. Zhou, Bearing fault diagnosis under variable working conditions based on domain adaptation using feature transfer learning, IEEE Access 6 (2018) 76187-76197. source
    • cites [421] 421. Z. Tong, W. Li, B. Zhang, M. Zhang, Bearing fault diagnosis based on domain adaptation using transferable features under different working conditions, Shock Vibrat. (2018) Doi: 10.1155/2018/6714520. source
  • May combine two claims.

    Findingcitation

    Shen et al. used cross-domain features to train kNN-based diagnosis models by TrAdaboost, which correctly recognized unlabeled target samples despite few labeled target samples.

    “The results showed that the trained diagnosis model could correctly recognize the unlabeled samples in the target domain although there were a small number of labeled samples in the target domain.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [36] 36. F. Shen, C. Chen, R. Yan, R.X. Gao, Bearing fault diagnosis based on svd feature extraction and transfer learning classification, in: Prognostics and System Health Management Conference, Beijing, China, 2015, pp. 1-6. source
  • May combine two claims.

    Findingcitation

    Compared with a diagnosis model just trained with a small number of target-domain samples, the fine-tuned diagnosis model presented a faster convergence rate and higher diagnosis accuracy.

    “Compared with the diagnosis model just trained with a small number of target-domain samples, the fine-tuned diagnosis model presented the faster convergence rate and higher diagnosis accuracy.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [438] 438. R. Zhang, H. Tao, L. Wu, Y. Guan, Transfer learning with neural networks for bearing fault diagnosis in changing working conditions, IEEE Access 5 (2017) 14347-14357. source
    • cites [37] 37. M.J. Hasan, J.M. Kim, Bearing fault diagnosis under variable rotational speeds using stockwell transform- based vibration imaging and transfer learning, Appl. Sci.-Basel 8 (2018) 2357. source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    Deep learning theories have reformed intelligent fault diagnosis in further releasing artificial assistance since the 2010s, encouraging the construction of an end-to-end diagnosis process.

    “Over the recent years, the advent of deep learning theories has reformed IFD in further releasing the artificial assistance since the 2010s, which encourages to construct an end-to-end diagnosis process.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    It needs a new review to summarize the current research progress of intelligent fault diagnosis.

    “Therefore, it needs a new review to summary the current research progress of IFD.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Interpretationreasoning

    Traditional machine learning weakened the contribution of human labor in machine fault diagnosis and pushed it into the era of artificial intelligence.

    “With the help of traditional machine learning, the diagnosis models began to establish the relationship between the selected features and the health states of machines, which weakened the contribution of human labor in machine fault diagnosis and pushed it into the era of artificial intelligence.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Transfer learning theories will promote the research of intelligent fault diagnosis in engineering scenarios in the future.

    “In the future, transfer learning theories will promote the research of IFD in engineering scenarios.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    Modified SVM and algorithm optimization are the two main branches to improve the diagnosis accuracy of SVM-based models.

    “In order to improve the diagnosis accuracy of SVM-based models, researchers mainly focused on two branches, i.e., the modified SVM and the algorithm optimization.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    SVM algorithm is originally used to solve binary classification tasks.

    “Third, the SVM algorithm is originally used to solve binary classification tasks.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    PGM-based diagnosis models easily achieve fault diagnosis with multiple health states and can analyze among-class discrepancy conveniently.

    “It is easy for PGM-based diagnosis models to achieve fault diagnosis with multiple health states of machines.They can be used to analyze the among-class discrepancy in convenience.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    If probabilistic relationship among variables is not clear, it is difficult to construct PGM-based diagnosis models.

    “Furthermore, if the probabilistic relationship among the variables is not clear, it would be difficult to construct the diagnosis models.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    Transfer-learning theories are expected to overcome the problems of lacking labeled samples and finally enlarge the applications of intelligent fault diagnosis in engineering scenarios.

    “Therefore, transfer-learning theories are expected to overcome the problems of lacking labeled samples and finally enlarge the applications of IFD in engineering scenarios.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    kNN-based diagnosis models are easily implemented.

    “The kNN-based diagnosis models are easily-implemented.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    Expert systems lack self-learning capability, so their diagnosis knowledge base is difficult to expand and correct.

    “Furthermore, the expert system lacks the self-learning capability so that the diagnosis knowledge base is difficult to be expanded and corrected.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    SVM performance is sensitive to kernel parameters; inappropriate kernel parameter cannot induce reliable diagnosis result.

    “Second, the performance of SVM-based diagnosis models is sensitive to the kernel parameters.The inappropriate kernel parameter even cannot induce the reliable diagnosis result.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    C4.5 algorithm is widely used to induce decision tree for classification and obtain satisfactory accuracy and easily-understood classification rules.

    “Among the proposed methods, the algorithm of C4.5 is widely used to induce a decision tree for classification and obtain satisfactory accuracy and easily-understood classification rules [300].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [300] 300. J.R. Quinlan, C4.5: Programs for machine learning, Morgan Kaufmann Publishers Inc., San Francisco, 1993.
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    kNN takes much computation cost to handle large-volume datasets.

    “However, it takes much computation cost to handle the large-volume dataset.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisereasoning

    SVM optimization uses convex quadratic optimization, so models can easily obtain global optimal solution and high diagnosis accuracy.

    “The optimization objective solution of SVM refers to the convex quadratic optimization so that the diagnosis models could easily obtain the global optimal solution and further get the high diagnosis accuracy.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Expert system-based diagnosis models' performance greatly relies on expert knowledge, which is difficult to acquire and express.

    “However, the performance of the diagnosis models greatly relies on the expert knowledge, which is difficult to be acquired and expressed.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Transfer learning is concerned to overcome such weaknesses by applying the knowledge learned from one or multiple tasks to other related but novel ones.

    “Fortunately, transfer learning is concerned to overcome such weaknesses by applying the knowledge learned from one or multiple tasks to other related but novel ones [27].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [27] 27. S.J. Pan, Q. Yang, A survey on transfer learning, IEEE Trans. Knowl. Data Eng. 22 (2010) 1345-1359. source
  • May combine two claims.

    Premisecitation

    Non-naive Bayesian classifier is developed to release the independence assumption and has been used for bearings and gears.

    “The non-naive Bayesian classifier [288] is further developed to release the assumption, and it has also been used for fault diagnosis of bearings [289] and gears [290].”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [288] 288. Y. He, R. Wang, S. Kwong, X. Wang, Bayesian classifiers based on probability density estimation and their applications to simultaneous fault diagnosis, Inf. Sci. 259 (2014) 252-268. source
    • cites [289] 289. J. Yu, B. Ding, Y. He, Rolling bearing fault diagnosis based on mean multigranulation decision-theoretic rough set and non-naive Bayesian classifier, J. Mech. Sci. Technol. 32 (2018) 5201-5211. source
    • cites [290] 290. M.Y. Asr, M.M. Ettefagh, R. Hassannejad, S.N. Razavi, Diagnosis of combined faults in rotary machinery by non-naive Bayesian approach, Mech. Syst. Signal Process. 85 (2017) 56-70. source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Multi-class classification in IFD requires complicated architectures like OAA and OAO to integrate results from multiple SVM-based models.

    “In terms of multi-class classification tasks in IFD, it always needs to use complicated 2 architectures, such as OAA and OAO, to integrate results from multiple SVM-based models.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    SVM-based diagnosis models are expected to recognize multiple states but not just the binary states of health and faults.

    “For these diagnosis objects, SVM-based diagnosis models are expected to recognize multiple states but not just the binary states of health and faults.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    Naive Bayesian classifier applications are subject to an assumption of independence among features.

    “It is noted that the applications of naive Bayesian classifier are subject to an assumption of independence among features.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisereasoning

    SVM-based diagnosis models are trained by minimizing structural risk, which improves interpretability due to rigorous theories.

    “Different from the ANN, SVM-based diagnosis models are trained by minimizing the structural risk, which is beneficial to improving the interpretability of the models due to the rigorous theories.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Random forest is investigated by integrating decisions from multiple tree-based classifiers to improve generalization performance of decision tree.

    “In order to improve the generalization performance of decision tree, the random forest [306] is further investigated by integrating decisions from multiply tree-based classifiers.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [306] 306. L. Breiman, Random forests, Mach. Learn. 45 (2001) 5-32. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The one-against-all strategy (OAA) and one-against-one strategy (OAO) are mainly concerned for multi-class SVM.

    “Thus, the one-against-all strategy (OAA) and one-against-one strategy (OAO) are mainly concerned [17].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [17] 17. A. Widodo, B.S. Yang, Support vector machine in machine condition monitoring and fault diagnosis, Mech. Syst. Signal Process. 21 (2007) 2560-2574. source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Parameter k is difficult to determine, greatly affecting performance of kNN diagnosis models.

    “Furthermore, the parameter 𝑘𝑘 is difficult to be determined, which greatly affects the performance of the diagnosis models.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    kNN is a commonly-used supervised learning model for classification.

    “The kNN is a commonly-used supervised learning model to complete the classification tasks [13].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [13] 13. T.M. Cover, P.E. Hart, Nearest neighbor pattern classification, IEEE Trans. Inf. Theory 13 (1967) 21-27. source
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    kNN performance is subject to indistinguishable neighborhood boundary and difficulty in selecting optimal neighborhood parameter.

    “However, the performance of kNN is subject to some problems, such as the indistinguishable neighborhood boundary and the difficulty in selecting the optimal neighborhood parameter.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The diagnosis process of traditional intelligent fault diagnosis includes three steps: data collection, artificial feature extraction, and health state recognition.

    “The diagnosis process includes three steps [1], i.e., data collection, artificial feature extraction, and health state recognition, as shown in Fig. 2.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [1] 1. Y. Lei, Intelligent fault diagnosis and remaining useful life prediction of rotating machinery, Butterworth- Heinemann Elsevier Ltd, Oxford, 2016.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Imbalanced distribution of collected data reduces diagnosis accuracy of kNN-based models.

    “In particular, the imbalanced distribution of the collected data would reduce the diagnosis accuracy of this kind of diagnosis models.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Prosperous development of sensor technologies and data transmission, especially IoT and high-speed internet, promotes collecting large number of data with real-time information.

    “4) The prosperous development of sensor technologies and data transmission, especially with the advent of IoT and high-speed internet, promotes to collect a large number of data that contain the real-time information.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [314] 314. G.I. Platforms, The rise of industrial big data, 2012, Available: http://www.geautomation.com/download/rise-industrial-big-data.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [315] 315. S. Yin, X. Li, H. Gao, O. Kaynak, Data-based techniques focused on modern industry: An overview, IEEE Trans. Ind. Electron. 62 (2015) 657-667. source
    • cites [316] 316. J. Lee, Industrial big data: The revolutionary transformation and value creation in industry 4.0 era, Mechanical Industry Press, Beijing, China, 2015.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisenone given

    Multiple AE can be stacked to represent information contained in input data deeply, and further obtain features in deep layers.

    “Multiple AE can be stacked to represent the information contained in the input data deeply, and further obtain the features in deep layers, as shown in Fig. 11.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisereasoning

    Monitoring big data of machines holds these characteristics and extends to specialized ones: large volume, low value density, multi-source and heterogeneous data structure, monitoring data stream.

    “In contrast, monitoring big data of machines holds these characteristics, and further extends to the much-specialized ones.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Stacked AE-based diagnosis models are able to automatically represent health information from input monitoring data, which does not rely on much expert knowledge in feature extraction.

    “Stacked AE-based diagnosis models are able to automatically represent the health information from the input monitoring data, which does not rely on much expert knowledge in feature extraction.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Artificial feature extraction in traditional IFD depends on human labor and is unrealistic for large-volume monitoring data due to huge labor cost.

    “First, the step of artificial feature extraction depends on the human labor, in which the engineers need to design powerful algorithms to extract sensitive features to health states of machines.However, it is still unrealistic for engineers to extract specialized features from the large-volume monitoring data by expert experience because of the huge labor cost.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [310] 310. F. Jia, Y. Lei, J. Lin, X. Zhou, N. Lu, Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data, Mech. Syst. Signal Process. 72-73 (2016) 303-315. source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Big data includes four characteristics: volume, velocity, variety, and veracity.

    “Generally, big data includes four characteristics, i.e., volume, velocity, variety, and veracity [312].”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [312] 312. V. Mayer-Schnberger, K. Cukier, Big data: A revolution that will transform how we live, work, and think, Hodder & Stoughton Press, Carmelite House, London, 2013.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • May combine two claims.

    Premisecitation

    Only minority of collected data is valuable; healthy condition accounts for majority of long-term operation, faults seldom happen, so easier to collect healthy data than faulty.

    “First, the healthy condition accounts for the majority of the longterm operation for machines, while faults seldom happen.Consequently, it is more easily to collect healthy data than faulty data.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [314] 314. G.I. Platforms, The rise of industrial big data, 2012, Available: http://www.geautomation.com/download/rise-industrial-big-data.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [315] 315. S. Yin, X. Li, H. Gao, O. Kaynak, Data-based techniques focused on modern industry: An overview, IEEE Trans. Ind. Electron. 62 (2015) 657-667. source
    • cites [316] 316. J. Lee, Industrial big data: The revolutionary transformation and value creation in industry 4.0 era, Mechanical Industry Press, Beijing, China, 2015.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Diagnosis performance of CNN-based diagnosis models is subject to training with sufficient labeled samples.

    “Similar to other deep learning-based models, the diagnosis performance of CNN-based diagnosis models is subject to training with sufficient labeled samples.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    Decision tree-based diagnosis models are naturally interpreted, may not rely on expert explanation, and can be easily converted into diagnosis rules.

    “The decision tree-based diagnosis models are naturally interpreted, which may not relay on the explanation of experts and can be easily converted into diagnosis rules.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisereasoning

    As unsupervised learning method, stacked AE cannot be directly used to recognize health states of machines; a classification layer is usually added, and models need sufficient labeled samples.

    “As an unsupervised learning method, the stacked AE cannot be directly used to recognize the health states of machines.Therefore, a classification layer is usually added at the top of the architecture of the model, and the constructed diagnosis models need to be trained with sufficient labeled samples.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    ResNet-based diagnosis models inherit advantages of CNN-based models and possibly obtain high diagnosis accuracy, especially for complicated operation conditions such as varying-speed or varying-load.

    “Therefore, the ResNet-based diagnosis models inherit the advantages of the CNN-based diagnosis models, and possibly obtain high diagnosis accuracy, especially for the complicated operation conditions such as varying-speed or varying-load conditions.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Decision tree-based diagnosis models could achieve diagnosis tasks with missing data.

    “Furthermore, they could achieve the diagnosis tasks with missing data.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    Number of training parameters in CNN-based diagnosis models is reduced by sharing weights, which accelerates convergence and restrains overfitting.

    “Furthermore, the number of training parameters in diagnosis models is reduced by sharing weights, which could accelerate the convergence and restrain the over fitting.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisereasoning

    Output layer is generally ANN-based classifier because of high capability in multi-class classification.

    “Furthermore, the output layer is placed after the last extraction layer for health state recognition, generally with an ANN-based classifier because of the high capability in multi-class classification.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    DBN-based diagnosis models could automatically learn features from input data by pre-training a set of stacked RBMs, which solves problem of vanishing gradient in using BP algorithm to fine-tune deep-layer networks.

    “Different from the stacked AE, DBN-based diagnosis models could automatically learn features from the input data by pre-training a set of stacked RBMs, which solves the problem of vanishing gradient in using BP algorithm to fine-tune the deep-layer networks.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    It is necessary to use sufficient labeled data to train DBN-based diagnosis models to obtain convinced diagnosis results.

    “It is necessary to use sufficient labeled data to train the constructed diagnosis models so as to obtain the convinced diagnosis results.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisenone given

    Deep learning-based diagnosis models automatically learn features from input monitoring data and simultaneously recognize health states according to learned features.

    “Deep learning-based diagnosis models automatically learn features from the input monitoring data and simultaneously recognize the health states of machines according to the learned features.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Many monitoring points and multi-source sensors are used, data stored with various structures.

    “3) In order to collect sufficient health information of machines, there are many monitoring points on machines.Furthermore, multisource sensors are used to collect different kinds of data.The collected data are stored with various data structures.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [314] 314. G.I. Platforms, The rise of industrial big data, 2012, Available: http://www.geautomation.com/download/rise-industrial-big-data.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [315] 315. S. Yin, X. Li, H. Gao, O. Kaynak, Data-based techniques focused on modern industry: An overview, IEEE Trans. Ind. Electron. 62 (2015) 657-667. source
    • cites [316] 316. J. Lee, Industrial big data: The revolutionary transformation and value creation in industry 4.0 era, Mechanical Industry Press, Beijing, China, 2015.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Premisenone given

    Decision tree-based diagnosis models are easily caught by overfitting and low generalization performance, reducing diagnosis performance.

    “However, this kind of diagnosis models is easily caught by the over fitting and the low generalization performance, which would reduce the diagnosis performance of the models on the diagnosis tasks.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Advent of edge computing and GPU helps cope with monitoring data stream effectively.

    “Furthermore, the advent of state-of-art technologies, such as the edge computing and the applications of GPU, helps cope with monitoring data stream effectively.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [314] 314. G.I. Platforms, The rise of industrial big data, 2012, Available: http://www.geautomation.com/download/rise-industrial-big-data.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites [315] 315. S. Yin, X. Li, H. Gao, O. Kaynak, Data-based techniques focused on modern industry: An overview, IEEE Trans. Ind. Electron. 62 (2015) 657-667. source
    • cites [316] 316. J. Lee, Industrial big data: The revolutionary transformation and value creation in industry 4.0 era, Mechanical Industry Press, Beijing, China, 2015.

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Premisenone given

    Tree-type models are mostly constructed according to expert knowledge.

    “In addition, the tree-type models are mostly constructed according to the expert knowledge.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisenone given

    Deep learning constructs end-to-end diagnosis models to automatically learn features from collected data and recognize machine health states.

    “The deep learning theories construct end-to-end diagnosis models to automatically learn features from the collected data, and subsequently recognize the health states of machines.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    GAN-based approaches can generate fake labeled data similar to actual target-domain data, which can help train reliable diagnosis models for target domain, and are not affected by availability of labeled target samples, so expected to work for TIM and TDM.

    “GAN-based approaches are able to generate fake labeled data that are similar to the actual data in the target domain.These fake data are able to help train reliable diagnosis models for the target domain.Therefore, such approaches are not affected by the condition whether labeled samples in the target domain are available, and they are expected to work for both the TIM scenarios and the TDM”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Feature-based and GAN-based approaches are widely concerned because they can accomplish TDM scenarios with serious cross-domain discrepancy; instance-based and parameter-based approaches are easily implemented and mostly focus on TIM scenarios with slight discrepancy; transfer performance may relate to number of labeled target samples.

    “Among them, feature-based approaches and GAN-based approaches are widely concerned because they can accomplish TDM scenarios subject to serious cross-domain discrepancy.In contrast, the instance-based approaches and parameter-based approaches are easily-implemented, and mostly focus on TIM scenarios subject to slight cross-domain discrepancy.Furthermore, the transfer performance of these”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Instance-based approaches are easily implemented, but their transfer performance relates to number of target-domain samples, and they can only correct discrepancy in TIM scenarios, not serious discrepancy such as TDM, because they may lack powerful data fitting capability.

    “Instance-based approaches are easily-implemented for transfer scenarios.However, the transfer performance of them relates to the number of target-domain samples.Furthermore, they just are able to correct discrepancy in TIM scenarios, but incapable to implement transfer scenarios with serious discrepancy, such as TDM scenarios, because these approaches may lack the powerful capability of data”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Deep learning-based diagnosis models are black boxes; it is difficult to acquire how they learn diagnosis knowledge from monitoring data, so they are constructed by experimental trials rather than strict theoretical background.

    “Although there are state-of-the-art achievements of deep learning-based diagnosis models, an open issue of black box for deep hierarchical networks still confuses the academic researchers.It is difficult to acquire how these models learn the diagnosis knowledge from the monitoring data.As a result, the diagnosis models are constructed by experimental trials once and once again rather than the”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationcitation

    Deep learning-based diagnosis models are beneficial to reducing cross-domain discrepancy by extracting deep-layer features, but they are unable to adapt serious cross-domain discrepancy in some scenarios such as TDM.

    “Deep learning-based diagnosis models are beneficial to reducing the cross-domain discrepancy by extracting deep-layer features [33].However, they are unable to adapt serious cross-domain discrepancy in some diagnosis scenarios, such as TDM.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [33] 33. M. Long, J. Wang, Y. Cao, J. Sun, P.S. Yu, Deep learning of transferable representation for scalable domain adaptation, IEEE Trans. Knowl. Data Eng. 28 (2016) 2027-2040. source
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationreasoning

    Selecting optimal transfer approach and guaranteeing transfer success takes much time by experimental trials.

    “To select the optimal one and guarantee the transfer success, it must take much time by experimental trials.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    ANN-based diagnosis models are black-boxed due to the lack of rigorous theoretical supports.

    “Second, the ANN-based diagnosis models are black-boxed due to the lack of rigorous 10 theoretical supports.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Imbalanced distribution in machine health states is common in engineering scenarios; healthy data are far more sufficient than fault data; training deep learning models on imbalanced data may shift decision boundary toward minority health states and reduce diagnosis accuracy.

    “Imbalanced distribution in health states of machines is a common phenomenon in engineering scenarios.For example, the data collected from the healthy state are far more sufficient than those from the faults.If the imbalanced data are used to train the deep learning-based diagnosis models, the decision boundary of the models might be enforced to shift towards the health states with minority of”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationnone given

    Transfer learning is promising to expand IFD from academic research to engineering scenarios.

    “Transfer learning is promising to expand IFD from academic research to engineering scenarios.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Data collected from real-case machines are seriously imbalanced because machines mostly work healthy and faults seldom happen, making healthy data easier to collect than faulty data.

    “The fact is that machines mostly work under the healthy state, while the faults seldom happen.Thus, it is easier to collect healthy data than faulty data.As a result, the collected data are seriously imbalanced.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [26] 26. B. Yang, Y. Lei, F. Jia, S. Xing, An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings, Mech. Syst. Signal Process. 122 (2019) 692-706. source
  • May combine two claims.

    Premisecitation

    The majority of data collected from real-case machines are unlabeled because frequently stopping machines to inspect health states is unrealistic due to huge financial loss.

    “The majority of the collected data are unlabeled.It is unrealistic to frequently stop the machines and inspect the health states due to the huge loss of wealth.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [26] 26. B. Yang, Y. Lei, F. Jia, S. Xing, An intelligent fault diagnosis approach based on transfer learning from laboratory bearings to locomotive bearings, Mech. Syst. Signal Process. 122 (2019) 692-706. source
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Transfer learning theories are promising to construct diagnosis models in which diagnosis knowledge can be transferred across multiple diagnosis tasks.

    “To bridge the gap, transfer learning theories are promising to construct diagnosis models, in which the diagnosis knowledge can be transferred across multiple diagnosis tasks.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Deep learning-based diagnosis models are trained by minimizing empirical risk, which lacks rigorous theory, so their physical meanings are difficult to interpret.

    “The deep learning-based diagnosis models are trained by minimizing empirical risk, which really lacks rigorous theory.As a result, the physical meanings of them are difficult to be interpretable.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisereasoning

    It is possible to collect data from multiple source domains to match a common target domain, but health information in these source domains is not all related to target domain in engineering scenarios.

    “It is possible to collect data from multiple source domains to match a common target domain, but the health information contained in these source domains is not all related to the that in the target domain in engineering scenarios.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Transfer learning can reuse knowledge from one or more diagnosis tasks to other related but different ones.

    “Transfer learning is able to get the above purpose, in which the knowledge from one or more diagnosis tasks can be reused to other related but different ones [27].”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [27] 27. S.J. Pan, Q. Yang, A survey on transfer learning, IEEE Trans. Knowl. Data Eng. 22 (2010) 1345-1359. source
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationreasoning

    The process of learning features through deep learning is similar to filtering process, so adaptive filter theory is beneficial to analyzing physical meanings of deep learning-based diagnosis models.

    “The process of learning features through deep learning is similar to the filtering process.Therefore, the adaptive filter theory is beneficial to analyzing the physical meanings of deep learning-based diagnosis models.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    Constructed transfer learning-based diagnosis models are incapable to extract related health information.

    “The constructed transfer learning-based diagnosis models are incapable to extract the related health information.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    Transfer performance of different approaches is different for a given transfer scenario due to diverse performance ceilings.

    “According to Section 4.3, several approaches can be used in IFD, but the transfer performance of them is different for a given transfer scenario due to diverse performance ceilings.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisenone given

    In the past, IFD was implemented by data collection, artificial feature extraction, and health state recognition.

    “In the past, IFD is implemented by the steps of data collection, artificial feature extraction, and health state recognition.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Interpretationnone given

    With big data revolution, imbalanced health states and analytics for data stream bring negative effects on IFD using deep learning.

    “With the revolution of big data, two special issues come to bring negative effects on the IFD using deep learning theories, i.e., imbalanced health states and analytics for data stream.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Diagnosis models based on TCA and JDA use simple nonlinear mapping to extract features, which is difficult to fit complicated data distribution, so they may get poor transfer results on target domain due to under-corrected discrepancy.

    “Diagnosis models based on TCA and JDA use the simple nonlinear mapping to extract features, which is difficult to fit the complicated distribution of data.As a result, the diagnosis models may get poor transfer results on the target domain because of the under-corrected discrepancy of the source and target domains.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    Unreliable data transmission and bandwidth limitations prevent monitoring data stream from arriving in unbroken sequence, and inefficient computation impedes data stream analytics, so IFD using deep learning is just implemented based on off-line historical data.

    “Such issue has been concerned by the researchers for years, but the unreliable data transmission and the bandwidth limitations prevent the monitoring data stream from arriving the destination in an unbroken sequence.Furthermore, the inefficient computation capability impedes the success of data stream analytics.As a result, the IFD using deep learning is just implemented based on the off-line”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationnone given

    Parameter-based approaches fine-tune pre-trained diagnosis models for target-domain fault diagnosis, consuming less computation resources for massive data, but their transfer performance mostly depends on number of labeled target samples.

    “Parameter-based approaches fine-tune the pre-trained diagnosis models for fault diagnosis tasks in the target domain, which consumes less computation resources in handling massive data.However, the transfer performance of these approaches mostly depends on the number of labeled samples in the target domain.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Traditional machine learning diagnosis models can automatically recognize machine health states, but artificial feature extraction still relies on expert knowledge.

    “By using traditional machine learning theories, the diagnosis models are able to automatically recognize the health states of machines.However, the literature review presents that the artificial feature extraction still relies on the expert knowledge.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    TCA adapts only the marginal probability distribution of input cross-domain data and ignores the conditional probability distribution from feature space to target classes.

    “TCA just adapts the marginal probability distribution of the input cross-domain data, but 8 ignores the conditional probability distribution from the feature space to the target classes.Thus,”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [30] 30. M. Long, J. Wang, G. Ding, J. Sun, P.S. Yu, Transfer feature learning with joint distribution adaptation, in: IEEE International Conference on Computer Vision, Sydney, Australia, 2013, pp. 2200-2207. source
  • Classified as probably not a substantial claim. May combine two claims.

    Premisereasoning

    Statistical learning theories such as SVM and PGM have rigorous theory grounds, promoting construction of diagnosis models with easily-understood parameters, features, and results.

    “The statistical learning theories, such as SVM and PGM, have rigorous theory grounds, which promote to constructed diagnosis models with easily-understood model parameters, features, and diagnosis results.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationnone given

    Recollecting sufficient data and labeling them is costly and unpractical for machines in engineering scenarios.

    “However, it takes much cost to recollect sufficient data and further label them, which is unpractical for machines in engineering scenarios.”
    Quote in the paperSubstantial claim
82 of 82
  • The paper relies on this without support.

    In engineering scenarios, machine users would like an automatic method to shorten the maintenance cycle and improve the diagnosis accuracy.

    “In engineering scenarios, however, the machine users would like an automatic method to shorten the maintenance cycle and improve the diagnosis accuracy.”
  • The paper relies on this without support.

    Traditionally, the process of fault diagnosis is mostly developed by manually inspecting the health states of machines, which increases the labor intensity and reduces the diagnosis accuracy.

    “Traditionally, the process of fault diagnosis is mostly developed by manually inspecting the health states of machines, which increases the labor intensity and reduces the diagnosis accuracy.”
  • The paper relies on this without support.

    Advanced signal processing methods greatly rely on specialized knowledge that maintainers mostly lack in engineering scenarios.

    “However, these methods greatly rely on the specialized knowledge that maintainers mostly lack in engineering scenarios.”
  • The paper relies on this without support.

    The diagnosis results by signal processing methods are too specialized to be understood by the machine users.

    “Furthermore, the diagnosis results by signal processing methods are too specialized to be understood by the machine users.”
  • The paper relies on this without support.

    The volume of collected data is dramatically increasing due to rapid development of internet technologies and IoT.

    “With the rapid development of internet technologies and internet of things (IoT), the volume of collected data is dramatically gathered than ever before.”
  • The paper relies on this without support.

    Increasingly-grown data bring more sufficient information to machine fault diagnosis, making it more possible to provide accurate diagnosis results.

    “The increasingly-grown data bring more sufficient information to machine fault diagnosis so that it is more possible to provide accurate diagnosis results.”
  • The authors state this as an assumption.

    Labeled data are sufficient and contain complete information about the health states of machines.

    “the labeled data are sufficient and contain completed information about the health states of machines [35]”
  • The authors state this as an assumption.

    The source-domain data are labeled, while there are minority of labeled data or even none of labeled data in the target domain.

    “These two categories are both subject to the common assumption, in which the source-domain data are labeled, while there are minority of labeled data or even none of labeled data in the target domain.”
  • The authors state this as an assumption.

    In instance-based approaches, minority of labeled samples are labeled in the target domain, which is insufficient to train reliable diagnosis models.

    “In instance-based approaches, it is assumed that minority of labeled samples are labeled in the target domain, which is insufficient to train reliable diagnosis models.”
  • The authors state this as an assumption.

    In parameter-based approaches, there are minority of labeled samples in the target domain.

    “Similar to the instance-based approaches, parameter-based approaches also assume that there are minority of labeled samples in the target domain [27].”
  • The authors state this as an assumption.

    The successes of transfer learning are subject to the assumption of related health information across multiple diagnosis tasks.

    “The successes of transfer learning are subject to the assumption of related health information across multiple diagnosis tasks.”
11 of 11

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Polynomial-kernel study is assigned the GAN reference number

    Minor

    The discussion attributes a polynomial-kernel MMD study to reference [443], but [443] is a paper on generative adversarial nets. The polynomial-kernel paper appears instead as reference [444].

  • Motors and generators are both allowed and ruled out as a transfer pair

    Minor

    The paper gives transfer between motors and generators as an example of a TDM scenario, but elsewhere says using knowledge from motors to diagnose generators is unrealistic.

2 of 2

Cites

Flagged first, then by citations

13 of the 473 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Lei, Y., Yang, B., Jiang, X., Jia, F., Li, N., & Nandi, A. K.
Affiliations
  • Xi'an Jiaotong University (CN)
  • Brunel University of London (GB)
Corresponding author
Lei, Yaguo
Venue
Mechanical Systems and Signal Processing
Publisher
Elsevier BV
Published
2020-04
Volume
138
Pages
106587
ISSN
0888-3270 (ISSN-L)
OpenAlex
W2998506103
Cited by
2,997
References
473
Citations by year
2026: 553 · 2025: 549 · 2024: 497 · 2023: 515 · 2022: 439 · 2021: 327 · 2020: 115 · 2018: 1 · 2014: 1
FWCI
172.43
Type
journal article
Language
en
Open access
Locations
  • Mechanical Systems and Signal Processing (publishedVersion)
  • Brunel University Research Archive (BURA) (Brunel University London) (submittedVersion)
Funders
  • National Natural Science Foundation of China
  • Ministry of Science and Technology of the People's Republic of China
Topics
  • Physical Sciences › Engineering › Control and Systems Engineering › Machine Fault Diagnosis Techniques
  • Physical Sciences › Engineering › Control and Systems Engineering › Fault Detection and Control Systems
  • Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Reliability and Maintenance Optimization
Keywords
mechanical fault diagnosis, intelligent fault diagnosis, deep learning, transfer learning, condition monitoring, research trends

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-11.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-11.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review