The DOI matches its Crossref record; 86 of the 86 references it cites were found in a registry or an index.
Enhancing Debris Flow Warning via Machine Learning Feature Reduction and Model Selection
Open accessPublished version of a preprint
Abstract
The advent of machine learning has significantly improved the accuracy of identifying mass movements through the seismic waves they generate, making it possible to implement real‐time early warning systems for debris flows. However, we lack a profound understanding of the effective seismic features and the limitations of different machine learning models. In this work, we investigate eighty seismic features and three machine learning models for single‐station‐based binary debris flow classification and multi‐station‐based warning tasks. These seismic features, derived from physical and statistical knowledge of impact sources, are grouped into five sets: Benford's law, waveform, spectra, spectrogram, and network. The machine learning models belong to two families: two ensemble models, Random Forest and eXtreme Gradient Boosting (XGBoost); one recurrent neural network model, Long Short‐Term Memory (LSTM). We analyzed feature importance from the ensemble models and found that the number and even the types of seismic features are not critical for training an effective binary classifier for debris flow. When using models designed to capture patterns in sequential data rather than focusing on information only in one given window, using the LSTM does not significantly improve the performance of binary debris flow classification task over Random Forest and XGBoost. For the multi‐station‐based debris flow warning task, the LSTM model predicts debris flow probability more consistently and provides longer warning times. Our proposed framework simplifies machine learning‐driven debris flow classification and lays the foundation for affordable seismic signal‐driven early warning using a sparse seismic network.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
RETRACTED ARTICLE: Feature selection for machine learning classification problems: a recent overview
Kotsiantis, S. B. (2011) · Artificial Intelligence Review · doi:10.1007/s10462-011-9230-1 · Cited by 99
RetractedBreiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Hochreiter, S., & Schmidhuber, J. (1997) · Neural Computation · doi:10.1162/neco.1997.9.8.1735 · Cited by 102,318
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
PyTorch: An Imperative Style, High-Performance Deep Learning Library
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019) · arXiv · doi:10.48550/arxiv.1912.01703 · Cited by 31,473
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
(1993) · doi:10.1109/cvpr.1993 · Cited by 17,667
Statsmodels: Econometric and Statistical Modeling with Python
Seabold, S., & Perktold, J. (2010) · Proceedings of the Python in Science Conference · doi:10.25080/majora-92bf1922-011 · Cited by 6,465
Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network
Sherstinsky, A. (2020) · Physica D: Nonlinear Phenomena · doi:10.1016/j.physd.2019.132306 · Cited by 5,680
On hyperparameter optimization of machine learning algorithms: Theory and practice
Yang, L., & Shami, A. (2020) · Neurocomputing · doi:10.1016/j.neucom.2020.07.061 · Cited by 3,232
Iverson, R. M. (1997) · Reviews of Geophysics · doi:10.1029/97rg00426 · Cited by 3,092
Learning from imbalanced data: open challenges and future directions
Krawczyk, B. (2016) · Progress in Artificial Intelligence · doi:10.1007/s13748-016-0094-0 · Cited by 2,459
Learning from class-imbalanced data: Review of methods and applications
Haixiang, G., Yijing, L., Shang, J., Mingyun, G., Yuanyue, H., & Bing, G. (2017) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.035 · Cited by 2,377
Irrelevant Features and the Subset Selection Problem
John, G. H., Kohavi, R., & Pfleger, K. (1994) · Machine Learning Proceedings 1994 · doi:10.1016/b978-1-55860-335-6.50023-4 · Cited by 2,368
Temporal Convolutional Networks for Action Segmentation and Detection
Lea, C., Flynn, M. D., Vidal, R., Reiter, A., & Hager, G. D. (2017) · 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2017.113 · Cited by 2,238
Comparison of Values of Pearson's and Spearman's Correlation Coefficients on the Same Sets of Data
Hauke, J., & Kossowski, T. (2011) · Quaestiones Geographicae · doi:10.2478/v10117-011-0021-1 · Cited by 2,203
A review on the long short-term memory model
Van Houdt, G., Mosquera, C., & Nápoles, G. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-020-09838-1 · Cited by 1,991
LSTM Fully Convolutional Networks for Time Series Classification
Karim, F., Majumdar, S., Darabi, H., & Chen, S. (2018) · IEEE Access · doi:10.1109/access.2017.2779939 · Cited by 1,465
Feurer, M., & Hutter, F. (2019) · The Springer Series on Challenges in Machine Learning · doi:10.1007/978-3-030-05318-5_1 · Cited by 1,414
Evaluation metrics and statistical tests for machine learning
Rainio, O., Teuho, J., & Klén, R. (2024) · Scientific Reports · doi:10.1038/s41598-024-56706-x · Cited by 1,338
Machine learning for data-driven discovery in solid Earth geoscience
Bergen, K. J., Johnson, P. A., de Hoop, M. V., & Beroza, G. C. (2019) · Science · doi:10.1126/science.aau0323 · Cited by 1,249
Benchmarking attribute selection techniques for discrete class data mining
Hall, M. A., & Holmes, G. (2003) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2003.1245283 · Cited by 1,232
A survey of feature selection and feature extraction techniques in machine learning
Khalid, S., Khalil, T., & Nasreen, S. (2014) · 2014 Science and Information Conference · doi:10.1109/sai.2014.6918213 · Cited by 1,157
Note on the Frequency of Use of the Different Digits in Natural Numbers
Newcomb, S. (1881) · American Journal of Mathematics · doi:10.2307/2369148 · Cited by 974
A review of unsupervised feature selection methods
Solorio-Fernández, S., Carrasco-Ochoa, J. A., & Martínez-Trinidad, J. F. (2020) · Artificial Intelligence Review · doi:10.1007/s10462-019-09682-y · Cited by 648
González, S., García, S., Del Ser, J., Rokach, L., & Herrera, F. (2020) · Information Fusion · doi:10.1016/j.inffus.2020.07.007 · Cited by 582
Debris-flow hazards and related phenomena
Cruden, D. (2005) · Canadian Geotechnical Journal · doi:10.1139/t05-075 · Cited by 422
Zhou, X., Wen, H., Zhang, Y., Xu, J., & Zhang, W. (2021) · Geoscience Frontiers · doi:10.1016/j.gsf.2021.101211 · Cited by 421
Dowling, C. A., & Santi, P. M. (2014) · Natural Hazards · doi:10.1007/s11069-013-0907-4 · Cited by 389
Field observations of basal forces and fluid pore pressure in a debris flow
McArdell, B. W., Bartelt, P., & Kowalski, J. (2007) · Geophysical Research Letters · doi:10.1029/2006gl029183 · Cited by 371
Spearman Correlation Coefficients, Differences between
Myers, L., & Sirois, M. J. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess5050 · Cited by 321
Debris-flow monitoring and warning: Review and examples
Hürlimann, M., Coviello, V., Bel, C., Guo, X., Berti, M., Graf, C., Hübl, J., Miyata, S., Smith, J. B., & Yin, H.-Y. (2019) · Earth-Science Reviews · doi:10.1016/j.earscirev.2019.102981 · Cited by 297
Machine Learning in Earthquake Seismology
Mousavi, S. M., & Beroza, G. C. (2022) · Annual Review of Earth and Planetary Sciences · doi:10.1146/annurev-earth-071822-100323 · Cited by 295
Takahashi, T. (2007) · Taylor & Francis eBooks · doi:10.1201/9780203946282 · Cited by 240
McNemar χ2test revisited: comparing sensitivity and specificity of diagnostic examinations
Trajman, A., & Luiz, R. R. (2008) · Scandinavian Journal of Clinical and Laboratory Investigation · doi:10.1080/00365510701666031 · Cited by 219
Environmental seismology: What can we learn on earth surface processes with ambient noise?
Larose, É., Carrière, S., Voisin, C., Bottelin, P., Baillet, L., Guéguen, P., Walter, F., Jongmans, D., Guillier, B., Garambois, S., et al. (2015) · Journal of Applied Geophysics · doi:10.1016/j.jappgeo.2015.02.001 · Cited by 219
Self-citationDebris flow modeling: A review
Hutter, K., Svendsen, B., & Rickenmann, D. (1994) · Continuum Mechanics and Thermodynamics · doi:10.1007/bf01175749 · Cited by 204
Imbalanced data preprocessing techniques for machine learning: a systematic mapping study
de Vargas, V. W., Aranda, J. A. S., Costa, R. D. S., Pereira, P., & Barbosa, J. L. V. (2022) · Knowledge and Information Systems · doi:10.1007/s10115-022-01772-8 · Cited by 202
A debris-flow alarm system for the Alpine Illgraben catchment: design and performance
Badoux, A., Graf, C., Rhyner, J., Kuntner, R., & McArdell, B. W. (2008) · Natural Hazards · doi:10.1007/s11069-008-9303-x · Cited by 199
Provost, F., Hibert, C., & Malet, J. (2016) · Geophysical Research Letters · doi:10.1002/2016gl070709 · Cited by 197
Self-citationJakob, M. (2007) · Springer eBooks · doi:10.1007/3-540-27129-5_17 · Cited by 196
Systems and Sensors for Debris-flow Monitoring and Warning
Arattano, M., & Marchi, L. (2008) · Sensors · doi:10.3390/s8042436 · Cited by 174
Benford's law in the natural sciences
Sambridge, M. S., Tkalčić, ., & Jackson, A. (2010) · Geophysical Research Letters · doi:10.1029/2010gl044830 · Cited by 155
Detection and potential early warning of catastrophic flow events with regional seismic networks
Cook, K., Rekapalli, R., Dietze, M. C., Pilz, M., Cesca, S., Rao, N. P., Srinagesh, D., Paul, H., Metz, M., Mandal, P., et al. (2021) · Science · doi:10.1126/science.abj1227 · Cited by 141
Self-citationThe Seismic Signature of Debris Flows: Flow Mechanics and Early Warning at Montecito, California
Lai, V. H., Tsai, V. C., Lamb, M. P., Ulizio, T. P., & Beer, A. R. (2018) · Geophysical Research Letters · doi:10.1029/2018gl077683 · Cited by 140
Debris-flow impact, vulnerability, and response
Santi, P. M., Hewitt, K., VanDine, D. F., & Barillas Cruz, E. (2011) · Natural Hazards · doi:10.1007/s11069-010-9576-8 · Cited by 133
Machine Learning Improves Debris Flow Warning
Chmiel, M., Walter, F., Wenner, M., Zhang, Z., McArdell, B. W., & Hibert, C. (2020) · Geophysical Research Letters · doi:10.1029/2020gl090874 · Cited by 127
Self-citationHibert, C., Provost, F., Malet, J., Maggi, A., Stumpf, A., & Ferrazzini, V. (2017) · Journal of Volcanology and Geothermal Research · doi:10.1016/j.jvolgeores.2017.04.015 · Cited by 125
Self-citationSeismic monitoring of torrential and fluvial processes
Burtin, A., Hovius, N., & Turowski, J. M. (2016) · Earth Surface Dynamics · doi:10.5194/esurf-4-285-2016 · Cited by 117
Self-citationA physical model of the high‐frequency seismic signal generated by debris flows
Farin, M., Tsai, V. C., Lamb, M. P., & Allstadt, K. E. (2019) · Earth Surface Processes and Landforms · doi:10.1002/esp.4677 · Cited by 117
Testing seismic amplitude source location for fast debris-flow detection at Illgraben, Switzerland
Walter, F., Burtin, A., McArdell, B. W., Hovius, N., Weder, B., & Turowski, J. M. (2017) · Natural hazards and earth system sciences · doi:10.5194/nhess-17-939-2017 · Cited by 103
Self-citationInfrasound Array Analysis of Debris Flow Activity and Implication for Early Warning
Marchetti, E., Walter, F., Barfucci, G., Genco, R., Wenner, M., Ripepe, M., McArdell, B. W., & Price, C. G. (2019) · Journal of Geophysical Research Earth Surface · doi:10.1029/2018jf004785 · Cited by 86
Self-citationMaggi, A., Ferrazzini, V., Hibert, C., Beauducel, F., Boissier, P., & Amemoutou, A. (2017) · Seismological Research Letters · doi:10.1785/0220160189 · Cited by 84
Self-citationHibert, C., David Michéa, B., Provost, F., Malet, J., & Geertsema, M. (2019) · Geophysical Journal International · doi:10.1093/gji/ggz354 · Cited by 83
Self-citationA Seismic-Event Spotting System for Volcano Fast-Response Systems
Hammer, C., Beyreuther, M., & Ohrnberger, M. M. (2012) · Bulletin of the Seismological Society of America · doi:10.1785/0120110167 · Cited by 77
Tiranti, D., Cremonini, R., Marco, F., et al. (2014) · Computers & Geosciences · doi:10.1016/j.cageo.2014.05.004 · Cited by 68
AI-based rainfall prediction model for debris flows
Zhao, Y. N., Meng, X., Qi, T., Li, Y., Chen, G., Yue, D., & Qing, F. (2021) · Engineering Geology · doi:10.1016/j.enggeo.2021.106456 · Cited by 68
Wenner, M., Hibert, C., van Herwijnen, A., Meier, L., & Walter, F. (2021) · Natural hazards and earth system sciences · doi:10.5194/nhess-21-339-2021 · Cited by 65
Self-citationAbdalzaher, M. S., Moustafa, S. S. R., Abd‐Elnaby, M., & Elwekeil, M. (2021) · IEEE Access · doi:10.1109/access.2021.3076119 · Cited by 65
Burtin, A., Hovius, N., McArdell, B. W., Turowski, J. M., & Vergne, J. (2014) · Earth Surface Dynamics · doi:10.5194/esurf-2-21-2014 · Cited by 64
Self-citationInsights From the Particle Impact Model Into the High‐Frequency Seismic Signature of Debris Flows
Zhang, Z., Walter, F., McArdell, B. W., Wenner, M., Chmiel, M., de Haas, T., & He, S. (2020) · Geophysical Research Letters · doi:10.1029/2020gl088994 · Cited by 55
Self-citationSeismic Advances in Process Geomorphology
Cook, K., & Dietze, M. C. (2022) · Annual Review of Earth and Planetary Sciences · doi:10.1146/annurev-earth-032320-085133 · Cited by 54
Self-citationAttention-based LSTM-FCN for earthquake detection and location
Bai, T., & Tahmasebi, P. (2021) · Geophysical Journal International · doi:10.1093/gji/ggab401 · Cited by 52
Deep Learning Can Predict Laboratory Quakes From Active Source Seismic Data
Shokouhi, P., Girkar, V., Rivière, J., Shreedharan, S., Marone, C. J., Giles, C. L., & Kifer, D. (2021) · Geophysical Research Letters · doi:10.1029/2021gl093187 · Cited by 50
Farin, M., Mangeney, A., de Rosny, J., Toussaint, R., & Trinh, P. (2018) · Journal of Geophysical Research Earth Surface · doi:10.1029/2017jf004296 · Cited by 49
Using LSTM Neural Networks for Onsite Earthquake Early Warning
Wang, C.-Y., Huang, T., & Wu, Y. (2022) · Seismological Research Letters · doi:10.1785/0220210197 · Cited by 48
Belli, G., Walter, F., McArdell, B. W., Gheri, D., & Marchetti, E. (2022) · Journal of Geophysical Research Earth Surface · doi:10.1029/2021jf006576 · Cited by 48
Self-citationAn Optimized Learning Model Augment Analyst Decisions for Seismic Source Discrimination
Abdalzaher, M. S., Moustafa, S. S. R., Hafiez, H. E. A., & Farid, W. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2022.3208097 · Cited by 48
Field Measurements of Forces in Debris Flows at the Illgraben: Implications for Channel-Bed Erosion
McArdell, B. W. (2016) · International Journal of Erosion Control Engineering · doi:10.13101/ijece.9.194 · Cited by 42
Du, J., Zhou, G. G. D., Tang, H., Turowski, J. M., & Cui, K. F. E. (2023) · Water Resources Research · doi:10.1029/2022wr033242 · Cited by 40
Self-citationExplainable machine learning for labquake prediction using catalog-driven features
Karimpouli, S., Caus, D., Grover, H., Martínez‐Garzón, P., Bohnhoff, M., Beroza, G. C., Dresen, G., Goebel, T. H. W., Weigel, T., & Kwiatek, G. (2023) · Earth and Planetary Science Letters · doi:10.1016/j.epsl.2023.118383 · Cited by 36
A New Decade in Seismoacoustics (2010–2022)
Dugick, F. D., Koch, C. D., Berg, E. M., Arrowsmith, S., & Albert, S. (2023) · Bulletin of the Seismological Society of America · doi:10.1785/0120220157 · Cited by 27
Ponziani, M., Ponziani, D., Giorgi, A., Stevenin, H., & Ratto, S. M. (2023) · Natural Hazards · doi:10.1007/s11069-023-05853-x · Cited by 24
End-to-End LSTM-Based Earthquake Magnitude Estimation With a Single Station
Cofré, A., Marín, M., Pino, O. V., Galleguillos, N., Riquelme, S., Barrientos, S. E., & Yoma, N. B. (2022) · IEEE Geoscience and Remote Sensing Letters · doi:10.1109/lgrs.2022.3175108 · Cited by 23
A review on acoustic moni toring of debris flow
Hübl, J., Schimmel, A., Kogelnig, A., Suriñach, E., Vilajosana, I., & McArdell, B. W. (2013) · International Journal of Safety and Security Engineering · doi:10.2495/safe-v3-n2-105-115 · Cited by 17
Porter, R. C., Joyal, T. J., Beers, R. L., Youberg, A., Loverich, J. B., Schenk, E. R., & Robichaud, P. R. (2023) · Journal of Geophysical Research Earth Surface · doi:10.1029/2022jf006962 · Cited by 17
Hibert, C., Noël, F., Toe, D., Talib, M., Desrues, M., Wyser, E., Brenguier, O., Bourrier, F., Toussaint, R., Malet, J., et al. (2024) · Earth Surface Dynamics · doi:10.5194/esurf-12-641-2024 · Cited by 14
Self-citationFundamental Limits for Learning Hidden Markov Model Parameters
Abraham, K., Gassiat, É., & Naulet, Z. (2022) · IEEE Transactions on Information Theory · doi:10.1109/tit.2022.3213429 · Cited by 13
Benford's Law as Debris Flow Detector in Seismic Signals
Zhou, Q. M., Tang, H., Turowski, J. M., Braun, J., Dietze, M. C., Walter, F., Yang, C., & Lagarde, S. (2024) · Journal of Geophysical Research Earth Surface · doi:10.1029/2024jf007691 · Cited by 13
Self-citationYang, Y., Chen, G., Li, Y., Meng, X., Chong, Y., Bian, S., Jin, J., Shi, W., Wu, J., & Yue, D. (2024) · Journal of Geophysical Research Earth Surface · doi:10.1029/2023jf007527 · Cited by 10
Temporary deployments in Switzerland associated with landslides
Zurich, S. S. S. (. A. E. (2012) · Swiss Seismological Service, national earthquake monitoring and hazard center · doi:10.12686/sed/networks/xp · Cited by 10
Debris-flow volumes at the Illgraben 2000-2017
McArdell, B. W., & Hirschberg, J. (2020) · doi:10.16904/envidat.173 · Cited by 8
Rock slope failure preparation paced by total crack boundary length
Lagarde, S., Dietze, M. C., Hammer, C., Zeckra, M., Voigtländer, A., Illien, L., Schöpa, A., Hirschberg, J., Burtin, A., Hovius, N., et al. (2023) · Communications Earth & Environment · doi:10.1038/s43247-023-00851-0 · Cited by 7
Self-citationIllgraben debris-flow characteristics 2019-2022
McArdell, B. W., Hirschberg, J., Graf, C., Boss, S., & Badoux, A. (2023) · doi:10.16904/envidat.378 · Cited by 7
Zhou, Q. (2025) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.15020367 · Cited by 1
Self-citation(2014) · doi:10.5555/2627435.2697065
Research works printed but not linked: 4
- Aki K., 2002, Quantitative seismology
- Cutler A., 2012, Random forests, 157
- Petley D., 2023, The devastating 17 July 2023 debris flow at Quetame in Colombia, American Geophysical Union Blogosphere
- Petley D., 2024, The possible causes of the deadly 21 June 2024 SORTE debris flow in Switzerland, Eos American Geophysical Union
Cited by
Real-Time Railway Hazard Detection Using Distributed Acoustic Sensing and Hybrid Ensemble Learning
Yürekli, Y., Özarpa, C., & Avcı, İ. (2025) · Sensors · doi:10.3390/s25133992 · Cited by 21
Metadata
- Authors
- Zhou, Q., Tang, H., Hibert, C., Chmiel, M., Walter, F., Dietze, M., & Turowski, J. M.
- Affiliations
- University of Potsdam (DE)
- GFZ Helmholtz Centre for Geosciences (DE)
- Centre National de la Recherche Scientifique (FR)
- Swiss Federal Institute for Forest, Snow and Landscape Research (CH)
- Corresponding author
- Zhou, Qi
- ORCID
- Venue
- Journal of Geophysical Research: Earth Surface
- Publisher
- American Geophysical Union (AGU)
- Published
- 2025-04
- Volume
- 130
- Issue
- 4
- ISSN
- 2169-9003 (ISSN-L)
- 2169-9011
- OpenAlex
- W4409831609
- Cited by
- 20
- References
- 86
- Citations by year
- 2026: 13 · 2025: 7
- FWCI
- 7.93
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- Locations
- Journal of Geophysical Research Earth Surface (publishedVersion, cc-by)
- HAL (submittedVersion, cc-by)
- DORA WSL (Swiss Federal Institute for Forest, Snow and Landscape Research) (submittedVersion, other-oa)
- Publication Database GFZ (GFZ German Research Centre for Geosciences) (submittedVersion, other-oa)
- GoeScholar The Publication Server of the Georg-August-Universität Göttingen (Georg-August-Universität Göttingen) (submittedVersion, cc-by)
- Funders
- State Key Laboratory of Geohazard Prevention and Geoenvironment Protection (SKLGP2023K003)
- National Natural Science Foundation of China (42120104002)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Seismology and Earthquake Studies
- Physical Sciences › Environmental Science › Management, Monitoring, Policy and Law › Landslides and related hazards
- Physical Sciences › Engineering › Mechanics of Materials › Geotechnical and Geomechanical Engineering
- Keywords
- debris flow early warning, seismic signals, machine learning model selection, Benford's law, seismic spectra, spectrogram, sparse seismic networks, feature importance, random forest, XGBoost, LSTM
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.