CoChat
Sign Up
PreprintCited by 1Time Series Analysis and ForecastingMusic and Audio ProcessingDomain Adaptation and Few-Shot Learning

The DOI matches its DataCite record.

Mantis: Lightweight Foundation Model for Time Series Classification

Open access
Feofanov, Vasilii, Wen, Songkang, Xie, Shifeng, Roschmann, Simon, Alonso, Marius, Guo, Hongbo, Ilbert, Romain, Tiomoko, Malik, Bouniot, Quentin, Akata, Zeynep, Pan, Lujia, Zhang, Jianfeng, Redko, Ievgen·2025·arXiv
DOI 10.48550/arxiv.2502.15637arXiv 2502.15637
Open this paper in CoChat — free accountOpen PDF

Abstract

While foundation models have revolutionized various domains, their application to time series classification remains rather under-explored, with existing literature predominantly focused on forecasting. To bridge this gap, we introduce \textbf{Mantis}, a transformer-based foundation model pre-trained exclusively on synthetic data via self-supervised contrastive learning. We demonstrate that effective tokenization is critical to unlocking the full potential of transformers, proposing a novel token generator unit. Furthermore, we introduce an enhanced test-time methodology that bridges the performance gap between Mantis and strong specialized approaches by leveraging intermediate-layer representations, self-ensembling, and cross-model embedding fusion. Extensive experiments demonstrate that Mantis establishes a new state-of-the-art, outperforming existing foundation models across four diverse dataset collections covering various application domains.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2502.15637

Cites

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Foundation models MOMENT-small and Mantis are inherently capable of handling variable-length sequences.

    “Notably, Foundation models like MOMENT-small and Mantis are inherently capable of handling variable-length sequences.”

    From COMODO: Cross-Modal Video-to-IMU Distillation for Efficient Egocentric Human Activity Recognition (2026) · cites this paper as [14]

    Section 3.2 (Architecture; page unavailable) says Mantis requires inputs to be resized or padded, normally to length 512, rather than inherently accepting arbitrary sequence lengths. Appendix A.2 (Models; page unavailable) likewise says the evaluated MOMENT model needs padding or interpolation to length 512; it is MOMENT-large, not MOMENT-small. (LLM, conf=0.88)

    Checked by a reasoning model — may be wrong.

    Experimental — accuracy not yet measured

  • MOMENT-small uses attention masking with left padding, and Mantis uses a built-in resize function to standardize inputs to a fixed length.

    “MOMENT-small leverages attention masking with left padding to process sequences of different lengths, while Mantis employs a built-in resize function to internally standardize all inputs to a fixed length (e.g., 512).”

    From COMODO: Cross-Modal Video-to-IMU Distillation for Efficient Egocentric Human Activity Recognition (2026) · cites this paper as [14]

    Section 3.2 (page unavailable) says Mantis inputs should be resized or padded and that the authors resize them to length 512 by default. It does not establish that Mantis has a built-in function that performs this resizing internally. Appendix A.2 (page unavailable) discusses MOMENT-large, not MOMENT-small, and does not describe attention masking with left padding. (LLM, conf=0.87)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

No references could be resolved yet.

Research works printed but not linked: 75

  1. Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F. L., Almeida, D., Altenschmidt, J., Altman, S., Anadkat, S., et al. (2023). GPT-4 technical report. arXiv preprint arXiv:2303.08774. · arXiv
  2. Ansari, A. F., Shchur, O., Küken, J., Auer, A., Han, B., Mercado, P., Rangapuram, S. S., Shen, H., Stella, L., Zhang, X., et al. (2025). Chronos-2: From univariate to universal forecasting. arXiv preprint arXiv:2510.15821. · arXiv
  3. Ashok, A., Williams, A. R., Zheng, V. Z., Rish, I., Chapados, N., Marcotte, É., Zantedeschi, V., and Drouin, A. (2025). Beyond naïve prompting: Strategies for improved zero- shot context-aided forecasting with LLMs. arXiv preprint arXiv:2508.09904. · arXiv
  4. Auer, A., Klotz, D., Böck, S., and Hochreiter, S. (2025a). Pre-trained forecasting models: Strong zero-shot feature extractors for time series classification. arXiv preprint arXiv:2510.26777. · arXiv
  5. Auer, A., Podest, P., Klotz, D., Böck, S., Klambauer, G., and Hochreiter, S. (2025b). TiRex: Zero-shot forecasting across long and short horizons with enhanced in-context learning. arXiv preprint arXiv:2505.23719. · arXiv
  6. Ba, J. L., Kiros, J. R., and Hinton, G. E. (2016). Layer normalization. arXiv preprint arXiv:1607.06450. · arXiv
  7. Bagnall, A., Dau, H. A., Lines, J., Flynn, M., Large, J., Bostrom, A., Southam, P., and Keogh, E. (2018). The UEA multivariate time series classification archive, 2018. arXiv preprint arXiv:1811.00075. · arXiv
  8. Beck, M., Pöppel, K., Spanring, M., Auer, A., Prudnikova, O., Kopp, M., Klambauer, G., Brandstetter, J., and Hochreiter, S. (2024). xlstm: Extended long short-term memory. Advances in Neural Information Processing Systems, 37:107547-107603.
  9. Benechehab, A., Feofanov, V., Paolo, G., Thomas, A., Fil- ippone, M., and Kégl, B. (2025). Adapts: Adapting univariate foundation models to probabilistic multivariate time series forecasting. arXiv preprint arXiv:2502.10235. · arXiv
  10. Bhethanabhotla, S. K., Swelam, O., Siems, J., Salinas, D., and Hutter, F. (2024). Mamba4Cast: Efficient zero-shot time series forecasting with state space models. arXiv preprint arXiv:2410.09385. · arXiv
  11. Chen, B., Wongso, W., Li, Z., Khaokaew, Y., Xue, H., and Salim, F. (2025). COMODO: Cross-modal video- to-imu distillation for efficient egocentric human activity recognition. arXiv preprint arXiv:2503.07259. · arXiv
  12. Chen, M., Shen, L., Li, Z., Wang, X. J., Sun, J., and Liu, C. (2024). VisionTS: Visual masked autoencoders are free- lunch zero-shot time series forecasters. arXiv preprint arXiv:2408.17253. · arXiv
  13. Chicaiza, K. O. and Benalcázar, M. E. (2021). A brain- computer interface for controlling IoT devices using EEG signals. In 2021 IEEE Fifth Ecuador Technical Chapters Meeting (ETCM), pages 1-6. IEEE.
  14. Cohen, B., Khwaja, E., Doubli, Y., Lemaachi, S., Lettieri, C., Masson, C., Miccinilli, H., Ramé, E., Ren, Q., Ros- tamizadeh, A., et al. (2025). This time is different: An observability perspective on time series foundation mod- els. arXiv preprint arXiv:2505.14766. · arXiv
  15. Das, A., Kong, W., Sen, R., and Zhou, Y. (2023). A decoder- only foundation model for time-series forecasting. arXiv preprint arXiv:2310.10688. · arXiv
  16. Dau, H. A., Bagnall, A., Kamgar, K., Yeh, C.-C. M., Zhu, Y., Gharghabi, S., Ratanamahatana, C. A., and Keogh, E. (2019). The UCR time series archive. IEEE/CAA Journal of Automatica Sinica, 6(6):1293-1305.
  17. Dempster, A., Petitjean, F., and Webb, G. I. (2020). ROCKET: exceptionally fast and accurate time series classification using random convolutional kernels. Data Mining and Knowledge Discovery, 34(5):1454-1495.
  18. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 con- ference of the North American chapter of the association for computational linguistics: human language technolo- gies, volume 1 (long and short papers), pages 4171-4186.
  19. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., and Houlsby, N. (2021). An image is worth 16x16 words: Trans- formers for image recognition at scale. arXiv preprint arXiv:2010.11929. · arXiv
  20. Egede, J. O., Song, S., Olugbade, T. A., Wang, C., Amanda, C. D. C., Meng, H., Aung, M., Lane, N. D., Valstar, M., Gagnon-Audet, J.-C., Ahuja, K., Darvishi-Bayazi, M.-J., Mousavi, P., Dumas, G., and Rish, I. (2022). WOODS: Benchmarks for out-of-distribution generalization in time series. arXiv preprint arXiv:2203.09978. · arXiv
  21. Gao, S., Koker, T., Queen, O., Hartvigsen, T., Tsiligkaridis, T., and Zitnik, M. (2024). UniTS: A unified multi-task time series model. In The Thirty-eighth Annual Confer- ence on Neural Information Processing Systems.
  22. Gnassounou, T., Moakher, Y., Xie, S., Feofanov, V., and Redko, I. (2025). Leveraging generic time series foun- dation models for EEG classification. arXiv preprint arXiv:2510.27522. · arXiv
  23. Goswami, M., Szafer, K., Choudhry, A., Cai, Y., Li, S., and Dubrawski, A. (2024). MOMENT: A family of open time-series foundation models. arXiv preprint arXiv:2402.03885. · arXiv
  24. Graf, L., Ortner, T., Wo Ĺs ¸niak, S., Pantazi, A., et al. (2025). FlowState: Sampling rate invariant time series forecast- ing. arXiv preprint arXiv:2508.05287. · arXiv
  25. Grauman, K., Westbury, A., Byrne, E., Chavis, Z., Furnari, A., Girdhar, R., Hamburger, J., Jiang, H., Liu, M., Liu, X., et al. (2022). Ego4D: Around the world in 3,000 hours of egocentric video. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 18995-19012.
  26. He, K., Fan, H., Wu, Y., Xie, S., and Girshick, R. (2020). Momentum contrast for unsupervised visual representa- tion learning. In Proceedings of the IEEE/CVF confer- ence on computer vision and pattern recognition, pages 9729-9738.
  27. Hollmann, N., Müller, S., Eggensperger, K., and Hutter, F. (2022). TabPFN: A transformer that solves small tabu- lar classification problems in a second. arXiv preprint arXiv:2207.01848. · arXiv
  28. Ilbert, R., Feofanov, V., Tiomoko, M., Redko, I., and Palpanas, T. (2025). User-friendly foundation model adapters for multivariate time series classification. In 2025 IEEE 41st International Conference on Data Engi- neering Workshops (ICDEW), pages 136-144. IEEE.
  29. Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., and Muller, P.-A. (2019). Deep learning for time series classification: a review. Data mining and knowledge discovery, 33(4):917-963.
  30. Kemp, B., Zwinderman, A. H., Tuk, B., Kamphuisen, H. A., and Oberye, J. J. (2000). Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG. IEEE Transactions on Biomedical Engineer- ing, 47(9):1185-1194.
  31. Lee, J., Youn, H. L., Poon, J., and Han, S. C. (2023). Stock- Emotions: Discover investor emotions for financial senti- ment analysis and multivariate time series. arXiv preprint arXiv:2301.09279. · arXiv
  32. Li, D., Liao, X., Chen, S., and Zhao, S. (2025a). Data- efficient motor condition monitoring with time series foundation models. arXiv preprint arXiv:2511.23177. · arXiv
  33. Li, Z., Chen, B., Xue, H., and Salim, F. D. (2025b). ZARA: Zero-shot motion time-series analysis via knowl- edge and retrieval driven llm agents. arXiv preprint arXiv:2508.04038. · arXiv
  34. Liao, X., Zhang, X., Wei, X., Liu, J., Zhao, S., Bu, S., and Zhang, Y. (2025). PE-TSFM: Self-supervised time- series learning for generalizable power converter health monitoring under unseen conditions. arXiv preprint arXiv:2511.08250. · arXiv
  35. Liu, C., Aksu, T., Liu, J., Liu, X., Yan, H., Pham, Q., Savarese, S., Sahoo, D., Xiong, C., and Li, J. (2025). Moirai 2.0: When less is more for time series forecasting. arXiv preprint arXiv:2511.11698. · arXiv
  36. Liu, Z., Mao, H., Wu, C.-Y., Feichtenhofer, C., Darrell, T., and Xie, S. (2022). A ConvNet for the 2020s. Proceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  37. Loshchilov, I., Hutter, F., et al. (2017). Fixing weight decay regularization in Adam. arXiv preprint arXiv:1711.05101, · arXiv
  38. Lubba, C. H., Sethi, S. S., Knaute, P., Schultz, S. R., Fulcher, B. D., and Jones, N. S. (2019). catch22: CAnonical Time- series CHaracteristics: Selected through highly compar- ative time-series analysis. Data mining and knowledge discovery, 33(6):1821-1852.
  39. Marks, M., Knott, M., Kondapaneni, N., Cole, E., Defraeye, T., Perez-Cruz, F., and Perona, P. (2025). A closer look at benchmarking self-supervised pre-training with image classification. International Journal of Computer Vision, 133(8):5013-5025.
  40. Morales, J. L. and Nocedal, J. (2011). Remark on "algo- rithm 778: L-BFGS-B: Fortran subroutines for large-scale bound constrained optimization". ACM Transactions on Mathematical Software (TOMS), 38(1):1-4.
  41. Moroshan, V., Siems, J., Zela, A., Carstensen, T., and Hutter, F. (2025). Tempopfn: Synthetic pre-training of linear rnns for zero-shot time series forecasting. arXiv preprint arXiv:2510.25502. · arXiv
  42. Oord, A. v. d., Li, Y., and Vinyals, O. (2018). Representa- tion learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748. · arXiv
  43. Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al. (2019). PyTorch: An imperative style, high- performance deep learning library. Advances in neural information processing systems, 32.
  44. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., et al. (2011). Scikit-learn: Ma- chine learning in Python. the Journal of machine Learn- ing research, 12:2825-2830.
  45. Radford, A., Kim, J. W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J., Krueger, G., and Sutskever, I. (2021). Learning transfer- able visual models from natural language supervision. In ICML.
  46. Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., and Liu, P. J. (2020). Ex- ploring the limits of transfer learning with a unified text- to-text transformer. Journal of machine learning research, 21(140):1-67.
  47. Rommel, C., Paillard, J., Moreau, T., and Gramfort, A. (2022). Data augmentation for learning predictive models on eeg: a systematic comparison. Journal of Neural Engineering, 19(6):066020.
  48. Roschmann, S., Bouniot, Q., Feofanov, V., Redko, I., and Akata, Z. (2025). Time series representations for classifi- cation lie hidden in pretrained vision transformers. arXiv preprint arXiv:2506.08641. · arXiv
  49. Schalk, G., McFarland, D. J., Hinterberger, T., Birbaumer, N., and Wolpaw, J. R. (2004). BCI2000: a general- purpose brain-computer interface (BCI) system. IEEE Transactions on biomedical engineering, 51(6):1034- 1043.
  50. Schuhmann, C., Beaumont, R., Vencu, R., Gordon, C. W., Wightman, R., Cherti, M., Coombes, T., Katta, A., Mullis, C., Wortsman, M., Schramowski, P., Kundurthy, S. R., Crowson, K., Schmidt, L., Kaczmarczyk, R., and Jitsev, J. (2022). LAION-5B: An open large-scale dataset for train- ing next generation image-text models. In Thirty-sixth Conference on Neural Information Processing Systems Datasets and Benchmarks Track.
  51. Serra, J., Pascual, S., and Karatzoglou, A. (2018). Towards a universal neural network encoder for time series. In Artificial Intelligence Research and Development, pages 120-129. IOS Press.
  52. Shazeer, N. (2020). GLU variants improve transformer. arXiv preprint arXiv:2002.05202. · arXiv
  53. Singh, A., Bevilacqua, A., Nguyen, T. L., Hu, F., McGuin- ness, K., O'Reilly, M., Whelan, D., Caulfield, B., and Ifrim, G. (2023). Fast and robust video-based exercise classification via body pose tracking and scalable multi- variate time series classifiers. Data Mining and Knowl- edge Discovery, 37(2):873-912.
  54. Skean, O., Arefin, M. R., Zhao, D., Patel, N., Naghiyev, J., LeCun, Y., and Shwartz-Ziv, R. (2025). Layer by layer: Uncovering hidden representations in language models. arXiv preprint arXiv:2502.02013. · arXiv
  55. Stisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., and Jensen, M. M. (2015). Smart devices are different: Assessing and miti- gatingmobile sensing heterogeneities for activity recog- nition. In Proceedings of the 13th ACM conference on embedded networked sensor systems, pages 127-140.
  56. Sungu Isiacik, P., Nguyen, T. L., Aderinola, T., and Ifrim, G. (2025). An empirical evaluation of foundation models for multivariate time series classification. In Joint Euro- pean Conference on Machine Learning and Knowledge Discovery in Databases, pages 3-21. Springer.
  57. Tanisaro, P. and Heidemann, G. (2016). Time series clas- sification using time warping invariant echo state net- works. In 2016 15th IEEE international conference on machine learning and applications (ICMLA), pages 831- 836. IEEE.
  58. Terzano, M. G., Parrino, L., Smerieri, A., Chervin, R., Chokroverty, S., Guilleminault, C., Hirshkowitz, M., Ma- howald, M., Moldofsky, H., Rosa, A., et al. (2002). Atlas, rules, and recording techniques for the scoring of cyclic alternating pattern (CAP) in human sleep. Sleep medicine, 3(2):187-199.
  59. Tonekaboni, S., Eytan, D., and Goldenberg, A. (2021). Unsupervised representation learning for time series with temporal neighborhood coding. arXiv preprint arXiv:2106.00750. · arXiv
  60. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L. u., and Polosukhin, I. (2017). Attention is all you need. In Guyon, I., Luxburg, U. V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R., editors, Advances in Neural Information Processing Systems, volume 30.
  61. Wang, J., Zhao, S., Luo, Z., Zhou, Y., Jiang, H., Li, S., Li, T., and Pan, G. (2024). CBraMod: A criss-cross brain foundation model for EEG decoding. arXiv preprint arXiv:2412.07236. · arXiv
  62. Wang, T. and Isola, P. (2020). Understanding contrastive rep- resentation learning through alignment and uniformity on the hypersphere. In International conference on machine learning, pages 9929-9939.
  63. PMLR.
  64. Wang, Z., Yan, W., and Oates, T. (2017). Time series classi- fication from scratch with deep neural networks: A strong baseline. In 2017 International joint conference on neural networks (IJCNN), pages 1578-1585. IEEE.
  65. Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M., Davison, J., Shleifer, S., von Platen, P., Ma, C., Jernite, Y., Plu, J., Xu, C., Scao, T. L., Gugger, S., Drame, M., Lhoest, Q., and Rush, A. M. (2020). Transformers: State- of-the-art natural language processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 38- 45, Online. Association for Computational Linguistics.
  66. Wong, S., Shankar, R., Albert, B., and Jones, G. D. (2025). Large language models surpass domain-specific architec- tures for antepartum electronic fetal monitoring analysis. arXiv preprint arXiv:2509.18112. · arXiv
  67. Wu, R. and Keogh, E. J. (2021). Current time series anomaly detection benchmarks are flawed and are creating the illusion of progress. IEEE transactions on knowledge and data engineering, 35(3):2421-2429.
  68. Xie, S., Feofanov, V., Zhang, J., Palpanas, T., and Redko, I. (2026). Cauker: Classification time series founda- tion models can be pretrained on synthetic data. In The Fourteenth International Conference on Learning Repre- sentations.
  69. Ye, H.-J., Liu, S.-Y., and Chao, W.-L. (2025). A closer look at TabPFN v2: Strength, limitation, and extension. arXiv preprint arXiv:2502.17361. · arXiv
  70. Yue, Z., Wang, Y., Duan, J., Yang, T., Huang, C., Tong, Y., and Xu, B. (2022). TS2Vec: Towards universal represen- tation of time series. Proceedings of the AAAI Conference on Artificial Intelligence, 36(8):8980-8987.
  71. Zhang, B. and Sennrich, R. (2019). Root mean square layer normalization. Advances in neural information processing systems, 32.
  72. Zhang, X., Zhao, Z., Tsiligkaridis, T., and Zitnik, M. (2022). Self-supervised contrastive pre-training for time series via time-frequency consistency. In Koyejo, S., Mohamed, S., Agarwal, A., Belgrave, D., Cho, K., and Oh, A., edi- tors, Advances in Neural Information Processing Systems, volume 35, pages 3988-4003.
  73. Zhao, B., Lu, H., Chen, S., Liu, J., and Wu, D. (2017). Convolutional neural networks for time series classifi- cation. Journal of systems engineering and electronics, 28(1):162-169.
  74. Zhou, T., Niu, P., Sun, L., Jin, R., et al. (2023). One fits all: Power general time series analysis by pretrained LM. Advances in neural information processing systems, 36:43322-43355.
  75. Zhu, C., Byrd, R. H., Lu, P., and Nocedal, J. (1997). Algo- rithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization. ACM Transactions on mathematical software (TOMS), 23(4):550-560.

Cited by

Sorted by citations

Metadata

Authors
Feofanov, V., Wen, S., Xie, S., Roschmann, S., Alonso, M., Guo, H., Ilbert, R., Tiomoko, M., Bouniot, Q., Akata, Z., Pan, L., Zhang, J., & Redko, I.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2025
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2502.15637
arXiv
2502.15637
OpenAlex
W6948129972
Cited by
1
References
0
Citations by year
2025: 1
Type
posted content
Language
en
Open access
Licence
Locations
  • arXiv (Cornell University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Physical Sciences › Computer Science › Signal Processing › Time Series Analysis and Forecasting
  • Physical Sciences › Computer Science › Signal Processing › Music and Audio Processing
  • Physical Sciences › Computer Science › Artificial Intelligence › Domain Adaptation and Few-Shot Learning
Keywords
time series classification, foundation models, transformer pre-training, synthetic data, self-supervised contrastive learning, tokenization, intermediate layer representations

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review