A Survey of Time Delay Estimation Performance Bounds
The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
In this paper we review performance bounds, as well as some current trends, in time delay estimation (TDE). Research over several decades reveals that a few key parameters determine TDE performance. The most basic are the signal-to-noise ratio (SNR), and the signal time-bandwidth (TB) product; larger values for each are desirable. The Cramer-Rao bound (CRB) reveals asymptotic maximum-likelihood estimation (MLE) behavior with respect to TB and SNR. At moderate to lower SNR, TDEs generally break down as ambiguities arise due to increased noise and the cross-correlation of the signal, causing the TDE to deviate (often quite sharply) away from the CRB. Because it is a local bound, the CRB does not indicate the threshold behavior, and Ziv-Zakai and other bounds have been developed to handle this. When TD is measured between multiple sensors, the coherence between them can fundamentally limit the result, an effect that occurs in acoustics due to the turbulent atmosphere. We discuss modifications to the classical bounds that accommodate the coherence loss, and reveal a threshold coherence phenomenon. When communications and other signals are utilized for TDE, they may have significant nuisance parameters, including carrier uncertainty, unknown symbols, as well as effects due to an unknown channel. Recent TDE performance limits reveal the effect of these parameters for various signal models, including the impact of diversity channels on TDE
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Citations
Cites
Fundamentals of Statistical Signal Processing: Estimation Theory
Sengijpta, S. K. (1995) · Technometrics · doi:10.1080/00401706.1995.10484391 · Cited by 11,076
Fundamentals of statistical signal processing: Estimation theory
Prasad, K. V. (1994) · Control Engineering Practice · doi:10.1016/0967-0661(94)90195-3 · Cited by 7,902
The generalized correlation method for estimation of time delay
Knapp, C., & Carter, G. (1976) · IEEE Transactions on Acoustics, Speech, and Signal Processing · doi:10.1109/tassp.1976.1162830 · Cited by 4,433
Locating the nodes: cooperative localization in wireless sensor networks
Patwari, N., Ash, J. N., Kyperountas, S., Hero, A. O., Moses, R. L., & Correal, N. S. (2005) · IEEE Signal Processing Magazine · doi:10.1109/msp.2005.1458287 · Cited by 3,031
Coherence and time delay estimation
Carter, G. C. (1987) · Proceedings of the IEEE · doi:10.1109/proc.1987.13723 · Cited by 1,200 · cited 4×
“, see [11], [6], and references therein.”
BackgroundInfluentialThe state of the art in underwater acoustic telemetry
Kilfoyle, D. B., & Baggeroer, A. B. (2000) · IEEE Journal of Oceanic Engineering · doi:10.1109/48.820733 · Cited by 1,073 · cited 1×
“, see [31] for an early analysis of the CRB on TDE with scattering, with more recent work in [5], [19] and elsewhere.”
BackgroundMcDonough, R. N., & WHALEN, A. D. (1971) · CERN Document Server (European Organization for Nuclear Research) · Cited by 1,041
Fundamentals of Statistical Signal Processing: Estimation Theory
Sengupta, S. K., & Kay, S. M. (1995) · Technometrics · doi:10.2307/1269750 · Cited by 901
(1971) · Elsevier eBooks · doi:10.1016/c2013-0-07634-7 · Cited by 894
A fundamental limit on delay estimation using partially correlated speckle signals
Walker, W. F., & Trahey, G. E. (1995) · IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control · doi:10.1109/58.365243 · Cited by 479 · cited 1×
“In medical ultrasonics (sounds in the MHz range propagating through living tissues), the CRB on TDE has been analyzed for partially correlated speckle signals [39], [7].”
Background
Research works printed but not linked: 2
- kozick, 2005, Signal Processing and Propagation for Aeroacoustic Sensor Networking, Distributed sensor networks, 225
- huang, 2006, Ziv-Zakai bound for ultra-wideband signals, IEEE International Conference on Ultra-Wideband
Cited by
Sahmoudi, M., & Amin, M. G. (2008) · IEEE Transactions on Wireless Communications · doi:10.1109/t-wc.2008.070700 · Cited by 90
“For the case of single path, the CRB expression is well established [18], [28].”
BackgroundNLOS mitigation in TOA-based localization using semidefinite programming
Vaghefi, R. M., Schloemann, J., & Buehrer, R. M. (2013) · Workshop on Positioning Navigation and Communication · doi:10.1109/wpnc.2013.6533288 · Cited by 80
“This variance in the TOA measurements is related to the captured signal-to-noise ratio (SNR) [1], [17].”
BackgroundTarget Localization Geometry Gain in Distributed MIMO Radar
Sadeghi, M., Behnia, F., Amiri, R., & Farina, A. (2021) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2021.3062197 · Cited by 73
“, the accuracy of time delay, depends on the transmitted signal bandwidth, signal to noise ratio at the receiver input, observation time and time delay estimation techniques [28], [29].”
BackgroundAsynchronous time-of-arrival-based source localization
Vaghefi, R. M., & Buehrer, R. M. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6638427 · Cited by 58
“Since the accuracy of TOA measurements is related to the received SNR [1] [23] which itself is a function to the distance and path-loss exponent [6] [24], the variance of ni is typically modeled as [22] σ 2 i = αd β i , (3) where α is a constant which defines the relationship between the noise variance and the true di…”
BackgroundPrecision Bounds in GNSS-R Ocean Altimetry
Pascual, D., Camps, A., Martín, F., Park, H., Alonso-Arroyo, A., & Onrubia, R. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2014.2303251 · Cited by 54
Performance of time delay estimation in a cognitive radar
Mishra, K. V., & Eldar, Y. C. (2017) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2017.7952735 · Cited by 51
“Other bounds that are tighter than the CRLB have been developed (see e.g. [20] for a survey).”
BackgroundZiv–Zakai Bounds on Time Delay Estimation in Unknown Convolutive Random Channels
Sadler, B. M., Liu, N., & Xu, Z. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2041379 · Cited by 37
“A survey of TDE bounds is given in [10].”
BackgroundMethodSelf-citationZiv-Zakai Time Delay Estimation Bound for Ultra-Wideband Signals
Sadler, B. M., Huang, L., & Xu, Z. (2007) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2007.366738 · Cited by 31
Self-citationOFDM-Based Multiband Sensing For ISAC: Resolution Limit, Algorithm Design, and Open Issues
Wan, Y., Hu, Z., Liu, A., Du, R. Y., Han, T. X., & Quek, T. Q. S. (2024) · IEEE Vehicular Technology Magazine · doi:10.1109/mvt.2024.3368205 · Cited by 27
“Using some classic global performance bounds to study the fundamental limits of multiband sensing may be a good choice, e.g., the Weiss–Weinstein and Ziv–Zakai bounds, which have been verified as tighter bounds than the CRB [15].”
BackgroundTime Delay Estimation Bounds in Convolutive Random Channels
Xu, Z., & Sadler, B. M. (2007) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2007.906581 · Cited by 23
“TDE is often analyzed in an additive white Gaussian noise (AWGN) channel, or for narrowband fading channels; e.g., see the survey in [ 7 ].”
BackgroundSelf-citationZiv-Zakai bound for time delay estimation of unknown deterministic signals
Decarli, N., & Dardari, D. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6854488 · Cited by 21
“INTRODUCTION Time delay estimation, also referred to as epoch estimation or time-of-arrival (TOA) estimation, is a classical signal processing problem with many applications such as synchronization, radar/sonar target distance estimate, and wireless localization [1–5].”
BackgroundStatistics of the MLE and Approximate Upper and Lower Bounds—Part I: Application to TOA Estimation
Mallat, A., Gezici, S., Dardari, D., Craeye, C., & Vandendorpe, L. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2014.2355771 · Cited by 22
Decentralized Picosecond Synchronization for Distributed Wireless Systems
Shandi, N., Merlo, J. M., & Nanzer, J. A. (2024) · IEEE Transactions on Communications · doi:10.1109/tcomm.2024.3480993 · Cited by 21
“An extensive survey can be found in [44], which also discusses how the classical estimation bounds can be modified in order to accommodate the coherence loss and reveal a threshold coherence phenomenon.”
Liu, N., Xu, Z., & Sadler, B. M. (2010) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2010.2068547 · Cited by 17
“Various TDE bounds have been developed [1], and the Ziv–Zakai lower bound (ZZB) [2], [3] is among the best mean-square-error (MSE) bounds for predicting optimal estimation performance over a wide range of signal-to-noise ratios (SNRs), e.”
BackgroundSelf-citationSahmoudi, M., & Amin, M. G. (2006) · Asilomar Conference on Signals, Systems and Computers (ACSSC) · doi:10.1109/acssc.2006.354814 · Cited by 17
Accuracy Bounds for Array-Based Positioning in Dense Multipath Channels
Wilding, T., Grebien, S., Mühlmann, U., & Witrisal, K. (2018) · Sensors · doi:10.3390/s18124249 · Cited by 16
“Regarding the waveform-based class, a generic overview of different bounds is given in [15] and specifically for time-delay-estimation in [16].”
BackgroundChoi, J., & Choi, H. (2015) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.1109/oceans-genova.2015.7271437 · Cited by 18
Low-complexity PDoA-based localization
Sackenreuter, B., Hadaschik, N., Fassbinder, M., & Mutschler, C. (2016) · International Conference on Indoor Positioning and Indoor Navigation · doi:10.1109/ipin.2016.7743692 · Cited by 14
“However, the typically high bandwidth signals for accurate localization [3] contradict the objective of low-cost and low-power devices for the IoT.”
BackgroundMultipath exploited Bayesian and Cramér-Rao bounds for single-sensor target localization
Setlur, P., & Devroye, N. (2013) · EURASIP Journal on Advances in Signal Processing · doi:10.1186/1687-6180-2013-53 · Cited by 14
A General Class of Outage Error Probability Lower Bounds in Bayesian Parameter Estimation
Routtenberg, T., & Tabrikian, J. (2012) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2012.2187523 · Cited by 14
“Closed-form expressions and approximation of the integrals in (57)–(58) can be derived in similar to ZZLB [37].”
BackgroundOn the Accuracy Limit of Time-delay Estimation with a Band-limited Signal
Das, P. S., Vilà‐Valls, J., Chaumette, É., Vincent, F., Davain, L., & Bonnabel, S. (2019) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2019.8682948 · Cited by 13
“Even if several time-delay estimation CRB expressions have been already derived for different applications [17–21], an easy to use compact CRB for band-limited signals is not available, whereas a compact CRB for infinite bandwidth signals has already been given in [22].”
MethodAcoustic Source Localization in a Room Environment and at Moderate Distances
Pertila, P. E. (2009) · Tampere University Institutional Repository (Tampere University) · Cited by 20
Bayesian and Cramér-Rao bounds for single sensor target localization via multipath exploitation
Setlur, P., & Devroye, N. (2013) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2013.6638785 · Cited by 12
Leakage detection using leak noise correlation techniques
Glentis, G.-O., & Angelopoulos, K. (2019) · Panhellenic Conference on Informatics · doi:10.1145/3368640.3368646 · Cited by 12
“Techniques based on the TDE have long been used to locate and track the position of a signal source, [6, 9, 12, 15, 16, 28, 33, 39, 61, 68, 69, 74, 75].”
MethodValenzise, G., Prandi, G., Tagliasacchi, M., & Sarti, A. (2008) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2008.4518176 · Cited by 9
“In our work we take into account the influence of the SNR on TDOA estimation variance [10], considering only high SNRs.”
MethodMinimum Variance Signal Selection for Aorta Radius Estimation Using Radar
Solberg, L. E., Hamran, S., Berger, T., & Balasingham, I. (2010) · EURASIP Journal on Advances in Signal Processing · doi:10.1155/2010/682037 · Cited by 8
“The survey in [16] provides an overview of lower bounds in timedelay estimation.”
BackgroundSensor fusion by a novel algorithm for time delay estimation
Terry, A. J., Zaman, M., & Illingworth, J. (2012) · Digital Signal Processing · doi:10.1016/j.dsp.2012.01.005 · Cited by 8
“time delay estimation problems, many methods or algorithms have been created to help carry out such estimation [15].”
MethodImproving mobile node tracking performance in NLOS environments using cooperation
Vaghefi, R. M., Amuru, S., & Buehrer, R. M. (2015) · International Conference on Communications · doi:10.1109/icc.2015.7249376 · Cited by 7
“This variance in the TOA measurements is related to the captured signal-to-noise ratio (SNR) [17] which is a function of the distance and path-loss exponent [18].”
BackgroundTime-of-Flight Estimation in the Presence of Outliers Part I—Single Echo Processing
Apartsin, A., Cooper, L. N., & Intrator, N. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2272737 · Cited by 8
Semi-coherent time of arrival estimation using regression
Apartsin, A., Cooper, L. N., & Intrator, N. (2012) · The Journal of the Acoustical Society of America · doi:10.1121/1.4730885 · Cited by 6
“The 1d factor is used to account for all non-free space propagation losses (e.g. attenuation of the signal in the medium).”
MethodReal-time acoustic source localization for autonomous navigation of underwater vehicles
Choi, J., & Choi, H. (2014) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.1109/oceans.2014.7003076 · Cited by 6
“For this purpose, many researchers have developed various methods to estimate TDOA [6]–[8].”
MethodEKF SLAM using acoustic sources for autonomous underwater vehicle equipped with two hydrophones
Choi, J., Lee, Y., Kim, T., Jung, J., & Choi, H. (2016) · MTS/IEEE OCEANS Conference (OCEANS) · doi:10.1109/oceans.2016.7761439 · Cited by 7
An Adaptive Time Delay Estimator Based on ETDE Algorithm with Noisy Measurements
Xia, W., Jiang, W., & Zhu, L. (2017) · Chinese Journal of Electronics · doi:10.1049/cje.2017.04.011 · Cited by 6
Performance of time delay estimation in a cognitive radarPreprint
Mishra, K. V., & Eldar, Y. C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1701.03898 · Cited by 6
“Other bounds that are tighter than the CRLB have been developed (see e.g. [20] for a survey).”
BackgroundYin, M., Zhu, W., Bao, M., Gao, Y., Wang, Z., & Zhao, J. (2022) · Applied Acoustics · doi:10.1016/j.apacoust.2022.108963 · Cited by 5
Time-of-Flight Estimation in the Presence of Outliers. Part II—Multiple Echo Processing
Apartsin, A., Cooper, L. N., & Intrator, N. (2013) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2013.2276919 · Cited by 5
Ziv-Zakai bound on time delay estimation in unknown convolutive random channels
Sadler, B. M., Liu, N., & Xu, Z. (2008) · IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM) · doi:10.1109/sam.2008.4606897 · Cited by 5
“in additive white Gaussian noise (AWGN) channels, or narrowband fading channels, is given in [ 6 ].”
Self-citationBIOSONAR-INSPIRED SOURCE LOCALIZATION IN LOW SNR
Apartsin, S., Cooper, L. N., & Intrator, N. (2011) · International Conference on Bio-inspired Systems and Signal Processing · doi:10.5220/0003126803990404 · Cited by 4
Angelopoulos, K., & Glentis, G.-O. (2019) · Panhellenic Conference on Electronics & Telecommunications (PACET) · doi:10.1109/pacet48583.2019.8956255 · Cited by 4
Mallat, A., Gezici, S., Dardari, D., & Vandendorpe, L. (2014) · IEEE Transactions on Signal Processing · doi:10.1109/tsp.2014.2355776 · Cited by 5
“NONLINEAR deterministic parameter estimation is subject to the threshold effect Ziv and Zakai [1969], Chow and Schultheiss [1981], Weiss and Weinstein [1983], Weinstein and Weiss [1984], Zeira and Schultheiss [1993, 1994], Sadler and Kozick [2006], Sadler et al. [2007]. Due to this effect the signal-to-noise ratio (SN…”
BackgroundA TDOA sequence estimation method of underwater sound source based on hidden Markov model
Feng, M., Fang, S., Zhu, C., An, L., Gu, Z., Cao, W., & Cao, H. (2024) · Applied Acoustics · doi:10.1016/j.apacoust.2024.110238 · Cited by 3
On The Accuracy Limit of Joint Time-Delay/Doppler/Acceleration Estimation with a Band-Limited Signal
McPhee, H., Ortega, L., Vilà‐Valls, J., & Chaumette, É. (2021) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp39728.2021.9414270 · Cited by 3
Target localization in passive and active systems: Performance bounds
Chiriac, V. M. (2012) · Cited by 3
An enhanced mixed modulated Lagrange explicit time delay estimator with noisy input
Xia, W., Zhu, J., Jiang, W., & Zhu, L. (2016) · Frontiers of Information Technology & Electronic Engineering · doi:10.1631/fitee.1500417 · Cited by 3
“Recently, TDE has attracted renewed attention in the context of wireless sensor networks (Jamalabdollahi and Zekavat, 2015), as well as geolocation of mobile ad-hoc network nodes (Patwari et al., 2005; Sadler and Kozick, 2006).”
BackgroundInfluentialDuplicate false targets discrimination for mainlobe jamming cancellation in multistatic radar
Yang, Y., Su, H., Huang, J., Hu, Q., & Zhou, S. (2017) · IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC) · doi:10.1109/icspcc.2017.8242502 · Cited by 3
“Assume that range is the only unknown target parameter, then the error in the TOA estimation of the targets through the matched filtering is normally distributed with the variance given by [7]”
MethodEnergy-Efficient Time-of-Flight Estimation in the Presence of Outliers: A Machine Learning Approach
Apartsin, A., Cooper, L. N., & Intrator, N. (2014) · IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing · doi:10.1109/jstars.2013.2295324 · Cited by 2
Performance Bounds of UWB TOA Estimation in Presence of Wi-Fi 6E Wideband Interference
Hechenberger, S., Tertinek, S., & Arthaber, H. (2024) · International Conference on Indoor Positioning and Indoor Navigation · doi:10.1109/ipin62893.2024.10786151 · Cited by 2
“B u is the bandwidth of the interference signal and f u is the carrier frequency offset between the Wi-Fi and the UWB signal. bounds are frequently used in literature [8]–[10], where the Cram ´ er-Rao lower bound (CRLB) is arguably the most common.”
Analog transmit signal optimization for undersampled delay-Doppler estimation
Lenz, A., Stein, M. S., & Swindlehurst, A. L. (2017) · European Signal Processing Conference (EUSIPCO) · doi:10.23919/eusipco.2017.8081399 · Cited by 2
Radar based central blood pressure estimation
Solberg, L. E. (2016) · NORA - Norwegian Open Research Archives · Cited by 2
A frequency domain approach to synchronization of filterbank multicarrier systems in practice
Thein, C. (2015) · Institutional Repository of Leibniz Universität Hannover (Leibniz Universität Hannover) · doi:10.15488/8586 · Cited by 2
AN EXPERIMENTAL COMPARISON OF TIME DELAY WEIGHTS FOR DIRECTION OF ARRIVAL ESTIMATION
Pirinen, T. W. (2008) · Cited by 1
Wideband TDoA Positioning Exploiting RSS-Based Clustering
Fuchs, A., Wielandner, L., Neunteufel, D., Arthaber, H., & Witrisal, K. (2023) · Sensors · doi:10.3390/s23125772 · Cited by 1
Ziv-Zakai bound for rate-constrained time-delay estimation in a wireless sensor network
Srinivasan, S. (2010) · International Conference on Information Fusion (FUSION) · doi:10.1109/icif.2010.5712069
Performance of time delay estimation and range-based localization in wireless channels
Liu, N. (2010) · eScholarship (California Digital Library)
Sadler, B. M., Liu, N., & Xu, Z. (2010) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2010.5496276
“Various performance bounds have been developed for TDE performance [1], and the Ziv-Zakai bound (ZZB) [2] is among the best mean-square-error (MSE) bounds for predicting optimal estimation performance over a wide range of signal-to-noise ratios (SNRs); e.”
BackgroundSelf-citationAnalysis of signal bandwith effect on the performance of passive TDOA Estimation
Basciftci, C. H., & Balaban, H. S. (2011) · Signal Processing and Communications Applications Conference (SIU) · doi:10.1109/siu.2011.5929660
Time Delay Estimation Bounds in Wideband Random Channels
Xu, Z., & Sadler, B. M. (2007) · IEEE Military Communications Conference (MILCOM) · doi:10.1109/milcom.2007.4454972
“TDE is often analyzed in an additive white Gaussian noise (AWGN) channel, or for narrowband fading channels; e.g., see the survey in [ 4 ].”
BackgroundSelf-citationCramér-Rao bounds for rate-constrained distributed time-delay estimation
Srinivasan, S. (2010) · International Symposium on Communications, Control and Signal Processing · doi:10.1109/isccsp.2010.5463462 · Cited by 3
ZIV-ZAKAI BOUND ON TIME DELAY ESTIMATIONIN UNKNOWNCONVOLUTIVE RANDOM CHANNELS
Sadler, B. M., & Liu, N. (2008)
Self-citationChin, P. A., Roan, M. J., Leonessa, A., & Papenfuss, C. (2012) · VTechWorks (Virginia Tech)
Source localization via time difference of arrival
Comsa, C. R. (2012)
Metadata
- Authors
- Sadler, B. M., & Kozick, R. J.
- Affiliations
- DEVCOM Army Research Laboratory (US)
- Bucknell University (US)
- Venue
- Fourth IEEE Workshop on Sensor Array and Multichannel Processing, 2006.
- Publisher
- IEEE
- Published
- 2006-09-08
- Pages
- 282-288
- ISSN
- 1551-2282 (ISSN-L)
- OpenAlex
- W2139689000
- Semantic Scholar
- 307909a9c59bc674b36b5a3613279b971796ef26
- Cited by
- 62
- References
- 59
- Citations by year
- 2026: 1 · 2024: 4 · 2023: 1 · 2022: 1 · 2021: 2 · 2019: 3 · 2018: 1 · 2017: 5 · 2016: 4 · 2015: 3 · 2014: 6 · 2013: 6 · 2012: 6
- FWCI
- 6.08
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM) (publishedVersion)
- Topics
- Physical Sciences › Engineering › Aerospace Engineering › Radar Systems and Signal Processing
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Indoor and Outdoor Localization Technologies
- Physical Sciences › Computer Science › Signal Processing › Direction-of-Arrival Estimation Techniques
- Keywords
- time delay estimation, performance bounds, Cramer-Rao lower bound, Ziv-Zakai bound, signal-to-noise ratio, time-bandwidth product, nuisance parameters, unknown channel, maximum likelihood estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.