Smart Devices are Different: Assessing and MitigatingMobile Sensing Heterogeneities for Activity Recognition
The DOI matches its Crossref record; 48 of the 49 references it cites were found in a registry or an index.
Abstract
The widespread presence of motion sensors on users' personal mobile devices has spawned a growing research interest in human activity recognition (HAR). However, when deployed at a large-scale, e.g., on multiple devices, the performance of a HAR system is often significantly lower than in reported research results. This is due to variations in training and test device hardware and their operating system characteristics among others. In this paper, we systematically investigate sensor-, device- and workload-specific heterogeneities using 36 smartphones and smartwatches, consisting of 13 different device models from four manufacturers. Furthermore, we conduct experiments with nine users and investigate popular feature representation and classification techniques in HAR research. Our results indicate that on-device sensor and sensor handling heterogeneities impair HAR performances significantly. Moreover, the impairments vary significantly across devices and depends on the type of recognition technique used. We systematically evaluate the effect of mobile sensing heterogeneities on HAR and propose a novel clustering-based mitigation technique suitable for large-scale deployment of HAR, where heterogeneity of devices and their usage scenarios are intrinsic.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Stisen et al. [179] demonstrate the problem of sensing heterogeneities in HAR, showcasing how the same movements recorded at identical locations but with different sensors result in vastly different sensor readings.”
From Past, Present, and Future of Sensor-based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task (2025) · cites this paper as Stisen et al. [179]
In the citing paper
“This fragmentation stems from varying sensor characteristics across devices (e.g., watches, phones, wristbands), placement-dependent data variations, diverse sensing specifications [38,41,43], and inconsistent activity taxonomies [43].”
From Towards Customizable Foundation Models for Human Activity Recognition with Wearable Devices (2025) · cites this paper as [43]
In the citing paper
“The diversity in sensing conditions, including device types [43], placements [5], and user demographics [38] coupled with rapidly evolving sensing technologies and emerging activity types, makes it impractical to collect comprehensive datasets for every scenario.”
From Towards Customizable Foundation Models for Human Activity Recognition with Wearable Devices (2025) · cites this paper as [43]
In the citing paper
“In total, nine participants performed scripted activities for 5 minutes, ensuring an equal distribution of categories.”
From TS2ACT: Few-Shot Human Activity Sensing with Cross-Modal Co-Learning (2023) · cites this paper as [46]
In the citing paper
“The dataset covers a diverse set of devices, including 36 smart devices of 13 models from 4 manufacturers, with varying sampling rates to accommodate heterogeneous data.”
From TS2ACT: Few-Shot Human Activity Sensing with Cross-Modal Co-Learning (2023) · cites this paper as [46]
3 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Pattern Recognition and Machine Learning
(2006) · doi:10.1007/978-0-387-45528-0 · Cited by 9,824
Pattern Recognition and Machine Learning
(2007) · Kybernetes · doi:10.1108/03684920710743466 · Cited by 8,265
(2006) · Springer eBooks · Cited by 8,123
Clustering by Passing Messages Between Data Points
Frey, B. J., & Dueck, D. (2007) · Science · doi:10.1126/science.1136800 · Cited by 6,758 · cited 1×
“To this end, we chose an affinity propagation clustering algorithm [21].”
MethodNote on the Sampling Error of the Difference Between Correlated Proportions or Percentages
McNemar, Q. (1947) · Psychometrika · doi:10.1007/bf02295996 · Cited by 4,754 · cited 1×
“Lastly, we perform statistical testing to measure variations in recognition performances using the McNemar χ(2)-tests with Yates’ correction [35].”
MethodActivity Recognition from User-Annotated Acceleration Data
Bao, L., & Intille, S. S. (2004) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-24646-6_1 · Cited by 3,147 · cited 1×
“Accelerometer-based HAR has been deployed in a large number of domains including smart homes [5, 32, 38], health care [31, 37], daily activity tracking [29], fitness tracking [16], fall detection of elderly people [18] and transportation mode detection [9, 24, 42].”
BackgroundActivity recognition using cell phone accelerometers
Kwapisz, J. R., Weiss, G. M., & Moore, S. A. (2011) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1964897.1964918 · Cited by 2,912 · cited 2×
“selected activity classes (or a subset of them) have been investigated prominently in a large number of HAR publications [10, 11, 14, 27, 29, 41, 47].”
BackgroundA survey of mobile phone sensing
Lane, N., Miluzzo, E., Lu, H., Peebles, D., Choudhury, T., & Campbell, A. (2010) · IEEE Communications Magazine · doi:10.1109/mcom.2010.5560598 · Cited by 2,292 · cited 4×
“Motion sensors can be further paired with sensors, e.g., GPS, GSM, WiFi, and barometer, especially for recognizing tasks beyond basic HAR.”
BackgroundInfluentialA tutorial on human activity recognition using body-worn inertial sensors
Bulling, A., Blanke, U., & Schiele, B. (2014) · ACM Computing Surveys · doi:10.1145/2499621 · Cited by 1,668 · cited 8×
“A typical ARC for HAR is composed of five stages: (i) data collection, (ii) pre-processing, (iii) segmentation, (iv) feature extraction and (v) classification.”
BackgroundInfluentialUsing mobile phones to determine transportation modes
Reddy, S., Mun, M., Burke, J., Estrin, D., Hansen, M., & Srivastava, M. (2010) · ACM Transactions on Sensor Networks · doi:10.1145/1689239.1689243 · Cited by 852 · cited 1×
“Accelerometer-based HAR has been deployed in a large number of domains including smart homes [5, 32, 38], health care [31, 37], daily activity tracking [29], fitness tracking [16], fall detection of elderly people [18] and transportation mode detection [9, 24, 42].”
BackgroundActivity Classification Using Realistic Data From Wearable Sensors
Parkka, J., Ermes, M., Korpipaa, P., Mantyjarvi, J., Peltola, J., & Korhonen, I. (2006) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2005.856863 · Cited by 760 · cited 1×
“Accelerometer-based HAR has been deployed in a large number of domains including smart homes [5, 32, 38], health care [31, 37], daily activity tracking [29], fitness tracking [16], fall detection of elderly people [18] and transportation mode detection [9, 24, 42].”
BackgroundPreprocessing techniques for context recognition from accelerometer data
Figo, D., Diniz, P. C., Ferreira, D. R., & Cardoso, J. M. P. (2010) · Personal and Ubiquitous Computing · doi:10.1007/s00779-010-0293-9 · Cited by 578 · cited 2×
“More specifically, we used all time- and frequency domain features, as listed in Table 2 and 3 of [20], respectively, with the exception of the cross-time/frequency-domain Wavelet feature.”
MethodPreece, S. J., Goulermas, J. Y., Kenney, L. P. J., & Howard, D. (2009) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2008.2006190 · Cited by 551 · cited 1×
“selected activity classes (or a subset of them) have been investigated prominently in a large number of HAR publications [10, 11, 14, 27, 29, 41, 47].”
BackgroundA Practical Approach to Recognizing Physical Activities
Lester, J., Choudhury, T., & Borriello, G. (2006) · Lecture Notes in Computer Science · doi:10.1007/11748625_1 · Cited by 464 · cited 1×
“Accelerometer-based HAR has been deployed in a large number of domains including smart homes [5, 32, 38], health care [31, 37], daily activity tracking [29], fitness tracking [16], fall detection of elderly people [18] and transportation mode detection [9, 24, 42].”
BackgroundAccelerometer-based transportation mode detection on smartphones
Hemminki, S., Nurmi, P., & Tarkoma, S. (2013) · Proceedings of the 11th ACM Conference on Embedded Networked Sensor Systems · doi:10.1145/2517351.2517367 · Cited by 435 · cited 1×
“Accelerometer-based HAR has been deployed in a large number of domains including smart homes [5, 32, 38], health care [31, 37], daily activity tracking [29], fitness tracking [16], fall detection of elderly people [18] and transportation mode detection [9, 24, 42].”
BackgroundActivity recognition with smartphone sensors
Su, X., Tong, H., & Ji, P. (2014) · Tsinghua Science and Technology · doi:10.1109/tst.2014.6838194 · Cited by 383 · cited 3×
“Motion sensors can be further paired with sensors, e.g., GPS, GSM, WiFi, and barometer, especially for recognizing tasks beyond basic HAR.”
BackgroundA Long-Term Evaluation of Sensing Modalities for Activity Recognition
Logan, B., Healey, J., Philipose, M., Tapia, E. M., & Intille, S. S. (2007) · Cited by 342
Feature Learning for Activity Recognition in Ubiquitous Computing
Plötz, T., Hammerla, N., & Olivier, P. (2011) · Newcastle University · doi:10.25405/ncl.34175319 · Cited by 337
Yang, J. (2009) · Proceedings of the 1st international workshop on Interactive multimedia for consumer electronics · doi:10.1145/1631040.1631042 · Cited by 315 · cited 1×
“selected activity classes (or a subset of them) have been investigated prominently in a large number of HAR publications [10, 11, 14, 27, 29, 41, 47].”
BackgroundActivity Recognition from Accelerometer Data on a Mobile Phone
Brezmes, T., Gorricho, J.-L., & Cotrina, J. (2009) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-02481-8_120 · Cited by 294 · cited 1×
“selected activity classes (or a subset of them) have been investigated prominently in a large number of HAR publications [10, 11, 14, 27, 29, 41, 47].”
BackgroundAccelPrint: Imperfections of Accelerometers Make Smartphones Trackable
Dey, S., Roy, N., Xu, W., Choudhury, R. R., & Nelakuditi, S. (2014) · Proceedings 2014 Network and Distributed System Security Symposium · doi:10.14722/ndss.2014.23059 · Cited by 263 · cited 1×
“accelerometer fingerprint, which the authors define via its biases and variations [19].”
BackgroundSun, L., Zhang, D., Li, B., Guo, B., & Li, S. (2010) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-16355-5_42 · Cited by 251 · cited 2×
“, body motion approximations aimed at on-body sensor setups [28], gravity vector estimation techniques for smartphones [25], as well as the training of several classifiers each associated with an individual phone orientation and/or placement, often combined with algorithms for identifying this context information from…”
BackgroundOnline Detection of Freezing of Gait with Smartphones and Machine Learning Techniques
Mazilu, S., Hardegger, M., Zhu, Z., Roggen, D., Troester, G., Plotnik, M., & Hausdorff, J. (2012) · Proceedings of the 6th International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2012.248680 · Cited by 231 · cited 1×
“, for detecting freezing of gait in patients with Parkinson’s disease [34].”
BackgroundRecognizing Human Activities User-independently on Smartphones Based on Accelerometer Data
Siirtola, P., & Röning, J. (2012) · International Journal of Interactive Multimedia and Artificial Intelligence · doi:10.9781/ijimai.2012.155 · Cited by 206 · cited 1×
“The severe HAR accuracy impairments these can cause have been investigated, initially for on-body-sensors but increasingly also for phones [3, 6, 9, 17, 25, 28, 44, 46].”
BackgroundProcedure for in-use calibration of triaxial accelerometers in medical applications
Lötters, J. C., Schipper, J., Veltink, P. H., Olthuis, W., & Bergveld, P. (1998) · Sensors and Actuators A: Physical · doi:10.1016/s0924-4247(98)00049-1 · Cited by 203 · cited 1×
“proposed an online calibration method to mitigate accelerometer drift and offset over a long period of time [33].”
MethodMOPET: A context-aware and user-adaptive wearable system for fitness training
Buttussi, F., & Chittaro, L. (2008) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2007.11.004 · Cited by 171 · cited 1×
“Accelerometer-based HAR has been deployed in a large number of domains including smart homes [5, 32, 38], health care [31, 37], daily activity tracking [29], fitness tracking [16], fall detection of elderly people [18] and transportation mode detection [9, 24, 42].”
BackgroundDealing with sensor displacement in motion-based onbody activity recognition systems
Kunze, K., & Lukowicz, P. (2008) · Proceedings of the 10th international conference on Ubiquitous computing · doi:10.1145/1409635.1409639 · Cited by 161 · cited 2×
“, body motion approximations aimed at on-body sensor setups [28], gravity vector estimation techniques for smartphones [25], as well as the training of several classifiers each associated with an individual phone orientation and/or placement, often combined with algorithms for identifying this context information from…”
BackgroundMobile phone-based pervasive fall detection
Dai, J., Bai, X., Yang, Z., Shen, Z., & Dong, X. (2010) · Personal and Ubiquitous Computing · doi:10.1007/s00779-010-0292-x · Cited by 160 · cited 1×
“Accelerometer-based HAR has been deployed in a large number of domains including smart homes [5, 32, 38], health care [31, 37], daily activity tracking [29], fitness tracking [16], fall detection of elderly people [18] and transportation mode detection [9, 24, 42].”
BackgroundSensor Fusion and Calibration of Inertial Sensors, Vision, Ultra-Wideband and GPS
Hol, J. D. (2011) · DiVA (Linkoping University) · Cited by 149
Hammerla, N. Y., Kirkham, R., Andras, P., & Ploetz, T. (2013) · Proceedings of the 2013 International Symposium on Wearable Computers · doi:10.1145/2493988.2494353 · Cited by 138 · cited 14×
“However, the ECDF features require setting a parameter value, namely the number of bins used in the inverse function computation.”
BackgroundMethodInfluentialUsing Mobile Phones for Activity Recognition in Parkinson’s Patients
Albert, M. V., Toledo, S., Shapiro, M., & Kording, K. (2012) · Frontiers in Neurology · doi:10.3389/fneur.2012.00158 · Cited by 126 · cited 1×
“[1] show that the accelerometer sampling rate on T-mobile G1 phones running Android varies between 15−25 Hz.”
BackgroundUsing unlabeled data in a sparse-coding framework for human activity recognition
Bhattacharya, S., Nurmi, P., Hammerla, N., & Plötz, T. (2014) · Pervasive and Mobile Computing · doi:10.1016/j.pmcj.2014.05.006 · Cited by 121
Self-citationAccurate Activity Recognition Using a Mobile Phone Regardless of Device Orientation and Location
Henpraserttae, A., Thiemjarus, S., & Marukatat, S. (2011) · 2011 International Conference on Body Sensor Networks · doi:10.1109/bsn.2011.8 · Cited by 113 · cited 2×
“, body motion approximations aimed at on-body sensor setups [28], gravity vector estimation techniques for smartphones [25], as well as the training of several classifiers each associated with an individual phone orientation and/or placement, often combined with algorithms for identifying this context information from…”
BackgroundBenchmarking classification techniques using the Opportunity human activity dataset
Sagha, H., Digumarti, S. T., del R. Millan, J., Chavarriaga, R., Calatroni, A., Roggen, D., & Troster, G. (2011) · 2011 IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2011.6083628 · Cited by 109 · cited 1×
“Moreover, in line with standard practices in HAR research [9, 43], we report the weighted average of the individual F1-scores of all classes, which is more resilient to class imbalances in the test dataset, i.”
Hand, belt, pocket or bag: Practical activity tracking with mobile phones
Antos, S. A., Albert, M. V., & Kording, K. P. (2013) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2013.09.015 · Cited by 96
Activity Recognition for Everyday Life on Mobile Phones
Bieber, G., Voskamp, J., & Urban, B. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-02710-9_32 · Cited by 90 · cited 2×
“selected activity classes (or a subset of them) have been investigated prominently in a large number of HAR publications [10, 11, 14, 27, 29, 41, 47].”
BackgroundBatista, P., Silvestre, C., Oliveira, P., & Cardeira, B. (2010) · IEEE Transactions on Control Systems Technology · doi:10.1109/tcst.2010.2076321 · Cited by 88 · cited 1×
“also proposed a calibration technique, based on time-varying Kalman filtering and gravity estimation, for estimating biases observed on micro-electrical-mechanicalsystems accelerometers (tri-axial) [7].”
MethodSlice&Dice: Recognizing Food Preparation Activities Using Embedded Accelerometers
Pham, C., & Olivier, P. L. (2009) · Lecture notes in computer science · doi:10.1007/978-3-642-05408-2_4 · Cited by 84 · cited 1×
“Accelerometer-based HAR has been deployed in a large number of domains including smart homes [5, 32, 38], health care [31, 37], daily activity tracking [29], fitness tracking [16], fall detection of elderly people [18] and transportation mode detection [9, 24, 42].”
BackgroundRecognizing User Context Using Mobile Handsets with Acceleration Sensors
Kawahara, Y., Kurasawa, H., & Morikawa, H. (2007) · IEEE International Conference on Portable Information Devices (PORTABLE) · doi:10.1109/portable.2007.12 · Cited by 61 · cited 1×
“selected activity classes (or a subset of them) have been investigated prominently in a large number of HAR publications [10, 11, 14, 27, 29, 41, 47].”
BackgroundAnalysis, modeling and compensation of bias drift in MEMS inertial sensors
Gulmammadov, F. (2009) · International Conference on Recent Advances in Space Technologies · doi:10.1109/rast.2009.5158260 · Cited by 53 · cited 1×
“Gulmammadov also studied the accelerometer bias drifts, in the domain of aerospace engineering, and modeled bias as a combination of time and temperature dependent variables [22].”
BackgroundExtreme learning machine-based device displacement free activity recognition model
Chen, Y., Zhao, Z., Wang, S., & Chen, Z. (2012) · Soft Computing · doi:10.1007/s00500-012-0822-8 · Cited by 47 · cited 2×
“, body motion approximations aimed at on-body sensor setups [28], gravity vector estimation techniques for smartphones [25], as well as the training of several classifiers each associated with an individual phone orientation and/or placement, often combined with algorithms for identifying this context information from…”
BackgroundEvaluation of gyroscope-embedded mobile phones
Barthold, C., Subbu, K. P., & Dantu, R. (2011) · Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics · doi:10.1109/icsmc.2011.6083905 · Cited by 41 · cited 2×
“studied the influence of heavy magnetic environments and motion on gyroscopebased orientation estimations [6].”
BackgroundRobust and Energy-Efficient Trajectory Tracking for Mobile Devices
Bhattacharya, S., Blunck, H., Kjærgaard, M. B., & Nurmi, P. (2014) · IEEE Transactions on Mobile Computing · doi:10.1109/tmc.2014.2318712 · Cited by 39 · cited 2×
“The accelerometer has gained immense popularity in HAR research as it allows recognizing a wide variety of human activities, while having a relatively small energy footprint [8].”
BackgroundSelf-citationActivity Recognition and Healthier Food Preparation
Plötz, T., Moynihan, P., Pham, C., & Olivier, P. (2011) · Atlantis Ambient and Pervasive Intelligence · doi:10.2991/978-94-91216-05-3_14 · Cited by 39
On heterogeneity in mobile sensing applications aiming at representative data collection
Blunck, H., Bouvin, N. O., Franke, T., Grønbæk, K., Kjaergaard, M. B., Lukowicz, P., & Wüstenberg, M. (2013) · Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication · doi:10.1145/2494091.2499576 · Cited by 37 · cited 2×
“[13] give a taxonomy of device-, user- and project-specific heterogeneities and sketch challenges for mobile app development and deployment projects.”
BackgroundSelf-citationMobile physical activity recognition of stand-up and sit-down transitions for user behavior analysis
Bieber, G., Koldrack, P., Sablowski, C., Peter, C., & Urban, B. (2010) · International Conference on PErvasive Technologies Related to Assistive Environments (PETRA) · doi:10.1145/1839294.1839354 · Cited by 36 · cited 1×
“selected activity classes (or a subset of them) have been investigated prominently in a large number of HAR publications [10, 11, 14, 27, 29, 41, 47].”
BackgroundBanos, O., Calatroni, A., Damas, M., Pomares, H., Rojas, I., Sagha, H., del R. Mill´n, J., Troster, G., Chavarriaga, R., & Roggen, D. (2012) · 2012 16th International Symposium on Wearable Computers · doi:10.1109/iswc.2012.17 · Cited by 33
On the need for quality standards in activity recognition using ubiquitous sensors
Amft, O. O. (2010) · TU/e Research Portal · Cited by 10
Research works printed but not linked: 3
- 10.5555/1771592.1771620 · doi:10.5555/1771592.1771620
- 10.5555/2283516.2283683 · doi:10.5555/2283516.2283683
- 10.5555/1929661.1929712 · doi:10.5555/1929661.1929712
Cited by
A Survey of Deep Active Learning
Ren, P., Xiao, Y., Chang, X., Huang, P.-Y., Li, Z., Gupta, B. B., Chen, X., & Wang, X. (2022) · ACM Computing Surveys · doi:10.1145/3472291 · Cited by 1,169
“011 Robotics [83, 96] HHAR [214], NWFD [145] Smart device [37] Foursquare, Twitter [116] Social network”
MethodVariational Deep Embedding: An Unsupervised and Generative Approach to Clustering
Jiang, Z., Zheng, Y., Tan, H., Tang, B., & Zhou, H. (2017) · Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence · doi:10.24963/ijcai.2017/273 · Cited by 706
Sensor-based and vision-based human activity recognition: A comprehensive survey
Minh Dang, L., Min, K., Wang, H., Jalil Piran, M., Hee Lee, C., & Moon, H. (2020) · Pattern Recognition · doi:10.1016/j.patcog.2020.107561 · Cited by 730
Deep Learning for Sensor-based Human Activity Recognition
Chen, K., Zhang, D., Yao, L., Guo, B., Yu, Z., & Liu, Y. (2022) · ACM Computing Surveys · doi:10.1145/3447744 · Cited by 690
DeepSense: A Unified Deep Learning Framework for Time-Series Mobile Sensing Data Processing
Yao, S., Hu, S., Zhao, Y., Zhang, A., & Abdelzaher, T. (2017) · Proceedings of the 26th International Conference on World Wide Web · doi:10.1145/3038912.3052577 · Cited by 667
“Using these sensors, mobile devices are able to infer user activities and states [35, 39] and recognize surrounding context [31, 42].”
BackgroundMethodInfluential
Metadata
- Authors
- Stisen, A., Blunck, H., Bhattacharya, S., Prentow, T. S., Kjærgaard, M. B., Dey, A., Sonne, T., & Jensen, M. M.
- Affiliations
- Aarhus University (DK)
- Bell Laboratories, Dublin, Ireland
- Carnegie Mellon University (US)
- ORCID
- Venue
- Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems
- Publisher
- ACM
- Published
- 2015-11
- Pages
- 127-140
- OpenAlex
- W2057907879
- Cited by
- 714
- References
- 49
- Citations by year
- 2026: 45 · 2025: 81 · 2024: 99 · 2023: 91 · 2022: 82 · 2021: 82 · 2020: 61 · 2019: 62 · 2018: 54 · 2017: 35 · 2016: 21 · 2015: 1
- FWCI
- 15.18
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- ACM Conference on Embedded Networked Sensor Systems (SenSys) (publishedVersion)
- Funders
- Danish Advanced Technology Foundation (076-2011- 3.)
- The Danish Council for Strategic Research (11-11533)
- Topics
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Social Sciences › Transportation › Human Mobility and Location-Based Analysis
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Keywords
- human activity recognition, mobile sensing, sensor heterogeneity, heterogeneous devices, smartphone sensors, smartwatches, large-scale deployment, feature representation, classification methods, motion sensors
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.