Toward Measurement of Situation Awareness in Autonomous Vehicles
The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
Abstract
Until vehicles are fully autonomous, safety, legal and ethical obligations require that drivers remain aware of the driving situation. Key decisions about whether a driver can take over when the vehicle is confused, or its capabilities are degraded, depend on understanding whether he or she is responsive and aware of external conditions. The leading techniques for measuring situation awareness in simulated environments are ill-suited to autonomous driving scenarios, and particularly to on-road testing. We have developed a technique, named Daze, to measure situation awareness through real-time, in-situ event alerts. The technique is ecologically valid: it resembles applications people use in actual driving. It is also flexible: it can be used in both simulator and on-road research settings. We performed simulator-based and on-road test deployments to (a) check that Daze could characterize drivers' awareness of their immediate environment and (b) understand practical aspects of the technique's use. Our contributions include the Daze technique, examples of collected data, and ways to analyze such data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Results show that 58% of respondents could correctly differentiate between different events in case of visible alert, 83% in case of audible alert, and 95% in the case of visible and audible alerts. Additionally, respondents need an average response time of 5–9 s in order to take control back depending on the alert method [193].”
From Public acceptance and perception of autonomous vehicles: a comprehensive review (2021) · cites this paper as [193]
Citations
Cites
Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research
(1988) · Advances in Psychology · doi:10.1016/s0166-4115(08)62386-9 · Cited by 15,003
Toward a Theory of Situation Awareness in Dynamic Systems
Endsley, M. R. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049543 · Cited by 8,875
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Measurement of Situation Awareness in Dynamic Systems
Endsley, M. R. (1995) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872095779049499 · Cited by 2,039 · cited 4×
“These methods include eye-tracking, the simulation freeze technique [9], subjective ratings, question probes (during and post activity), and task performance measures.”
MethodInfluentialLee, K. M. (2004) · Communication Theory · doi:10.1111/j.1468-2885.2004.tb00302.x · Cited by 1,631
ENDSLEY, M. R., & KABER, D. B. (1999) · Ergonomics · doi:10.1080/001401399185595 · Cited by 1,088 · cited 1×
“However, situation awareness is also important to assess prior to transition, given concerns over driver performance [11].”
BackgroundParasuraman, R., Sheridan, T. B., & Wickens, C. D. (2008) · Journal of Cognitive Engineering and Decision Making · doi:10.1518/155534308x284417 · Cited by 695
Situational Awareness Rating Technique (Sart): The Development of a Tool for Aircrew Systems Design
Taylor, R. M. (2017) · Situational Awareness · doi:10.4324/9781315087924-8 · Cited by 525
Models of driving behavior: A review of their evolution
Ranney, T. A. (1994) · Accident Analysis & Prevention · doi:10.1016/0001-4575(94)90051-5 · Cited by 512
The Invisible Gorilla Strikes Again: Sustained Inattentional Blindness in Expert Observers
Drew, T., Võ, M. L.-H., & Wolfe, J. M. (2013) · Psychological Science · doi:10.1177/0956797613479386 · Cited by 483
Research works printed but not linked: 5
- Cheryl A. Bolstad , Haydee M. Cuevas , Jingjing Wang-Costello , Mica R. Endsley , and Linda S . Angell . 2009 . Measurement of situation awareness for automobile technologies of the future. In Performance Metrics for Assessing Driver Distraction. SAE , 195--213. Cheryl A. Bolstad, Haydee M. Cuevas, Jingjing Wang-Costello, Mica R. Endsley, and Linda S. Angell. 2009. Measurement of situation awareness for automobile technologies of the future. In Performance Metrics for Assessing Driver Distraction. SAE, 195--213.
- National Highway Traffic Safety Administration and U.S. Department of Transportation . 2016 . Federal Automated Vehicles Policy: Accelerating the Next Revolution in Roadway Safety. Washington, DC. National Highway Traffic Safety Administration and U.S. Department of Transportation. 2016. Federal Automated Vehicles Policy: Accelerating the Next Revolution in Roadway Safety. Washington, DC.
- National Highway Traffic Safety Administration and others. 2013. Preliminary Statement of Policy Concerning Automated Vehicles . Washington, DC . National Highway Traffic Safety Administration and others. 2013. Preliminary Statement of Policy Concerning Automated Vehicles. Washington, DC.
- Thomas B. Sheridan . 2006. Supervisory control. Handbook of Human Factors and Ergonomics ( 2006 ), 1025--1052. http://onlinelibrary.wiley.com/doi/10. 1002/0470048204.ch38/summary Thomas B. Sheridan. 2006. Supervisory control. Handbook of Human Factors and Ergonomics (2006), 1025--1052. http://onlinelibrary.wiley.com/doi/10. 1002/0470048204.ch38/summary
- M. W. Smolensky . 1993 . Toward the physiological measurement of situation awareness: The case for eye movement measurements . In Proc. of the Human Factors and Ergonomics Society , Vol. 41 . M. W. Smolensky. 1993. Toward the physiological measurement of situation awareness: The case for eye movement measurements. In Proc. of the Human Factors and Ergonomics Society, Vol. 41.
Cited by
Explanations in Autonomous Driving: A Survey
Omeiza, D., Webb, H., Jirotka, M., & Kunze, L. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3122865 · Cited by 355
Public acceptance and perception of autonomous vehicles: a comprehensive review
Othman, K. (2021) · AI and Ethics · doi:10.1007/s43681-021-00041-8 · Cited by 347
“Additionally, respondents need an average response time of 5–9 s in order to take control back depending on the alert method [193].”
BackgroundXing, Y., Lv, C., Cao, D., & Hang, P. (2021) · Transportation Research Part C: Emerging Technologies · doi:10.1016/j.trc.2021.103199 · Cited by 209
Zhou, F., Yang, X. J., & de Winter, J. C. F. (2022) · IEEE Transactions on Intelligent Transportation Systems · doi:10.1109/tits.2021.3069776 · Cited by 204
Assessing Distraction Potential of Augmented Reality Head-Up Displays for Vehicle Drivers
Kim, H., & Gabbard, J. L. (2019) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819844845 · Cited by 142
Capallera, M., Angelini, L., Meteier, Q., Khaled, O. A., & Mugellini, E. (2022) · IEEE Transactions on Intelligent Vehicles · doi:10.1109/tiv.2022.3200826 · Cited by 95
Currano, R., Park, S. Y., Moore, D. J., Lyons, K., & Sirkin, D. M. (2021) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3411764.3445575 · Cited by 91
Self-citationDmitrenko, D., Maggioni, E., Brianza, G., Holthausen, B. E., Walker, B. N., & Obrist, M. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376176 · Cited by 88
The Utility of Explainable AI in Ad Hoc Human-Machine TeamingPreprint
Paleja, R., Ghuy, M., Arachchige, N. R., Jensen, R., & Gombolay, M. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2209.03943 · Cited by 67
Adasa: A Conversational In-Vehicle Digital Assistant for Advanced Driver Assistance Features
Lin, S.-C., Hsu, C.-H., Talamonti, W. J., Zhang, Y., Oney, S., Mars, J., & Tang, L. (2018) · ACM Symposium on User Interface Software and Technology (UIST) · doi:10.1145/3242587.3242593 · Cited by 62
A Scoping Review of Ethics Across SIGCHI
Nunes Vilaza, G., Doherty, K., McCashin, D., Coyle, D., Bardram, J., & Barry, M. (2022) · Designing Interactive Systems Conference · doi:10.1145/3532106.3533511 · Cited by 43
Effect of automation failure type on trust development in driving automation systems
Mishler, S., & Chen, J. (2022) · Applied Ergonomics · doi:10.1016/j.apergo.2022.103913 · Cited by 62
Yoo, Y., Yang, M.-Y., Lee, S., Baek, H. W., & Kim, J. (2022) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2022.01.009 · Cited by 42
Measuring Driver Perception: Combining Eye-Tracking and Automated Road Scene Perception
Stapel, J., el Hassnaoui, M., & Happee, R. (2020) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820959958 · Cited by 36
Owner Manuals Review and Taxonomy of ADAS Limitations in Partially Automated Vehicles
Capallera, M., Meteier, Q., de Salis, E., Angelini, L., Carrino, S., Khaled, O. A., & Mugellini, E. (2019) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3342197.3344530 · Cited by 34
Zheng, H., Zhou, T., Han, T., Li, S., & Yu, C. (2024) · Advanced Engineering Informatics · doi:10.1016/j.aei.2024.102683 · Cited by 32
Zhang, Y., Wang, W., Zhou, X., Wang, Q., & Sun, X. (2022) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2022.2098965 · Cited by 29
Collaborative Mapping with IoE-based Heterogeneous Vehicles for Enhanced Situational Awareness
Queralta, J. P., Gia, T. N., Tenhunen, H., & Westerlund, T. (2019) · IEEE Sensors Applications Symposium (SAS) · doi:10.1109/sas.2019.8706110 · Cited by 27
Situation Awareness Measurement in Remotely Controlled Cars
Linkov, V., & Vanžura, M. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.592930 · Cited by 23
The effects of motivation and noise on situation awareness: A study based on SAGAT and EEG
Liu, Y., Chen, N., & Rau, P. P. (2023) · International Journal of Industrial Ergonomics · doi:10.1016/j.ergon.2023.103491 · Cited by 23
Visual Attention During Simulated Autonomous Driving in the US and Japan
Shinohara, Y., Currano, R., Ju, W. G., & Nishizaki, Y. (2017) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3122986.3122991 · Cited by 23
Self-citationToward Prediction of Driver Awareness of Automotive Hazards: Driving-Video-Based Simulation Approach
Kim, H., Gabbard, J. L., Martin, S., Tawari, A., & Misu, T. (2019) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1071181319631003 · Cited by 21
Meteier, Q., Capallera, M., de Salis, E., Sonderegger, A., Angelini, L., Carrino, S., Khaled, O. A., & Mugellini, E. (2020) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3409120.3410649 · Cited by 21
Gao, X., Wu, X., Ho, S., Misu, T., & Akash, K. (2022) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv51971.2022.9827008 · Cited by 20
HUMAN FACTORS AND ERGONOMICS IN DESIGN OF A 3 : AUTOMATION, AUTONOMY, AND ARTIFICIAL INTELLIGENCE
Sawyer, B. D., Miller, D., Canham, M., & Karwowski, W. (2021) · Wiley eBooks · doi:10.1002/9781119636113.ch52 · Cited by 20
Physiological Indices to Predict Driver Situation Awareness in VR
Kim, G., Lee, J., Yeo, D., An, E., & Kim, S. (2023) · ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp) · doi:10.1145/3594739.3610687 · Cited by 18
Improving children’s on-road cycling with immersive video-based training: A pilot study
Bishop, D. T., Dkaidek, T. S., Atanasova, G., & Broadbent, D. P. (2022) · Transportation Research Interdisciplinary Perspectives · doi:10.1016/j.trip.2022.100699 · Cited by 15
Toward an Adaptive Situational Awareness Support System for Urban Driving
Wu, T., Sachdeva, E., Akash, K., Wu, X., Misu, T., & Ortiz, J. (2022) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv51971.2022.9827205 · Cited by 15
Hierarchy of Gans for Learning Embodied Self-Awareness Model
Ravanbakhsh, M., Baydoun, M., Campo, D., Marin-Plaza, P., Martín, D., Marcenaro, L., & Regazzoni, C. S. (2018) · Proceedings - International Conference on Image Processing · doi:10.1109/icip.2018.8451418 · Cited by 12
MakeAware: Designing to Support Situation Awareness in Makerspaces
Stark, J., Anderson, F., Fitzmaurice, G. W., & Somanath, S. (2020) · Designing Interactive Systems Conference · doi:10.1145/3357236.3395472 · Cited by 12
Chowdhury, S. S., Islam, K. M., & Noor, R. (2020) · International Conference on Machine Learning and Applications · doi:10.1109/icmla51294.2020.00039 · Cited by 11
Toward Fully Autonomous Driving: AI, Challenges, Opportunities, and Needs
Ullrich, L., Buchholz, M., Dietmayer, K., & Graichen, K. (2026) · IEEE Access · doi:10.1109/access.2026.3659192 · Cited by 11
Beyond "Taming Electric Scooters": Disentangling Understandings of Micromobility Naturalistic Riding
Tabatabaie, M., He, S., Wang, H., & Shin, K. G. (2024) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3678513 · Cited by 10
EEG-based neural activity for decoding situation awareness at different levels
Wu, Q., Chen, N., & Rau, P. P. (2025) · Ergonomics · doi:10.1080/00140139.2024.2449570 · Cited by 9
Metz, B., Wörle, J., Metzulat, M., & Neukum, A. (2025) · Accident Analysis & Prevention · doi:10.1016/j.aap.2025.108142 · Cited by 7
Seeking Human Help to Manage Plan Failure Risks in Semi-Autonomous Mobile Manipulation
Al-Hussaini, S., Dhanaraj, N., Gregory, J. M., Joseph, R. J., Thakar, S., Shah, B. C., Marvel, J. A., & Gupta, S. K. (2022) · Journal of Computing and Information Science in Engineering · doi:10.1115/1.4054088 · Cited by 7
Developing Situational Awareness for Joint Action with Autonomous VehiclesPreprint
Kaufman, R. P., Kirsh, D., & Weibel, N. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2404.11800 · Cited by 7
Nair, V. V., Rehmann, M., de la Rosa, S., & Curio, C. (2024) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv55156.2024.10588734 · Cited by 6
Unsupervised Abnormality Detection Using Heterogeneous Autonomous SystemsPreprint
Chowdhury, S. S., Islam, K. M., & Noor, R. (2020) · arXiv (Cornell University) · doi:10.48550/arxiv.2006.03733 · Cited by 6
Development of Situational Awareness Enhancing System for AV-to-Manual Handover and Other Tasks
Li, Y., Sharma, A., Alabi, B. N. T., Chen, S., & Labi, S. (2023) · Purdue e-Pubs (Purdue University System) · doi:10.5703/1288284317730 · Cited by 8
Truong-Allié, C., Herbeth, M., & Paljic, A. (2023) · IEEE Conference on Virtual Reality and 3D User Interfaces (VR) · doi:10.1109/vr55154.2023.00069 · Cited by 5
Operationalizing Dyadic Urban Traffic Interaction Studies: From Theory to Practice
Dey, D., Habibovic, A., & Ju, W. G. (2025) · Applied Sciences · doi:10.3390/app15073738 · Cited by 5
Self-citationCross-Layer System Design for Autonomous Driving
Lin, S.-C. (2019) · Deep Blue (University of Michigan) · Cited by 4
Bayro, A., McGarry, S. P. D., NeSmith, R., Coyne, J. T., & Jeong, H. (2026) · Computers & Graphics · doi:10.1016/j.cag.2026.104541 · Cited by 3
Stojmenova, K. (2023) · International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME) · doi:10.1109/iceccme57830.2023.10253014 · Cited by 3
A Virtual Driving System Based on Customized Evaluation Model
Song, W., Pang, M., Zhao, X., & Wan, B. (2018) · International Conference on Virtual Reality and Visualization · doi:10.1109/icvrv.2018.00027 · Cited by 3
Unsupervised Abnormality Detection Using Heterogenous Autonomous System
Islam, K. M., Noor, R., Chowdhury, S. S., Ohi, T. T., Islam, M. R., Roy, C. K., & Sakib, N. (2020) · IEEE Region 10 Conference (TENCON) · doi:10.1109/tencon50793.2020.9293742 · Cited by 3
Molaei, S., Robert, L., & Banović, N. (2025) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3757437 · Cited by 2
Mishler, S., & Chen, J. (2018) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/1541931218621439 · Cited by 2
Stojmenova, K., Jakus, G., Tomažič, S., & Sodnik, J. (2022) · AHFE international · doi:10.54941/ahfe1001741 · Cited by 2
Situation Awareness, Multi-tasking and Distraction
Chen, F., & Terken, J. M. B. (2022) · Springer tracts in mechanical engineering · doi:10.1007/978-981-19-3448-3_5 · Cited by 2
Hierarchy of GANs for learning embodied self-awareness modelPreprint
Ravanbakhsh, M., Baydoun, M., Campo, D., Marin-Plaza, P., Martín, D., Marcenaro, L., & Regazzoni, C. S. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1806.04012 · Cited by 2
The “Trolley Problem” in Fully Automated AI-Driven Media: A Challenge Beyond Autonomous Driving
Wang, J., & Ye, B. (2024) · Journal of Media Ethics · doi:10.1080/23736992.2024.2418053 · Cited by 1
Wang, H., Gupta, J., & Martelaro, N. (2025) · International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI) · doi:10.1145/3744333.3747831 · Cited by 1
Self-citationKim, M., & Ham, Y. (2026) · Developments in the Built Environment · doi:10.1016/j.dibe.2026.100908 · Cited by 1
A Comparative Study on Situation Awareness While Reading in a Highly Automated Vehicle
Mirnig, A. G., Trösterer, S., & Colley, M. (2026) · Vehicles · doi:10.3390/vehicles8050108 · Cited by 1
The Hexagonal Spindle Model for Human Situation Awareness While Autonomous Driving
Park, D.-H., & Yoon, W.-C. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-22666-4_5 · Cited by 1
Fu, X., Zou, Y., & Tan, H. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-60913-8_8 · Cited by 1
Exploration of smart infrastructure for drivers of autonomous vehicles
Wiegand, G. (2020) · Electronic Theses of LMU Munich (Ludwig-Maximilians-Universität München) · doi:10.5282/edoc.26920 · Cited by 1
Folorunsho, O. J. (2021) · Mspace (University of Manitoba) · Cited by 1
Improving Drivers’ Behaviour When Partial Driving Automation Fails
Ebadi, Y. (2020) · ScholarWorks@UMassAmherst (University of Massachusetts Amherst) · doi:10.7275/18512156
Mann, D. (2021) · Agriculture automation and control · doi:10.1007/978-3-030-70400-1_15
Situacijsko zavedanje voznikov avtomatiziranih vozil
Stojmenova, K., Tomažič, S., & Sodnik, J. (2022) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.7347887
Attention management to improve fallback-readiness in conditional automated vehicles
Gerber, M. A. (2023) · Queensland University of Technology · doi:10.5204/thesis.eprints.239712
Gaze Patterns as a Measure of Situation Awareness in Take-Over Situations in Automated DrivingPreprint
Metz, B., & Wörle, J. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4581030
What Makes a Fantastic Passenger-Car Driver in Urban Contexts?Preprint
Yu, Y., Yi, Z., Yang, X., Chu, M., Lu, J., Chang, X., Liu, Y., Qin, J., Jin, Y., Song, J., et al. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2311.04150
Liang, Y., & Chai, C. (2023) · International Symposium of Chinese CHI (Chinese CHI) · doi:10.1145/3629606.3629630
Kim, M., & Ham, Y. (2025) · International Symposium on Automation and Robotics in Construction (ISARC) · doi:10.22260/isarc2025/0044
Klug, M., Rabe, L., Zander, T. O., & Gramann, K. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5734932
Azevedo, A. S., Souza, L. C., Silva, M., da Silva, I. M. D., & Fernandes, M. A. C. (2025) · Congresso Brasileiro de Inteligência Computacional (CBIC) · doi:10.21528/cbic2025-1175899
2019 IEEE Sensors Applications Symposium (SAS)
Queralta, J. P., Gia, T. N., Tenhunen, H., & Westerlund, T. (2025) · UTUPub (University of Turku)
Information balance and density in augmented reality assistance
Truong-Allié, C. (2024) · theses.fr (ABES) · doi:10.70675/d9615408z0710z45b3za86fz1f7e14c67768
See Something, Say Something: Layered Driver Situational Awareness from Language
Gupta, P., Stent, S., Gideon, J., Battel, K., Dees, L., Gomez, P. R. C., Applegate-Kenton, M., Sumner, E. B., & Rosman, G. (2026) · IEEE Intelligent Vehicles Symposium · doi:10.1109/iv66570.2026.11623912
Driver behaviour in can-scenarios: A new approach to assess situation awareness in automated driving
Metz, B., Schömig, N., Ackner, G. J., & Neukum, A. (2026) · Transportation Research Part F Traffic Psychology and Behaviour · doi:10.1016/j.trf.2026.103798
Development of Situational Awareness Enhancing System for Manual Takeover of AV
Li, Y., Sharma, A., John, A. P., Alabi, B. N. T., Chen, S., & Labi, S. (2023) · ROSA P
Metadata
- Authors
- Sirkin, D., Martelaro, N., Johns, M., & Ju, W.
- Affiliations
- Stanford University (US)
- Venue
- Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2017-05-02
- Pages
- 405-415
- OpenAlex
- W2611536443
- Cited by
- 61
- References
- 35
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 6 · 2023: 8 · 2022: 11 · 2021: 8 · 2020: 8 · 2019: 6 · 2018: 4 · 2017: 1
- FWCI
- 8.41
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Funders
- Center for Design Research Affiliates Program
- Topics
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- Physical Sciences › Engineering › Safety, Risk, Reliability and Quality › Traffic and Road Safety
- Keywords
- situational awareness, autonomous vehicles, driver monitoring, driver takeover, road testing, driving simulator, ecological validity
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.