The effect of haptic guidance, aging, and initial skill level on motor learning of a steering task
Open accessThe DOI matches its Crossref record; 43 of the 43 references it cites were found in a registry or an index.
Abstract
In a previous study, we found that haptic guidance from a robotic steering wheel can improve short-term learning of steering of a simulated vehicle, in contrast to several studies of other tasks that had found that the guidance either impairs or does not aid motor learning. In this study, we examined whether haptic guidance-as-needed can improve long-term retention (across 1 week) of the steering task, with age and initial skill level as independent variables. Training with guidance-as-needed allowed all participants to learn to steer without experiencing large errors. For young participants (age 18-30), training with guidance-as-needed produced better long-term retention of driving skill than did training without guidance. For older participants (age 65-92), training with guidance-as-needed improved long-term retention in tracking error, but not significantly. However, for a subset of less skilled, older subjects, training with guidance-as-needed significantly improved long-term retention. The benefits of guidance-based training were most evident as an improved ability to straighten the vehicle direction when coming out of turns. In general, older participants not only systematically performed worse at the task than younger subjects (errors approximately 3 times greater), but also apparently learned more slowly, forgetting a greater percentage of the learned task during the 1 week layoffs between the experimental sessions. This study demonstrates that training with haptic guidance can benefit long-term retention of a driving skill for young and for some old drivers. Training with haptic guidance is more useful for people with less initial skill.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“In particular, learning of temporal aspects can be accelerated with haptic guidance (Marchal-Crespo, McHughen, Cramer, & Reinkensmeyer, 2009), which seems also to be true if haptic guidance is added to visual feedback.”
From Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review (2013) · cites this paper as Marchal-Crespo, McHughen, Cramer, & Reinkensmeyer, 2009
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Motor Control and Learning: A Behavioral Emphasis
Schmidt, R. A. (1982) · Cited by 4,770
Schmidt, R. A., & Bjork, R. A. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00029.x · Cited by 1,582 · cited 2×
“…S. C. Cramer Departments of Anatomy and Neurobiology, University of California, Irvine, USA D. J. Reinkensmeyer Departments of Mechanical and Aerospace Engineering and Biomedical Engineering, University of California, Irvine, USA actual relationship (Salmoni et al. 1984; Schmidt and Bjork 1992).”
BackgroundGuadagnoli, M. A., & Lee, T. D. (2004) · Journal of Motor Behavior · doi:10.3200/jmbr.36.2.212-224 · Cited by 1,534 · cited 2×
“An influential motor learning theory, the challenge point theory (Guadagnoli and Lee 2004) states that optimal learning is achieved when the difficulty of the task is appropriate for the individual participant’s level of expertise (i.”
BackgroundKnowledge of results and motor learning: A review and critical reappraisal.
Salmoni, A. W., Schmidt, R. A., & Walter, C. B. (1984) · Psychological Bulletin · doi:10.1037/0033-2909.95.3.355 · Cited by 1,438 · cited 2×
“…S. C. Cramer Departments of Anatomy and Neurobiology, University of California, Irvine, USA D. J. Reinkensmeyer Departments of Mechanical and Aerospace Engineering and Biomedical Engineering, University of California, Irvine, USA actual relationship (Salmoni et al. 1984; Schmidt and Bjork 1992).”
BackgroundMotor learning: its relevance to stroke recovery and neurorehabilitation
Krakauer, J. W. (2006) · Current Opinion in Neurology · doi:10.1097/01.wco.0000200544.29915.cc · Cited by 1,275 · cited 1×
“…finding that physically guiding movements does not aid in motor learning and may in fact hamper it (Hagman 1983; Winstein et al. 1994; Armstrong 1970; Tsutsui and Imanaka 2003; Gillespie et al. 1998; O’Malley et al. 2006; Wallis and Koh 2002; Feygin et al. 2002; Liu et al. 2006; Kahn et al. 2006).”
BackgroundTactile Displays: Guidance for Their Design and Application
Jones, L. A., & Sarter, N. B. (2008) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872008x250638 · Cited by 561 · cited 1×
“There is a body of work on haptic guidance that have showed the benefits of human–machine haptic interactions on driving performance (Suzuki and Jansson 2003; Griffths and Gillespie 2005; Jones and Sarter 2008).”
BackgroundMotor learning in man: A review of functional and clinical studies
Halsband, U., & Lange, R. K. (2006) · Journal of Physiology-Paris · doi:10.1016/j.jphysparis.2006.03.007 · Cited by 538 · cited 2×
“Research on motor adaption has emphasized that kinematic errors generated during movement are a fundamental neural signal that drives motor adaptation when steering the arm along a desired path (Fine and Thoroughman 2007; Halsband and Lange 2006; Krakauer 2006).”
BackgroundPatton, J. L., Stoykov, M. E., Kovic, M., & Mussa-Ivaldi, F. A. (2006) · Experimental Brain Research · doi:10.1007/s00221-005-0097-8 · Cited by 469 · cited 2×
“training strategies to enhance motor learning can be found in Patton et al. (2006) and Bayart et al. (2005).”
BackgroundHaptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill
Feygin, D., Keehner, M., & Tendick, R. (2003) · Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002 · doi:10.1109/haptic.2002.998939 · Cited by 394 · cited 4×
“A number of studies have confirmed this hypothesis finding that physically guiding movements does not aid in motor learning and may in fact hamper it (Hagman 1983; Winstein et al. 1994; Armstrong 1970; Tsutsui and Imanaka 2003; Gillespie et al. 1998; O’Malley et al. 2006; Wallis and Koh 2002; Feygin et al. 2002; Liu e…”
BackgroundResultInfluentialKahn, L. E., Zygman, M. L., Rymer, W. Z., & Reinkensmeyer, D. J. (2006) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-3-12 · Cited by 375
Self-citationMotor-skill learning in older adults—a review of studies on age-related differences
Voelcker-Rehage, C. (2008) · European Review of Aging and Physical Activity · doi:10.1007/s11556-008-0030-9 · Cited by 311 · cited 3×
“A decline of motor performance with age has been observed in many previous studies with a variety of movement tasks (Voelcker-Rehage 2008; Voelcker-Rehage and Willim-czik 2006; Etnier 1998; Tunney et al. 1998).”
BackgroundResultWinstein, C. J., Pohl, P. S., & Lewthwaite, R. (1994) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1994.10607635 · Cited by 264 · cited 3×
“A number of studies have confirmed this hypothesis finding that physically guiding movements does not aid in motor learning and may in fact hamper it (Hagman 1983; Winstein et al. 1994; Armstrong 1970; Tsutsui and Imanaka 2003; Gillespie et al. 1998; O’Malley et al. 2006; Wallis and Koh 2002; Feygin et al. 2002; Liu e…”
BackgroundHaptic Feedback Enhances Force Skill Learning
Morris, D., Tan, H., Barbagli, F., Chang, T., & Salisbury, K. (2007) · Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07) · doi:10.1109/whc.2007.65 · Cited by 208 · cited 1×
“…has been evaluated in recent studies, which found a positive effect of guidance on the time-related components of the dynamic task, such as an increase in speed and smoothness in tracking trajectories (Bluteau et al. 2008), and a better learning of temporal patterns of force (Morris et al. 2007).”
BackgroundGriffiths, P. G., & Gillespie, R. B. (2005) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1518/001872005774859944 · Cited by 206 · cited 1×
“There is a body of work on haptic guidance that have showed the benefits of human–machine haptic interactions on driving performance (Suzuki and Jansson 2003; Griffths and Gillespie 2005; Jones and Sarter 2008).”
BackgroundEmken, J. L., Benitez, R., & Reinkensmeyer, D. J. (2007) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-4-8 · Cited by 199
Self-citationSuzuki, K. (2003) · JSAE Review · doi:10.1016/s0389-4304(02)00247-3 · Cited by 196
Haptic Guidance Can Enhance Motor Learning of a Steering Task
Crespo, L. M., & Reinkensmeyer, D. J. (2008) · Journal of Motor Behavior · doi:10.3200/jmbr.40.6.545-557 · Cited by 166 · cited 8×
“…complex tasks such as skiing (Wulf et al. 1998) and driving a vehicle learn to time their movement better with cues provided by haptic guidance, such as the moment to begin a turn when encountering a sharp curve or the moment to rectify after a curve (Marchal-Crespo and Reinkensmeyer 2008b).”
BackgroundMethodResultInfluentialSelf-citationShared Control in Haptic Systems for Performance Enhancement and Training
O’Malley, M. K., Gupta, A., Gen, M., & Li, Y. (2006) · Journal of Dynamic Systems, Measurement, and Control · doi:10.1115/1.2168160 · Cited by 166
Haptic Guidance Improves the Visuo-Manual Tracking of Trajectories
Bluteau, J., Coquillart, S., Payan, Y., & Gentaz, E. (2008) · PLoS ONE · doi:10.1371/journal.pone.0001775 · Cited by 153 · cited 2×
“…has been evaluated in recent studies, which found a positive effect of guidance on the time-related components of the dynamic task, such as an increase in speed and smoothness in tracking trajectories (Bluteau et al. 2008), and a better learning of temporal patterns of force (Morris et al. 2007).”
BackgroundSwinnen, S. P. (1998) · Cognitive Neuropsychology · doi:10.1080/026432998381104 · Cited by 139 · cited 4×
“…in old participants have been hypothesized to be a consequence of a decreased capability to overcome ‘‘over-learned’’ coordination patterns to a specific task, i.e. old subjects have difficulties to learn variations on a task they are already skilled at Swinnen (1998) and Brosseau et al. (2007).”
BackgroundInfluentialFine, M. S., & Thoroughman, K. A. (2007) · Journal of Neurophysiology · doi:10.1152/jn.00196.2007 · Cited by 129 · cited 1×
“Research on motor adaption has emphasized that kinematic errors generated during movement are a fundamental neural signal that drives motor adaptation when steering the arm along a desired path (Fine and Thoroughman 2007; Halsband and Lange 2006; Krakauer 2006).”
BackgroundLiu, J., Cramer, S. C., & Reinkensmeyer, D. (2006) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-3-20 · Cited by 119
Self-citationWiseman, P. (1998) · bepress Legal Repository · Cited by 103
Zhai, S., Accot, J., & Woltjer, R. (2004) · PRESENCE Virtual and Augmented Reality · doi:10.1162/1054746041382393 · Cited by 94
Motor plasticity in a juggling task in older adults—a developmental study
Voelcker‐Rehage, C., & Willimczik, K. (2006) · Age and Ageing · doi:10.1093/ageing/afl025 · Cited by 90
Wishart, L. R., Lee, T. D., Cunningham, S. J., & Murdoch, J. E. (2002) · Acta Psychologica · doi:10.1016/s0001-6918(02)00036-7 · Cited by 87 · cited 3×
“Studies have also found that aging slows the rate of motor learning (Swinnen 1998; Brosseau et al. 2007; Wishart et al. 2002).”
BackgroundPhysical-Guidance Benefits in Learning a Complex Motor Skill
Wulf, G., Shea, C. H., & Whitacre, C. A. (1998) · Journal of Motor Behavior · doi:10.1080/00222899809601351 · Cited by 83 · cited 2×
“One possible interpretation of these results is that subjects performing complex tasks such as skiing (Wulf et al. 1998) and driving a vehicle learn to time their movement better with cues provided by haptic guidance, such as the moment to begin a turn when encountering a sharp curve or the moment…”
BackgroundThe influence of age on learning a locomotor task
van Hedel, H. J. A., & Dietz, V. (2004) · Clinical Neurophysiology · doi:10.1016/j.clinph.2004.03.029 · Cited by 75 · cited 2×
“learning to drive a new car or a powered wheelchair, Hedel and Dietz 2004 ).”
BackgroundMotor Performance and Motor Learning as a Function of Age and Fitness
Etnier, J. L., & Landers, D. M. (1998) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1998.10607679 · Cited by 64 · cited 2×
“We adapted the control gains (i.e. firmness of guidance) using an adaptive algorithm described in Emken et al. (2007): Giþ1 ¼ fR Gi þ gR xi xdj j ð2Þ where G represents the value of a control gain in the guidance controller, fR is the robot forgetting factor (fR = 0.099986), gR is the robot…”
BackgroundMethodInfluentialEffects of Aging and Schedules of Knowledge of Results on Motor Learning
Swanson, L. R., & Lee, T. D. (1992) · Journal of Gerontology · doi:10.1093/geronj/47.6.p406 · Cited by 64 · cited 2×
“Motor performance and motor learning have been documented to be impaired with aging (Dijk et al. 2007; Carnahan et al. 1996; Wishart and Lee 1997; Swanson and Lee 1992; Swinnen 1998; Wishart et al. 2002; Voelcker-Rehage 2008), even though the need to learn new skills remains crucial with aging…”
BackgroundEffects of Aging and Reduced Relative Frequency of Knowledge of Results on Learning a Motor Skill
Wishart, L. R., & Lee, T. D. (1997) · Perceptual and Motor Skills · doi:10.2466/pms.1997.84.3.1107 · Cited by 61 · cited 2×
“Motor performance and motor learning have been documented to be impaired with aging (Dijk et al. 2007; Carnahan et al. 1996; Wishart and Lee 1997; Swanson and Lee 1992; Swinnen 1998; Wishart et al. 2002; Voelcker-Rehage 2008), even though the need to learn new skills remains crucial with aging…”
BackgroundThe Influence of Summary Knowledge of Results and Aging on Motor Learning
Carnahan, H., Vandervoort, A. A., & Swanson, L. R. (1996) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.1996.10607955 · Cited by 50 · cited 2×
“Motor performance and motor learning have been documented to be impaired with aging (Dijk et al. 2007; Carnahan et al. 1996; Wishart and Lee 1997; Swanson and Lee 1992; Swinnen 1998; Wishart et al. 2002; Voelcker-Rehage 2008), even though the need to learn new skills remains crucial with aging…”
BackgroundPresentation- and test-trial effects on acquisition and retention of distance and location.
Hagman, J. D. (1983) · Journal of Experimental Psychology: Learning, Memory, and Cognition · doi:10.1037/0278-7393.9.2.334 · Cited by 50 · cited 3×
“A number of studies have confirmed this hypothesis finding that physically guiding movements does not aid in motor learning and may in fact hamper it (Hagman 1983; Winstein et al. 1994; Armstrong 1970; Tsutsui and Imanaka 2003; Gillespie et al. 1998; O’Malley et al. 2006; Wallis and Koh 2002; Feygin et al. 2002; Liu e…”
BackgroundEffect of robotic guidance on motor learning of a timing task
Crespo, L. M., & Reinkensmeyer, D. J. (2008) · 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics · doi:10.1109/biorob.2008.4762796 · Cited by 38
Self-citationBayart, B., Pocheville, A., & Kheddar, A. (2005) · IEEE International Workshop on Haptic Audio visual Environments and Games · doi:10.1109/have.2005.1545651 · Cited by 38 · cited 1×
“Examples of research towards the study of optimal forms of haptic training strategies to enhance motor learning can be found in Patton et al. (2006) and Bayart et al. (2005).”
BackgroundOn the Use of Divergent Force Fields in Robot-Mediated Neurorehabilitation
Cesqui, B., Aliboni, S., Mazzoleni, S., Carrozza, M. C., Posteraro, F., & Micera, S. (2008) · 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics · doi:10.1109/biorob.2008.4762927 · Cited by 34 · cited 1×
“Motor performance and motor learning have been documented to be impaired with aging (Dijk et al. 2007; Carnahan et al. 1996; Wishart and Lee 1997; Swanson and Lee 1992; Swinnen 1998; Wishart et al. 2002; Voelcker-Rehage 2008), even though the need to learn new skills remains crucial with aging…”
BackgroundEffects of Age and Content of Augmented Feedback on Learning an Isometric Force-Production Task
van Dijk, H., Mulder, T. W., & Hermens, H. J. (2007) · Experimental Aging Research · doi:10.1080/03610730701319194 · Cited by 33 · cited 2×
“Motor performance and motor learning have been documented to be impaired with aging ( Dijk et al. 2007; Carnahan et al. 1996; Wishart and Lee 1997; Swanson and Lee 1992; Swinnen 1998; Wishart et al. 2002; Voelcker-Rehage 2008), even though the need to learn new skills remains crucial with aging (e.g.”
BackgroundAging Affects Motor Skill Learning When the Task Requires Inhibitory Control
Brosseau, J., Potvin, M.-J., & Rouleau, I. (2007) · Developmental Neuropsychology · doi:10.1080/87565640701361120 · Cited by 30 · cited 2×
“…in old participants have been hypothesized to be a consequence of a decreased capability to overcome ‘‘over-learned’’ coordination patterns to a specific task, i.e. old subjects have difficulties to learn variations on a task they are already skilled at Swinnen (1998) and Brosseau et al. (2007).”
BackgroundThe effect of a fast bowling harness in cricket: an intervention study
Wallis, R., Elliott, B., & Koh, M. (2002) · Journal of Sports Sciences · doi:10.1080/02640410252925161 · Cited by 30 · cited 2×
“A number of studies have confirmed this hypothesis finding that physically guiding movements does not aid in motor learning and may in fact hamper it (Hagman 1983; Winstein et al. 1994; Armstrong 1970; Tsutsui and Imanaka 2003; Gillespie et al. 1998; O’Malley et al. 2006; Wallis and Koh 2002; Feygin et al. 2002; Liu e…”
BackgroundGillespie, R. B., O’Modhrain, M. S., Tang, P., Zaretzky, D., & Pham, C. (1998) · Dynamic Systems and Control · doi:10.1115/imece1998-0250 · Cited by 26 · cited 1×
“…finding that physically guiding movements does not aid in motor learning and may in fact hamper it (Hagman 1983; Winstein et al. 1994; Armstrong 1970; Tsutsui and Imanaka 2003; Gillespie et al. 1998; O’Malley et al. 2006; Wallis and Koh 2002; Feygin et al. 2002; Liu et al. 2006; Kahn et al. 2006).”
BackgroundAging and Motor Learning of a Functional Motor Task
Tunney, N. M., Taylor, L. F., Gaddy, M., Rosenfeld, A., Pearce, N., Tamanini, J., & Treby, A. (2003) · Physical & Occupational Therapy In Geriatrics · doi:10.1080/j148v21n03_01 · Cited by 23
Effect of Manual Guidance on Acquiring a New Bimanual Coordination Pattern
Tsutsui, S., & Imanaka, K. (2003) · Research Quarterly for Exercise and Sport · doi:10.1080/02701367.2003.10609069 · Cited by 17 · cited 2×
“A number of studies have confirmed this hypothesis finding that physically guiding movements does not aid in motor learning and may in fact hamper it (Hagman 1983; Winstein et al. 1994; Armstrong 1970; Tsutsui and Imanaka 2003; Gillespie et al. 1998; O’Malley et al. 2006; Wallis and Koh 2002; Feygin et al. 2002; Liu e…”
Background
Cited by
Augmented visual, auditory, haptic, and multimodal feedback in motor learning: A review
Sigrist, R., Rauter, G., Riener, R., & Wolf, P. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-012-0333-8 · Cited by 1,416
Rehabilitation robots for the treatment of sensorimotor deficits: a neurophysiological perspective
Gassert, R., & Dietz, V. (2018) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-018-0383-x · Cited by 440
“can be promoted through adaptive assistance [51], in a way to avoid slacking of the patient [52], as well as”
BackgroundDevelopment and pilot testing of HEXORR: Hand EXOskeleton Rehabilitation Robot
Schabowsky, C. N., Godfrey, S. B., Holley, R. J., & Lum, P. S. (2010) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/1743-0003-7-36 · Cited by 280
A Review of Shared Control for Automated Vehicles: Theory and Applications
Marcano, M., Diaz, S., Perez, J., & Irigoyen, E. (2020) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2020.3017748 · Cited by 256
Can proprioceptive training improve motor learning?
Wong, J. D., Kistemaker, D. A., Chin, A., & Gribble, P. L. (2012) · Journal of Neurophysiology · doi:10.1152/jn.00122.2012 · Cited by 175
“…benefits of haptic assistance in movement recovery in both clinical (Lo et al. 2010; see Marchal-Crespo and Reinkensmeyer 2009 for review) and healthy (Marchal-Crespo et al. 2010; Reinkensmeyer and Patton 2009 for review) subpopulations, where most often a robot is used to assist active movement.”
Background
Metadata
- Authors
- Marchal-Crespo, L., McHughen, S., Cramer, S. C., & Reinkensmeyer, D. J.
- Affiliations
- University of California, Irvine (US)
- Venue
- Experimental Brain Research
- Published
- 2009-10-10
- Volume
- 201
- Issue
- 2
- Pages
- 209-220
- ISSN
- 0014-4819 (ISSN-L)
- 1432-1106
- PMC
- PMC2832903
- OpenAlex
- W2061271044
- Cited by
- 143
- References
- 43
- Citations by year
- 2026: 10 · 2025: 6 · 2024: 7 · 2023: 5 · 2022: 12 · 2021: 13 · 2020: 11 · 2019: 6 · 2018: 4 · 2017: 15 · 2016: 5 · 2015: 11 · 2014: 14 · 2013: 7 · 2012: 5
- FWCI
- 2.74
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- cc-by-nc
- Locations
- Experimental Brain Research (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- Bern Open Repository and Information System (University of Bern) (submittedVersion, cc-by-nc)
- eScholarship (California Digital Library) (submittedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- Open Access CRIS of the University of Bern
- Funders
- National Institutes of Health (N01-HD-3–)
- National Institute of Biomedical Imaging and Bioengineering
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (N01 HD 33352)
- National Center for Medical Rehabilitation Research
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Motor Control and Adaptation
- Life Sciences › Neuroscience › Cognitive Neuroscience › Tactile and Sensory Interactions
- Physical Sciences › Engineering › Mechanical Engineering › Teleoperation and Haptic Systems
- Keywords
- haptic guidance, motor learning, driving skills, steering, aging, older drivers, long-term retention, forgetting
- MeSH terms
- Adult, Aged, Aging, Algorithms, Computer Graphics, Computer Simulation, Data Interpretation, Statistical, Female, Humans, Learning, Male, Motor Skills, Psychomotor Performance, Wheelchairs, Feedback, Psychological, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.