Ethical and Quality of Care–Related Challenges of Digital Health Twins in Care Settings for Older Adults: Scoping Review
Open accessThe DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Background: Digital health twins (DHTs) have been evolving with their diverse applications in medicine, particularly in care settings for older adults, in response to the increasing demands of older adults. Despite its numerous benefits, the optimal implementation of DHTs has faced several challenges, particularly in terms of ethics and quality of care. Given the continuous rise in the need for such care and the evident potential for DHTs to meet these needs, this review seeks to identify and address the gaps in research knowledge to enhance DHT implementation. Objective: The review aims to compile and synthesize the best available evidence regarding the issues associated with quality of care, the ethical implications of DHTs, and the strategies undertaken to overcome those challenges in care settings for older adults. Methods: The review followed the Joanna Briggs Institute (JBI) methodology as a guide. The published studies were searched through CINAHL, MEDLINE, JBI, and Web of Science. The unpublished studies were searched through Mednar, Trove, OCLC WorldCat, and Dissertations and Theses. Studies published in English from 2016 were considered. This review included studies of older individuals (aged 60 years and older) undergoing care delivery associated with DHTs and respective care providers. The concept involved the application of technology, and the context included studies based on care settings for older adults. A broad scope of evidence, including quantitative, qualitative, text, and opinion studies, was considered. In addition, 2 independent reviewers screened the titles and abstracts and reviewed the full text. Results: The results will be presented in a PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram. A total of 2 draft charting tables were developed and presented. A summary of the characteristics of the included studies was then described in terms of location, study sites, timing, participants, and outcomes measured or phenomena of interest. A result-based convergent (integrated) synthesis design was used to identify 5 key challenges. Those challenges included (1) data security and privacy concerns, (2) equity and accessibility of health care, (3) effectiveness concerning context, timing, and location, (4) ethical implications regarding autonomy, consent, and overdiagnosis, and (5) the impact of DHTs on health care workflows and provider workload. Conclusions: The studies reviewed reveal several critical characteristics regarding the implementation of DHT technologies and their associated ethical considerations, particularly in terms of safety, equity, timing, location, participant characteristics, and workflow impact. The implications of these challenges emphasize the necessity for more practical ethical guidelines and policy frameworks to mitigate the potential risks associated with DHT application in older care. Further research should be conducted to examine other dimensions of the quality of care, such as access, timeliness, acceptability, and appropriateness.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As digital health infrastructures increasingly span organisational and sectoral boundaries, risks associated with design, configuration, and interoperability cannot be managed solely at the local level (1, 42, 61).”
From Why digital health fails silently: a sociotechnical theory of health information technology–related risk (2026) · cites this paper as [61]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565 · cited 1×
“The search results and the study inclusion process were reported in full in the final scoping review and presented in the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews) flow diagram [36,37].”
Guidance for conducting systematic scoping reviews
Peters, M. D. J., Godfrey, C. M., Khalil, H., McInerney, P., Parker, D., & Soares, C. B. (2015) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000050 · Cited by 7,472 · cited 1×
“The proposed scoping review was conducted under the guidance provided by the Joanna Briggs Institute (JBI) methodology for scoping reviews [25].”
JBI Manual for Evidence Synthesis
(2024) · doi:10.46658/jbimes-24-01 · Cited by 2,483
Munn, Z., Aromataris, E., Tufanaru, C., Stern, C., Porritt, K., Farrow, J., Lockwood, C., Stephenson, M., Moola, S., Lizarondo, L., et al. (2019) · International Journal of Evidence-Based Healthcare · doi:10.1097/xeb.0000000000000152 · Cited by 977 · cited 1×
“Potentially relevant sources were retrieved in full, and their citation details were imported into a Microsoft Excel sheet instead of the JBI System for the Unified Management, Assessment, and Review of Information [35] due to a lack of resources.”
A Novel Cloud-Based Framework for the Elderly Healthcare Services Using Digital Twin
Liu, Y., Zhang, L., Yang, Y., Zhou, L., Ren, L., Wang, F., Liu, R., Pang, Z., & Deen, M. J. (2019) · IEEE Access · doi:10.1109/access.2019.2909828 · Cited by 763 · cited 8×
“Studies show that DHTs perform optimally in well-structured health care settings, such as hospitals and specialist clinics, with strong technological infrastructures that support real-time patient location and accurate data integration [26].”
InfluentialDigital twins for health: a scoping review
Katsoulakis, E., Wang, Q., Wu, H., Shahriyari, L., Fletcher, R., Liu, J., Achenie, L., Liu, H., Jackson, P., Xiao, Y., et al. (2024) · npj Digital Medicine · doi:10.1038/s41746-024-01073-0 · Cited by 760 · cited 2×
“Incorporating innovative technologies, including virtual reality (VR), within DHT frameworks opens new avenues for training and treatment [24].”
Hong, Q. N., Pluye, P., Bujold, M., & Wassef, M. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0454-2 · Cited by 754 · cited 1×
“A result-based convergent synthesis design was used in which all types of studies, such as quantitative and qualitative, were analyzed and presented [39].”
Digital Twins in Health Care: Ethical Implications of an Emerging Engineering Paradigm
Bruynseels, K., Santoni de Sio, F., & van den Hoven, J. (2018) · Frontiers in Genetics · doi:10.3389/fgene.2018.00031 · Cited by 704 · cited 10×
“…and potential discrimination, which resonated with Chakshu et al [16], who, although focusing on noninvasive detection of carotid stenosis, implicitly align with Bruynseels and colleagues’ [12] ethical stance by advocating for procedural alignment and ethical validation in clinical application.”
InfluentialDigital twins to personalize medicine
on behalf of the Swedish Digital Twin Consortium, Björnsson, B., Borrebaeck, C., Elander, N., Gasslander, T., Gawel, D. R., Gustafsson, M., Jörnsten, R., Lee, E. J., Li, X., et al. (2020) · Genome Medicine · doi:10.1186/s13073-019-0701-3 · Cited by 566 · cited 1×
“The analytical and predictive capability of a digital twin makes it distinct from a dummy replica of the physical system [9,10].”
Digital Twins: From Personalised Medicine to Precision Public Health
Kamel Boulos, M. N., & Zhang, P. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11080745 · Cited by 530
On the Integration of Agents and Digital Twins in Healthcare
Croatti, A., Gabellini, M., Montagna, S., & Ricci, A. (2020) · Journal of Medical Systems · doi:10.1007/s10916-020-01623-5 · Cited by 350 · cited 1×
“• Limitations associated with relying solely on secondary data could indicate that future research should prioritize empirical validation through direct engagement with health care professionals, caregivers, and older adults [49,50].”
Prakosa, A., Arevalo, H. J., Deng, D., Boyle, P. M., Nikolov, P. P., Ashikaga, H., Blauer, J. J. E., Ghafoori, E., Park, C. J., Blake, R. C., et al. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0282-2 · Cited by 297 · cited 2×
“These sophisticated virtual representations simulate individual health profiles by integrating extensive datasets, promising personalized health and social care interventions that can significantly enhance patient outcomes [5,6].”
Venkatesh, K. P., Raza, M. M., & Kvedar, J. C. (2022) · npj Digital Medicine · doi:10.1038/s41746-022-00694-7 · Cited by 232 · cited 3×
“• Engagement is essential for refining the practical applications of DHTs and effectively assessing their real-world impact [9,19,29].”
Sahal, R., Alsamhi, S. H., & Brown, K. N. (2022) · Sensors · doi:10.3390/s22155918 · Cited by 174 · cited 6×
“The studies span different periods, with some focusing on contemporary advancements [32] and others taking a longer-term view of digital health transformation [26].”
InfluentialTowards enabling a cardiovascular digital twin for human systemic circulation using inverse analysis
Chakshu, N. K., SAZONOV, I. A., & Nithiarasu, P. (2020) · Biomechanics and Modeling in Mechanobiology · doi:10.1007/s10237-020-01393-6 · Cited by 121 · cited 5×
“Although DHTs hold promise for personalized care, disparities in access to technology may exacerbate existing health inequities [16].”
InfluentialGraph Representation Forecasting of Patient's Medical Conditions: Toward a Digital Twin
Barbiero, P., Viñas, R., & Lió, P. (2021) · Frontiers in Genetics · doi:10.3389/fgene.2021.652907 · Cited by 110 · cited 5×
“Both studies demonstrated how, although helpful for precision treatment, personalized health care models could worsen disparities if access is not sufficiently addressed [7,11].”
InfluentialAlruwaili, M. M., Shaban, M., & Elsayed Ramadan, O. M. (2023) · Sustainability · doi:10.3390/su152316503 · Cited by 109 · cited 1×
“This is achieved through the promotion of preventive care, disease self-management, and the personalized interventions that address the specific needs of older adults [1,2].”
Human Digital Twin for Personalized Elderly Type 2 Diabetes Management
Thamotharan, P., Srinivasan, S., Kesavadev, J., Krishnan, G., Mohan, V., Seshadhri, S., Bekiroglu, K., & Toffanin, C. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12062094 · Cited by 106 · cited 3×
“There has been a consistent call for robust ethical oversight, patient-centered governance, and policies that ensure equitable access to these technologies [12,21,23].”
Developing an Integrated Assessment Tool for the Health and Social Care of Older People
Taylor, B. J. (2011) · The British Journal of Social Work · doi:10.1093/bjsw/bcr133 · Cited by 67 · cited 1×
“Creating personalized health models could inadvertently establish new benchmarks affecting the safety and effectiveness of health and social care interventions across diverse patient populations [13].”
Calderita, L. V., Vega, A., Barroso, S., Bustos, P., & Núñez, P. (2020) · Sensors · doi:10.3390/s20144005 · Cited by 62 · cited 1×
“The usefulness of such technologies in home-care environments where technology and care capabilities are limited has not been adequately established [27].”
Digital twins to enable better precision and personalized dementia care
Wickramasinghe, N. S., Ulapane, N. N. B., Andargoli, A., Ossai, C. I., Shuakat, M. N., Nguyen, T. A., & Zelcer, J. (2022) · JAMIA Open · doi:10.1093/jamiaopen/ooac072 · Cited by 59 · cited 3×
“On the other hand, the transition to DHT-based care models necessitates significant changes to clinical workflows, potentially increasing short-term workload and requiring extensive training [31].”
Digital Twins in Critical Care: What, When, How, Where, Why?
Chase, J. G., Zhou, C., Knopp, J. L., Shaw, G. M., Näswall, K., Wong, J. H. K., Malinen, S. K., Möeller, K., Benyó, B. I., Chiew, Y. S., et al. (2021) · IFAC-PapersOnLine · doi:10.1016/j.ifacol.2021.10.274 · Cited by 50 · cited 1×
“To support the effective integration of DHTs into care for older adults, several key considerations for system adaptation can be identified: • This study clearly highlights the pressing need for health and social care providers and institutions to integrate DHTs thoughtfully [48].”
Bahrami, F., Rossi, R. M., Nys, K. D., & Defraeye, T. (2023) · Drug Delivery and Translational Research · doi:10.1007/s13346-023-01305-y · Cited by 50 · cited 3×
“Research studies by Bahrami et al [7,18] highlighted how inequitable access to tailored drug therapies and health interventions could worsen disparities in health outcomes if these technologies were not broadly accessible or affordable.”
Harnessing digital health interventions to bridge the gap in prevention for older adults
Daniels, K., & Bonnechère, B. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1281923 · Cited by 45 · cited 1×
“Digital health interventions can be tailored to individual needs and abilities (personalized care), addressing specific health concerns like falls, sarcopenia, and mental health challenges to support independence and well-being [3,4].”
Rahman Jabin, M. S., Steen, M., Wepa, D., & Bergman, P. (2023) · DIGITAL HEALTH · doi:10.1177/20552076231174307 · Cited by 44 · cited 1×
“Ethical guidelines governing the use of DHT must prioritize informed patient choice over algorithmic assumptions, so that clinical decisions are made appropriately based on clinical need [28,45].”
Jabin, M. S. R. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1367431 · Cited by 43 · cited 1×
“Although DHTs provide substantial benefits, such as continuous health monitoring [40] and predictive health care analytics [7], they also introduce risks, including data breaches and unwarranted surveillance [19].”
Self-citationRahman Jabin, M. S., & Pan, D. (2023) · DIGITAL HEALTH · doi:10.1177/20552076231203600 · Cited by 41 · cited 1×
“The performance of any digital health technology dramatically depends on the environment in which they are implemented [41,42].”
Jabin, M. S. R., Pan, D., & Nilsson, E. (2024) · Frontiers in Digital Health · doi:10.3389/fdgth.2024.1260521 · Cited by 41 · cited 1×
“This is achieved through the promotion of preventive care, disease self-management, and the personalized interventions that address the specific needs of older adults [1,2].”
Self-citationRahman Jabin, M. S., Pan, D., & Nilsson, E. (2022) · Health Informatics Journal · doi:10.1177/14604582221105440 · Cited by 40 · cited 1×
“Digital health interventions can be tailored to individual needs and abilities (personalized care), addressing specific health concerns like falls, sarcopenia, and mental health challenges to support independence and well-being [3,4].”
Digital health testbeds in Sweden: an exploratory study
Jabin, M. S. R., Nilsson, E., Nilsson, A.-L., Bergman, P., & Jokela, P. (2022) · DIGITAL HEALTH · doi:10.1177/20552076221075194 · Cited by 37 · cited 1×
“The performance of any digital health technology dramatically depends on the environment in which they are implemented [41,42].”
Self-citationImproving cloud storage and privacy security for digital twin based medical records
Yi, H. (2023) · Journal of Cloud Computing Advances Systems and Applications · doi:10.1186/s13677-023-00523-6 · Cited by 37 · cited 1×
“The continuous and urgent influx of personal health information, combined with the potential for remote access and manipulation, makes DHTs a prime target for cyberattacks and privacy breaches, highlighting the need for collaborative efforts among professionals to address this issue [15].”
The paradigm and future value of the metaverse for the intervention of cognitive decline
Zhou, H., Gao, J.-Y., & Chen, Y. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.1016680 · Cited by 35 · cited 1×
“On the other hand, Sahal et al [32] and Zhou et al [33] advocated for integrating blockchain technologies and decentralized models to enhance data security and user control.”
Rodríguez-Aguilar, R., & Marmolejo-Saucedo, J. A. (2020) · EAI Endorsed Transactions on Pervasive Health and Technology · doi:10.4108/eai.13-7-2018.164261 · Cited by 29 · cited 1×
“However, deploying such innovations must be approached with caution to mitigate risks related to data privacy and security, particularly among older adults who are often more susceptible to data breaches [14].”
Khan, S., Saied, I., Ratnarajah, T., & Arslan, T. (2022) · Sensors · doi:10.3390/s22218519 · Cited by 28 · cited 7×
“This concern is amplified in older populations [30] who may lack familiarity with digital systems and are more susceptible to exploitation.”
InfluentialMarasinghe, K. M., Chaurasia, A. K., Adil, M., Liu, Q. Y., Nur, T. I., & Oremus, M. (2022) · BMC Geriatrics · doi:10.1186/s12877-022-03557-8 · Cited by 28 · cited 1×
“…future practice and policy: • The implications of this study emphasize the necessity for solid ethical guidelines and policy frameworks to mitigate the potential risks associated with DHT application in older adult care and to ensure that the patient remains the ultimate decision-maker [30,46,47].”
Bahrami, F., Rossi, R. M., & Defraeye, T. (2022) · Drug Delivery · doi:10.1080/10717544.2022.2050846 · Cited by 27 · cited 9×
“Both studies demonstrated how, although helpful for precision treatment, personalized health care models could worsen disparities if access is not sufficiently addressed [7,11].”
InfluentialJabin, M. S. R., Yaroson, E. V., Ilodibe, A., & Eldabi, T. (2023) · JMIR Research Protocols · doi:10.2196/51153 · Cited by 24 · cited 4×
“Despite the considerable advantages that DHTs present—improvements in effectiveness, safety, and accessibility of care—their implementation raises critical ethical dilemmas and challenges related to the quality of care that necessitate rigorous examination [7,8].”
InfluentialSelf-citationCai, F., Patharkar, A., Wu, T., Lure, F. Y. M., Chen, H., & Chen, V. C. (2023) · IEEE Sensors Journal · doi:10.1109/jsen.2023.3263071 · Cited by 23 · cited 3×
“In contrast, studies like the one by Cai et al [34] focus on the early detection of Alzheimer disease, aiming to measure how DHTs could assist in identifying disease risk early, ultimately improving diagnosis and treatment outcomes.”
Lin, T., Chiu, S. Y., Liao, L.-C., Chen, S. L., Chiu, H., & Chen, T. H.-H. (2023) · npj Digital Medicine · doi:10.1038/s41746-023-00763-5 · Cited by 22
Jabin, S. R., Schultz, T., Hibbert, P. D., Mandel, C., & Runciman, W. B. (2016) · The JBI Database of Systematic Reviews and Implementation Reports · doi:10.11124/jbisrir-2016-003078 · Cited by 17 · cited 1×
“The second ethical concern is overdiagnosis [43,44].”
Alves, S. F. D. R., Uribe-Quevedo, Á., Chen, D., Morris, J., & Radmard, S. (2022) · IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) · doi:10.1109/vrw55335.2022.00036 · Cited by 15 · cited 7×
“Alves and colleagues’ [5] focus on online training environments and Sahal and colleagues’ [32] blockchain-enabled PDT framework were both operating in tandem, suggesting technological steps to ensure openness and confidence [5,32].”
InfluentialVidal, P., Vienne-Jumeau, A., Moreau, A., Vidal, C., Wang, D., Audiffren, J., Bargiotas, I., Barrois, R., Buffat, S., Dubost, C., et al. (2020) · Aging Medicine · doi:10.1002/agm2.12115 · Cited by 13 · cited 4×
“Informed consent in these contexts became a complex ethical issue, as health care providers must balance the benefits of personalized care with the need to protect vulnerable patients’ rights to autonomy and decision-making [22,26,28].”
InfluentialJabin, M. S. R., Schultz, T., Mandel, C., Bessen, T., Hibbert, P., Wiles, L., & Runciman, W. (2022) · Journal of Patient Safety · doi:10.1097/pts.0000000000000709 · Cited by 13 · cited 1×
“The second ethical concern is overdiagnosis [43,44].”
Self-citationJabin, M. S. R., Samuriwo, R., Chilaka, M. A., & Yaroson, E. V. (2024) · JMIR Research Protocols · doi:10.2196/56346 · Cited by 8 · cited 1×
“…future practice and policy: • The implications of this study emphasize the necessity for solid ethical guidelines and policy frameworks to mitigate the potential risks associated with DHT application in older adult care and to ensure that the patient remains the ultimate decision-maker [30,46,47].”
Self-citationJovanović, R., Davidović, M., Lazović, I. M., Jovanović, M., & Jovašević-Stojanović, M. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18126217 · Cited by 7 · cited 7×
“For example, in-home care environments, where resources might be limited, implementing DHTs could be more challenging compared to well-equipped health care facilities [29].”
InfluentialDementia Sign Detection System Using Digital Twin
Kobayashi, T., Fukae, K., Imai, T., & Arai, K. (2021) · International Symposium on Computing and Networking · doi:10.1109/candar53791.2021.00025 · Cited by 6 · cited 8×
“This illustrates the potential of DHTs in early disease detection and dementia, particularly in highlighting their potential contribution to preventive health care [19].”
InfluentialResearch on the Elderly User Assisted Experience Based on Digital Twin Remote Collaboration System
Zhao, Y., Mao, M., Wang, Y., & Hu, G. (2023) · Frontiers in artificial intelligence and applications · doi:10.3233/faia220717 · Cited by 4 · cited 7×
“These systems can enhance care safety and effectiveness through timely interventions and provoke significant privacy and autonomy concerns [20].”
Influential
Cited by
Jabin, M. S. R. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1785086 · Cited by 10
Self-citationWhy health information technology safety problems remain invisible
Jabin, M. S. R. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1785141 · Cited by 16
Self-citationJabin, M. S. R., & Nyatuka, D. R. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1848840 · Cited by 9
Self-citationJabin, M. S. R., & Nyatuka, D. R. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1848844 · Cited by 7
Self-citationDigital Twins in Neurology Care: Evidence, Limitations, and a Path Forward
Gazerani, P. (2026) · Journal of Integrative Neuroscience · doi:10.31083/jin50563 · Cited by 2
Metadata
- Authors
- Jabin, M. S. R., Mirza, A., Ilodibe, A., Eldabi, T., & Vann Yaroson, E.
- Affiliations
- University of Bradford (GB)
- Corresponding author
- Jabin, Md Shafiqur Rahman
- Venue
- JMIR Aging
- Publisher
- JMIR Publications Inc.
- Published
- 2025-10-28
- Volume
- 8
- Pages
- e73925-e73925
- ISSN
- 2561-7605 (ISSN-L)
- PMC
- PMC12560958
- OpenAlex
- W4415695894
- Cited by
- 18
- References
- 48
- Citations by year
- 2026: 18
- FWCI
- 1.06
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR Aging (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Health Sciences › Medicine › Geriatrics and Gerontology › Technology Use by Older Adults
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Keywords
- older adults, ethics of digital health, quality of care, data security and privacy, informed consent, patient autonomy, overdiagnosis, provider workload, implementation barriers, digital health adoption, health care effectiveness, health care outcomes
- MeSH terms
- Digital Health, Aged, Humans, Middle Aged, Quality of Health Care, Telemedicine
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
