Six habits of highly successful health information technology: powerful strategies for design and implementation
Open accessThe DOI matches its Crossref record; 52 of the 53 references it cites were found in a registry or an index.
Abstract
Healthcare information technologies are now a routine component of patient–clinician interactions. Originally designed for operational functions including billing and regulatory compliance, these systems have had unintended consequences including increased exam room documentation, divided attention during the visit, and use of scribes to alleviate documentation burdens. In an age in which technology is ubiquitous in everyday life, we must re-envision healthcare technology to support both clinical operations and, above all, the patient–clinician relationship. We present 6 habits for designing user-centered health technologies: (1) put patient care first, (2) assemble a team with the right skills, (3) relentlessly ask WHY, (4) keep it simple, (5) be Darwinian, and (6) don’t lose the forest for the trees. These habits should open dialogues between developers, implementers, end users, and stakeholders, as well as outline a path for better, more usable technology that puts patients and their clinicians back at the center of care.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Following existing standards from the industry was recommended as this supports the interoperability of AIPMs9,18,20,26 (e.g., ISO/IEC JTC 1/SC 4292 or the IEEE 7000-202193).”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“A feasibility study or implementation pilot is recommended preceding an impact study to ensure correct and safe use in healthcare practice10,18,72.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [18]
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This type of study consists of repeated live clinical tests in which variation is key to understanding the functionality of the technology and workflow11,18.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [18]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“To arrive at a good design, repeated extensive user experience testing is recommended11,18.”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [18]
In the citing paper
“End users interacting with the AIPM can be healthcare professionals, auditors, or patients (e.g., physicians may need to communicate about the AIPM with patients18).”
From Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: a scoping review (2022) · cites this paper as [18]
4 more claims about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1993) · Cited by 9,879
The information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1954) · Journal of Experimental Psychology · doi:10.1037/h0055392 · Cited by 6,466 · cited 1×
“35,36 This principle has been used in cockpit design for over 60 years but is rarely considered when determining the placement of buttons to click in the EHR.”
BackgroundThe information capacity of the human motor system in controlling the amplitude of movement.
Fitts, P. M. (1992) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.121.3.262 · Cited by 6,278
Designing the user interface: Strategies for effective human-computer interaction
(1993) · Applied Ergonomics · doi:10.1016/0003-6870(93)90471-k · Cited by 5,587
(1993) · Elsevier eBooks · doi:10.1016/c2009-0-21512-1 · Cited by 5,504
User Centered System Design: New Perspectives on Human-computer Interaction
Norman, D. A., & Draper, S. W. (1986) · CRC Press eBooks · doi:10.1201/b15703 · Cited by 3,132
Agile Software Development with SCRUM
Schwaber, K., & Beedle, M. (2001) · Cited by 2,656
Physician Communication and Patient Adherence to Treatment: A Meta-Analysis
Haskard Zolnierek, K. B., & DiMatteo, M. R. (2009) · Medical Care · doi:10.1097/mlr.0b013e31819a5acc · Cited by 2,489
A mathematical model of the finding of usability problems
Nielsen, J., & Landauer, T. K. (1993) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '93 · doi:10.1145/169059.169166 · Cited by 1,961
User Centered System Design: New Perspectives on Human-Computer Interaction
Anderson, N. S., Norman, D. A., & Draper, S. W. (1988) · The American Journal of Psychology · doi:10.2307/1422802 · Cited by 1,840
Ash, J. S. (2003) · Journal of the American Medical Informatics Association · doi:10.1197/jamia.m1471 · Cited by 1,789 · cited 1×
“50 Incremental benefits when considered in the aggregate can be hazardous if they overload the humans in the system.”
BackgroundMotor-output variability: A theory for the accuracy of rapid motor acts.
Schmidt, R. A. (1979) · Psychological Review · doi:10.1037//0033-295x.86.5.415 · Cited by 1,555 · cited 1×
“35,36 This principle has been used in cockpit design for over 60 years but is rarely considered when determining the placement of buttons to click in the EHR.”
BackgroundUse of Electronic Health Records in U.S. Hospitals
Jha, A. K., DesRoches, C. M., Campbell, E. G., Donelan, K., Rao, S. R., Ferris, T. G., Shields, A., Rosenbaum, S., & Blumenthal, D. (2009) · New England Journal of Medicine · doi:10.1056/nejmsa0900592 · Cited by 1,473 · cited 1×
“In a 2009 survey of almost 3000 hospitals across the United States, fewer than 1 in 10 had an electronic health record system (EHR).(1) That same year, the federal government implemented the Health Information Technology Economic and Clinical Health Act.”
BackgroundOn error management: lessons from aviation
Helmreich, R. L. (2000) · BMJ · doi:10.1136/bmj.320.7237.781 · Cited by 1,327 · cited 2×
“33,34 Designers should leverage the science of human factors in considering the user’s abilities and limits for visual perception, working memory, and motor skill.”
BackgroundLevinson, W. (1997) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1997.03540310051034 · Cited by 1,119
Methods to support human-centred design
MAGUIRE, M. (2001) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.2001.0503 · Cited by 1,057 · cited 2×
“28,31 Building from user-generated ideas can establish early user buy-in for later design solutions.”
BackgroundBeyond the five-user assumption: benefits of increased sample sizes in usability testing
Faulkner, L. (2003) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195514 · Cited by 1,053 · cited 1×
“The most important issues are often identified with only 3-5 users; groups of 15 participants find more than 90% of errors.(45,46) Prepare for implementation by understanding potential barriers and solutions.”
BackgroundEffectiveness of empathy in general practice: a systematic review
Derksen, F., Bensing, J., & Lagro-Janssen, A. (2013) · British Journal of General Practice · doi:10.3399/bjgp13x660814 · Cited by 1,034
Arndt, B. G., Beasley, J. W., Watkinson, M. D., Temte, J. L., Tuan, W.-J., Sinsky, C. A., & Gilchrist, V. J. (2017) · The Annals of Family Medicine · doi:10.1370/afm.2121 · Cited by 972 · cited 2×
“Physicians now spend nearly 45% of their workday and more than 11 h/wk outside of their workdays interacting with EHRs.(51) Although much of this time is spent satisfying documentation requirements,(32) technology should be capable of easing some of this burden.”
BackgroundSelf-citationSittig, D. F., & Singh, H. (2010) · Quality and Safety in Health Care · doi:10.1136/qshc.2010.042085 · Cited by 897 · cited 1×
“Safe adoption of any new HIT requires careful consideration of technology design within medicine’s complex social, political, and communication systems.(5) Despite intentions to improve safety, new technologies can introduce safety risks.”
BackgroundSMART on FHIR: a standards-based, interoperable apps platform for electronic health records
Mandel, J. C., Kreda, D. A., Mandl, K. D., Kohane, I. S., & Ramoni, R. B. (2016) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv189 · Cited by 829 · cited 1×
“41 Industry standards exist for technology platforms (eg, SMART on FHIR [Fast Healthcare Interoperability Resource]) 42 and usability testing (eg, International Organization for Standardization (ISO), Usability.gov).”
MethodDesigning the user interface: Strategies for effective human-computer interaction
Sriram, D. (1987) · Artificial Intelligence in Engineering · doi:10.1016/0954-1810(87)90189-0 · Cited by 756
Blumenthal, D. (2010) · New England Journal of Medicine · doi:10.1056/nejmp0912825 · Cited by 714 · cited 1×
“The legislation called for the adoption and meaningful use of health information technology (HIT) to support coordination of care, tracking of clinical conditions, and clinical quality measures.(2) By 2015, 96%(3) of nonfederal acute care hospitals and 86% of office-based physicians reported adopting some type of EHR…”
BackgroundCreative Confidence: Unleashing the Creative Potential Within Us All
Kelley, T. A., & Kelley, D. H. (2013) · Cited by 649
Middleton, B., Bloomrosen, M., Dente, M. A., Hashmat, B., Koppel, R., Overhage, J. M., Payne, T. H., Rosenbloom, S. T., Weaver, C., & Zhang, J. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2012-001458 · Cited by 618
Health IT and Patient Safety: Building Safer Systems for Better Care
Chou, D. (2012) · JAMA · doi:10.1001/jama.308.21.2282-a · Cited by 503
Physician Burnout in the Electronic Health Record Era: Are We Ignoring the Real Cause?
Downing, N. L., Bates, D. W., & Longhurst, C. A. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0139 · Cited by 418 · cited 2×
“32 In this model, needs of the client have prioritized institutional level goals over the patient–clinician relationship often at the expense of both of these key end users.”
BackgroundIn Search of Joy in Practice: A Report of 23 High-Functioning Primary Care Practices
Sinsky, C. A., Willard-Grace, R., Schutzbank, A. M., Sinsky, T. A., Margolius, D., & Bodenheimer, T. (2013) · The Annals of Family Medicine · doi:10.1370/afm.1531 · Cited by 415 · cited 1×
“Team-based care, in which a clerically or clinically trained person provides in-room data entry and retrieval support, allows the clinician to provide undivided attention to the patient.(18,19) Performing front-line clinician and patient needs assessments during early design phases can help to drive new and innovative…”
BackgroundSelf-citationElectronic Health Record Usability Issues and Potential Contribution to Patient Harm
Howe, J. L., Adams, K. T., Hettinger, A. Z., & Ratwani, R. M. (2018) · JAMA · doi:10.1001/jama.2018.1171 · Cited by 281 · cited 1×
“6,40 Technical standards are essential for error prevention, learnability, efficiency, and interoperability.”
BackgroundSelf-citationZahabi, M., Kaber, D. B., & Swangnetr, M. (2015) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720815576827 · Cited by 240 · cited 1×
“37,38 Moreover, the use of smart data entry may aid error prevention by supporting cognitive processing during documentation.”
BackgroundAlkureishi, M. A., Lee, W. W., Lyons, M., Press, V. G., Imam, S., Nkansah-Amankra, A., Werner, D., & Arora, V. M. (2016) · Journal of General Internal Medicine · doi:10.1007/s11606-015-3582-1 · Cited by 230 · cited 1×
“A systematic review of the literature on HIT in the patient–clinician relationship demonstrates EHR use can negatively impact communication behaviors through interrupted speech patterns, multitasking, and lack of screen sharing.(11) HIT can be a positive factor when technology is situated in a way that facilitates con…”
BackgroundRatwani, R. M., Fairbanks, R. J., Hettinger, A. Z., & Benda, N. C. (2015) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocv050 · Cited by 204 · cited 2×
“Yet, many technology developers are not employing well-developed UCD processes.(25,26) Challenges for developers employing UCD range from lack of understanding, resources, and access to the right users and contexts.”
BackgroundSelf-citationA usability and safety analysis of electronic health records: a multi-center study
Ratwani, R. M., Savage, E., Will, A., Arnold, R., Khairat, S., Miller, K., Fairbanks, R. J., Hodgkins, M., & Hettinger, A. Z. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy088 · Cited by 180 · cited 2×
“40,47 Both healthcare organizations and vendors need to encourage user feed-back.”
BackgroundSelf-citationIdentifying electronic health record usability and safety challenges in pediatric settings
Ratwani, R. M., Savage, E., Will, A., Fong, A., Karavite, D., Muthu, N., Rivera, A. J., Gibson, C., Asmonga, D., Moscovitch, B., et al. (2018) · Health Affairs · doi:10.1377/hlthaff.2018.0699 · Cited by 163 · cited 1×
“Despite intentions to improve safety, new technologies can introduce safety risks.(6,7) A 2012 National Academy of Medicine report lists usability, workflow, and interface complexity among the patient safety threats related to the introduction of HIT.”
BackgroundSelf-citationNavigation in the electronic health record: A review of the safety and usability literature
Roman, L. C., Ancker, J. S., Johnson, S. B., & Senathirajah, Y. (2017) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2017.01.005 · Cited by 163 · cited 1×
“39 Inconsistency in HIT designs and lack of adoption of shared standards creates patient safety challenges.”
BackgroundDuke, P., Frankel, R. M., & Reis, S. (2013) · Teaching and Learning in Medicine · doi:10.1080/10401334.2013.827981 · Cited by 138 · cited 1×
“Work specific to EHR implementation highlights the importance of usability, 52 evaluation, 47 the environment, 53 and clinician training.”
BackgroundSelf-citationToll, E. (2012) · JAMA · doi:10.1001/jama.2012.4946 · Cited by 114 · cited 1×
“The introduction of HIT, especially in the exam room, splits providers’ attention between a computer screen and the patient.(14) Empathic clinician communication is a key driver for better patient adherence, clinical outcomes, and reduced risk of malpractice lawsuits.”
BackgroundTechnical evaluation, testing, and validatiaon of the usability of electronic health records
Lowry, S. Z., Quinn, M. T., Ramaiah, M., Schumacher, R. M., Patterson, E. S., North, R. A., Zhang, J., Gibbons, M. C., & Abbott, P. A. (2012) · doi:10.6028/nist.ir.7804 · Cited by 101 · cited 1×
“41 Industry standards exist for technology platforms (eg, SMART on FHIR [Fast Healthcare Interoperability Resource]) 42 and usability testing (eg, International Organization for Standardization (ISO), Usability.gov).”
MethodA systems engineering perspective on the human-centered design of health information systems
Samaras, G. M., & Horst, R. L. (2004) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2004.11.013 · Cited by 100 · cited 1×
“Formative evaluation of prototypes with users, allows for an iterative design process identifying which features are successful and which need to be redesigned or eliminated early in development.(28,31) Building from user-generated ideas can establish early user buy-in for later design solutions.”
MethodAshton, M. (2018) · New England Journal of Medicine · doi:10.1056/nejmp1809698 · Cited by 100 · cited 1×
“30 Ideas can then be refined with low-fidelity prototypes.”
BackgroundEffken, J. A. (2002) · International Journal of Medical Informatics · doi:10.1016/s1386-5056(02)00003-5 · Cited by 95 · cited 1×
“27,28 Design thinking approaches engage users and key stakeholders directly in design processes through brainstorming.”
BackgroundRatwani, R. M., Benda, N. C., Hettinger, A. Z., & Fairbanks, R. J. (2015) · JAMA · doi:10.1001/jama.2015.8372 · Cited by 91 · cited 3×
“Yet, many technology developers are not employing well-developed UCD processes.(25,26) Challenges for developers employing UCD range from lack of understanding, resources, and access to the right users and contexts.”
BackgroundSelf-citationSittig, D. F., Ash, J. S., & Singh, H. (2014) · PubMed · Cited by 87
The Patient-Physician Relationship: JAMA Focuses on the Center of Medicine
Glass, R. M. (1996) · JAMA · doi:10.1001/jama.1996.03530260061033 · Cited by 81 · cited 1×
“The clinician–patient relationship is the center of medicine; we should move away from technology driving patient care to patient care driving technology.(20) Doing so will likely lead to new, patient-centered hardware and software configurations.”
BackgroundTransitional Chaos or Enduring Harm? The EHR and the Disruption of Medicine
Rosenbaum, L. (2015) · New England Journal of Medicine · doi:10.1056/nejmp1509961 · Cited by 76
Fairbanks, T., Savage, E., Adams, K., Wittie, M., Boone, E., Hayden, A., Barnes, J., Hettinger, Z., Gettinger, A., & Ratwani, R. (2016) · Applied Clinical Informatics · doi:10.4338/aci-2016-06-r-0105 · Cited by 75 · cited 1×
“40,47 Both healthcare organizations and vendors need to encourage user feed-back.”
BackgroundSelf-citationCreating a “Manageable Cockpit” for Clinicians: A Shared Responsibility
Sinsky, C. A., & Privitera, M. R. (2018) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2018.0575 · Cited by 64 · cited 2×
“33,34 Designers should leverage the science of human factors in considering the user’s abilities and limits for visual perception, working memory, and motor skill.”
BackgroundSelf-citationMiller, K., Capan, M., Weldon, D., Noaiseh, Y., Kowalski, R., Kraft, R., Schwartz, S., Weintraub, W. S., & Arnold, R. (2018) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2018.05.008 · Cited by 50 · cited 1×
“37,38 Moreover, the use of smart data entry may aid error prevention by supporting cognitive processing during documentation.”
BackgroundTeam-based care: saving time and improving efficiency.
Hopkins, K., & Sinsky, C. A. (2014) · PubMed · Cited by 40
Self-citationImproving Electronic Health Record Usability and Safety Requires Transparency
Ratwani, R. M., Hodgkins, M., & Bates, D. W. (2018) · JAMA · doi:10.1001/jama.2018.14079 · Cited by 36 · cited 1×
“It is important to find and address these errors before they reach the patient.(49) The healthcare landscape is dynamic; technical solutions supporting it must adapt as the field advances.”
BackgroundSelf-citationShould US doctors embrace electronic health records?
(2017) · BMJ · doi:10.1136/bmj.j242 · Cited by 18 · cited 1×
“To address these concerns, we need to envision new possibilities for the patient–clinician-EHR relationship in the digital age.(10) To accelerate a move from widespread (and widely frustrating)(13)”
BackgroundSelf-citationNew Marketplace Survey: The Sources of Health Care Innovation
Dafny, L., & Mohta, N. S. (2017) · NEJM Catalyst · Cited by 7
Research works printed but not linked: 4
- 3. Henry J, Pylypchuk Y, Searcy T, et al. Adoption of electronic health record systems among US non-federal acute care hospitals: 2008-2015. ONC Data Brief 2016; 35: 1–9. [PubMed] [Google Scholar]
- 4. The Office of the National Coordinator for Health Information. Office-based Health Care Professionals Participating in the CMS EHR Incentive Programs. Health IT Quick-Stat #44; 2017. https://dashboard.healthit.gov/quickstats/pages/FIG-Health-Care-Professionals-EHR-Incentive-Programs.php. Accessed June 4, 2019. [Google Scholar]
- 13. Gawande A. Why doctors hate their computers. The New Yorker. 2018. Nov 5. https://www.newyorker.com/magazine/2018/11/12/why-doctors-hate-their-computers. Accessed June 4, 2019. [Google Scholar]
- 2009, Ergonomics of human system interaction-Part 210: Human-centred design for interactive systems
Cited by
de Hond, A. A. H., Leeuwenberg, A. M., Hooft, L., Kant, I. M. J., Nijman, S. W. J., van Os, H. J. A., Aardoom, J. J., Debray, T. P. A., Schuit, E., van Smeden, M., et al. (2022) · npj Digital Medicine · doi:10.1038/s41746-021-00549-7 · Cited by 499
“Identifying and involving the right expertise and stakeholders in each consecutive phase of the AIPM development, evaluation and implementation cycle is crucial for its success in daily healthcare practice 8,18,22,23,26,32,58,79,88 .”
BackgroundMethodInfluentialMelnick, E. R., Harry, E., Sinsky, C. A., Dyrbye, L. N., Wang, H., Trockel, M. T., West, C. P., & Shanafelt, T. (2020) · Journal of Medical Internet Research · doi:10.2196/23382 · Cited by 100
“…into consideration to design EHR interfaces and workflows that meet users’needs and are free from unnecessary extraneous cognitive load, such that the EHR becomes part of a physician work environment more closely resembling a “manageable cockpit” that is streamlined, ergonomic, and safe [10,61,62].”
BackgroundSelf-citationTransitions from One Electronic Health Record to Another: Challenges, Pitfalls, and Recommendations
Huang, C., Koppel, R., McGreevey, J. D., Craven, C. K., & Schreiber, R. (2020) · Applied Clinical Informatics · doi:10.1055/s-0040-1718535 · Cited by 97
“8,24 We have observed transitions requiring dozens to hundreds of additional staff — some of whom continue for several years, especially to preserve legacy systems.”
BackgroundHofer, I. S., Burns, M., Kendale, S., & Wanderer, J. P. (2020) · Anesthesia & Analgesia · doi:10.1213/ane.0000000000004575 · Cited by 70
Artificial intelligence and telemedicine in anesthesia: potential and problems
Bellini, V., Valente, M., Gaddi, A. V., Pelosi, P. P., & Bignami, E. G. (2022) · Minerva Anestesiologica · doi:10.23736/s0375-9393.21.16241-8 · Cited by 79
Metadata
- Authors
- Ray, J. M., Ratwani, R. M., Sinsky, C. A., Frankel, R. M., Friedberg, M. W., Powsner, S. M., Rosenthal, D. I., Wachter, R. M., & Melnick, E. R.
- Affiliations
- Yale University (US)
- MedStar Health (US)
- American Medical Association (US)
- Cleveland Clinic (US)
- Brigham and Women's Hospital (US)
- University of California, San Francisco (US)
- Corresponding author
- Melnick, Edward R
- ORCID
- Venue
- Journal of the American Medical Informatics Association
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-07-02
- Volume
- 26
- Issue
- 10
- Pages
- 1109-1114
- ISSN
- 1067-5027 (ISSN-L)
- 1527-974X
- PMC
- PMC7647223
- OpenAlex
- W2955254708
- Cited by
- 34
- References
- 53
- Citations by year
- 2026: 7 · 2025: 4 · 2024: 3 · 2023: 4 · 2022: 4 · 2021: 7 · 2020: 5
- FWCI
- 4.37
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- Journal of the American Medical Informatics Association (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- IUScholarWorks (Indiana University) (submittedVersion)
- Purdue University Indianapolis (Indiana University) (submittedVersion)
- Topics
- Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
- Physical Sciences › Computer Science › Human-Computer Interaction › Usability and User Interface Design
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Technology and Human Factors in Education and Health
- Keywords
- health information technology, user-centered design, patient-clinician relationship, clinical documentation burden, EHR implementation, usability, stakeholder engagement, clinical workflow, scribes
- MeSH terms
- User-Centered Design, Patient Care, Humans, Medical Informatics, Medical Informatics Applications, Physician-Patient Relations
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.