The Use of Technology for Communicating With Clinicians or Seeking Health Information in a Multilingual Urban Cohort: Cross-Sectional Survey
Open accessPublished version of a preprint
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
Background: Technology is being increasingly used to communicate health information, but there is limited knowledge on whether these strategies are effective for vulnerable populations, including non–English speaking or low-income individuals. Objective: This study assessed how language preferences (eg, English, Spanish, or Chinese), smartphone ownership, and the type of clinic for usual source of care (eg, no usual source of care, nonintegrated safety net, integrated safety net, private or community clinic, academic tertiary medical center, or integrated payer-provider) affect technology use for health-related communication. Methods: From May to September 2017, we administered a nonrandom, targeted survey to 1027 English-, Spanish-, and Chinese-speaking San Francisco residents and used weighted multivariable logistic regression analyses to assess predictors of five technology use outcomes. The three primary predictors of interest—language preference, smartphone ownership, and type of clinic for usual care—were adjusted for age, gender, race or ethnicity, limited English proficiency, educational attainment, health literacy, and health status. Three outcomes focused on use of email, SMS text message, or phone apps to communicate with clinicians. The two other outcomes were use of Web-based health videos or online health support groups. Results: Nearly one-third of participants watched Web-based health videos (367/1027, 35.74%) or used emails to communicate with their clinician (318/1027, 30.96%). In adjusted analyses, individuals without smartphones had significantly lower odds of texting their clinician (adjusted odds ratio [aOR] 0.27, 95% CI 0.13-0.56), using online health support groups (aOR 0.14, 95% CI 0.04-0.55), or watching Web-based health videos (aOR 0.31, 95% CI 0.15-0.64). Relative to English-speaking survey respondents, individuals who preferred Chinese had lower odds of texting their clinician (aOR 0.25, 95% CI 0.08-0.79), whereas Spanish-speaking survey respondents had lower odds of using apps to communicate with clinicians (aOR 0.34, 95% CI 0.16-0.75) or joining an online support group (aOR 0.30, 95% CI 0.10-0.92). Respondents who received care from a clinic affiliated with the integrated safety net, academic tertiary medical center, or integrated payer-provider systems had higher odds than individuals without a usual source of care at using emails, SMS text messages, or apps to communicate with clinicians. Conclusions: In vulnerable populations, smartphone ownership increases the use of many forms of technology for health purposes, but device ownership itself is not sufficient to increase the use of all technologies for communicating with clinicians. Language preference impacts the use of technology for health purposes even after considering English proficiency. Health system factors impact patients’ use of technology-enabled approaches for communicating with clinicians. No single factor was associated with higher odds of using technology for all health purposes; therefore, existing disparities in the use of digital health tools among diverse and vulnerable populations can only be addressed using a multipronged approach.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“An important aspect in the application of telemedicine will be the integration of telemedicine with the current health system workflows and the connection to the electronic health record [46].”
From Physicians’ Perspectives of Telemedicine During the COVID-19 Pandemic in China: Qualitative Survey Study (2021) · cites this paper as [46]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2008.08.010 · Cited by 51,384 · cited 1×
“REDCap [30,31] is a secure, Web-based software platform designed to support data capture for research studies.”
MethodThe REDCap consortium: building an international community of software platform partners
Harris, P. A., Taylor, R., Minor, B. L., Elliott, V., Fernandez, M., O'Neal, L., McLeod, L., Delacqua, G., Delacqua, F., Kirby, J., et al. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103208 · Cited by 24,013 · cited 1×
“REDCap [30,31] is a secure, Web-based software platform designed to support data capture for research studies.”
MethodTechnology Acceptance Model 3 and a Research Agenda on Interventions
Venkatesh, V., & Bala, H. (2008) · Decision Sciences · doi:10.1111/j.1540-5915.2008.00192.x · Cited by 8,159 · cited 4×
“However, we can use the technology acceptance model (TAM) [38] as a conceptual model to try to explain why certain populations may be more likely to use technology for each purpose.”
MethodInfluentialMoorhead, S. A., Hazlett, D. E., Harrison, L., Carroll, J. K., Irwin, A., & Hoving, C. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.1933 · Cited by 2,517 · cited 1×
“Similarly, prior studies have shown frequent use of social media for health-related purposes [19-21], but studies have rarely included non–English speaking, low socioeconomic populations.”
Validation of Screening Questions for Limited Health Literacy in a Large VA Outpatient Population
Chew, L. D., Griffin, J. M., Partin, M. R., Noorbaloochi, S., Grill, J. P., Snyder, A., Bradley, K. A., Nugent, S. M., Baines, A. D., & VanRyn, M. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-008-0520-5 · Cited by 1,428 · cited 2×
“English proficiency and health literacy were reported as limited if participants reported speaking English less than well or if participants felt less than quite a bit comfortable completing medical forms independently [27].”
BackgroundMethodInstrument translation process: a methods review
Maneesriwongul, W., & Dixon, J. K. (2004) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2004.03185.x · Cited by 1,320 · cited 1×
“) We used a standard dual-reviewer process [28] to translate questions for the Spanish and Chinese surveys.”
MethodKontos, E., Blake, K. D., Chou, W.-Y. S., & Prestin, A. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3117 · Cited by 917 · cited 2×
“For the most part, many of our findings are consistent with prior literature that females who are younger and better educated are more likely to use digital tools to engage in their health care [13,16,36].”
MethodResultGood intentions are not enough: how informatics interventions can worsen inequality
Veinot, T. C., Mitchell, H., & Ancker, J. S. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy052 · Cited by 704 · cited 1×
“Given the known disparities in internet use and broadband access among rural, older, lower socioeconomic status, nonwhite populations [2], reliance on technology to disseminate health information may exacerbate health inequities [3,4].”
BackgroundDiamond, L., Izquierdo, K., Canfield, D., Matsoukas, K., & Gany, F. (2019) · Journal of General Internal Medicine · doi:10.1007/s11606-019-04847-5 · Cited by 586 · cited 1×
“We also anticipated that language preference, similar to smartphone ownership, would be associated with all technology use behaviors given the known barriers to communicating with health care clinicians for limited English-proficient patients as well as the higher quantity of English-language health content in the int…”
BackgroundSarkar, U., Karter, A. J., Liu, J. Y., Adler, N. E., Nguyen, R., Lopez, A., & Schillinger, D. (2011) · Journal of the American Medical Informatics Association · doi:10.1136/jamia.2010.006015 · Cited by 428 · cited 1×
“Unfortunately, studies have consistently shown that patient portals are used less frequently by racial and ethnic minorities, persons of a lower socioeconomic status, and those without neighborhood broadband internet access [5-8].”
BackgroundSelf-citation
Cited by
Role of Health Literacy in Health-Related Information-Seeking Behavior Online: Cross-sectional Study
Lee, H. Y., Jin, S. W., Henning-Smith, C., Lee, J., & Lee, J. (2021) · Journal of Medical Internet Research · doi:10.2196/14088 · Cited by 180
“Thus, the internet has the potential to improve access to health information [9], to reduce barriers in communicating with health professionals [38], and to offer assistance to caregivers [39].”
BackgroundBlood, A. J., Cannon, C. P., Gordon, W. J., Mailly, C., MacLean, T., Subramaniam, S., Tucci, M., Crossen, J., Nichols, H., Wagholikar, K. B., et al. (2023) · JAMA Cardiology · doi:10.1001/jamacardio.2022.4018 · Cited by 108
Khoong, E. C., Butler, B. A., Mesina, O., Su, G., DeFries, T. B., Nijagal, M., & Lyles, C. R. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa234 · Cited by 94
Self-citationKhoong, E. C., Olazo, K., Rivadeneira, N. A., Thatipelli, S., Barr-Walker, J., Fontil, V., Lyles, C. R., & Sarkar, U. (2021) · npj Digital Medicine · doi:10.1038/s41746-021-00486-5 · Cited by 73
Self-citationHaynes, S. C., Kompala, T., Neinstein, A. B., Rosenthal, J. L., & Crossen, S. S. (2021) · Journal of Diabetes Science and Technology · doi:10.1177/1932296821997851 · Cited by 68
Chu, J. N., Sarkar, U., Rivadeneira, N. A., Hiatt, R. A., & Khoong, E. C. (2021) · Patient Education and Counseling · doi:10.1016/j.pec.2021.08.028 · Cited by 83
Self-citationDisparities in telehealth use: How should the supportive care community respond?
Dixit, N., Van Sebille, Y., Crawford, G. B., Ginex, P. K., Ortega, P. F., & Chan, R. J. (2022) · Supportive Care in Cancer · doi:10.1007/s00520-021-06629-4 · Cited by 62
Zeng, B., Rivadeneira, N. A., Wen, A., Sarkar, U., & Khoong, E. C. (2022) · Journal of Medical Internet Research · doi:10.2196/35828 · Cited by 57
“In prior studies, we have found that the accessibility and use of 1 digital health tool does not translate to other tools [4]; that is, the lessons learned about disparities in telemedicine use may not be applicable to disparities in patient portal use or the use of web-based communication and…”
Self-citationChallenges and Opportunities in Using Telehealth for Diabetes Care
Crossen, S. S., Bruggeman, B., Haller, M. J., & Raymond, J. K. (2022) · Diabetes Spectrum · doi:10.2337/dsi21-0018 · Cited by 50
Liu, J., Liu, S., Zheng, T., & Bi, Y. (2021) · JMIR Medical Informatics · doi:10.2196/26463 · Cited by 38
“An important aspect in the application of telemedicine will be the integration of telemedicine with the current health system workflows and the connection to the electronic health record [46].”
BackgroundQiu, Y., Huang, H., Gai, J., & Leo, G. D. (2024) · Journal of Medical Internet Research · doi:10.2196/65541 · Cited by 31
“…as the age-based disparity in digital health technology uses results from objective barriers (eg, bad internet connections or no digital devices) [11-13] and subjective barriers such as health literacy [14], we excluded the sample without internet connections or digital devices to isolate the…”
Rabinowitz, M. J., Kohn, T. P., Ellimoottil, C. S., Alam, R., Liu, J. L., & Herati, A. S. (2021) · Sexual Medicine · doi:10.1016/j.esxm.2021.100366 · Cited by 23
Kim, B. Y., Ma, Q., & Diamond, L. C. (2024) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3613905.3637125 · Cited by 21
“…literature on health disparities have examined how age, race, ethnicity, and smartphone ownership infuence a patient with LEP’s likelihood of using the patient portal [11, 17], but no studies have examined how patients with LEP interact with the patient portal ofered in their preferred languages.”
Health Equity in the Veterans Health Administration From Veterans’ Perspectives by Race and Sex
Lee, N. S., Keddem, S., Sorrentino, A. E., Jenkins, K. A., & Long, J. A. (2024) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.56600 · Cited by 16
Lin, J. L., Huber, B., Amir, O., Gehrmann, S., Ramirez, K. S., Ochoa, K. M., Asch, S. M., Gajos, K. Z., Grosz, B. J., & Sanders, L. (2022) · Journal of Medical Internet Research · doi:10.2196/30902 · Cited by 14
Lessons learned from a multi-site collaborative working toward a digital health use screening tool
Hernandez, A. M., Khoong, E. C., Kanwar, N., López-Solano, N., Rodriguez, J. A., Marchis, E. H. D., Nguyen, O. K., & Casillas, A. (2024) · Frontiers in Public Health · doi:10.3389/fpubh.2024.1421129 · Cited by 13
Self-citationKim, J., Linos, E., Fishman, D. A., Dove, M. S., Hoch, J. S., & Keegan, T. H. M. (2023) · JMIR Cancer · doi:10.2196/44339 · Cited by 10
“However, it has been associated with OPPC in the general population [61].”
BackgroundPublic awareness, attitudes, behavior and norms building green hospitals' power
Nurfikri, A., Kesa, D. D., Wu, M., Roselina, E., & Hidayat, A. (2024) · Heliyon · doi:10.1016/j.heliyon.2024.e39336 · Cited by 20
“Statements about norms in communication in society is adapted from the concept in articles by Khoong et al. [51].”
MethodImpact of Telemedicine Modalities on Equitable Access to Ambulatory Gastroenterology Care
Rodriguez, N. J., Okwara, N. C., Shen, L., Jajoo, K., & Chan, W. W. (2021) · Gastroenterology · doi:10.1053/j.gastro.2021.05.042 · Cited by 10
Clary, K. L., Nason, E. E., Selber, K., & Smith, K. S. (2022) · Smith College Studies in Social Work · doi:10.1080/00377317.2022.2041148 · Cited by 8
“All these factors should be considered and documented in agency policy, which should then be shared with social work interns (Khoong et al., 2020et al., 2020”
BackgroundKilleen, O. J., Niziol, L. M., Elam, A. R., Bicket, A. K., John, D. A., Wood, S. D., Musch, D. C., Zhang, J., Johnson, L., Kershaw, M., et al. (2023) · Ophthalmology · doi:10.1016/j.ophtha.2023.09.025 · Cited by 7
Lee, H. Y., Yoon, Y. J., Choi, Y. J., & Ham, Y.-H. (2023) · Journal of Immigrant and Minority Health · doi:10.1007/s10903-023-01540-y · Cited by 8
“Furthermore, considering immigrants’ cultural and language barriers, health information available online in their native language and English would be beneficial in obtaining and facilitating enhanced communication of health information [22, 23].”
Factors impacting electronic patient-generated data use in safety-net systems: a qualitative study
Khoong, E. C., Wong, J., Garcia, F., Olazo, K., Miles, M., Zeng, B., Lyles, C. R., & Sarkar, U. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf079 · Cited by 6
“38 Given the importance of language discordance in the implementation of digital health tools and communication, 39,40 we planned a priori to analyze themes stratified by patient language to ascertain differences by language preference.”
Self-citationValdez, R. S., & Rogers, C. C. (2022) · Yearbook of Medical Informatics · doi:10.1055/s-0042-1742520 · Cited by 8
“Studies that only adopted limited aspects of community-oriented research recruited participants from community-based sites and events [16, 18, 21, 22, 24, 32] and received permission from community leaders to conduct the research [31].”
BackgroundInfluentialFrom Cancer Epidemiology to Policy and Practice: the Role of a Comprehensive Cancer Center
Hiatt, R. A., Sibley, A., Venkatesh, B., Cheng, J. W., Dixit, N., Fox, R. K., Ling, P. M., Nguyen, T. T., Oh, D. L., Palmer, N. R., et al. (2022) · Current Epidemiology Reports · doi:10.1007/s40471-021-00280-7 · Cited by 7
Self-citationThe Role of Social Media as an Information Source in COVID-19 Pandemic
Yüksel, B., Sarılar, Ö., Gültekin, M. H., Çağlar, U., Gelmiş, M., & Özgör, F. (2021) · Turkiye Klinikleri Journal of Health Sciences · doi:10.5336/healthsci.2020-77283 · Cited by 6
Zhuang, Y., Yang, D., & Han, Q. (2025) · Sustainable Cities and Society · doi:10.1016/j.scs.2025.106899 · Cited by 11
Kinoshita, S., Kitazawa, M., Abe, Y., Suda, A., Nakamae, T., Kanazawa, T., Tomita, H., Hishimoto, A., & Kishimoto, T. (2023) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-023-00368-5 · Cited by 4
“Increased digitization of the health-care system will also make the telepsychiatry workflow more familiar and allow for further applications (Khoong et al., 2020).”
Tieu, L., Lyles, C. R., Kim, H. C., Luna, I., Wong, J., López-Solano, N., Li, J., Yang, A., Rodriguez, J. A., Nguyen, O. K., et al. (2025) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaf151 · Cited by 5
Self-citationImpact of Coronavirus disease 2019 on patients with toothache
Li, C., Liu, X., Li, N., Yang, F., Zheng, M., Li, Y., & Zhang, J. (2021) · Medicine · doi:10.1097/md.0000000000026713 · Cited by 2
“Moreover, a study by Khoong et al([16]) also indicated that nearly one-third of the participants watched a Web-based health video or used email to communicate with their clinician.”
BackgroundThe Ongoing Transmutation of Type 1 Diabetes: Disparities in Care and Outcomes
Shulman, R. M., Nakhla, M. M., & Daneman, D. (2020) · Canadian Journal of Diabetes · doi:10.1016/j.jcjd.2020.11.005 · Cited by 2
Health Literacy and Plain Language
Ghaddar, S. F. (2024) · Wiley eBooks · doi:10.1002/9781119853855.ch9 · Cited by 3
Rapson, T., Ramirez, M., He, S., Wong, J., Kim, H. C., Luna, I., Yang, A., Li, J., Fishman, P. A., Ralston, J. D., et al. (2026) · JMIR Human Factors · doi:10.2196/78430 · Cited by 3
“In particular, older adults, especially those with non-English language preferences or who identify as a racial or ethnic minority, experience large disparities in digital health tool adoption because of steep disparities in device, internet, or cellular data access [9,14,15].”
Self-citationChinese Americans’ Use of Patient Portal Systems: Scoping Review
Lawrence, K. S., Chong, S. K., Krelle, H., Roberts, T. R., Thorpe, L. E., Trinh‐Shevrin, C., Yi, S. S., & Kwon, S. C. (2022) · JMIR Human Factors · doi:10.2196/27924 · Cited by 2
“In their study examining patients’ patterns of texting and communication with their clinicians via apps, Khoong et al [36] found that individuals who preferred to use Chinese language had lower odds of texting or using an app to communicate with their clinicians compared to English-speaking survey respondents.”
BackgroundInfluentialTeixeira, E. M., Guaraciaba, A. P. B., dos Santos, A. C. A., Guedes, B. L. D. S., Terra, C. M. D., Campos, I. B., Souza, L. M. D., Amaral, P., Dias, A. M. N., Mendes, N. B. D. E. S., et al. (2021) · Brazilian Journal of Health Review · doi:10.34119/bjhrv4n6-131 · Cited by 3
Rapson, T., Ramirez, M., He, S., Wong, J., Kim, H. C., Luna, I., Yang, A., Li, J., Fishman, P. A., Ralston, J. D., et al. (2025) · doi:10.2196/preprints.78430 · Cited by 1
Self-citationTelemedicine's Role in Pandemic Response and Control Measures
Shetu, S. N., & Jannat, T. (2022) · International Journal of Applied Research on Public Health Management · doi:10.4018/ijarphm.309410
Coulibaly, S. (2022) · Queensland University of Technology · doi:10.5204/thesis.eprints.236175 · Cited by 1
Social Media as Sources of Information about COVID-19 among Food Handlers Working in Restaurants
Agwa, Y., & Elnadory, E. (2023) · International Journal of Heritage, Tourism, and Hospitality · doi:10.21608/ijhth.2023.328379
“As the prevalence of social media usage has escalated, investigations into its influence on the mental health and well-being of young individuals have been undertaken, unveiling a spectrum of both positive and negative effects (Khoong et al., 2020).”
BackgroundAo, S. H., Zhu, Y., Wu, Y., & Zhao, X. (2024) · doi:10.2196/preprints.63518
Khoong, E. C., Kim, H. C., Li, J., Larreynaga, J., Luna, I., Yang, A., Kazi, D. S., Lyles, C. R., McCulloch, C. E., Rahman, S. B., et al. (2025) · Contemporary Clinical Trials · doi:10.1016/j.cct.2025.108101 · Cited by 1
Self-citationFactors Associated With Minorities’ Use of Telehealth During COVID-19
Miller, E., Harris, A., Abu-Alhaija, D. M., Okour, A., & Bakas, T. (2025) · Western Journal of Nursing Research · doi:10.1177/01939459251386264
“Additionally, Khoong et al 14 further found that Internet or data access posed a significant issue.”
Lipitz‐Snyderman, A., Chimonas, S. C., Spiegelhoff, Z., Strachna, O., White, C., Seier, K., Kuperman, G. J., Garcia, J., Daly, B., Robson, M. E., et al. (2026) · Health and Technology · doi:10.1007/s12553-025-01043-w
“Our major find - ing highlights enduring barriers to participation in remote monitoring programs: We observed wide variation by The language disparities that we observed are consistent with findings reported in studies of other digital technolo - gies such as telemedicine [ 21, 25, 29, 30].”
Identifying trajectories across care modalities before and after COVID-19 using sequence analysis
Rapson, T., Kemper-McIsaac, K. E., Sherwin, E. B., Clifford, N., Pacca, L., Rubinsky, A. D., Lyles, C. R., & Khoong, E. C. (2026) · npj Digital Medicine · doi:10.1038/s41746-026-02766-4
“…digitaltooladoptionandaremorelikelytostrugglewithspeci fi c tasks required to use digital health tools effectively, but it still illustrates that linguistic and cultural barriers in fl uence how patients access and interact with different modalities and aspects of care 18,51,52 .”
Self-citation
Metadata
- Authors
- Khoong, E. C., Rivadeneira, N. A., Hiatt, R. A., & Sarkar, U.
- Affiliations
- San Francisco General Hospital (US)
- University of California, San Francisco (US)
- Corresponding author
- Khoong, Elaine C
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-04-06
- Volume
- 22
- Issue
- 4
- Pages
- e16951
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7171563
- OpenAlex
- W3004276829
- Cited by
- 44
- References
- 52
- Citations by year
- 2026: 3 · 2025: 6 · 2024: 7 · 2023: 5 · 2022: 9 · 2021: 11 · 2020: 3
- FWCI
- 7.31
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- National Institutes of Health (T32HP19025, KL2TR001870)
- University of California, San Francisco (P30CA082103)
- National Heart, Lung, and Blood Institute (K12HL138046)
- National Cancer Institute (P30CA082103)
- National Center for Advancing Translational Sciences (T32HP19025)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- health information technology, patient-clinician communication, multilingual populations, language preference, smartphone ownership, usual source of care, safety-net clinics, health literacy, limited English proficiency, Chinese-speaking patients, Spanish-speaking patients, vulnerable populations, health information seeking, mobile health apps
- MeSH terms
- Adult, Aged, Communication, Cross-Sectional Studies, Female, Humans, Male, Middle Aged, Surveys and Questionnaires, Urban Health, Cohort Studies, Multilingualism, Health Literacy, Information Seeking Behavior
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
