Old-Fashioned Technology in the Era of “Bling”: Is There a Future for Text Messaging in Health Care?
Open accessPublished version of a preprint
The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Abstract
In the quest to discover the next high-technology solution to solve many health problems, proven established technologies are often overlooked in favor of more “technologically advanced” systems that have not been fully explored for their applicability to support behavior change theory, or used by consumers. Text messages or SMS is one example of an established technology still used by consumers, but often overlooked as part of the mobile health (mHealth) toolbox. The purpose of this paper is to describe the benefits of text messages as a health promotion modality and to advocate for broader scale implementation of efficacious text message programs. Text messaging reaches consumers in a ubiquitous real-time exchange, contrasting the multistep active engagement required for apps and wearables. It continues to be the most widely adopted and least expensive mobile phone function. As an intervention modality, text messaging has taught researchers substantial lessons about tailored interactive health communication; reach and engagement, particularly in low-resource settings; and embedding of behavior change models into digital health. It supports behavior change techniques such as reinforcement, prompts and cues, goal setting, feedback on performance, support, and progress review. Consumers have provided feedback to indicate that text messages can provide them with useful information, increase perceived support, enhance motivation for healthy behavior change, and provide prompts to engage in health behaviors. Significant evidence supports the effectiveness of text messages alone as part of an mHealth toolbox or in combination with health services, to support healthy behavior change. Systematic reviews have consistently reported positive effects of text message interventions for health behavior change and disease management including smoking cessation, medication adherence, and self-management of long-term conditions and health, including diabetes and weight loss. However, few text message interventions are implemented on a large scale. There is still much to be learned from investing in text messaging delivered research. When a modality is known to be effective, we should be learning from large-scale implementation. Many other technologies currently suffer from poor long-term engagement, the digital divide within society, and low health and technology literacy of users. Investing in and incorporating the learnings and lessons from large-scale text message interventions will strengthen our way forward in the quest for the ultimate digitally delivered behavior change model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Text messaging was selected as an intervention medium as it is one the most used forms of interpersonal communication across demographic groups (Gallup., 2014), and is accessible without internet-capable devices like smartphones or without consistent access to a data plan (Willcox et al., 2019).”
From A text messaging intervention to support the mental health of young adults: User engagement and feedback from a field trial of an intervention prototype (2023) · cites this paper as Willcox et al., 2019
The cited source says what the claim attributes to it.
In the citing paper
“There have also been calls to employ more widely used technologies, such as text messaging (Willcox et al., 2019), messaging apps (Fitzpatrick et al., 2017), and social media (Dobias et al., 2022), so that interventions fit easily into users' daily routines and are more scalable.”
From A text messaging intervention to support the mental health of young adults: User engagement and feedback from a field trial of an intervention prototype (2023) · cites this paper as Willcox et al., 2019
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Michie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697
The Meaning of Translational Research and Why It Matters
Woolf, S. H. (2008) · JAMA · doi:10.1001/jama.2007.26 · Cited by 1,910
Free, C., Phillips, G., Galli, L., Watson, L., Felix, L., Edwards, P., Patel, V., & Haines, A. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001362 · Cited by 1,766 · cited 1×
“Systematic reviews and meta-analyses have consistently reported positive effects of text message interventions for health behavior change or promotion [25,42-46] and disease management [43,45,47,48].”
BackgroundMichie, S., Ashford, S., Sniehotta, F. F., Dombrowski, S. U., Bishop, A., & French, D. P. (2011) · Psychology & Health · doi:10.1080/08870446.2010.540664 · Cited by 1,756 · cited 1×
“Text messaging appears to support behavior change through the ease of application of proven behavior change techniques such as reinforcement, prompts and cues, goal setting, feedback on performance, support, and progress review [20].”
BackgroundWandersman, A., Duffy, J., Flaspohler, P., Noonan, R., Lubell, K., Stillman, L., Blachman, M., Dunville, R., & Saul, J. (2008) · American Journal of Community Psychology · doi:10.1007/s10464-008-9174-z · Cited by 1,339
Text messaging as a tool for behavior change in disease prevention and management
Cole-Lewis, H., & Kershaw, T. (2010) · Epidemiologic Reviews · doi:10.1093/epirev/mxq004 · Cited by 1,190
Firth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097 · cited 1×
“In contrast, systematic reviews of smartphone apps have thus far reported mainly pilots and studies with small sample sizes with limited evidence of effectiveness [24,53,54], although their application in mental health [55], schizophrenia [56] and weight loss [57] is promising.”
BackgroundHealthcare in the pocket: Mapping the space of mobile-phone health interventions
Klasnja, P., & Pratt, W. (2012) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2011.08.017 · Cited by 970 · cited 1×
“Text messages are a “push” technology, where intervention messages are delivered to individuals without any effort from the individual [9] and exhibit a 98% open rate and a response rate double that of email, phone, or social media [10].”
BackgroundMobile Text Messaging for Health: A Systematic Review of Reviews
Hall, A. K., Cole-Lewis, H., & Bernhardt, J. M. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031914-122855 · Cited by 815
Wearable Devices as Facilitators, Not Drivers, of Health Behavior Change
Patel, M. S., Asch, D. A., & Volpp, K. G. (2015) · JAMA · doi:10.1001/jama.2014.14781 · Cited by 808
Torous, J., Nicholas, J., Larsen, M. E., Firth, J., & Christensen, H. (2018) · Evidence Based Mental Health · doi:10.1136/eb-2018-102891 · Cited by 790
Rodgers, A., Corbett, T., Bramley, D., Riddell, T., Wills, M., Lin, R.-B., & Jones, M. (2005) · Tobacco Control · doi:10.1136/tc.2005.011577 · Cited by 732 · cited 1×
“that have been implemented at a large scale internationally [71-73] and offer learnings.”
BackgroundFree, C., Knight, R., Robertson, S., Whittaker, R., Edwards, P., Zhou, W., Rodgers, A., Cairns, J., Kenward, M. G., & Roberts, I. (2011) · The Lancet · doi:10.1016/s0140-6736(11)60701-0 · Cited by 728 · cited 2×
“Free and colleagues [67] recruited, via community advertising, smokers willing to quit (n=5800) and randomized them to either the txt2stop intervention, comprising motivational messages and behavioral change support, or the control group that received text messages unrelated to quitting.”
BackgroundMethodSelf-citationMobile Telephone Text Messaging for Medication Adherence in Chronic Disease: A Meta-analysis
Thakkar, J., Kurup, R., Laba, T.-L., Santo, K., Thiagalingam, A., Rodgers, A., Woodward, M., Redfern, J., & Chow, C. K. (2016) · JAMA Internal Medicine · doi:10.1001/jamainternmed.2015.7667 · Cited by 685
Efficacy of text messaging-based interventions for health promotion: A meta-analysis
Head, K. J., Noar, S. M., Iannarino, N. T., & Grant Harrington, N. (2013) · Social Science & Medicine · doi:10.1016/j.socscimed.2013.08.003 · Cited by 654
Aranda-Jan, C. B., Mohutsiwa-Dibe, N., & Loukanova, S. (2014) · BMC Public Health · doi:10.1186/1471-2458-14-188 · Cited by 644
O’Connor, S., Hanlon, P., O’Donnell, C. A., Garcia, S., Glanville, J., & Mair, F. S. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0359-3 · Cited by 636
Flores Mateo, G., Granado-Font, E., Ferré-Grau, C., & Montaña-Carreras, X. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.4836 · Cited by 540
Payne, H. E., Lister, C., West, J. H., & Bernhardt, J. M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3335 · Cited by 524
Agarwal, S., Perry, H. B., Long, L., & Labrique, A. B. (2015) · Tropical Medicine & International Health · doi:10.1111/tmi.12525 · Cited by 498
Mobile phone text messaging and app-based interventions for smoking cessation
Whittaker, R., McRobbie, H., Bullen, C., Rodgers, A., Gu, Y., & Dobson, R. (2019) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd006611.pub5 · Cited by 452
Self-citationKnowledge translation in health: how implementation science could contribute more
Wensing, M., & Grol, R. (2019) · BMC Medicine · doi:10.1186/s12916-019-1322-9 · Cited by 413
Finitsis, D. J., Pellowski, J. A., & Johnson, B. T. (2014) · PLoS ONE · doi:10.1371/journal.pone.0088166 · Cited by 355
mHealth 2.0: Experiences, Possibilities, and Perspectives
Becker, S., Miron-Shatz, T., Schumacher, N., Krocza, J., Diamantidis, C., & Albrecht, U.-V. (2014) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3328 · Cited by 354
The Continued Use of Mobile Health Apps: Insights From a Longitudinal Study
Vaghefi, I., & Tulu, B. (2019) · JMIR mHealth and uHealth · doi:10.2196/12983 · Cited by 335
Clawson, J., Pater, J. A., Miller, A. D., Mynatt, E. D., & Mamykina, L. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2807554 · Cited by 307
Prescribable mHealth apps identified from an overview of systematic reviews
Byambasuren, O., Sanders, S., Beller, E., & Glasziou, P. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0021-9 · Cited by 291
Smartphone Apps for Schizophrenia: A Systematic Review
Firth, J., & Torous, J. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4930 · Cited by 268
SMS for disease control in developing countries: a systematic review of mobile health applications
Déglise, C., Suggs, L. S., & Odermatt, P. (2012) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2012.110810 · Cited by 240 · cited 1×
“There is already evidence of the potential health uplift in developing countries where text messages have been utilized in smoking cessation, antenatal, diabetes, and retroviral interventions as well as communication with health workers [39-41].”
BackgroundThe Most Popular Smartphone Apps for Weight Loss: A Quality Assessment
Chen, J., Cade, J. E., & Allman-Farinelli, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4334 · Cited by 219
Mendiola, M. F., Kalnicki, M., & Lindenauer, S. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4283 · Cited by 213
Preventive Health Behavior Change Text Message Interventions: A Meta-analysis
Armanasco, A. A., Miller, Y. D., Fjeldsoe, B. S., & Marshall, A. L. (2017) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2016.10.042 · Cited by 210 · cited 3×
“Although text messaging has proven to be effective when used singularly, evidence suggests that text interventions were efficacious when combined with supplementary intervention components [24,25].”
BackgroundMbuagbaw, L., Mursleen, S., Lytvyn, L., Smieja, M., Dolovich, L., & Thabane, L. (2015) · BMC Health Services Research · doi:10.1186/s12913-014-0654-6 · Cited by 187
Smoking cessation using mobile phone text messaging is as effective in Maori as non-Maori.
Bramley, D. M., Riddell, T., Whittaker, R., Corbett, T., Lin, R., Wills, M., Jones, M., & Rodgers, A. (2005) · PubMed · Cited by 178
Self-citationOrr, J. A., & King, R. J. (2015) · Health Psychology Review · doi:10.1080/17437199.2015.1022847 · Cited by 174
Saffari, M., Ghanizadeh, G., & Koenig, H. G. (2014) · Primary Care Diabetes · doi:10.1016/j.pcd.2014.03.004 · Cited by 170 · cited 1×
“High-quality evidence may be found across health issues for smoking cessation [24], medication adherence [49] including antiretroviral therapy [47,50], and self-management of long-term conditions and health including diabetes and weight loss [42,46,51,52].”
BackgroundMilitello, L. K., Kelly, S. A., & Melnyk, B. M. (2012) · Worldviews on Evidence-Based Nursing · doi:10.1111/j.1741-6787.2011.00239.x · Cited by 167
Dobson, R., Whittaker, R., Jiang, Y., Maddison, R., Shepherd, M., McNamara, C., Cutfield, R., Khanolkar, M., & Murphy, R. (2018) · BMJ · doi:10.1136/bmj.k1959 · Cited by 164
Self-citationThe Dynamics of Consumer Engagement with Mobile Technologies
Viswanathan, V., Hollebeek, L. D., Malthouse, E. C., Masłowska, E., Kim, S. J., & Xie, W. (2017) · Service Science · doi:10.1287/serv.2016.0161 · Cited by 163
A systematic review and meta-analysis of interventions for weight management using text messaging
Siopis, G., Chey, T., & Allman‐Farinelli, M. (2015) · Journal of Human Nutrition and Dietetics · doi:10.1111/jhn.12207 · Cited by 155
Guerriero, C., Cairns, J., Roberts, I., Rodgers, A., Whittaker, R., & Free, C. (2013) · The European Journal of Health Economics · doi:10.1007/s10198-012-0424-5 · Cited by 152
Self-citationWillcox, J. C., Wilkinson, S. A., Lappas, M., Ball, K., Crawford, D. A., McCarthy, E. A., Fjeldsoe, B. S., Whittaker, R., Maddison, R., & Campbell, K. J. (2017) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.14552 · Cited by 136
Self-citationJones, K. R., Lekhak, N., & Kaewluang, N. (2014) · Worldviews on Evidence-Based Nursing · doi:10.1111/wvn.12030 · Cited by 114
Nouri, S. S., Avila-Garcia, P., Cemballi, A. G., Sarkar, U., Aguilera, A., & Lyles, C. R. (2019) · JMIR mHealth and uHealth · doi:10.2196/14250 · Cited by 112
Willcox, J. C., van der Pligt, P., Ball, K., Wilkinson, S. A., Lappas, M., McCarthy, E. A., & Campbell, K. J. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4869 · Cited by 106
Self-citationBall, K. (2015) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-015-0303-4 · Cited by 95
Challenges in implementing mHealth interventions: a technical perspective
Gurupur, V. P., & Wan, T. T. H. (2017) · mHealth · doi:10.21037/mhealth.2017.07.05 · Cited by 93
Text message behavioral interventions: from here to where?
Suffoletto, B. P. (2015) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2015.09.012 · Cited by 75
Mhurchú, C. N., Morenga, L. T., Firestone, R. T., Grey, J., Jiang, Y., Jull, A., Whittaker, R., Dobson, R., Dalhousie, S., Funaki, T., et al. (2019) · The Lancet Digital Health · doi:10.1016/s2589-7500(19)30130-x · Cited by 74
Self-citationBaskerville, N. B., Struik, L. L., Guindon, G. E., Norman, C. D., Whittaker, R., Burns, C., Hammond, D., Dash, D., & Brown, K. S. (2018) · JMIR mHealth and uHealth · doi:10.2196/10893 · Cited by 71
Self-citationA Randomized Trial of Text Messaging for Smoking Cessation in Pregnant Women
Abroms, L. C., Johnson, P. R., Leavitt, L. E., Cleary, S. D., Bushar, J., Brandon, T. H., & Chiang, S. C. (2017) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2017.08.002 · Cited by 62
‘Someone batting in my corner’: experiences of smoking-cessation support via text message
Douglas, N., & Free, C. (2013) · British Journal of General Practice · doi:10.3399/bjgp13x674459 · Cited by 59
Development of a Culturally Tailored Text Message Maternal Health Program: TextMATCH
Dobson, R., Whittaker, R., Bartley, H., Connor, A., Chen, R., Ross, M., & McCool, J. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.7205 · Cited by 49 · cited 3×
“Participants frequently report that they think that text messaging is a good way to deliver these types of prompts, information, and support [32,36,64,65].”
BackgroundSelf-citationLaws, R., Denney‐Wilson, E., Taki, S., Russell, C. G., Zheng, M., Litterbach, E., Ong, K., Lymer, S. J., Elliott, R. M., & Campbell, K. J. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.9040 · Cited by 48
Medicine, morality and health care social media
Timimi, F. K. (2012) · BMC Medicine · doi:10.1186/1741-7015-10-83 · Cited by 47
Gopinathan, P., Kaur, J., Joshi, S., Prasad, V. M., Pujari, S., Panda, P. K., & Murthy, P. (2018) · BMJ Innovations · doi:10.1136/bmjinnov-2018-000285 · Cited by 46
Text2Quit: an analysis of participant engagement in the mobile smoking cessation program
Heminger, C. L., Boal, A. L., Zumer, M., & Abroms, L. C. (2016) · The American Journal of Drug and Alcohol Abuse · doi:10.3109/00952990.2016.1149591 · Cited by 37
Kurumop, S., Bullen, C., Whittaker, R., Betuela, I., Hetzel, M. W., & Pulford, J. (2013) · PLoS ONE · doi:10.1371/journal.pone.0076578 · Cited by 31
Self-citationMcAlearney, A. S., Walker, D. M., Livaudais‐Toman, J., Parides, M. K., & Bickell, N. A. (2016) · SAGE Open Medicine · doi:10.1177/2050312116666215 · Cited by 27
Graham, A. L., Jacobs, M. A., Cohn, A. M., Cha, S., Abroms, L. C., Papandonatos, G. D., & Whittaker, R. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-010687 · Cited by 26
Self-citationSpeirs, K. E., Grutzmacher, S. K., Munger, A., & Messina, L. A. (2015) · Health Informatics Journal · doi:10.1177/1460458215577995 · Cited by 25
Dobson, R., Whittaker, R., Jiang, Y., McNamara, C. M., Shepherd, M., Maddison, R., Cutfield, R. G., Khanolkar, M., & Murphy, R. (2019) · Diabetic Medicine · doi:10.1111/dme.14182 · Cited by 25
Self-citationAsk, don't tell - mobile phones to improve HIV care.
Lester, R. (2013) · New England Journal of Medicine · doi:10.1056/nejmc1310509 · Cited by 21
Using text messages to engage low-income parents in school-based nutrition education
Grutzmacher, S. K., Duru, E. B., Speirs, K. E., Worthington, L., Munger, A., & Lachenmayr, L. (2017) · Journal of Hunger & Environmental Nutrition · doi:10.1080/19320248.2017.1364196 · Cited by 13
Carrillo-Larco, R. M., Jiwani, S. S., Diez‐Canseco, F., Kanter, R., Beratarrechea, A. G., Irazola, V. E., Ramírez‐Zea, M., Rubinstein, A. L., Martínez, H., Miranda, J. J., et al. (2018) · JMIR mhealth and uhealth · doi:10.2196/10226 · Cited by 8
TXTTaofiTapaa: pilot trial of a Samoan mobile phone smoking cessation programme
Whittaker, R., Umali, E., Tanielu, H., & McCool, J. P. (2019) · Journal of Global Health Reports · doi:10.29392/joghr.3.e2019035 · Cited by 8
Self-citation
Research works printed but not linked: 3
- Bramley, D, 2005, N Z Med J, 118, U1494
- 10.2196/jmir.4836 · DOI · Paper page
- 2019, WHO Guideline: recommendations on digital interventions for health system strengthening
Cited by
Mobile Health (mHealth) in Low- and Middle-Income Countries
McCool, J., Dobson, R., Whittaker, R., & Paton, C. (2022) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-052620-093850 · Cited by 269
Self-citationThe role of digital health technology in rural cancer care delivery: A systematic review
Morris, B. B., Rossi, B., & Fuemmeler, B. (2022) · The Journal of Rural Health · doi:10.1111/jrh.12619 · Cited by 104
Nelson, L. A., Greevy, R. A., Spieker, A., Wallston, K. A., Elasy, T. A., Kripalani, S., Gentry, C., Bergner, E. M., LeStourgeon, L. M., Williamson, S. E., et al. (2021) · Diabetes Care · doi:10.2337/dc20-0961 · Cited by 74
“Text content can address adherence barriers, and texts can directly support adherence by helping patients self-cue adherence behavior (8).”
BackgroundKornfield, R., Stamatis, C. A., Bhattacharjee, A., Pang, B., Nguyen, T., Williams, J. J., Kumar, H., Popowski, S., Beltzer, M., Karr, C. J., et al. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100667 · Cited by 33
“There have also been calls to employ more widely used technologies, such as text messaging (Willcox et al., 2019), messaging apps (Fitzpa-trick et al., 2017), and social media (Dobias et al., 2022), so that interventions fit easily into users' daily routines and are more scalable.”
BackgroundMethodNelson, L. A., Spieker, A. J., Mayberry, L. S., McNaughton, C., & Greevy, R. A. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocab254 · Cited by 23
Metadata
- Authors
- Willcox, J. C., Dobson, R., & Whittaker, R.
- Affiliations
- La Trobe University (AU)
- University of Auckland (NZ)
- Corresponding author
- Willcox, Jane C
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2019-12-20
- Volume
- 21
- Issue
- 12
- Pages
- e16630
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC6942182
- OpenAlex
- W2995291628
- Semantic Scholar
- 721dcb24da02dbdebe3fd14e8fce4db4de67ae17
- Cited by
- 95
- References
- 66
- Citations by year
- 2026: 6 · 2025: 14 · 2024: 18 · 2023: 18 · 2022: 16 · 2021: 16 · 2020: 6 · 2019: 1
- FWCI
- 13.16
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- ResearchSpace (University of Auckland) (submittedVersion, cc-by)
- Funders
- La Trobe University
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Physical Sciences › Computer Science › Information Systems › Mobile Learning in Education
- Social Sciences › Health › Social Media in Health Education
- Keywords
- text messaging, mobile health, health behavior change, text messaging intervention, behaviour change techniques, smoking cessation, medication adherence, disease self-management, digital divide, large-scale implementation, resource-limited settings, health promotion
- MeSH terms
- Humans, Health Behavior, Telemedicine, Cell Phone, Text Messaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.