Web-Based Health Information Following the Renewal of the Cervical Screening Program in Australia: Evaluation of Readability, Understandability, and Credibility
Open accessPublished version of a preprint
The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.
Abstract
Background: Three main changes were implemented in the Australian National Cervical Screening Program (NCSP) in December 2017: an increase in the recommended age to start screening, extended screening intervals, and change from the Papanicolaou (Pap) test to primary human papillomavirus screening (cervical screening test). The internet is a readily accessible source of information to explain the reasons for these changes to the public. It is important that web-based health information about changes to national screening programs is accessible and understandable for the general population. Objective: This study aimed to evaluate Australian web-based resources that provide information about the changes to the cervical screening program. Methods: The term cervical screening was searched in 3 search engines. The first 10 relevant results across the first 3 pages of each search engine were selected. Overall, 2 authors independently evaluated each website for readability (Flesch Reading Ease [FRE], Flesch-Kincaid Grade Level, and Simple Measure of Gobbledygook [SMOG] index), quality of information (Patient Education Materials Assessment Tool [PEMAT] for printable materials), credibility (Journal of the American Medical Association [JAMA] benchmark criteria and presence of Health on the Net Foundation code of conduct [HONcode] certification), website design, and usability with 5 simulation questions to assess the relevance of information. A descriptive analysis was conducted for the readability measures, PEMAT, and the JAMA benchmark criteria. Results: Of the 49 websites identified in the search, 15 were eligible for inclusion. The consumer-focused websites were classed as fairly difficult to read (mean FRE score 51.8, SD 13.3). The highest FRE score (easiest to read) was 70.4 (Cancer Council Australia Cervical Screening Consumer Site), and the lowest FRE score (most difficult to read) was 33.0 (NCSP Clinical Guidelines). A total of 9 consumer-focused websites and 4 health care provider–focused websites met the recommended threshold (sixth to eighth grade; SMOG index) for readability. The mean PEMAT understandability scores were 87.7% (SD 6.0%) for consumer-focused websites and 64.9% (SD 13.8%) for health care provider–focused websites. The mean actionability scores were 58.1% (SD 19.1%) for consumer-focused websites and 36.7% (SD 11.0%) for health care provider–focused websites. Moreover, 9 consumer-focused and 3 health care provider–focused websites scored above 70% for understandability, and 2 consumer-focused websites had an actionability score above 70%. A total of 3 websites met all 4 of the JAMA benchmark criteria, and 2 websites displayed the HONcode. Conclusions: It is important for women to have access to information that is at an appropriate reading level to better understand the implications of the changes to the cervical screening program. These findings can help health care providers direct their patients toward websites that provide information on cervical screening that is written at accessible reading levels and has high understandability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“A Flesch reading ease score above 60 generally indicates that the text is fairly easy to read for most audiences [19], whereas a score below 50 suggests increased difficulty.”
From Evaluating the Capability of Large Language Model Chatbots for Generating Plain Language Summaries in Radiology (2025) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Flesch, R. (1948) · Journal of Applied Psychology · doi:10.1037/h0057532 · Cited by 5,391 · cited 12×
“Victoria CSP had the highest grade level (FKGL and SMOG) and the lowest reading ease (FRE).”
BackgroundMethodInfluentialCharnock, D., Shepperd, S., Needham, G., & Gann, R. (1999) · Journal of Epidemiology and Community Health · doi:10.1136/jech.53.2.105 · Cited by 3,329
Shoemaker, S. J., Wolf, M. S., & Brach, C. (2014) · Patient Education and Counseling · doi:10.1016/j.pec.2014.05.027 · Cited by 1,322
Epidemiology and burden of HPV-related disease
Serrano, B., Brotons, M., Bosch, F. X., & Bruni, L. (2018) · Best Practice & Research Clinical Obstetrics & Gynaecology · doi:10.1016/j.bpobgyn.2017.08.006 · Cited by 560
The Health On the Net Code of Conduct for medical and health Websites
Boyer, C., Selby, M., Scherrer, J.-R., & Appel, R. D. (1998) · Computers in Biology and Medicine · doi:10.1016/s0010-4825(98)00037-7 · Cited by 427
Sun, Y., Zhang, Y., Gwizdka, J., & Trace, C. B. (2019) · Journal of Medical Internet Research · doi:10.2196/12522 · Cited by 333
Dunn, A. G., Coiera, E., Mandl, K. D., & Bourgeois, F. T. (2016) · Research Integrity and Peer Review · doi:10.1186/s41073-016-0006-7 · Cited by 208
Understanding online health information: Evaluation, tools, and strategies
Beaunoyer, E., Arsenault, M., Lomanowska, A. M., & Guitton, M. J. (2017) · Patient Education and Counseling · doi:10.1016/j.pec.2016.08.028 · Cited by 191
Lew, J.-B., Simms, K. T., Smith, M. A., Hall, M., Kang, Y.-J., Xu, X. M., Caruana, M., Velentzis, L. S., Bessell, T., Saville, M., et al. (2017) · The Lancet Public Health · doi:10.1016/s2468-2667(17)30007-5 · Cited by 160 · cited 1×
“Recent modeling studies have predicted that the new program will reduce the incidence and mortality of cervical cancer in vaccinated women by 31% and 36%, respectively [3,4].”
Background
Research works printed but not linked: 1
- McLaughlin, GH, 1969, J Read, 12, 639
Cited by
Using Large Language Models to Generate Educational Materials on Childhood Glaucoma
Dihan, Q. A., Chauhan, M. Z., Eleiwa, T. K., Hassan, A. K., Sallam, A. B., Khouri, A. S., Chang, T. C., & Elhusseiny, A. M. (2024) · American Journal of Ophthalmology · doi:10.1016/j.ajo.2024.04.004 · Cited by 60
Dhinagaran, D. A., Martinengo, L., Ho, M. R., Joty, S., Kowatsch, T., Atun, R. A., & Car, L. T. (2022) · JMIR mhealth and uhealth · doi:10.2196/38740 · Cited by 41
Pavuloori, M., Lin, A., & Mi, M. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1575801 · Cited by 24
Tan, D. J. Y., Ko, T. K., & Fan, K. S. (2023) · JMIR Formative Research · doi:10.2196/47762 · Cited by 24
Quality of cerebral palsy videos on Chinese social media platforms
He, W., Tang, D., Jin, Y., Zhang, W., Kang, Y., & Xia, Q. (2025) · Scientific Reports · doi:10.1038/s41598-024-84845-8 · Cited by 23
Promoting patient engagement in cancer genomics research programs: An environmental scan
Schuster, A. L. R., Crossnohere, N. L., Paskett, J., Thomas, N. A., Hampel, H., Ma, Q., Tiner, J. C., Paskett, E. D., & Bridges, J. F. P. (2023) · Frontiers in Genetics · doi:10.3389/fgene.2023.1053613 · Cited by 22
Patient education information material assessment criteria: A scoping review
Ahmadzadeh, K., Bahrami, M., Zare‐Farashbandi, F., Adibi, P., Boroumand, M. A., & Rahimi, A. (2023) · Health Information & Libraries Journal · doi:10.1111/hir.12467 · Cited by 20
Basnet, R., Méndez, D. R., Lugo-González, I. V., O’Hagan, E. T., O’Keeffe, M., Sharma, S., Pate, J. W., & Kennedy, D. S. (2023) · PAIN Reports · doi:10.1097/pr9.0000000000001078 · Cited by 14
Haghighi, R., & Farhadloo, M. (2025) · JMIR Infodemiology · doi:10.2196/70756 · Cited by 11
Evaluation of a Digital Health Initiative in Illicit Substance Use: Cross-sectional Survey Study
Kershaw, S., Birrell, L., Deen, H., Newton, N. C., Stapinski, L. A., Champion, K. E., KAY‐LAMBKIN, F. J., Teesson, M., & Chapman, C. (2021) · Journal of Medical Internet Research · doi:10.2196/29026 · Cited by 11
An evaluation of the quality of online perinatal depression information
Hardman, M. P., Reynolds, K., Petty, S. K., Pryor, T. A. M., Pierce, S. K., Bernstein, M. T., & Furer, P. (2022) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-021-04320-4 · Cited by 10
Chérrez-Ojeda, I., Zuberbier, T., Rodas‐Valero, G., Sanchez, J., Rudenko, M., Dramburg, S., Demoly, P. M., Caimmi, D. P., Gómez, R. M., Ramon, G. D., et al. (2025) · Clinical and Translational Allergy · doi:10.1002/clt2.70130 · Cited by 11
Willburger, B. K., Chen, Z., & Mansfield, K. J. (2024) · Australian and New Zealand Journal of Obstetrics and Gynaecology · doi:10.1111/ajo.13830 · Cited by 8
Gynaecological cancer resources for Aboriginal and Torres Strait Islander women: A resource audit
Kinghorn, M., Garvey, G., & Butler, T. (2023) · Health Promotion Journal of Australia · doi:10.1002/hpja.822 · Cited by 7
Sarangi, P. K., Hui, P., Mondal, H., Kumar Nayak, D. S., Swarup, M. S., Ishan, & Panda, S. (2025) · iRADIOLOGY · doi:10.1002/ird3.70030 · Cited by 6
Korkmaz, Y. Y., Aydın, O., Güngör, F., Kudaş, İ., Sarıgöz, T., & Bostancı, Ö. (2025) · Surgical Endoscopy · doi:10.1007/s00464-025-12315-x · Cited by 7
Evaluation of online text‐based information resources of gynaecological cancer symptoms
DiSipio, T., Scholte, C., & Diaz, A. (2024) · Cancer Medicine · doi:10.1002/cam4.7167 · Cited by 6
Dodd, R. H., Nickel, B., Smith, M. A., Brotherton, J. M. L., & McCaffery, K. J. (2020) · Preventive Medicine Reports · doi:10.1016/j.pmedr.2020.101268 · Cited by 6
Self-citationJi, M., Bodomo, A. B., Xie, W., & Huang, R. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph181910329 · Cited by 5
Maxwell‐Smith, C., Smith, S. J., Nicholson, L., O’Connor, M., Davies, J., Basson, M., Dhillon, H. M., & Halkett, G. K. B. (2025) · Psycho-Oncology · doi:10.1002/pon.70349 · Cited by 4
Mohamed, H., O’Malley, L., & Kelly, D. (2023) · Digital Health · doi:10.1177/20552076231205286 · Cited by 4
Xie, W., Ji, M., Liu, Y., Hao, T., & Chow, C.-Y. (2021) · JMIR Medical Informatics · doi:10.2196/30115 · Cited by 3
Millar, B. C., Peters, C., & Moore, J. E. (2025) · British Journal of Biomedical Science · doi:10.3389/bjbs.2025.15435 · Cited by 1
Alomar, A., Shahriarirad, R., Ghanem, O. M., & Laplante, S. J. (2026) · Surgical Endoscopy · doi:10.1007/s00464-026-12845-y · Cited by 1
Otero, M. C. B., Bernolo, L. J. L., Miguel, R. M., Regencia, Z. J. G., Murao, L. A. E., & Baja, E. S. (2025) · COVID · doi:10.3390/covid5030042 · Cited by 1
Automatic Diagnosis of Mental Healthcare Information Actionability: Developing Binary Classifiers
Ji, M., Xie, W., Huang, R., & Qian, X. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph182010743
Dhinagaran, D. A. (2022) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/163179
Chérrez-Ojeda, I., Zuberbier, T., Rodas‐Valero, G., Sanchez, J. M., Rudenko, M., Dramburg, S., Demoly, P. M., Caimmi, D. P., Gómez, R. M., Ramon, G. D., et al. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.5042342
Health literacy demand and quality of website nutrition information for multiple sclerosis
Probst, Y., Sharp, M., & Zoszak, K. (2025) · Journal of Public Health · doi:10.1007/s10389-024-02398-6
Dhinagaran, D. A., Martinengo, L., Ho, M.-H. R., Joty, S., Kowatsch, T., Atun, R. A., & Car, L. T. (2022) · doi:10.2196/preprints.38740
Parker, A., Lawless, M., Thomas, J., & Yaxley, A. (2026) · Australian Journal on Ageing · doi:10.1111/ajag.70201
McElroy, M. (2025) · ResearchOnline at James Cook University (James Cook University) · doi:10.25903/547x-1d63
Ahad, M., Wallace, J., Richmond, J., Moussa, D., Wade, A., Doyle, J., & Howell, J. A. (2026) · BMC Public Health · doi:10.1186/s12889-026-28545-0
Lahut, D., Erdede, Ö., & Sezer, R. G. (2026) · Children · doi:10.3390/children13091272
Metadata
- Authors
- Mac, O. A., Thayre, A., Tan, S., & Dodd, R. H.
- Affiliations
- The University of Sydney (AU)
- Corresponding author
- Dodd, Rachael H
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2020-06-26
- Volume
- 22
- Issue
- 6
- Pages
- e16701
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC7381085
- OpenAlex
- W3015653605
- Cited by
- 35
- References
- 27
- Citations by year
- 2026: 5 · 2025: 10 · 2024: 5 · 2023: 6 · 2022: 4 · 2021: 4 · 2020: 1
- FWCI
- 3.92
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Social Sciences › Health › Social Media in Health Education
- Health Sciences › Medicine › Epidemiology › Cervical Cancer and HPV Research
- Keywords
- online health information, readability, comprehensibility, credibility, health information quality, human papillomavirus screening, Pap smear, health literacy, website usability, Health on the Net Foundation, consumer health information, United States
- MeSH terms
- Adult, Aged, Australia, Uterine Cervical Neoplasms, Female, Humans, Male, Middle Aged, Comprehension, Consumer Health Information, Early Detection of Cancer
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.