The DOI matches its Crossref record; 62 of the 62 references it cites were found in a registry or an index.
Quality of health information for consumers on the web: A systematic review of indicators, criteria, tools, and evaluation results
Abstract
The quality of online health information for consumers has been a critical issue that concerns all stakeholders in healthcare. To gain an understanding of how quality is evaluated, this systematic review examined 165 articles in which researchers evaluated the quality of consumer‐oriented health information on the web against predefined criteria. It was found that studies typically evaluated quality in relation to the substance and formality of content, as well as to the design of technological platforms. Attention to design, particularly interactivity, privacy, and social and cultural appropriateness is on the rise, which suggests the permeation of a user‐centered perspective into the evaluation of health information systems, and a growing recognition of the need to study these systems from a social‐technical perspective. Researchers used many preexisting instruments to facilitate evaluation of the formality of content; however, only a few were used in multiple studies, and their validity was questioned. The quality of content (i.e., accuracy and completeness) was always evaluated using proprietary instruments constructed based on medical guidelines or textbooks. The evaluation results revealed that the quality of health information varied across medical domains and across websites, and that the overall quality remained problematic. Future research is needed to examine the quality of user‐generated content and to explore opportunities offered by emerging new media that can facilitate the consumer evaluation of health information.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Kincaid, J. P., Fishburne, Jr., Robert P., R., Richard L., C., & Brad, S. (1975) · doi:10.21236/ada006655 · Cited by 3,497
Charnock, D., Shepperd, S., Needham, G., & Gann, R. (1999) · Journal of Epidemiology and Community Health · doi:10.1136/jech.53.2.105 · Cited by 3,329
Eysenbach, G., Powell, J., Kuss, O., & Sa, E.-R. (2002) · JAMA · doi:10.1001/jama.287.20.2691 · Cited by 1,871 · cited 13×
“Most indicators for credibility identified in this review overlapped with the technical criteria identified in Eysenbach et al. (2002) and the objective criteria identified in Silberg et al. (1997), and they were grouped into three categories: attribution, authorship, and disclosure.”
BackgroundMethodResultInfluentialConsumer health information seeking on the internet: the state of the art
Cline, R. J. W. (2001) · Health Education Research · doi:10.1093/her/16.6.671 · Cited by 1,708
Persuasion theory and research
O’Keefe, D. J. (1990) · Cited by 1,555
Silberg, W. M. (1997) · JAMA · doi:10.1001/jama.277.15.1244 · Cited by 1,151
Medicine 2.0: Social Networking, Collaboration, Participation, Apomediation, and Openness
Eysenbach, G. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1030 · Cited by 1,143
Who Is Rational?: Studies of individual Differences in Reasoning
Stanovich, K. E. (1999) · Cited by 1,114
Stanovich, K. E. (1999) · Psychology Press eBooks · doi:10.4324/9781410603432 · Cited by 951
Kincaid, J. P., Robert, P. F. L., Richard, L. R., & Brad, S. (1975) · Cited by 739
Rating Health Information on the Internet: Navigating to Knowledge or to Babel?
Jadad, A. R., & Gagliardi, A. (1998) · JAMA · doi:10.1001/jama.279.8.611 · Cited by 696
Credibility and computing technology
Tseng, S., & Fogg, B. J. (1999) · Communications of the ACM · doi:10.1145/301353.301402 · Cited by 583
Published criteria for evaluating health related web sites: review
Kim, P., Eng, T. R., Deering, M. J., & Maxfield, A. (1999) · BMJ · doi:10.1136/bmj.318.7184.647 · Cited by 498
The Conceptual Framework of Psychology [1952]
Brunswik, E., & Cooksey, R. W. (2001) · The Essential Brunswik · doi:10.1093/oso/9780195130133.003.0013 · Cited by 476
The ethics of persuasive technology
Fogg, B. J. (2003) · Persuasive Technology · doi:10.1016/b978-155860643-2/50011-1 · Cited by 473
Eysenbach, G., Gray, J. A. M., Bonati, M., Arunachalam, S., Diepgen, T. L., Impicciatore, P., & Pandolfini, C. (1998) · BMJ · doi:10.1136/bmj.317.7171.1496 · Cited by 461 · cited 2×
“The other means is to build tools that can automatically detect quality indicators (Eysenbach & Diepgen, 1998).”
BackgroundGagliardi, A. (2002) · BMJ · doi:10.1136/bmj.324.7337.569 · Cited by 378
Social media use among patients and caregivers: a scoping review
Hamm, M. P., Chisholm, A., Shulhan, J., Milne, A., Scott, S. D., Given, L. M., & Hartling, L. (2013) · BMJ Open · doi:10.1136/bmjopen-2013-002819 · Cited by 345
Meric, F. (2002) · BMJ · doi:10.1136/bmj.324.7337.577 · Cited by 320
Web 2.0 for Health Promotion: Reviewing the Current Evidence
Chou, W.-Y. S., Prestin, A., Lyons, C., & Wen, K.-Y. (2013) · American Journal of Public Health · doi:10.2105/ajph.2012.301071 · Cited by 309
Analysis of Cases of Harm Associated With Use of Health Information on the Internet
Crocco, A. G. (2002) · JAMA · doi:10.1001/jama.287.21.2869 · Cited by 274
Commentary: measuring quality and impact of the world wide web: Table 1
Wyatt, J. C. (1997) · BMJ · doi:10.1136/bmj.314.7098.1879 · Cited by 269
Bernstam, E. V., Shelton, D. M., Walji, M., & Meric-Bernstam, F. (2005) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2004.10.001 · Cited by 262
Arora, N. K., Hesse, B. W., Rimer, B. K., Viswanath, K., Clayman, M. L., & Croyle, R. T. (2008) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0406-y · Cited by 240
Review Of Internet Health Information Quality Initiatives
Risk, A., & Dzenowagis, J. (2001) · Journal of Medical Internet Research · doi:10.2196/jmir.3.4.e28 · Cited by 237
eHealth Research from the User’s Perspective
Hesse, B. W., & Shneiderman, B. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.01.019 · Cited by 172
Health information and interaction on the internet: a survey of female urinary incontinence
Sandvik, H. (1999) · BMJ · doi:10.1136/bmj.319.7201.29 · Cited by 157
Interventions for enhancing consumers' online health literacy
Car, J., Lang, B., Colledge, A., Ung, C. Y., & Majeed, A. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007092.pub2 · Cited by 140
Beyond quality and accessibility: Source selection in consumer health information searching
Zhang, Y. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23023 · Cited by 125
Self-citationUsing the SMOG Formula to Revise a Health-Related Document
Hedman, A. S. (2008) · American Journal of Health Education · doi:10.1080/19325037.2008.10599016 · Cited by 121
What do Web-Use Skill Differences Imply for Online Health Information Searches?
Feufel, M. A., & Stahl, S. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2051 · Cited by 99
Reliability of Health Information on the Internet: An Examination of Experts' Ratings
Craigie, M. A., Loader, B. D., Burrows, R., & Muncer, S. (2002) · Journal of Medical Internet Research · doi:10.2196/jmir.4.1.e2 · Cited by 95
Head and neck cancer information on the internet: Type, accuracy and content
Ríordáin, R. N., & McCreary, C. (2008) · Oral Oncology · doi:10.1016/j.oraloncology.2008.10.006 · Cited by 91
Web page quality: can we measure it and what do we find? A report of exploratory findings
Abbott, V. (2000) · Journal of Public Health · doi:10.1093/pubmed/22.2.191 · Cited by 85
Automated Assessment of the Quality of Depression Websites
Griffiths, K. M., Tang, T. T., Hawking, D., & Christensen, H. M. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.5.e59 · Cited by 75
Automatic detecting indicators for quality of health information on the Web
Wang, Y., & Liu, Z. (2006) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2006.04.001 · Cited by 70
Social networking applications in health care
Williams, J. B. (2010) · Software Engineering in Health Care · doi:10.1145/1809085.1809091 · Cited by 63
Future directions for depicting credibility in health care web sites
O'Grady, L. A. (2005) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2005.07.035 · Cited by 62
Harland, J., & Bath, P. A. (2007) · Health Informatics Journal · doi:10.1177/1460458207079837 · Cited by 61
Hendrick, P. A., Ahmed, O. H., Bankier, S. S., Chan, T. J., Crawford, S. A., Ryder, C. R., Welsh, L. J., & Schneiders, A. G. (2012) · Manual Therapy · doi:10.1016/j.math.2012.02.019 · Cited by 60
Quality of Weight Loss Advice on Internet Forums
Hwang, K. O., Farheen, K., Johnson, C. W., Thomas, E. J., Barnes, A. S., & Bernstam, E. V. (2007) · The American Journal of Medicine · doi:10.1016/j.amjmed.2007.04.017 · Cited by 54
Evaluation of Web-Based Osteoporosis Educational Materials
Wallace, L. S., Turner, L. W., Ballard, J. E., Keenum, A. J., & Weiss, B. D. (2005) · Journal of Women s Health · doi:10.1089/jwh.2005.14.936 · Cited by 54
Perspectives on quality and content of information on the internet for adolescents with cancer
Stinson, J., White, M., Breakey, V. R., Chong, A. L., Mak, I. W. Y., Low, K. K., & Low, A. K. (2011) · Pediatric Blood & Cancer · doi:10.1002/pbc.23068 · Cited by 53
Bernstam, E. V., Sagaram, S., Walji, M. F., Johnson, C. W., & Meric‐Bernstam, F. (2005) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2005.02.002 · Cited by 53
Quality of web-based information on depression
Zermatten, A., Khazaal, Y., Coquard, O., Chatton, A., & Bondolfi, G. (2010) · Depression and Anxiety · doi:10.1002/da.20665 · Cited by 50
Quality and readability of online patient information for abdominal aortic aneurysms
Bailey, M. A., Coughlin, P. A., Sohrabi, S., Griffin, K. J., Rashid, S. T., Troxler, M. A., & Scott, D. J. A. (2012) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2011.12.063 · Cited by 50
Pérez-López, F. R., & Pérez‐Roncero, G. R. (2006) · Gynecological Endocrinology · doi:10.1080/09513590601012603 · Cited by 48
Nasser, S. (2012) · Australasian Medical Journal · doi:10.4066/amj.2012.86 · Cited by 46
Analysis of the Quality of Information Obtained About Uterine Artery Embolization From the Internet
Tavare, A. N., Alsafi, A., & Hamady, M. (2012) · CardioVascular and Interventional Radiology · doi:10.1007/s00270-012-0345-9 · Cited by 42
Consumer health information searching process in real life settings
Zhang, Y. (2012) · Proceedings of the American Society for Information Science and Technology · doi:10.1002/meet.14504901046 · Cited by 41
Self-citationReview of the Quality of Information on Bipolar Disorder on the Internet
Barnes, C. W., Harvey, R., Wilde, A., Hadži-Pavlović, D., Wilhelm, K. A., & Mitchell, P. B. (2009) · Australian & New Zealand Journal of Psychiatry · doi:10.1080/00048670903179137 · Cited by 40
Survey of quality, readability, and social reach of websites on osteosarcoma in adolescents
Lam, C. G., ROTER, D. L., & Cohen, K. J. (2012) · Patient Education and Counseling · doi:10.1016/j.pec.2012.08.006 · Cited by 38
Mousiolis, A., Michala, L., & Antsaklis, A. (2012) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2012.03.028 · Cited by 30
Irwin, J. Y., Thyvalikakath, T. P., Spallek, H., Wali, T., Kerr, A. R., & Schleyer, T. (2011) · Journal of Public Health Dentistry · doi:10.1111/j.1752-7325.2010.00207.x · Cited by 26
Filling a Void: Thyroid Cancer Surgery Information on the Internet
Yeo, H., Roman, S. A., Air, M., Maser, C., Trapasso, T., Kinder, B. K., & Sosa, J. A. (2007) · World Journal of Surgery · doi:10.1007/s00268-007-9010-x · Cited by 18
Patient information about general anaesthesia on the internet
Tallgren, M. K., & Bäcklund, M. (2009) · Anaesthesia · doi:10.1111/j.1365-2044.2008.05813.x · Cited by 16
Assessing the Reliability and Quality of Online Uterine Fibroid Embolization Resources
Kaicker, J., Wu, K., & Athreya, S. (2012) · CardioVascular and Interventional Radiology · doi:10.1007/s00270-012-0418-9 · Cited by 11
The Accuracy of Nutrition Information on the Internet for Type 2 Diabetes
Post, R. E. (2010) · Archives of Internal Medicine · doi:10.1001/archinternmed.2010.289 · Cited by 11
Quality of web-based information on alcohol dependence
Khazaal, Y., Chatton, A., Cochand, S., Coquard, O., Fernandez, S., Khan, R., & ZULLINO, D. F. (2010) · Drugs Education Prevention and Policy · doi:10.3109/09687630802530696 · Cited by 7
A Critical Assessment of Diabetes Information on the Internet
Tsunehara, S. T., & Gaster, B. (2002) · The Science of Diabetes Self-Management and Care · doi:10.1177/014572170202800206 · Cited by 4
Cited by
Public health and online misinformation: challenges and recommendations
Swire-Thompson, B., & Lazer, D. (2020) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-040119-094127 · Cited by 1,170
Trust and Credibility in Web-Based Health Information: A Review and Agenda for Future Research
Sbaffi, L., & Rowley, J. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7579 · Cited by 537
Prebiotics: why definitions matter
Hutkins, R. W., Krumbeck, J. A., Bindels, L. B., Cani, P. D., Fahey, G., Goh, Y. J., Hamaker, B., Martens, E. C., Mills, D. A., Rastal, R. A., et al. (2016) · Current Opinion in Biotechnology · doi:10.1016/j.copbio.2015.09.001 · Cited by 437
Kong, W., Song, S., Zhao, Y. C., Zhu, Q., & Sha, L. (2021) · Journal of Medical Internet Research · doi:10.2196/30409 · Cited by 354
Sun, Y., Zhang, Y., Gwizdka, J., & Trace, C. B. (2019) · Journal of Medical Internet Research · doi:10.2196/12522 · Cited by 333
Self-citation
Metadata
- Authors
- Zhang, Y., Sun, Y., & Xie, B.
- Venue
- Journal of the Association for Information Science and Technology
- Publisher
- Wiley
- Published
- 2015-04-29
- Volume
- 66
- Issue
- 10
- Pages
- 2071-2084
- ISSN
- 2330-1635 (ISSN-L)
- 2330-1643
- OpenAlex
- W1904811031
- Cited by
- 291
- References
- 62
- FWCI
- 2.57
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.