Assessment of the quality and variability of health information on chronic pain websites using the DISCERN instrument
Open accessThe DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Abstract
Background: The Internet is used increasingly by providers as a tool for disseminating pain-related health information and by patients as a resource about health conditions and treatment options. However, health information on the Internet remains unregulated and varies in quality, accuracy and readability. The objective of this study was to determine the quality of pain websites, and explain variability in quality and readability between pain websites. Methods: Five key terms (pain, chronic pain, back pain, arthritis, and fibromyalgia) were entered into the Google, Yahoo and MSN search engines. Websites were assessed using the DISCERN instrument as a quality index. Grade level readability ratings were assessed using the Flesch-Kincaid Readability Algorithm. Univariate (using alpha = 0.20) and multivariable regression (using alpha = 0.05) analyses were used to explain the variability in DISCERN scores and grade level readability using potential for commercial gain, health related seals of approval, language(s) and multimedia features as independent variables. Results: A total of 300 websites were assessed, 21 excluded in accordance with the exclusion criteria and 110 duplicate websites, leaving 161 unique sites. About 6.8% (11/161 websites) of the websites offered patients' commercial products for their pain condition, 36.0% (58/161 websites) had a health related seal of approval, 75.8% (122/161 websites) presented information in English only and 40.4% (65/161 websites) offered an interactive multimedia experience. In assessing the quality of the unique websites, of a maximum score of 80, the overall average DISCERN Score was 55.9 (13.6) and readability (grade level) of 10.9 (3.9). The multivariable regressions demonstrated that website seals of approval (P = 0.015) and potential for commercial gain (P = 0.189) were contributing factors to higher DISCERN scores, while seals of approval (P = 0.168) and interactive multimedia (P = 0.244) contributed to lower grade level readability, as indicated by estimates of the beta coefficients. Conclusion: The overall quality of pain websites is moderate, with some shortcomings. Websites that scored high using the DISCERN questionnaire contained health related seals of approval and provided commercial solutions for pain related conditions while those with low readability levels offered interactive multimedia options and have been endorsed by health seals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Flesch, R. (1948) · Journal of Applied Psychology · doi:10.1037/h0057532 · Cited by 5,391 · cited 2×
“The first 20 links reported by each search engine per keyword were evaluated for quality using the DISCERN questionnaire and readability through the Flesch-Kincaid Algorithm [9,20].”
BackgroundMethodThe kappa statistic in reliability studies: use, interpretation, and sample size requirements
Sim, J., & Wright, C. C. (2005) · Physical Therapy · doi:10.1093/ptj/85.3.257 · Cited by 4,093 · cited 2×
“With its growing use there is increasing concern about the quality of online health information, as well as variability amongst health websites [13,16,24].”
BackgroundCharnock, D., Shepperd, S., Needham, G., & Gann, R. (1999) · Journal of Epidemiology and Community Health · doi:10.1136/jech.53.2.105 · Cited by 3,329 · cited 1×
“The American Medical Association (AMA) has published guidelines to aid patients in search of health information on the Internet and they also address the variability in patient health literacy, quality of content and access to information online [16,26].”
BackgroundEysenbach, G., Powell, J., Kuss, O., & Sa, E.-R. (2002) · JAMA · doi:10.1001/jama.287.20.2691 · Cited by 1,871 · cited 2×
“Consumer risk can be reduced through the introduction of clear critical appraisal tools and with a standardized website evaluation system for health information, thus improving the ability of users to locate trustworthy sites and to filter the inadequate ones [1].”
BackgroundConsumer health information seeking on the internet: the state of the art
Cline, R. J. W. (2001) · Health Education Research · doi:10.1093/her/16.6.671 · Cited by 1,708 · cited 2×
“This percentage increased to 54% by 2008, with current usage estimated at over one billion users in the world [3-5].”
BackgroundHealth Information on the Internet: Accessibility, Quality, and Readability in English and Spanish
Berland, G. K., Elliott, M. N., Morales, L. S., Algazy, J. I., Kravitz, R. L., Broder, M. S., Kanouse, D. E., Muñoz, J. A., Puyol, J.-A., Lara, M., et al. (2001) · JAMA · doi:10.1001/jama.285.20.2612 · Cited by 1,208 · cited 3×
“With its growing use there is increasing concern about the quality of online health information, as well as variability amongst health websites [13,16,24].”
BackgroundStewart, W. F., Ricci, J. A., Chee, E., & Morganstein, D. (2003) · Journal of Occupational and Environmental Medicine · doi:10.1097/01.jom.0000099999.27348.78 · Cited by 427 · cited 2×
“This report highlighted that 76% of the production time loss was due to diminished performance of staff suffering from pain, rather than absenteeism [12].”
BackgroundThe Health On the Net Code of Conduct for medical and health Websites
Boyer, C., Selby, M., Scherrer, J.-R., & Appel, R. D. (1998) · Computers in Biology and Medicine · doi:10.1016/s0010-4825(98)00037-7 · Cited by 427 · cited 1×
“Health related seals of approval are attempting to unify the quality of medical information on the Internet and offers the audience an indication of the online provider’s commitment to providing quality information [28].”
BackgroundThe gap between patient reading comprehension and the readability of patient education materials.
Davis, T. C., Crouch, M. A., Wills, G. B., Miller, S. H., & Abdehou, D. M. (1990) · PubMed · Cited by 382
Patients’ use of the internet for pain-related medical information
de Boer, M. J., Versteegen, G. J., & van Wijhe, M. (2007) · Patient Education and Counseling · doi:10.1016/j.pec.2007.05.012 · Cited by 147 · cited 2×
“With its growing use there is increasing concern about the quality of online health information, as well as variability amongst health websites [13,16,24].”
BackgroundBrief DISCERN, six questions for the evaluation of evidence-based content of health-related websites
Khazaal, Y., Chatton, A., Cochand, S., Coquard, O., Fernandez, S., Khan, R., Billieux, J., & Zullino, D. (2009) · Patient Education and Counseling · doi:10.1016/j.pec.2009.02.016 · Cited by 133 · cited 2×
“This questionnaire was derived systematically with the input of an expert panel, health information providers and patients from a self-help group [15].”
MethodSurfing for Back Pain Patients: The Nature and Quality of Back Pain Information on the Internet
Li, L., Irvin, E., Guzmán, J., & Bombardier, A. C. (2001) · Spine · doi:10.1097/00007632-200103010-00020 · Cited by 123 · cited 1×
“Previous studies using the DISCERN tool have focused on the quality of websites for pain [29], low back pain [30,31], rheumatoid arthritis [32,33], burn scar management [34], and treatment for cough in children [35] have used different tools.”
MethodParents on the Web: Risks for Quality Management of Cough in Children
Pandolfini, C., Impicciatore, P., & Bonati, M. (2000) · Pediatrics · doi:10.1542/peds.105.1.e1 · Cited by 114 · cited 1×
“Previous studies using the DISCERN tool have focused on the quality of websites for pain [29], low back pain [30,31], rheumatoid arthritis [32,33], burn scar management [34], and treatment for cough in children [35] have used different tools.”
MethodAccessibility, nature and quality of health information on the Internet: a survey on osteoarthritis
Maloney, S. R., Ilic, D., & Green, S. (2005) · British journal of rheumatology · doi:10.1093/rheumatology/keh498 · Cited by 103 · cited 1×
“internet usage has led to about 37% of consumers using the electronic network to retrieve health related knowledge [7].”
BackgroundLumbar Disc Herniation: Evaluation of Information on the Internet
Greene, D. L., Appel, A. J., Reinert, S. E., & Palumbo, M. A. (2005) · Spine · doi:10.1097/01.brs.0000157754.98023.cd · Cited by 102 · cited 1×
“Previous studies using the DISCERN tool have focused on the quality of websites for pain [29], low back pain [30,31], rheumatoid arthritis [32,33], burn scar management [34], and treatment for cough in children [35] have used different tools.”
MethodThe Need for Knowledge Translation in Chronic Pain
Henry, J. L. (2008) · Pain Research and Management · doi:10.1155/2008/321510 · Cited by 66 · cited 1×
“Chronic pain is a serious health and socioeconomic concern [10].”
BackgroundThe Influence of Age, Height, and Weight on the Bone Mineral Content of Lumbar Vertebrae
HANSSON, T. H., & ROOS, B. (1980) · Spine · doi:10.1097/00007632-198011000-00010 · Cited by 62
The Quality of Internet-sourced Information for Patients With Chronic Pain Is Poor
Corcoran, T. B., Haigh, F., Seabrook, A., & Schug, S. A. (2009) · The Clinical Journal of Pain · doi:10.1097/ajp.0b013e3181a5b5d5 · Cited by 62 · cited 2×
“This study mentions that though there may be high quality chronic pain content available online that is relevant and reliable, it is difficult to find amongst all the content that is of poor quality [14].”
BackgroundQuality of Chronic Pain Websites
Washington, T. A., Fanciullo, G. J., Sorensen, J. A., & Baird, J. C. (2008) · Pain Medicine · doi:10.1111/j.1526-4637.2008.00419.x · Cited by 46 · cited 1×
“These terms included “Pain”, “Chronic Pain”, “Back pain”, “Arthritis”, and “Fibromyalgia” [18].”
Newman, M. A., Ziébland, S., & Barker, K. L. (2009) · Health Informatics Journal · doi:10.1177/1460458209102974 · Cited by 45
Batchelor, J., & Ohya, Y. (2009) · Allergology International · doi:10.2332/allergolint.08-sc-0022 · Cited by 42 · cited 2×
“This allows consumers to appraise web-based information themselves [17].”
BackgroundImproving on-line information for potential living kidney donors
Moody, E., Clemens, K. K., Storsley, L. J., Waterman, A. D., Parikh, C. R., & Garg, A. X. (2007) · Kidney International · doi:10.1038/sj.ki.5002168 · Cited by 40
A study of undue pain and surfing: using hierarchical criteria to assess website quality
Lorence, D. P., & Abraham, J. (2008) · Health Informatics Journal · doi:10.1177/1081180x08092827 · Cited by 28 · cited 1×
“Previous studies using the DISCERN tool have focused on the quality of websites for pain [29], low back pain [30,31], rheumatoid arthritis [32,33], burn scar management [34], and treatment for cough in children [35] have used different tools.”
MethodAn Evaluation of Internet Sites for Burn Scar Management
Bohacek, L., Gomez, M., & Fish, J. S. (2003) · Journal of Burn Care & Rehabilitation · doi:10.1097/01.bcr.0000075844.04297.d9 · Cited by 27 · cited 1×
“Previous studies using the DISCERN tool have focused on the quality of websites for pain [29], low back pain [30,31], rheumatoid arthritis [32,33], burn scar management [34], and treatment for cough in children [35] have used different tools.”
Method
Cited by
Stinson, J., White, M., Isaac, L., Campbell, F., Brown, S., Ruskin, D., Gordon, A., Galonski, M., Pink, L., Buckley, N., et al. (2013) · The Clinical Journal of Pain · doi:10.1097/ajp.0b013e31826dce65 · Cited by 81
Self-citationGoogling caesarean section: a survey on the quality of the information available on the Internet
Fioretti, B., Reiter, M., Betrán, A., & Torloni, M. (2015) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.13081 · Cited by 65
Sbaffi, L., & King, K. (2020) · Journal of Consumer Health on the Internet · doi:10.1080/15398285.2020.1816803 · Cited by 24
Metadata
- Authors
- Kaicker, J., Borg Debono, V., Dang, W., Buckley, N., & Thabane, L.
- Venue
- BMC Medicine
- Published
- 2010-10-12
- Volume
- 8
- Issue
- 1
- Pages
- 59-59
- ISSN
- 1741-7015 (ISSN-L)
- OpenAlex
- W2076838233
- Cited by
- 221
- References
- 24
- FWCI
- 10.05
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.