Improving Web Searches: Case Study of Quit-Smoking Web Sites for Teenagers
Open accessAbstract
BACKGROUND: The Web has become an important and influential source of health information. With the vast number of Web sites on the Internet, users often resort to popular search sites when searching for information. However, little is known about the characteristics of Web sites returned by simple Web searches for information about smoking cessation for teenagers. OBJECTIVE: To determine the characteristics of Web sites retrieved by search engines about smoking cessation for teenagers and how information quality correlates with the search ranking. METHODS: The top 30 sites returned by 4 popular search sites in response to the search terms "teen quit smoking" were examined. The information relevance and quality characteristics of these sites were evaluated by 2 raters. Objective site characteristics were obtained using a page-analysis Web site. RESULTS: Only 14 of the 30 Web sites are of direct relevance to smoking cessation for teenagers. The readability of about two-thirds of the 14 sites is below an eighth-grade school level and they ranked significantly higher (Kendall rank correlation, tau = -0.39, P =.05) in search-site results than sites with readability above or equal to that grade level. Sites that ranked higher were significantly associated with the presence of e-mail address for contact (tau = -0.46, P =.01), annotated hyperlinks to external sites (tau = -0.39, P =.04), and the presence of meta description tag (tau = -0.48, P =.002). The median link density (number of external sites that have a link to that site) of the Web pages was 6 and the maximum was 735. A higher link density was significantly associated with a higher rank (tau = -0.58, P =.02). CONCLUSIONS: Using simple search terms on popular search sites to look for information on smoking cessation for teenagers resulted in less than half of the sites being of direct relevance. To improve search efficiency, users could supplement results obtained from simple Web searches with human-maintained Web directories and learn to refine their searches with more advanced search syntax.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Reviews have attempted to rate the adequacy of behavior change websites.
“We acknowledge the important role played by reviews that attempt to rate the adequacy of behavior change websites [4-10].”
From The Information Architecture of Behavior Change Websites (2005) · cites this paper as [8]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The anatomy of a large-scale hypertextual Web search engine
Brin, S., & Page, L. (1998) · Computer Networks and ISDN Systems · doi:10.1016/s0169-7552(98)00110-x · Cited by 16,004 · see citing works
Assessing, Controlling, and Assuring the Quality of Medical Information on the Internet
Silberg, W. M. (1997) · JAMA · doi:10.1001/jama.277.15.1244 · Cited by 2,399 · see citing works
Consumer health information seeking on the internet: the state of the art
Cline, R. J. W. (2001) · Health Education Research · doi:10.1093/her/16.6.671 · Cited by 1,708 · see citing works
Silberg, W. M., Lundberg, G. D., & Musacchio, R. A. (1997) · PubMed · Cited by 875 · see citing works
Rating Health Information on the Internet
Jadad, A. R., & Gagliardi, A. R. (1998) · JAMA · doi:10.1001/jama.279.8.611 · Cited by 695 · see citing works
Published criteria for evaluating health related web sites: review
Kim, P., Eng, T. R., Deering, M. J., & Maxfield, A. M. (1999) · BMJ · doi:10.1136/bmj.318.7184.647 · Cited by 498 · see citing works
Gagliardi, A. R. (2002) · BMJ · doi:10.1136/bmj.324.7337.569 · Cited by 378 · see citing works
Meric, F. (2002) · BMJ · doi:10.1136/bmj.324.7337.577 · Cited by 320 · see citing works
Accuracy of information on apparently credible websites: survey of five common health topics
Kunst, H. (2002) · BMJ · doi:10.1136/bmj.324.7337.581 · Cited by 252 · see citing works
Evaluation of cancer information on the Internet
Biermann, J. S., Golladay, G. J., Greenfield, M. L. V. H., & Baker, L. H. (1999) · Cancer · doi:10.1002/(sici)1097-0142(19990801)86:3 · Cited by 240 · see citing works
Health information and interaction on the internet: a survey of female urinary incontinence
Sandvik, H. (1999) · BMJ · doi:10.1136/bmj.319.7201.29 · Cited by 157 · see citing works
An Evaluation of the Quality and Contents of Asthma Education on the World Wide Web
Croft, D. R., & Peterson, M. W. (2002) · CHEST Journal · doi:10.1378/chest.121.4.1301 · Cited by 120 · see citing works
The quality and accessibility of Australian depression sites on the World Wide Web
Griffiths, K. M., & Christensen, H. M. (2002) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2002.tb04509.x · Cited by 101 · see citing works
eEurope 2002: Quality Criteria for Health related Websites
Commission of the European Communities, B. (2002) · Journal of Medical Internet Research · doi:10.2196/jmir.4.3.e15 · Cited by 95 · see citing works
The potential of the internet as a medium to encourage and discourage youth tobacco use
Ribisl, K. M. (2003) · Tobacco Control · doi:10.1136/tc.12.suppl_1.i48 · Cited by 90 · see citing works
Quality of Breast Cancer Sites on the World Wide Web
Hoffman‐Goetz, L., & Clarke, J. N. (2000) · Canadian Journal of Public Health · doi:10.1007/bf03404290 · Cited by 85 · see citing works
Trends in the Evolution of the Public Web
O’Neill, E. T., Lavoie, B., & Bennett, R. (2003) · D-Lib Magazine · doi:10.1045/april2003-lavoie · Cited by 85 · see citing works
Does Pornography-Blocking Software Block Access to Health Information on the Internet?
Richardson, C. R. (2002) · JAMA · doi:10.1001/jama.288.22.2887 · Cited by 76 · see citing works
Winker, M. A., Flanagin, A., Chi-Lum, B., White, J., Andrews, K., Kennett, R. L., DeAngelis, C. D., & Musacchio, R. A. (2000) · JAMA · doi:10.1001/jama.283.12.1600 · Cited by 59 · see citing works
Quality of medical information about menorrhagia on the worldwide web
Latthe, P. M., Latthe, M., & Khan, K. S. (2000) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2000.tb11577.x · Cited by 36 · see citing works
Teen Smoking Cessation Help Via the Internet: A Survey of Search Engines
Edwards, C. C., Elliott, S. P., Conway, T. L., & Woodruff, S. I. (2003) · Health Promotion Practice · doi:10.1177/1524839903004003010 · Cited by 10 · see citing works
On-line teen smoking cessation: what's porn got to do with it?
Elliott, S. P., Edwards, C. C., Woodruff, S. I., & Conway, T. L. (2001) · Tobacco Control · doi:10.1136/tc.10.4.397a · Cited by 5 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Internet-based interventions for smoking cessation
Taylor, G. M. J., Dalili, M. N., Semwal, M., Čivljak, M., Sheikh, A., & Car, J. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007078.pub5 · Cited by 651 · see citing works
Skinner, H. A., Biscope, S., Poland, B. D., & Goldberg, E. (2003) · Journal of Medical Internet Research · doi:10.2196/jmir.5.4.e32 · Cited by 371 · see citing works
Self-citationInternet-based interventions for smoking cessation
Civljak, M., Stead, L. F., Hartmann-Boyce, J., Sheikh, A., & Car, J. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007078.pub4 · Cited by 249 · see citing works
Ana and the Internet: A review of pro‐anorexia websites
Norris, M. L., Boydell, K., Pinhas, L., & Katzman, D. K. (2006) · International Journal of Eating Disorders · doi:10.1002/eat.20305 · Cited by 248 · see citing works
The Information Architecture of Behavior Change Websites
Danaher, B. G., McKay, H. G., & Seeley, J. R. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.2.e12 · Cited by 129 · see citing works
Internet-based interventions for smoking cessation
Čivljak, M., Sheikh, A., Stead, L. F., & Car, J. (2010) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007078.pub3 · Cited by 108 · see citing works
McCown, F., & Nelson, M. L. (2007) · ACM/IEEE Joint Conference on Digital Libraries · doi:10.1145/1255175.1255237 · Cited by 77 · see citing works
Internet-based smoking cessation programs
Etter, J. (2005) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2005.06.014 · Cited by 67 · see citing works
Internet uses for health information seeking
Renahy, É., & Chauvin, P. (2006) · Revue d Épidémiologie et de Santé Publique · doi:10.1016/s0398-7620(06)76721-9 · Cited by 64 · see citing works
Therapy for Specific Problems: Youth Tobacco Cessation
Curry, S. J., Mermelstein, R. J., & Sporer, A. K. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.60.110707.163659 · Cited by 50 · see citing works
Web-Assisted Tobacco Interventions: Empowering Change in the Global Fight for the Public’s (e)Health
Norman, C. D., McIntosh, S. E., Selby, P. L., & Eysenbach, G. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1171 · Cited by 41 · see citing works
Bongué, B., Sommet, A., Pathak, A., & Montastruc, J. (2005) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-005-0925-6 · Cited by 29 · see citing works
The internet and the industrial revolution in smoking cessation counselling
Etter, J. (2006) · Drug and Alcohol Review · doi:10.1080/09595230500459545 · Cited by 28 · see citing works
Evaluation of an Adolescent Smoking-Cessation Media Campaign: GottaQuit.com
Klein, J. D., Havens, C. G., & Carlson, E. J. (2005) · PEDIATRICS · doi:10.1542/peds.2005-0492 · Cited by 15 · see citing works
Risque et utilité du Web en santé mentale chez l’adolescent, évolutions et perspectives
Auxéméry, Y. (2010) · Neuropsychiatrie de l Enfance et de l Adolescence · doi:10.1016/j.neurenf.2010.05.009 · Cited by 9 · see citing works
Contextual information retrieval from the WWW
Limbu, D. K. (2008) · Tuwhera (Auckland University of Technology) · Cited by 2 · see citing works
Body image and weight management : young people, internet advertisements and pharmacists
Luevorasirikul, K. (2007) · Nottingham ePrints (University of Nottingham) · Cited by 1 · see citing works
Chien, T., Wang, H., Chang, Y., & Chou, W. (2018) · doi:10.2196/preprints.11261
- Authors
- Koo, M., & Skinner, H.
- Affiliations
- University of Toronto (CA)
- Corresponding author
- Koo, Malcolm
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2003-11-14
- Volume
- 5
- Issue
- 4
- Pages
- e28
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W1974676139
- Cited by
- 18
- References
- 24
- Citations by year
- 2018: 1 · 2017: 1 · 2013: 1
- FWCI
- 5.70
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- PubMed (publishedVersion)
- TSpace (University of Toronto) (submittedVersion, cc-by)
- Funders
- Ontario Ministry of Health and Long-Term Care
- Topics
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
- Health Sciences › Medicine › Physiology › Smoking Behavior and Cessation
- Keywords
- smoking cessation, adolescents, health information on the web, search engine ranking, website quality, readability, link density, web directories
- MeSH terms
- Adolescent, Health Education, Humans, Information Services, Patient Education as Topic, Quality Assurance, Health Care, Smoking Cessation, Health Care Surveys, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
