Statistical profiles of highly-rated web sites
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
We are creating an interactive tool to help non-professional web site builders create high quality designs. We have previously reported that quantitative measures of web page structure can predict whether a site will be highly or poorly rated by experts, with accuracies ranging from 67--80%. In this paper we extend that work in several ways. First, we compute a much larger set of measures (157 versus 11), over a much larger collection of pages (5300 vs. 1900), achieving much higher overall accuracy (94% on average) when contrasting good, average, and poor pages. Second, we introduce new classes of measures that can make assessments at the site level and according to page type (home page, content page, etc.). Finally, we create statistical profiles of good sites, and apply them to an existing design, showing how that design can be changed to better match high-quality designs.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Classification And Regression Trees
Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (2017) · doi:10.1201/9781315139470 · Cited by 11,417
Sitemaps, storyboards, and specifications: a sketch of Web site design practice
Newman, M. W., & Landay, J. A. (2000) · Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques · doi:10.1145/347642.347758 · Cited by 220
Cited by
e-GovQual: A multiple-item scale for assessing e-government service quality
Papadomichelaki, X., & Mentzas, G. (2012) · Government Information Quarterly · doi:10.1016/j.giq.2011.08.011 · Cited by 358
Credibility: A multidisciplinary framework
Rieh, S. Y., & Danielson, D. R. (2007) · Annual Review of Information Science and Technology · doi:10.1002/aris.2007.1440410114 · Cited by 336
What do you see when you're surfing?: using eye tracking to predict salient regions of web pages
Buscher, G., Cutrell, E., & Morris, M. R. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518705 · Cited by 255
Augmenting web pages and search results to support credibility assessment
Schwarz, J., & Morris, M. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979127 · Cited by 181
“…how people evaluate credibility so as to help Webmasters and designers create sites that will appear more credible (regardless of their true information quality), e.g., Schneiderman’s guidelines for designing trust online [30] and Ivory and Hearst’s tool for high quality site design [19].”
When and How to Use AI in the Design Process? Implications for Human-AI Design Collaboration
Lee, S.-Y., Law, M., & Hoffman, G. (2025) · International Journal of Human–Computer Interaction · doi:10.1080/10447318.2024.2353451 · Cited by 97
“Ivory and Hearst (2002) described a machine-learning driven process for uncovering heuristics related to the quality of a web site design as the basis for improvement.”
Metadata
- Authors
- Ivory, M. Y., & Hearst, M. A.
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2002-04-20
- Pages
- 367-374
- OpenAlex
- W2095587486
- Cited by
- 85
- References
- 2
- FWCI
- 4.37
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.