CoChat

MRR: an unsupervised algorithm to rank reviews by relevance

Woloszyn, Vinicius, dos Santos, Henrique D. P., Wives, Leandro Krug, Becker, Karin · 2017 · Proceedings of the International Conference on Web Intelligence

The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.

Abstract

The automatic detection of relevant reviews plays a major role in tasks such as opinion summarization, opinion-based recommendation, and opinion retrieval. Supervised approaches for ranking reviews by relevance rely on the existence of a significant, domain-dependent training data set. In this work, we propose MRR (Most Relevant Reviews), a new unsupervised algorithm that identifies relevant revisions based on the concept of graph centrality. The intuition behind MRR is that central reviews highlight aspects of a product that many other reviews frequently mention, with similar opinions, as expressed in terms of ratings. MRR constructs a graph where nodes represent reviews, which are connected by edges when a minimum similarity between a pair of reviews is observed, and then employs PageRank to compute the centrality. The minimum similarity is graph-specific, and takes into account how reviews are written in specific domains. The similarity function does not require extensive pre-processing, thus reducing the computational cost. Using reviews from books and electronics products, our approach has outperformed the two unsupervised baselines and shown a comparable performance with two supervised regression models in a specific setting. MRR has also achieved a significantly superior run-time performance in a comparison with the unsupervised baselines.

Overview

Integrity signals

Registry

Crossref · 10.1145/3106426.3106444

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Citations

Cites

Research works printed but not linked: 3

  1. 10.5555/1610075.1610135 · doi:10.5555/1610075.1610135
  2. 10.5555/2390524.2390570 · doi:10.5555/2390524.2390570
  3. Frank Wilcoxon , SK Katti , and Roberta A Wilcox . 1970. Critical values and probability levels for the Wilcoxon rank sum test and the Wilcoxon signed rank test. Selected tables in mathematical statistics 1 ( 1970 ), 171--259. Frank Wilcoxon, SK Katti, and Roberta A Wilcox. 1970. Critical values and probability levels for the Wilcoxon rank sum test and the Wilcoxon signed rank test. Selected tables in mathematical statistics 1 (1970), 171--259.

Cited by

See all 16

Metadata

Authors
Woloszyn, V., dos Santos, H. D. P., Wives, L. K., & Becker, K.
Affiliations
  • Universidade Federal do Rio Grande do Sul (BR)
  • Pontificia Universidade, Catolica do Rio Grande do Sul, Porto Alegre, Rio Grande do Sul, Brazil
Venue
Proceedings of the International Conference on Web Intelligence
Publisher
ACM
Published
2017-08-23
Pages
877-883
OpenAlex
W2744303556
Cited by
9
References
23
Citations by year
2026: 1 · 2021: 3 · 2018: 4
FWCI
0.50
Type
conference paper
Language
en
Open access
closed
Locations
IEEE/WIC/ACM International Conference on Web Intelligence (publishedVersion)
Funders
CAPES and CNPq, Brazil (459322/2014-1)
Topics
  • Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
  • Physical Sciences › Computer Science › Information Systems › Recommender Systems and Techniques
  • Physical Sciences › Computer Science › Information Systems › Information Retrieval and Search Behavior
Keywords
graph centrality, PageRank, opinion retrieval, opinion summarization, product reviews

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.