Student or educator? Sign up with your school email and get 6 months of Pro free.
Cited by 1,502

The DOI matches its Crossref record; 1 of the 1 references it cites were found in a registry or an index.

Measuring praise and criticism: Inference of semantic orientation from association

Open access
Turney, Peter D., Littman, Michael L.·2003·ACM Transactions on Information Systems

Abstract

The evaluative character of a word is called its semantic orientation . Positive semantic orientation indicates praise (e.g., "honest", "intrepid") and negative semantic orientation indicates criticism (e.g., "disturbing", "superfluous"). Semantic orientation varies in both direction (positive or negative) and degree (mild to strong). An automated system for measuring semantic orientation would have application in text classification, text filtering, tracking opinions in online discussions, analysis of survey responses, and automated chat systems ( chatbots ). This article introduces a method for inferring the semantic orientation of a word from its statistical association with a set of positive and negative paradigm words. Two instances of this approach are evaluated, based on two different statistical measures of word association: pointwise mutual information (PMI) and latent semantic analysis (LSA). The method is experimentally tested with 3,596 words (including adjectives, adverbs, nouns, and verbs) that have been manually labeled positive (1,614 words) and negative (1,982 words). The method attains an accuracy of 82.8% on the full test set, but the accuracy rises above 95% when the algorithm is allowed to abstain from classifying mild words.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/944012.944013

Cites

1 of 1 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 28

  1. Agresti A., An Introduction to Categorical Data Analysis, 10.1002/0470114754 · DOI
  2. 10.1145/133160.133191 · DOI
  3. Budanitsky A., Workshop on WordNet and Other Lexical Resources, Second meeting of the North American Chapter of the Association for Computational Linguistics
  4. 10.3115/981623.981633 · DOI · Paper page
  5. 10.1002/(SICI)1097-4571(199009)41:6<391::AID-ASI1>3.0.CO;2-9 · DOI
  6. 10.5555/972450.972454 · doi:10.5555/972450.972454
  7. Firth J. R., Studies in Linguistic Analysis
  8. 10.3115/976909.979640 · DOI · Paper page
  9. 10.3115/990820.990864 · DOI · Paper page
  10. Hearst M. A., Text-Based Intelligent Systems: Current Research and Practice in Information Extraction and Retrieval
  11. Kamps J., Proceedings of the 1st International Conference on Global WordNet. CIIL
  12. Landauer T. K. 2002. On the computational basis of learning and cognition: Arguments from LSA. In The Psychology of Learning and Motivation B. H. Ross Ed. To appear.]] Landauer T. K. 2002. On the computational basis of learning and cognition: Arguments from LSA. In The Psychology of Learning and Motivation B. H. Ross Ed. To appear.]] · DOI
  13. 10.1037/0033-295X.104.2.211 · DOI · Paper page
  14. Manning C. D. and Schütze H. 1999. Foundations of Statistical Natural Language Processing. MIT Press Cambridge Mass.]] Manning C. D. and Schütze H. 1999. Foundations of Statistical Natural Language Processing. MIT Press Cambridge Mass.]]
  15. 10.1093/ijl/3.4.235 · DOI · Paper page
  16. Osgood C. E. Suci G. J. and Tannenbaum P. H. 1957. The Measurement of Meaning. University of Illinois Press Chicago Ill.]] Osgood C. E. Suci G. J. and Tannenbaum P. H. 1957. The Measurement of Meaning. University of Illinois Press Chicago Ill.]]
  17. 10.3115/1118693.1118704 · DOI · Paper page
  18. Resnik P., 1995, Proceedings of the 14th International Joint Conference on Artificial Intelligence. Morgan-Kaufmann, San Mateo, Calif., 448--453
  19. Schütze H., Advances in Neural Information Processing Systems 5
  20. 10.5555/972450.972458 · doi:10.5555/972450.972458
  21. Spertus E., 1997, Proceedings of the Conference on Innovative Applications of Artificial Intelligence. AAAI Press, Menlo Park, Calif., 1058--1065
  22. Stone P. J. Dunphy D. C. Smith M. S. and Ogilvie D. M. 1966. The General Inquirer: A Computer Approach to Content Analysis. MIT Press Cambridge Mass.]] Stone P. J. Dunphy D. C. Smith M. S. and Ogilvie D. M. 1966. The General Inquirer: A Computer Approach to Content Analysis. MIT Press Cambridge Mass.]]
  23. Tong R. M., 2001, Working Notes of the ACM SIGIR 2001 Workshop on Operational Text Classification. ACM
  24. 10.1007/3-540-44795-4_42 · DOI · Paper page
  25. 10.3115/1073083.1073153 · DOI · Paper page
  26. van Rijsbergen C. J., Information Retrieval
  27. Wiebe J. M., 2000, Proceedings of the 17th National Conference on Artificial Intelligence. AAAI Press, Menlo Park, Calif.]]
  28. 10.3115/1118078.1118104 · DOI

Cited by

See all 1,502

Metadata

Authors
Turney, P. D., & Littman, M. L.
Venue
ACM Transactions on Information Systems
Published
2003-10
Volume
21
Issue
4
Pages
315-346
ISSN
  • 1046-8188 (ISSN-L)
  • 1558-2868
OpenAlex
W2168625136
Cited by
1,502
References
1
FWCI
25.44
Type
journal article
Language
en
Open access
green

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.