The DOI matches its Crossref record; 47 of the 48 references it cites were found in a registry or an index.
Norms of valence, arousal, and dominance for 13,915 English lemmas
Open accessAbstract
Information about the affective meanings of words is used by researchers working on emotions and moods, word recognition and memory, and text-based sentiment analysis. Three components of emotions are traditionally distinguished: valence (the pleasantness of a stimulus), arousal (the intensity of emotion provoked by a stimulus), and dominance (the degree of control exerted by a stimulus). Thus far, nearly all research has been based on the ANEW norms collected by Bradley and Lang (1999) for 1,034 words. We extended that database to nearly 14,000 English lemmas, providing researchers with a much richer source of information, including gender, age, and educational differences in emotion norms. As an example of the new possibilities, we included stimuli from nearly all of the category norms (e.g., types of diseases, occupations, and taboo words) collected by Van Overschelde, Rawson, and Dunlosky (Journal of Memory and Language 50:289-335, 2004), making it possible to include affect in studies of semantic memory.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Warriner et al. (2013) present VAD ratings for 13,914 common English words, thereby providing an empirically validated way of assessing the overall emotional impact of a word, making mean VAD easy to calculate.”
From Five studies evaluating the impact on mental health and mood of recalling, reading, and discussing fiction (2022) · cites this paper as Warriner et al. (2013)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Osgood, C. E., Suci, G. J., & Tannenbaum, P. H. (1957) · Cited by 9,433
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Landauer, T. K., & Dumais, S. T. (1997) · Psychological Review · doi:10.1037/0033-295x.104.2.211 · Cited by 6,282
Sentiment Analysis and Opinion Mining
Zhang, L., & Liu, B. (2017) · Springer eBooks · doi:10.1007/978-1-4899-7687-1_907 · Cited by 3,307
Brysbaert, M., & New, B. (2009) · Behavior Research Methods · doi:10.3758/brm.41.4.977 · Cited by 2,821
Self-citationBalota, D. A., Yap, M. J.-M., Hutchison, K. A., Cortese, M. J., Kessler, B., Loftis, B., Neely, J. H., Nelson, D. L., Simpson, G. B., & Rebecca Treiman, A. (2007) · Behavior Research Methods · doi:10.3758/bf03193014 · Cited by 2,758
Sentiment Analysis and Opinion Mining
Liu, B. (2012) · Synthesis lectures on human language technologies · doi:10.1007/978-3-031-02145-9 · Cited by 1,872
Age-of-acquisition ratings for 30,000 English words
Kuperman, V., Stadthagen-González, H., & Brysbaert, M. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0210-4 · Cited by 1,308
Self-citationThe representation of abstract words: Why emotion matters.
Kousta, S. T., Vigliocco, G., Vinson, D., Andrews, M. W., & Campo, E. D. (2010) · Journal of Experimental Psychology General · doi:10.1037/a0021446 · Cited by 958
A meta-analytic review of research on gender differences in sexuality, 1993–2007.
Petersen, J. L., & Hyde, J. S. (2010) · Psychological Bulletin · doi:10.1037/a0017504 · Cited by 931
Emotions Evoked by Common Words and Phrases: Using Mechanical Turk to Create an Emotion Lexicon
Mohammad, S. M., & Turney, P. D. (2010) · NPARC · Cited by 882
Age-of-acquisition, imagery, concreteness, familiarity, and ambiguity measures for 1,944 words
Gilhooly, K. J., & Logie, R. H. (1980) · Behavior Research Methods · doi:10.3758/bf03201693 · Cited by 868
Gender differences in language use: An analysis of 14,000 text samples
Newman, M. L., Groom, C. J., Handelman, L. D., & Pennebaker, J. W. (2008) · Discourse Processes · doi:10.1080/01638530802073712 · Cited by 788
Emotion words, regardless of polarity, have a processing advantage over neutral words
Kousta, S. T., Vinson, D., & Vigliocco, G. (2009) · Cognition · doi:10.1016/j.cognition.2009.06.007 · Cited by 635
Category norms: An updated and expanded version of the Battig and Montague (1969) norms
Overschelde, J. P. V., Rawson, K. A., & Dunlosky, J. T. (2003) · Journal of Memory and Language · doi:10.1016/j.jml.2003.10.003 · Cited by 621
SUBTLEX-NL: A new measure for Dutch word frequency based on film subtitles
Keuleers, E., Brysbaert, M., & New, B. (2010) · Behavior Research Methods · doi:10.3758/brm.42.3.643 · Cited by 574
Self-citationKeuleers, E., Lacey, P., Rastle, K., & Brysbaert, M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0118-4 · Cited by 391
Self-citationThe Spanish adaptation of ANEW (Affective Norms for English Words)
Redondo, J., Fraga, I., Padrón, I., & Comesaña, M. (2007) · Behavior Research Methods · doi:10.3758/bf03193031 · Cited by 351
Imageability ratings for 3,000 monosyllabic words
Cortese, M. J., & Fugett, A. D. (2004) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03195585 · Cited by 335
Altarriba, J., Bauer, L., & Benvenuto, C. (1999) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200738 · Cited by 330
Norms of valence, arousal, dominance, and age of acquisition for 4,300 Dutch words
Moors, A., Houwer, J. D., Hermans, D., Wanmaker, S., van Schie, K., van Harmelen, A., Schryver, M. D., Winne, J. D., & Brysbaert, M. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0243-8 · Cited by 326
Self-citationThe Bristol norms for age of acquisition, imageability, and familiarity
Stadthagen-Gonzalez, H., & Davis, C. J. (2006) · Behavior Research Methods · doi:10.3758/bf03193891 · Cited by 315
The French Lexicon Project: Lexical decision data for 38,840 French words and 38,840 pseudowords
Ferrand, L., New, B., Brysbaert, M., Keuleers, E., Bonin, P., Méot, A., Augustinova, M., & Pallier, C. (2010) · Behavior Research Methods · doi:10.3758/brm.42.2.488 · Cited by 313
Self-citationMorphological influences on the recognition of monosyllabic monomorphemic words
Baayen, R. H., Feldman, L. B., & Schreuder, R. (2006) · Journal of Memory and Language · doi:10.1016/j.jml.2006.03.008 · Cited by 302
Adding part-of-speech information to the SUBTLEX-US word frequencies
Brysbaert, M., New, B., & Keuleers, E. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0190-4 · Cited by 283
Self-citationInkpen, D. Z., & Association for Computing Machinery-Digital Library (2010) · Cited by 218
The adaptation of the Affective Norms for English Words (ANEW) for European Portuguese
Soares, A. P., Comesaña, M., Pinheiro, A. P., Simões, A., & Frade, S. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0131-7 · Cited by 207
Exploring lexical co-occurrence space using HiDEx
Shaoul, C., & Westbury, C. F. (2010) · Behavior Research Methods · doi:10.3758/brm.42.2.393 · Cited by 146
Emotion words affect eye fixations during reading.
Scott, G. G., O'Donnell, P. J., & Sereno, S. C. (2012) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0027209 · Cited by 143
Burgess, C. (1998) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200643 · Cited by 133
Positive words carry less information than negative words
García, D., Garas, A., & Schweitzer, F. (2012) · EPJ Data Science · doi:10.1140/epjds3 · Cited by 126
Positivity of the English Language
Kloumann, I. M., Danforth, C. M., Harris, K. D., Bliss, C. A., & Dodds, P. S. (2012) · PLoS ONE · doi:10.1371/journal.pone.0029484 · Cited by 121
Sensory experience ratings for over 5,000 mono- and disyllabic words
Juhasz, B. J., & Yap, M. J.-M. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0242-9 · Cited by 119
Imageability estimates for 3,000 disyllabic words
Schock, J., Cortese, M. J., & Khanna, M. M. (2011) · Behavior Research Methods · doi:10.3758/s13428-011-0162-0 · Cited by 119
Verona, E., Sprague, J., & Sadeh, N. (2012) · Journal of Abnormal Psychology · doi:10.1037/a0025308 · Cited by 118
Body—object interaction ratings for 1,618 monosyllabic nouns
Tillotson, S. M., Siakaluk, P. D., & Pexman, P. M. (2008) · Behavior Research Methods · doi:10.3758/brm.40.4.1075 · Cited by 112
A Positivity Bias in Written and Spoken English and Its Moderation by Personality and Gender
Augustine, A. A., Mehl, M. R., & Larsen, R. J. (2011) · Social Psychological and Personality Science · doi:10.1177/1948550611399154 · Cited by 112
Affective norms for 210 British English and Finnish nouns
Eilola, T. M., & Havelka, J. (2010) · Behavior Research Methods · doi:10.3758/brm.42.1.134 · Cited by 111
Taboo, emotionally valenced, and emotionally neutral word norms
Janschewitz, K. (2008) · Behavior Research Methods · doi:10.3758/brm.40.4.1065 · Cited by 100
Tangible Words are Recognized Faster: The Grounding of Meaning in Sensory and Perceptual Systems
Juhasz, B. J., Yap, M. J.-M., Dicke, J., Taylor, S. C., & Gullick, M. M. (2011) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2011.605150 · Cited by 92
Checking and bootstrapping lexical norms by means of word similarity indexes
Bestgen, Y., & Vincze, N. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0195-z · Cited by 75
Perceptual and motor attribute ratings for 559 object concepts
Amsel, B. D., Urbach, T. P., & Marta Kutas, A. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0215-z · Cited by 68
Does Response Scale Format Affect the Answering of Personality Scales?
Rammstedt, B., & Krebs, D. (2007) · European Journal of Psychological Assessment · doi:10.1027/1015-5759.23.1.32 · Cited by 62
Contextual self-organizing map: software for constructing semantic representations
Zhao, X., Li, P., & Kohonen, T. (2010) · Behavior Research Methods · doi:10.3758/s13428-010-0042-z · Cited by 21
Validating an interlingual metanorm for emotional analysis of texts
Leveau, N., Jhean‐Larose, S., Denhière, G., & Nguyen, B.-L. (2012) · Behavior Research Methods · doi:10.3758/s13428-012-0208-y · Cited by 20
Brems, C., Johnson, M. E., Warner, T. D., & Roberts, L. W. (2010) · Journal of HIV/AIDS & Social Services · doi:10.1080/15381501.2010.525480 · Cited by 19
Emotional Nouns Affect Attachment Decisions in Sentence Completion Tasks
Fraga, I., Piñeiro, A., Acuña-Fariña, C., Redondo, J., & García-Orza, J. (2012) · Quarterly Journal of Experimental Psychology · doi:10.1080/17470218.2012.662989 · Cited by 15
Research works printed but not linked: 1
- Bradley, M. M., & Lang, P. J. (1999). Affective norms for English words (ANEW): Stimuli, instruction manual and affective ratings (Technical Report No. C-1). Gainesville, FL: University of Florida, NIMH Center for Research in Psychophysiology.
Cited by
Sorted by citations
Concreteness ratings for 40 thousand generally known English word lemmas
Brysbaert, M., Warriner, A. B., & Kuperman, V. (2014) · Behavior Research Methods · doi:10.3758/s13428-013-0403-5 · Cited by 1,821
Self-citationAn overview of online fake news: Characterization, detection, and discussion
Zhang, X., & Ghorbani, A. A. (2020) · Information Processing & Management · doi:10.1016/j.ipm.2019.03.004 · Cited by 997
Online Human-Bot Interactions: Detection, Estimation, and Characterization
Varol, O., Ferrara, E., Davis, C., Menczer, F., & Flammini, A. (2017) · Proceedings of the International AAAI Conference on Web and Social Media · doi:10.1609/icwsm.v11i1.14871 · Cited by 981
Obtaining Reliable Human Ratings of Valence, Arousal, and Dominance for 20,000 English Words
Mohammad, S. M. (2018) · Annual Meeting of the Association for Computational Linguistics · doi:10.18653/v1/p18-1017 · Cited by 703
A survey of multimodal sentiment analysis
Soleymani, M., García, D., Jou, B., Schuller, B. W., Chang, S., & Pantić, M. (2017) · Image and Vision Computing · doi:10.1016/j.imavis.2017.08.003 · Cited by 647
Metadata
- Authors
- Warriner, A. B., Kuperman, V., & Brysbaert, M.
- Affiliations
- McMaster University (CA)
- Ghent University (BE)
- Corresponding author
- Kuperman, Victor
- Venue
- Behavior Research Methods
- Published
- 2013-02-13
- Volume
- 45
- Issue
- 4
- Pages
- 1191-1207
- ISSN
- 1554-351X (ISSN-L)
- 1554-3528
- OpenAlex
- W2023736093
- Cited by
- 1,959
- References
- 48
- Citations by year
- 2026: 138 · 2025: 140 · 2024: 194 · 2023: 199 · 2022: 199 · 2021: 238 · 2020: 187 · 2019: 180 · 2018: 155 · 2017: 110 · 2016: 102 · 2015: 70 · 2014: 37 · 2013: 9
- FWCI
- 80.74
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Behavior Research Methods (publishedVersion)
- PubMed (publishedVersion)
- Ghent University Academic Bibliography (Ghent University) (submittedVersion)
- MacSphere (McMaster University) (submittedVersion)
- MacSphere (McMaster University)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Sentiment Analysis and Opinion Mining
- Physical Sciences › Computer Science › Artificial Intelligence › Emotion and Mood Recognition
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Categorization, perception, and language
- Keywords
- valence, arousal, dominance, ANEW, emotional words, semantic memory, word recognition, sentiment analysis, gender differences, age differences, educational differences, taboo words
- MeSH terms
- Adolescent, Adult, Affect, Aged, Aged, 80 and over, Arousal, Educational Status, Emotions, Female, Humans, Male, Middle Aged, Reading, Reference Values, Semantics, Sesquiterpenes, Sex Characteristics, Social Dominance, Socioeconomic Factors, Vocabulary, Word Association Tests, Databases, Factual, White People, Young Adult, Crowdsourcing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
