Cited by 3,068Reliability and Agreement in MeasurementNews Media Framing and Political CommunicationComputational and Text Analysis Methods

The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.

Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability

Lombard, Matthew, Snyder-Duch, Jennifer, Bracken, Cheryl Campanella·2002·Human Communication Research

DOI 10.1111/j.1468-2958.2002.tb00826.x

Open this paper in CoChat — free account

Abstract

As a method specifically intended for the study of messages, content analysis is fundamental to mass communication research. Intercoder reliability, more specifically termed intercoder agreement, is a measure of the extent to which independent judges make the same coding decisions in evaluating the characteristics of messages, and is at the heart of this method. Yet there are few standard and accessible guidelines available regarding the appropriate procedures to use to assess and report intercoder reliability, or software tools to calculate it. As a result, it seems likely that there is little consistency in how this critical element of content analysis is assessed and reported in published mass communication studies. Following a review of relevant concepts, indices, and tools, a content analysis of 200 studies utilizing content analysis published in the communication literature between 1994 and 1998 is used to characterize practices in the field. The results demonstrate that mass communication researchers often fail to assess (or at least report) intercoder reliability and often rely on percent agreement, an overly liberal index. Based on the review and these results, concrete guidelines are offered regarding procedures for assessment and reporting of this important aspect of content analysis.

Integrity signals

Registry

Crossref · 10.1111/j.1468-2958.2002.tb00826.x

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,351
The Content Analysis Guidebook
Neuendorf, K. A. (2017) · doi:10.4135/9781071802878 · Cited by 9,286 · cited 10×
“), but this technique has also been questioned (Neuendorf, 2002). With the coding data in hand, the researcher calculates and reports one or more indices of reliability. Popping (1988) identified 39 different “agreement indices” for coding nominal categories, which excludes several techniques for ratio and interval le…”
BackgroundMethodInfluential
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Content Analysis for the Social Sciences and Humanities.
Parker, E. B., & Holsti, O. R. (1970) · American Sociological Review · doi:10.2307/2093233 · Cited by 4,553
Content Analysis in Communication Research.
Pool, I. D. S., & Berelson, B. (1952) · American Sociological Review · doi:10.2307/2088029 · Cited by 3,106
Content Analysis for the Social Sciences and Humanities
Parker, S. R. (1970) · Sociology · doi:10.1177/003803857000400231 · Cited by 2,178
Handbook of Research Methods in Social and Personality Psychology
West, T., Reis, H. T., Judd, C. M., Banaji, M. R., Crandall, C., Giner-Sorolla, R., Biernat, M., Fiedler, K., Ermark, F., Tepper, S. J., et al. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009170123 · Cited by 2,134

Show all 42 references

Research works printed but not linked: 2

Lacy S., 1996, Journalism & Mass Communication Quarterly, 73, 969
Perreault W. D., 1989, Journal of Marketing Research, 26, 135, 10.1177/002224378902600201 · DOI · Paper page

Sorted by citations

Items 201–300 of 1,005

A changing climate of skepticism: The factors shaping climate change coverage in the US press
Schmid-Petri, H., Adam, S., Schmucki, I., & Häußler, T. (2015) · Public Understanding of Science · doi:10.1177/0963662515612276 · Cited by 120
The Role of TV Commercial Visuals in Forming Memorable and Impressive Destination Images
Pan, S. (2009) · Journal of Travel Research · doi:10.1177/0047287509355325 · Cited by 109
Meaningful categorisation of novice programmer errors
McCall, D., & Kölling, M. (2014) · IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2014.7044420 · Cited by 103
Fast food, beverage, and snack brands on social media in the United States: An examination of marketing techniques utilized in 2000 brand posts
Bragg, M. A., Pageot, Y. K., Amico, A., Miller, A. N., Gasbarre, A., Rummo, P. E., & Elbel, B. D. (2019) · Pediatric Obesity · doi:10.1111/ijpo.12606 · Cited by 102
Twitter as a Communication Tool for Nonprofits
Svensson, P. G., Mahoney, T. Q., & Hambrick, M. E. (2014) · Nonprofit and Voluntary Sector Quarterly · doi:10.1177/0899764014553639 · Cited by 102
Interactive Uncertainty Reduction Strategies and Verbal Affection in Computer-Mediated Communication
Antheunis, M. L., Schouten, A. P., Valkenburg, P. M., & Peter, J. (2012) · Communication Research · doi:10.1177/0093650211410420 · Cited by 103
An analysis of the methodological underpinnings of social learning research in natural resource management
Rodela, R., Cundill, G., & Wals, A. E. J. (2012) · Ecological Economics · doi:10.1016/j.ecolecon.2012.02.032 · Cited by 101
Employee attitudes towards corporate social responsibility: a study on gender, age and educational level differences
Rosati, F., Costa, R. M. D. S., Calabrese, A., & Pedersen, E. R. G. (2018) · Corporate Social Responsibility and Environmental Management · doi:10.1002/csr.1640 · Cited by 101
The Principles of Data-Centric AI
Jarrahi, M. H., Memariani, A., & Guha, S. (2023) · Communications of the ACM · doi:10.1145/3571724 · Cited by 101
ESPN—The Women's Sports Network? A Content Analysis of Internet Coverage of March Madness
Kian, E. M., Mondello, M. J., & Vincent, J. E. (2009) · Journal of Broadcasting & Electronic Media · doi:10.1080/08838150903102519 · Cited by 100
“There must be a reason”: Osama, Saddam, and inferred justification
Prasad, M., Perrin, A. J., Bezila, K., Hoffman, S. G., Kindleberger, K., Manturuk, K., & Powers, A. S. (2009) · Sociological Inquiry · doi:10.1111/j.1475-682x.2009.00280.x · Cited by 97
A Content Analysis of Smoking Fetish Videos on YouTube: Regulatory Implications for Tobacco Control
Kim, K., Paek, H., & Lynn, J. (2010) · Health Communication · doi:10.1080/10410230903544415 · Cited by 100
Changes in Media Portrayal of Human-wildlife Conflict During Successive Fatal Shark Bites
Sabatier, E., & Huveneers, C. P. M. (2018) · Conservation and Society · doi:10.4103/cs.cs_18_5 · Cited by 99
The current state of methods for establishing reliability in qualitative chemistry education research articles
Watts, F. M., & Finkenstaedt-Quinn, S. A. (2021) · Chemistry Education Research and Practice · doi:10.1039/d1rp00007a · Cited by 115
A feedback-based model for CSR assessment and materiality analysis
Calabrese, A., Costa, R. M. D. S., & Rosati, F. (2015) · Accounting Forum · doi:10.1016/j.accfor.2015.06.002 · Cited by 100
Information exchange on an academic social networking site: A multidiscipline comparison on researchgate Q&A
Jeng, W., DesAutels, S. J., He, D., & Li, L. (2016) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23692 · Cited by 99
The Evolution of Issue Interpretation within Organizational Fields: Actor Positions, Framing Trajectories, and Field Settlement
Litrico, J., & David, R. J. (2016) · Academy of Management Journal · doi:10.5465/amj.2013.0156 · Cited by 99
Religion and Crime: A Systematic Review and Assessment of Next Steps
Adamczyk, A., Freilich, J. D., & Kim, C. (2017) · Sociology of Religion · doi:10.1093/socrel/srx012 · Cited by 110
Amplifying Quiet Voices
Gooch, D., Barker, M., Hudson, L., Kelly, R., Kortuem, G., van der Linden, J., Petre, M., Brown, R., Klis-Davies, A., Forbes, H., et al. (2018) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3139398 · Cited by 99
Broad Bills or Particularistic Policy? Historical Patterns in American State Legislatures
Gamm, G. H., & Kousser, T. B. (2010) · American Political Science Review · doi:10.1017/s000305540999030x · Cited by 99
Learning Sentiment from Students’ Feedback for Real-Time Interventions in Classrooms
Altrabsheh, N., Cocea, M., & Fallahkhair, S. (2014) · Lecture notes in computer science · doi:10.1007/978-3-319-11298-5_5 · Cited by 98
A content analysis of advertising in a global magazine across seven countries
Nelson, M. R., & Paek, H. (2007) · International Marketing Review · doi:10.1108/02651330710727196 · Cited by 99
Hurricanes and hegemony: A qualitative analysis of micro-level climate change denial discourses
Jacques, P. J., & Knox, C. C. (2016) · Environmental Politics · doi:10.1080/09644016.2016.1189233 · Cited by 109
Policy Change: An Advocacy Coalition Framework Perspective
Pierce, J. J., Peterson, H. L., & Hicks, K. C. (2017) · Policy Studies Journal · doi:10.1111/psj.12223 · Cited by 97
What the Metrics Say. The Softening of News on the Facebook Pages of Mainstream Media Outlets
Lamot, K. (2021) · Digital Journalism · doi:10.1080/21670811.2021.1974917 · Cited by 97
Ludoliteracy: Defining, Understanding, and Supporting Games Education
Zagal, J. P. (2024) · Figshare · doi:10.1184/r1/6686828 · Cited by 97
Maintaining Moral Legitimacy through Worlds and Words: An Explanation of Firms' Investment in Sustainability Certification
Richards, M., Zellweger, T. M., & Gond, J. (2016) · Journal of Management Studies · doi:10.1111/joms.12249 · Cited by 96
Stock price reactions to news about corporate tax avoidance and evasion
Blaufus, K., Möhlmann, A., & Schwäbe, A. N. (2019) · Journal of Economic Psychology · doi:10.1016/j.joep.2019.04.007 · Cited by 96
AI invading the workplace: negative emotions towards the organizational use of personal virtual assistants
Hornung, O., & Smolnik, S. (2021) · Electronic Markets · doi:10.1007/s12525-021-00493-0 · Cited by 98
Turning Corporate Social Responsibility‐driven Opportunities in Competitive Advantages: a Two‐dimensional Model
Calabrese, A., Costa, R. M. D. S., Menichini, T., Rosati, F., & Sanfelice, G. (2013) · Knowledge and Process Management · doi:10.1002/kpm.1401 · Cited by 95
A comparative assessment of answer quality on four question answering sites
Fichman, P. (2011) · Journal of Information Science · doi:10.1177/0165551511415584 · Cited by 95
Smoking Cessation Apps for Smartphones: Content Analysis With the Self-Determination Theory
Choi, J., Noh, G.-Y., & Park, D.-J. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3061 · Cited by 97
Filtering 2008 US presidential election news on YouTube by elites and nonelites: An examination of the democratizing potential of the internet
Dylko, I. B., Beam, M. A., Landreville, K. D., & Geidner, N. W. (2011) · New Media & Society · doi:10.1177/1461444811428899 · Cited by 95
Investigating American and Chinese Subjects’ explicit and implicit perceptions of AI-Generated artistic work
Wu, Y., Mou, Y., Li, Z., & Xu, K. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.106186 · Cited by 99
Discipline-specific feedback literacies: A framework for curriculum design
Winstone, N., Balloo, K., & Carless, D. R. (2020) · Higher Education · doi:10.1007/s10734-020-00632-0 · Cited by 112
Historicizing New Media: A Content Analysis of Twitter
Humphreys, L., Gill, P., Krishnamurthy, B., & Newbury, E. (2013) · Journal of Communication · doi:10.1111/jcom.12030 · Cited by 94
What do the numbers say? The influence of motivation and peer feedback on students’ behaviour in online discussions
Xie, K. (2012) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2012.01291.x · Cited by 102
Sex and the Spectacle of Music Videos: An Examination of the Portrayal of Race and Sexuality in Music Videos
Turner, J. S. (2010) · Sex Roles · doi:10.1007/s11199-010-9766-6 · Cited by 104
International ethnic entrepreneurship: Antecedents, outcomes and environmental context
Nas, T. İ., Şahin, K. T., & ÜK, Z. Ç. (2011) · International Business Review · doi:10.1016/j.ibusrev.2011.02.011 · Cited by 93
Political leaders and the media. Can we measure political leadership images in newspapers using computer-assisted content analysis?
Aaldering, L., & Vliegenthart, R. (2015) · Quality & Quantity · doi:10.1007/s11135-015-0242-9 · Cited by 93
Disengagement Detection in Online Learning: Validation Studies and Perspectives
Cocea, M., & Weibelzahl, S. (2010) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2010.14 · Cited by 92
Checking the Fact-Checkers in 2008: Predicting Political Ad Scrutiny and Assessing Consistency
Amazeen, M. A. (2014) · Journal of Political Marketing · doi:10.1080/15377857.2014.959691 · Cited by 96
The phenomenon of purchasing second-hand products by the BOP consumers
Mukherjee, S., Datta, B., & Paul, J. (2020) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2020.102189 · Cited by 93
Corporate heritage in CSR communication: a means to responsible brand image?
Blombäck, A., & Scandelius, C. (2013) · Corporate Communications An International Journal · doi:10.1108/ccij-07-2012-0048 · Cited by 91
Using Twitter as a means of coping with emotions and uncontrollable crises
Brummette, J., & Sisco, H. F. (2014) · Public Relations Review · doi:10.1016/j.pubrev.2014.10.009 · Cited by 90
Ethics Emerging: The Story of Privacy and Security Perceptions in Virtual Reality
Adams, D., Bah, A., Barwulor, C., Musabay, N., Pitkin, K., & Redmiles, E. M. (2018) · University Libraries (University of Maryland) · doi:10.13016/m2b853k5p · Cited by 90
Exploring the role of the spouse in expatriate failure: a grounded theory-based investigation of expatriate' spouse adjustment issues from India
Gupta, R., Banerjee, P., & Gaur, J. (2012) · The International Journal of Human Resource Management · doi:10.1080/09585192.2011.645052 · Cited by 89
Speaking Law to Power: The Strategic Use of Precedent of the Court of Justice of the European Union
Larsson, O., Naurin, D., Derlén, M., & Lindholm, J. (2016) · Comparative Political Studies · doi:10.1177/0010414016639709 · Cited by 89
Unlocking women’s sustainability leadership potential: Perceptions of contributions and challenges for women in sustainable development
Shinbrot, X. A., Wilkins, K., Ulrike Gretzel, B., & Bowser, G. (2019) · World Development · doi:10.1016/j.worlddev.2019.03.009 · Cited by 109
A study on satisfaction of users towards learning management system at International University – Vietnam National University HCMC
Nguyen, N.-T. (2021) · Asia Pacific Management Review · doi:10.1016/j.apmrv.2021.02.001 · Cited by 88
Understanding Postadoptive Behaviors in Information Systems Use: A Longitudinal Analysis of System Use Problems in the Business Intelligence Context
Deng, X. N., & Chi, L. (2012) · Journal of Management Information Systems · doi:10.2753/mis0742-1222290309 · Cited by 94
Does Local Television News Coverage Cultivate Fatalistic Beliefs About Cancer Prevention?
Niederdeppe, J., Fowler, E. F., Goldstein, K. M., & Pribble, J. M. (2010) · Journal of Communication · doi:10.1111/j.1460-2466.2009.01474.x · Cited by 88
The impact of COVID-19 on the European football ecosystem – A Delphi-based scenario analysis
Beiderbeck, D., Frevel, N., von der Gracht, H. A., Schmidt, S. L., & Schweitzer, V. M. (2021) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.120577 · Cited by 87
Interaction patterns in crisis negotiations: Persuasive arguments and cultural differences.
Giebels, E., & Taylor, P. J. (2009) · Journal of Applied Psychology · doi:10.1037/a0012953 · Cited by 86
Reality and Perception of Copyright Terms of Service for Online Content Creation
Fiesler, C. L., Lampe, C. A. C., & Bruckman, A. S. (2016) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2818048.2819931 · Cited by 86
The customer as enabler of value (co)-creation in the solution business
Petri, J., & Jacob, F. (2016) · Industrial Marketing Management · doi:10.1016/j.indmarman.2016.03.009 · Cited by 86
Oral Communication Skills: Are the Priorities of the Workplace and AACSB-Accredited Business Programs Aligned?
Brink, K. E., & Costigan, R. D. (2015) · Academy of Management Learning & Education · doi:10.5465/amle.2013.0044 · Cited by 110
An Informal Science Education Program’s Impact on STEM Major and STEM Career Outcomes
Habig, B., Gupta, P., Levine, B., & Adams, J. (2020) · Research in Science Education · doi:10.1007/s11165-018-9722-y · Cited by 103
Impulse Buying: Design Practices and Consumer Needs
Moser, C., Schoenebeck, S., & Resnick, P. (2019) · International Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300472 · Cited by 91
Crowdfunding as a tool to support sustainability‐oriented initiatives: Preliminary insights into the role of product/service attributes
Testa, S., Roma, P., Vasi, M., & Cincotti, S. (2019) · Business Strategy and the Environment · doi:10.1002/bse.2385 · Cited by 92
Twitter hashtags for health: applying network and content analyses to understand the health knowledge sharing in a Twitter-based community of practice
Xu, W. W., Chiu, I.-H., Chen, Y., & Mukherjee, T. (2014) · Quality & Quantity · doi:10.1007/s11135-014-0051-6 · Cited by 88
“It's the Central Government's Fault”: Elected Regional Officials' Use of Blame‐Shifting Rhetoric
Mortensen, P. B. (2012) · Governance · doi:10.1111/j.1468-0491.2012.01585.x · Cited by 84
Contradictory Messages: A Content Analysis of Hollywood-Produced Romantic Comedy Feature Films
Johnson, K. R., & Holmes, B. (2009) · Communication Quarterly · doi:10.1080/01463370903113632 · Cited by 84
A Study of Quantitative Content Analysis of Health Messages in U.S. Media From 1985 to 2005
Manganello, J. A., & Blake, N. (2010) · Health Communication · doi:10.1080/10410236.2010.483333 · Cited by 81
Leadership in online creative collaboration
Luther, K., & Bruckman, A. S. (2008) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/1460563.1460619 · Cited by 84
Mass Media Effect on the Operating Environment of a Wildlife‐Related Risk‐Communication Campaign
Gore, M. L., & Knuth, B. A. (2009) · Journal of Wildlife Management · doi:10.2193/2008-343 · Cited by 84
Genre Knowledge and Writing Development: Results From the Writing Transfer Project
Driscoll, D. L., Paszek, J., Gorzelsky, G., Hayes, C. L., & Jones, E. (2019) · Written Communication · doi:10.1177/0741088319882313 · Cited by 105
Benefits to Qualitative Data Quality with Multiple Coders: Two Case Studies in Multi-coder Data Analysis
Church, S. P., Dunn, M., & Prokopy, L. S. (2019) · Journal of Rural Social Sciences · Cited by 83
Corporate Social Responsibility in the Construction Industry
Smallwood, J. (2013) · Routledge eBooks · doi:10.4324/9780203012338 · Cited by 84
Consumer attitudes towards enhanced flavonoid content in fruit
Lampila, P., van Lieshout, M., Gremmen, B., & Lähteenmäki, L. (2008) · Food Research International · doi:10.1016/j.foodres.2008.09.002 · Cited by 82
Visual Framing of the Early Weeks of the U.S.-Led Invasion of Iraq: Applying the Master War Narrative to Electronic and Print Images
Schwalbe, C. B., Silcock, B. W., & Keith, S. M. (2008) · Journal of Broadcasting & Electronic Media · doi:10.1080/08838150802205702 · Cited by 82
CSR disclosure in response to major airline accidents: a legitimacy-based exploration
Vourvachis, P., Woodward, T., Woodward, D., & Patten, D. M. (2016) · Sustainability Accounting Management and Policy Journal · doi:10.1108/sampj-12-2014-0080 · Cited by 82
Autism and the University Experience: Narratives from Students with Neurodevelopmental Disorders
Bolourian, Y., Zeedyk, S. M., & Blacher, J. (2018) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-018-3599-5 · Cited by 98
Co-innovation: the role of online communities
Bugshan, H. (2014) · Journal of Strategic Marketing · doi:10.1080/0965254x.2014.920905 · Cited by 79
Do Survivorship Care Plans Make a Difference? A Primary Care Provider Perspective
Shalom, M. M., Hahn, E. E., Casillas, J., & Ganz, P. A. (2011) · Journal of Oncology Practice · doi:10.1200/jop.2010.000208 · Cited by 83
Gun Stories: How Evidence Shapes Firearm Policy in the United States
Smith‐Walter, A., Peterson, H. L., Jones, M. D., & Marshall, A. N. R. (2016) · Politics & Policy · doi:10.1111/polp.12187 · Cited by 87
Cognitive impact of virtual reality sketching on designers’ concept generation
Yang, E. K., & Lee, J. H. (2020) · Digital Creativity · doi:10.1080/14626268.2020.1726964 · Cited by 81
From Novelty to Normalization? How Journalists Use the Term “Fake News” in their Reporting
Egelhofer, J. L., Aaldering, L., Eberl, J., Galyga, S., & Lecheler, S. K. (2020) · Journalism Studies · doi:10.1080/1461670x.2020.1745667 · Cited by 92
Crisis Communication on Social Media: What Types of COVID-19 Messages Get the Attention?
Kwok, L., Lee, J., & Han, S. H. (2021) · Cornell Hospitality Quarterly · doi:10.1177/19389655211028143 · Cited by 81
When groups decide to use asynchronous online discussions: collaborative learning and social presence under a voluntary participation structure
So, H. (2008) · Journal of Computer Assisted Learning · doi:10.1111/j.1365-2729.2008.00293.x · Cited by 83
Assessment of Interjudge Reliability in the Open-Ended Questions Coding Process
Muñoz‐Leiva, F., Montoro-Ríos, F. J., & Martínez, T. L. (2006) · Quality & Quantity · doi:10.1007/s11135-005-1093-6 · Cited by 86
The open kimono: How Intel balances trust and power to maintain platform leadership
Perrons, R. (2009) · Research Policy · doi:10.1016/j.respol.2009.06.009 · Cited by 87
Managing the Bright and Dark Sides of Status Endowment in Hierarchical Loyalty Programs
Eggert, A., Steinhoff, L., & Garnefeld, I. (2015) · Journal of Service Research · doi:10.1177/1094670514566797 · Cited by 83
Beyond Idea Generation: The Power of Groups in Developing Ideas
McMahon, K., Ruggeri, A., Kämmer, J. E., & Katsikopoulos, K. V. (2016) · Creativity Research Journal · doi:10.1080/10400419.2016.1195637 · Cited by 82
Comparing large Language models and human annotators in latent content analysis of sentiment, political leaning, emotional intensity and sarcasm
Bojić, L., Zagovora, O., Zelenkauskaitė, A., Vuković, V., Čabarkapa, M., Jerković, S. V., & Jovančević, A. (2025) · Scientific Reports · doi:10.1038/s41598-025-96508-3 · Cited by 119
Perceptions and Beliefs about Weed Management: Perspectives of Ohio Grain and Produce Farmers
Wilson, R. S., Tucker, M., Hooker, N. H., LeJeune, J., & Doohan, D. (2008) · Weed Technology · doi:10.1614/wt-07-143.1 · Cited by 79
Online discussion group sustainability: Investigating the interplay between structural dynamics and social dynamics over time
Ridings, C. M., & Wasko, M. M. (2010) · Journal of the Association for Information Systems · doi:10.17705/1jais.00220 · Cited by 78
Talking About Life and Finding Solutions to Different Hardships
Roe, D., Hasson‐Ohayon, I., Derhi, O., Yanos, P. T., & Lysaker, P. H. (2010) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0b013e3181f97c50 · Cited by 81
Birds of a feather flock together? Party leaders on Twitter during the 2013 Norwegian elections
Larsson, A. O., & Ihlen, Ø. (2015) · European Journal of Communication · doi:10.1177/0267323115595525 · Cited by 77
The Politics of Photography: Visual Depictions of Syrian Refugees in U.K. Online Media
Wilmott, A. C. (2017) · Visual Communication Quarterly · doi:10.1080/15551393.2017.1307113 · Cited by 77
Things Are Not Always What They Seem: The Origins and Evolution of Intragroup Conflict
Shah, P. P., Peterson, R. S., Jones, S. L., & Ferguson, A. J. (2020) · Administrative Science Quarterly · doi:10.1177/0001839220965186 · Cited by 82
The Prevalence of Sexual Assault Among Higher Education Students: A Systematic Review With Meta-Analyses
Steele, B., Martin, M., Sciarra, A., Meléndez‐Torres, G. J., Esposti, M. D., & Humphreys, D. K. (2023) · Trauma Violence & Abuse · doi:10.1177/15248380231196119 · Cited by 80
Dialogic Public Relations and Resource Dependency: New Jersey Community Colleges as Models for Web Site Effectiveness
McAllister-Spooner, S. M., & Kent, M. L. (2009) · Atlantic Journal of Communication · doi:10.1080/15456870903210113 · Cited by 77
Differential Innovativeness Outcomes of User and Employee Participation in an Online User Innovation Community
Yan, J., Leidner, D. E., & Benbya, H. (2018) · Journal of Management Information Systems · doi:10.1080/07421222.2018.1481669 · Cited by 80
Investigating Salesperson Performance Factors: A Systematic Review of the Literature on the Characteristics of Effective Salespersons
Herjanto, H., & Franklin, D. (2019) · Australasian Marketing Journal (AMJ) · doi:10.1016/j.ausmj.2018.12.001 · Cited by 89
On the Interpretability of Law: Lessons from the Decoding of National Constitutions
Ginsburg, T., Melton, J., Elkins, Z., & Leetaru, K. H. (2013) · eYLS (Yale Law School) · Cited by 76
Exploring the stimulating role of augmented reality features in E-commerce: A three-staged hybrid approach
Xu, X., Jia, Q., & Tayyab, S. M. U. (2024) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2023.103682 · Cited by 80
“People power” or “pester power”? YouTube as a forum for the generation of evidence and patient advocacy
Mazanderani, F., O’Neill, B. G., & powell, J. A. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.06.006 · Cited by 76
An Investigation of Peripheral and Central Cues of Online Customer Review Voting and Helpfulness through the Lens of Elaboration Likelihood Model
Mousavizadeh, M., Koohikamali, M., Salehan, M., & Kim, D. J. (2020) · Information Systems Frontiers · doi:10.1007/s10796-020-10069-6 · Cited by 75
DATA BREACH MANAGEMENT: AN INTEGRATED RISK MODEL
Khan, F., Kim, J. H., Mathiassen, L., & Moore, R. (2020) · Information & Management · doi:10.1016/j.im.2020.103392 · Cited by 75

Authors: Lombard, M., Snyder-Duch, J., & Bracken, C. C.
Affiliations: Temple University (US)
Cleveland State University (US)
Venue: Human Communication Research
Publisher: Oxford University Press (OUP)
Published: 2002-10
Volume: 28
Issue: 4
Pages: 587-604
ISSN: 0360-3989 (ISSN-L)
1468-2958
DOI: 10.1111/j.1468-2958.2002.tb00826.x
OpenAlex: W2160375265
Cited by: 3,068
References: 42
Citations by year: 2026: 234 · 2025: 173 · 2024: 136 · 2023: 143 · 2022: 212 · 2021: 238 · 2020: 206 · 2019: 206 · 2018: 174 · 2017: 168 · 2016: 174 · 2015: 153 · 2014: 168 · 2013: 158 · 2012: 117
FWCI: 19.75
Type: journal article
Language: en
Open access: closed
Licence: doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 4718 d)
Locations: Human Communication Research (publishedVersion)
EngagedScholarship @ Cleveland State University (Cleveland State University) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Social Sciences › Communication › News Media Framing and Political Communication
Social Sciences › General Social Sciences › Computational and Text Analysis Methods
Keywords: intercoder reliability, inter-coder agreement, content analysis, mass communication research, reporting practices, percent agreement, reliability index, coding procedures, research guidelines

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks