Cited by 3,068Reliability and Agreement in MeasurementNews Media Framing and Political CommunicationComputational and Text Analysis Methods

The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.

Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability

Lombard, Matthew, Snyder-Duch, Jennifer, Bracken, Cheryl Campanella·2002·Human Communication Research

DOI 10.1111/j.1468-2958.2002.tb00826.x

Open this paper in CoChat — free account

Abstract

As a method specifically intended for the study of messages, content analysis is fundamental to mass communication research. Intercoder reliability, more specifically termed intercoder agreement, is a measure of the extent to which independent judges make the same coding decisions in evaluating the characteristics of messages, and is at the heart of this method. Yet there are few standard and accessible guidelines available regarding the appropriate procedures to use to assess and report intercoder reliability, or software tools to calculate it. As a result, it seems likely that there is little consistency in how this critical element of content analysis is assessed and reported in published mass communication studies. Following a review of relevant concepts, indices, and tools, a content analysis of 200 studies utilizing content analysis published in the communication literature between 1994 and 1998 is used to characterize practices in the field. The results demonstrate that mass communication researchers often fail to assess (or at least report) intercoder reliability and often rely on percent agreement, an overly liberal index. Based on the review and these results, concrete guidelines are offered regarding procedures for assessment and reporting of this important aspect of content analysis.

Integrity signals

Registry

Crossref · 10.1111/j.1468-2958.2002.tb00826.x

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,351
The Content Analysis Guidebook
Neuendorf, K. A. (2017) · doi:10.4135/9781071802878 · Cited by 9,286 · cited 10×
“), but this technique has also been questioned (Neuendorf, 2002). With the coding data in hand, the researcher calculates and reports one or more indices of reliability. Popping (1988) identified 39 different “agreement indices” for coding nominal categories, which excludes several techniques for ratio and interval le…”
BackgroundMethodInfluential
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Content Analysis for the Social Sciences and Humanities.
Parker, E. B., & Holsti, O. R. (1970) · American Sociological Review · doi:10.2307/2093233 · Cited by 4,553
Content Analysis in Communication Research.
Pool, I. D. S., & Berelson, B. (1952) · American Sociological Review · doi:10.2307/2088029 · Cited by 3,106
Content Analysis for the Social Sciences and Humanities
Parker, S. R. (1970) · Sociology · doi:10.1177/003803857000400231 · Cited by 2,178
Handbook of Research Methods in Social and Personality Psychology
West, T., Reis, H. T., Judd, C. M., Banaji, M. R., Crandall, C., Giner-Sorolla, R., Biernat, M., Fiedler, K., Ermark, F., Tepper, S. J., et al. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009170123 · Cited by 2,134

Show all 42 references

Research works printed but not linked: 2

Lacy S., 1996, Journalism & Mass Communication Quarterly, 73, 969
Perreault W. D., 1989, Journal of Marketing Research, 26, 135, 10.1177/002224378902600201 · DOI · Paper page

Sorted by citations

Items 901–1,000 of 1,005

Coding empathy in dialogue
Macagno, F., Rapanta, C., Mayweg-Paus, E., & García-Milà, M. (2022) · Journal of Pragmatics · doi:10.1016/j.pragma.2022.02.011 · Cited by 27
Microfoundations of Problem Solving: Attentional Engagement Predicts Problem-Solving Strategies
Martinez, D. L., Arrieta, J. P., & Brusoni, S. (2023) · Organization Science · doi:10.1287/orsc.2019.13213 · Cited by 24
Automating annotation of information-giving for analysis of clinical conversation
Mayfield, E., Laws, M. B., Wilson, I. B., & Rosé, C. P. (2013) · Journal of the American Medical Informatics Association · doi:10.1136/amiajnl-2013-001898 · Cited by 23
Reporting suicide: Interpreting media guidelines
Machlin, A., Skehan, J., Sweet, M. A., Wake, A. N., Fletcher, J. R., Spittal, M. J., & Pirkis, J. (2012) · RMIT Research Repository (RMIT University Library) · Cited by 23
CSR and service quality in nonprofit organizations: the case of a performing arts association
Andreini, D., Pedeliento, G., & Signori, S. (2014) · International Journal of Nonprofit and Voluntary Sector Marketing · doi:10.1002/nvsm.1488 · Cited by 23
Cross‐cultural comparison of interactivity and advertising appeals on antismoking web sites in the United States and South Korea
Yu, H., Paek, H., & Bae, B. (2008) · Internet Research · doi:10.1108/10662240810912738 · Cited by 23
Accessible haptic user interface design approach for users with visual impairments
Kim, H. N., Smith‐Jackson, T. L., & Kleiner, B. M. (2013) · Universal Access in the Information Society · doi:10.1007/s10209-013-0325-0 · Cited by 23
TILES: classifying contextual information for mobile tourism applications
Tan, E. M., Foo, S. S.-B., Goh, D. H., & Theng, Y. (2009) · Aslib Journal of Information Management · doi:10.1108/00012530911005526 · Cited by 23
Developing and validating measures for child welfare agencies to self-monitor fidelity to a child safety intervention
Kaye, S., & Osteen, P. J. (2011) · Children and Youth Services Review · doi:10.1016/j.childyouth.2011.06.020 · Cited by 23
How reliable and valid is the coding of the variables of the European Statistics on Accidents at Work (ESAW)? A need to improve preventive public policies
Ruiz, E. M., Pitarque, S., Fondevila-McDonald, Y., & Martín-Bustamante, M. (2015) · Safety Science · doi:10.1016/j.ssci.2015.05.005 · Cited by 23
Correcting Measurement Error in Content Analysis
Bachl, M., & Scharkow, M. (2017) · Communication Methods and Measures · doi:10.1080/19312458.2017.1305103 · Cited by 22
Permitted to Build? Moral Foundations in Newspaper Framing of Mosque-Construction Controversies
Bowe, B. (2018) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699017709253 · Cited by 23
The language of ‘nudge’ in health policy: pre-empting working class obesity through ‘biopedagogy’
Mulderrig, J. (2017) · Critical Policy Studies · doi:10.1080/19460171.2017.1398672 · Cited by 23
In search for impregnable exchange relationships with buyers: Exploratory insights for suppliers
Clauß, T., & Tangpong, C. (2018) · Industrial Marketing Management · doi:10.1016/j.indmarman.2018.03.005 · Cited by 23
Understanding the Software Development Industry's Perspective on Coding Boot Camps versus Traditional 4-year Colleges
Burke, Q., Bailey, C. S., Lyon, L. A., & Green, E. (2018) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3159450.3159485 · Cited by 23
A Critical Examination of Feedback in Early Reading Games
Benton, L., Vasalou, A., Berkling, K., Barendregt, W., & Mavrikis, M. (2018) · International Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173947 · Cited by 21
Why Johnny can’t develop a secure application? A usability analysis of Java Secure Socket Extension API
Wijayarathna, C., & Arachchilage, N. A. G. (2018) · Computers & Security · doi:10.1016/j.cose.2018.09.007 · Cited by 23
Port labour, competitiveness and drivers of change in the Mediterranean Sea: a conceptual framework
Satta, G., Maugéri, S., Panetti, E., & Ferretti, M. (2019) · Production Planning & Control · doi:10.1080/09537287.2019.1590745 · Cited by 23
Media coverage of harm reduction, 2000–2016: A content analysis of tone, topics, and interventions in Canadian print news
Wild, T. C., Koziel, J., Anderson-Baron, J. T., Hathaway, J., McCurdy, A., Xu, X., Asbridge, M., Belle‐Isle, L., Hathaway, A. D., MacPherson, D., et al. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.107599 · Cited by 23
¡Vamos a Jugar Counters! Learning Mathematics Through Funds of Knowledge, Play, and the Third Space
Razfar, A. (2012) · Bilingual Research Journal · doi:10.1080/15235882.2012.668868 · Cited by 25
Implementing a Change to a Learner-Centered Philosophy in a School of Nursing:Faculty Perceptions
Colley, S. L. (2012) · Nursing Education Perspectives · doi:10.5480/1536-5026-33.4.229 · Cited by 23
Proposal of a Qualitative Content Analysis Process for a Solo Researcher
Kawamoto, M., Koizumi, M., & Yoshikane, F. (2023) · Libri · doi:10.1515/libri-2022-0068 · Cited by 27
Sound-Bite Science: On the Brevity of Science and Scientific Experts in Western European Television News
Verhoeven, P. (2010) · Science Communication · doi:10.1177/1075547010362709 · Cited by 22
Interpretive Content Analysis
Drisko, J. W., & Maschi, T. M. (2015) · doi:10.1093/acprof:oso/9780190215491.003.0003 · Cited by 22
The role of identification in frontline employee decision-making
Mascio, R. D., & Fatima, J. K. (2018) · Journal of Retailing and Consumer Services · doi:10.1016/j.jretconser.2018.01.008 · Cited by 22
More than Just a Laughing Matter: A Coding Framework of Humor in Media Entertainment for Tweens and Teens
van der Wal, A., Piotrowski, J. T., Fikkers, K. M., & Valkenburg, P. M. (2020) · Journal of Broadcasting & Electronic Media · doi:10.1080/08838151.2020.1796389 · Cited by 22
Conceptualizing Inclusive Learning and Development: A Framework towards Entrepreneurial Competency Practices for Sustainability
Chander, N., Siow, M. L., Ramachandran, S., Kunasekaran, P., & Rathakrishnan, T. (2020) · Sustainability · doi:10.3390/su12176905 · Cited by 25
Framing Science: How Opioid Research Is Presented in Online News Media
Matthias, L., Fleerackers, A., & Alperín, J. P. (2020) · Frontiers in Communication · doi:10.3389/fcomm.2020.00064 · Cited by 22
Should the EFQM Excellence Model be Adapted for Specific Industries? A Restaurant Sector Example
Liu, Y.-L., Ko, P.-F., Chiang, J.-T., & Shyr, W. (2020) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2020.102694 · Cited by 22
Environmental key performance indicators: the role of regulations and stakeholder influence
Zarzycka, E., & Krasodomska, J. (2021) · Environment Systems & Decisions · doi:10.1007/s10669-021-09825-z · Cited by 22
Combating the Infodemic: A Chinese Infodemic Dataset for Misinformation Identification
Luo, J., Xue, R., Hu, J., & Baz, D. E. (2021) · Healthcare · doi:10.3390/healthcare9091094 · Cited by 22
Plastics in Mass Media. A Content Analysis of German Media Coverage of Plastic-Associated Risks and Sustainable Alternatives to Plastics
Welzenbach-Vogel, I. C., Werling, K., Barkela, B., & Milde, J. (2021) · Environmental Communication · doi:10.1080/17524032.2021.1979618 · Cited by 22
Reasons for (not) choosing dental treatments—A qualitative study based on patients’ perspective
Felgner, S., Dreger, M., & Henschke, C. (2022) · PLoS ONE · doi:10.1371/journal.pone.0267656 · Cited by 22
Financial statement fraud, recidivism and punishment
Wang, Y., Ashton, J. K., & Jaafar, A. (2023) · Emerging Markets Review · doi:10.1016/j.ememar.2023.101033 · Cited by 22
Knowledge construction and misconstruction: A case study approach in asynchronous discussion using Knowledge Construction – Message Map (KCMM) and Knowledge Construction – Message Graph (KCMG)
Yap, K. C., & Chia, K. P. (2010) · Computers & Education · doi:10.1016/j.compedu.2010.07.002 · Cited by 22
Interactions between E nglish‐speaking and C hinese‐speaking users and librarians on social networking sites
Huang, H., Chu, S. K. W., & Chen, D. Y. (2014) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23251 · Cited by 22
A persuasive-based latent class segmentation analysis of luxury brand websites
Díaz, E., Martín‐Consuegra, D., & Estelami, H. (2016) · Electronic Commerce Research · doi:10.1007/s10660-016-9212-0 · Cited by 21
Perceptions of Teachers’ Preparedness to Teach Deaf and Hard of Hearing Students with Additional Disabilities: A Qualitative Case Study.
Musyoka, M. M., Gentry, M. A., & Meek, D. R. (2017) · Journal of Developmental and Physical Disabilities · doi:10.1007/s10882-017-9555-z · Cited by 31
Couple-Level Dynamics and Multilevel Challenges Among Black Men Who Have Sex with Men: A Framework of Dyadic HIV Care
Tan, J. Y., Campbell, C. K., Conroy, A. A., Tabrisky, A. P., Kegeles, S. M., & Dworkin, S. L. (2018) · AIDS Patient Care and STDs · doi:10.1089/apc.2018.0131 · Cited by 22
The effects of offline events on online connective actions: An examination of #BoycottNFL using social network analysis
Chung, T.-L. D., Johnson, O., Hall‐Phillips, A., & Kim, K. (2020) · Computers in Human Behavior · doi:10.1016/j.chb.2020.106623 · Cited by 22
Content Analysis as a Method to Assess Online Discussions for Learning
Rodriguez, M. A. (2014) · SAGE Open · doi:10.1177/2158244014559019 · Cited by 27
Players’ Value Structure in Digital Games
Lin, Y.-L., Lin, H., & Yang, Y. (2015) · Games and Culture · doi:10.1177/1555412015581710 · Cited by 22
Stop Playing with Your Food
Cicchirillo, V. J., & Lin, J.-S. (2011) · Journal of Advertising Research · doi:10.2501/jar-51-3-484-498 · Cited by 24
News, Geography and Disadvantage: Mapping Newspaper Coverage of High-needs Neighbourhoods in Toronto, Canada
Lindgren, A. (2021) · doi:10.32920/ryerson.14636889.v1 · Cited by 22
Poll Reporting and Journalistic Paradigm: A Study of Popularity Poll Coverage in Hong Kong Newspapers
Lee, F. L. F. (2006) · Asian Journal of Communication · doi:10.1080/01292980600638629 · Cited by 21
Communicating Health: Media Framing of Ebola Outbreak in Nigerian Newspapers
Adekunle, A. L., & Adnan, H. M. (2016) · Jurnal Komunikasi Malaysian Journal of Communication · doi:10.17576/jkmjc-2016-3202-19 · Cited by 21
A Comparative Analysis on Cognitive Domain for the Malaysian Primary Four Textbook Series
Ismail, Z. B., Joo, T. K., & Abidin, M. (2018) · Eurasia Journal of Mathematics Science and Technology Education · doi:10.29333/ejmste/82625 · Cited by 21
SLSS Gamification as an E-Commerce Model in China
Hu, T. “., Tang, Z. R., Warkentin, M. E., & Wen, N. (2021) · Journal of Computer Information Systems · doi:10.1080/08874417.2021.1949759 · Cited by 21
An overview of maritime logistics: trends and research agenda
Gülmez, S., Şakar, G. D., & Baştuğ, S. (2021) · Maritime Policy & Management · doi:10.1080/03088839.2021.1962557 · Cited by 21
Social Media Health Promotion and Audience Engagement: The Roles of Information Dissemination, Organization-Audience Interaction, and Action Confidence Building
Jiang, S., Tay, J., Ngien, A., & Basnyat, I. (2022) · Health Communication · doi:10.1080/10410236.2022.2150809 · Cited by 27
Communicating COVID-19 Risk on Instagram: A Content Analysis of Official Public Health Messaging During the First Year of the Pandemic
Mello, S., Glowacki, E. M., Fuentes, I., & Seabolt, J. (2023) · Journal of Health Communication · doi:10.1080/10810730.2023.2175278 · Cited by 21
Diverse politics, diverse news coverage? A longitudinal study of diversity in Dutch political news during two decades of election campaigns
van Hoof, A. M. J., Jacobi, C., Ruigrok, N., & van Atteveldt, W. (2014) · European Journal of Communication · doi:10.1177/0267323114545712 · Cited by 21
On the Ethics of Management Research: An Exploratory Investigation
Frechtling, D. C., & Boo, S. (2011) · Journal of Business Ethics · doi:10.1007/s10551-011-0986-7 · Cited by 28
Racial Mediation in the Coverage of Candidates' Political Viability: A Comparison of Approaches
Tolley, E. (2015) · Journal of Ethnic and Migration Studies · doi:10.1080/1369183x.2014.1002201 · Cited by 22
Political market orientation and strategic party postures in Danish political parties
Ormrod, R. P., & Henneberg, S. C. M. (2011) · European Journal of Marketing · doi:10.1108/03090561111119949 · Cited by 21
Are subjective assessments of snoring sounds reliable?
Rohrmeier, C., Fischer, R., Merz, A.-K., Ettl, T., Herzog, M., & Kuehnel, T. S. (2014) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-014-3211-3 · Cited by 21
Mixed messages, partial pictures? Discourses under construction in CCTV’sAfrica Livecompared with the BBC
Marsh, V. (2015) · Chinese Journal of Communication · doi:10.1080/17544750.2015.1105269 · Cited by 21
Who’s Responsible? Media Framing of Pediatric Environmental Health and Mothers’ Perceptions of Accountability
Mello, S., & Tan, A. S. L. (2016) · Journal of Health Communication · doi:10.1080/10810730.2016.1240267 · Cited by 21
Interest groups and social media: An examination of cause and sectional groups' social media strategies in the EU
Kanol, D., & Nat, M. C. (2017) · Journal of Public Affairs · doi:10.1002/pa.1649 · Cited by 21
Applying the Theory of Reasoned Action to Understanding Teen Pregnancy with American Indian Communities
Dippel, E. A., Hanson, J. D., McMahon, T. R., Griese, E. R., & Kenyon, D. B. (2017) · Maternal and Child Health Journal · doi:10.1007/s10995-017-2262-7 · Cited by 21
Melfi’s Choice: Morally Conflicted Content Leads to Moral Rumination in Viewers
Eden, A., Daalmans, S., van Ommen, M., & Weljers, A. (2017) · Journal of Media Ethics · doi:10.1080/23736992.2017.1329019 · Cited by 21
Examining Science Teachers’ Argumentation in a Teacher Workshop on Earthquake Engineering
Cavlazoglu, B., & Stuessy, C. L. (2018) · Journal of Science Education and Technology · doi:10.1007/s10956-018-9728-2 · Cited by 24
Web-Based Integrated CSR Reporting: An Empirical Analysis
Bosetti, L. (2018) · Symphonya Emerging Issues in Management · doi:10.4468/2018.1.02bosetti · Cited by 21
Studying psychotherapy change in narrative terms: The innovative moments method
Batista, J., da Silva, J. R., Magalhães, C., Ferreira, H., Fernández‐Navarro, P., & Gonçalves, M. M. (2020) · Counselling and Psychotherapy Research · doi:10.1002/capr.12297 · Cited by 21
Systematic review of documented Indigenous Knowledge of freshwater biodiversity in the circumpolar Arctic
Knopp, J., Levenstein, B., Watson, A., Ivanova, I., & Lento, J. (2020) · Freshwater Biology · doi:10.1111/fwb.13570 · Cited by 18
Modularity in making: simplifying solution space for user innovation
Naik, H., Fritzsche, A., & Moeslein, K. M. (2020) · R and D Management · doi:10.1111/radm.12427 · Cited by 22
What role for national parliaments in EU governance? A view by members of parliament
Kinski, L. (2020) · Journal of European Integration · doi:10.1080/07036337.2020.1817000 · Cited by 21
Alliance Formation in the Automobile Sector during an Era of Ferment
Sierzchula, W., Bakker, S., Maat, K., & van Wee, B. (2014) · Creativity and Innovation Management · doi:10.1111/caim.12077 · Cited by 21
Taking Advantage of a Vulnerable Group? Emotional Cues in Ads Targeting Parents
Stanton, J. V., & Guion, D. T. (2013) · Journal of Consumer Affairs · doi:10.1111/joca.12018 · Cited by 21
Meeting health information needs of people with HIV/AIDS: sources and means of collaboration
O'Grady, L. A. (2008) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2007.00764.x · Cited by 21
Are dissertations trustworthy enough? The case of Turkish ph. d. dissertations on social studies education
ERYILMAZ, Ö. (2022) · Participatory Educational Research · doi:10.17275/per.22.70.9.3 · Cited by 20
Understanding B2B customer journeys for complex digital services: The case of cloud computing
Terpoorten, C., Klein, J. F., & Merfeld, K. (2024) · Industrial Marketing Management · doi:10.1016/j.indmarman.2024.04.011 · Cited by 20
Insiders and Outsiders: Presentation of Self on Canadian Parliamentary Websites and Newsletters
Koop, R., & Marland, A. (2012) · Policy & Internet · doi:10.1002/poi3.13 · Cited by 20
Imaginary travellers: Identity conceptualisations of the audience among travel journalists
Duffy, A. M., & Mangharam, S. (2016) · Journalism · doi:10.1177/1464884916636169 · Cited by 20
Understanding the Subjective and Objective Assessments of Service Quality through Spa Customers’ E-complaints in Bangkok
Sangpikul, A. (2021) · Journal of Quality Assurance in Hospitality & Tourism · doi:10.1080/1528008x.2021.1891598 · Cited by 20
Understanding resort service quality through customer complaints
Sangpikul, A. (2021) · Anatolia · doi:10.1080/13032917.2021.1925937 · Cited by 20
What do people post on social media relative to low back pain? A content analysis of Australian data
O’Hagan, E. T., Traeger, A. C., Bunzli, S., Leake, H. B., Schabrun, S. M., Wand, B. M., O'Neill, S. G., Harris, I. A., & McAuley, J. H. (2021) · Musculoskeletal Science and Practice · doi:10.1016/j.msksp.2021.102402 · Cited by 20
“Good morning, Twitter! What are you doing today to support the voice of people with #disability?”: disability and digital organizing
Sarkar, T., Forber‐Pratt, A. J., Hanebutt, R. A., & Cohen, M. (2021) · Journal of Community Practice · doi:10.1080/10705422.2021.1982802 · Cited by 20
Willingness to purchase refurbished products sold online: a qualitative inquiry of young consumers from an emerging market
Gaur, J., Srivastava, A., & Gupta, R. (2022) · Young Consumers Insight and Ideas for Responsible Marketers · doi:10.1108/yc-11-2021-1417 · Cited by 20
How to conduct more systematic reviews of agent-based models and foster theory development - Taking stock and looking ahead
Achter, S., Borit, M., Cottineau, C., Meyer, M., Polhill, G. J., & Radchuk, V. (2023) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2023.105867 · Cited by 20
Has the Dutch news media acted as a policy actor in the road pricing policy debate?
Ardıç, Ö., Annema, J. A., & van Wee, B. (2013) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2013.09.005 · Cited by 20
Memorable First Time Sexual Experiences: Gendered Patterns and Nuances
Orbe, M. P., Johnson, A., Kauffman, L. D., & Cooke-Jackson, A. F. (2014) · Communication Quarterly · doi:10.1080/01463373.2014.911764 · Cited by 21
Children forgotten in hot cars: a mental models approach for improving public health messaging
Williams, C. A., & Grundstein, A. (2017) · Injury Prevention · doi:10.1136/injuryprev-2016-042261 · Cited by 20
Exploration of Parent–Provider Communication During Clinic Visits for Children With Chronic Conditions
Giambra, B. K., Haas, S. M., Britto, M. T., & Lipstein, E. A. (2017) · Journal of Pediatric Health Care · doi:10.1016/j.pedhc.2017.06.005 · Cited by 20
The Power of Interactive Whiteboards for Secondary Mathematics Teaching: Two Case Studies
Vita, M. D., Verschaffel, L., & Elen, J. (2018) · Journal of Educational Technology Systems · doi:10.1177/0047239518767112 · Cited by 20
Conflict and responsibility: Content analysis of American news media organizations’ framing of North Korea
Curran, N. M., & Gibson, J. (2019) · Media War & Conflict · doi:10.1177/1750635219839203 · Cited by 20
The impact of professional development training on teachers’ performance in Abu Dhabi Cycle Two and Three schools
Afi, A. D. E. (2019) · Teacher Development · doi:10.1080/13664530.2019.1589562 · Cited by 20
Redesigning a Sentinel Surveillance System for Collecting and Disseminating Near Real-Time Agricultural Injury Reports: System Usability Study
Weichelt, B. P., Heimonen, T., Görücü, S., Redmond, E., Vechinski, J., Pflughoeft, K. A., Bendixsen, C. G., Salzwedel, M. A., Scott, E., Namkoong, K., et al. (2019) · JMIR Formative Research · doi:10.2196/13621 · Cited by 20
Use of Social Media by Hospitals and Clinics in Japan: Descriptive Study
Sugawara, Y., Murakami, M., & Narimatsu, H. (2020) · JMIR Medical Informatics · doi:10.2196/18666 · Cited by 22
Who are the “Real” Experts? The Debate Surrounding COVID-19 Health Risk Management: An Israeli Case Study
Gesser‐Edelsburg, A., Zemach, M., & Hijazi, R. (2021) · Risk Management and Healthcare Policy · doi:10.2147/rmhp.s311334 · Cited by 21
HIV/AIDS stigma in Chinese Internet forums: a content analysis approach
Zhuang, J., & Bresnahan, M. (2012) · Chinese Journal of Communication · doi:10.1080/17544750.2012.664443 · Cited by 20
The content of attenuated psychotic symptoms in those at clinical high risk for psychosis
Marshall, C., Denny, E., Cadenhead, K. S., Cannon, T. D., Cornblatt, B. A., McGlashan, T. H., Perkins, D. O., Seidman, L. J., Tsuang, M. T., Woods, S. W., et al. (2014) · Psychiatry Research · doi:10.1016/j.psychres.2014.06.023 · Cited by 20
Inclusion and Transparency in Planning Decision-Making: Planning Officer Reports to the Planning Committee
Weston, J., & Weston, M. (2012) · Planning Practice and Research · doi:10.1080/02697459.2012.704736 · Cited by 20
Why Is It (Un-)ethical? Comparing Potential European Partners: A Western Christian and An Eastern Islamic Country – On Arguments Used in Explaining Ethical Judgments
Srnka, K. J., Gegez, A. E., & Arzova, S. B. (2007) · Journal of Business Ethics · doi:10.1007/s10551-006-9223-1 · Cited by 20
The Interplay of Communication and Decisions in Electronic Negotiations: Communicative Decisions or Decisive Communication?
Schoop, M., van Amelsvoort, M., Gettinger, J., Körner, M., Koeszegi, S. T., & van der Wijst, P. (2013) · Group Decision and Negotiation · doi:10.1007/s10726-013-9357-3 · Cited by 20
Challenges in the industrial implementation of generative design systems: An exploratory study
Nordin, A. (2017) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060416000536 · Cited by 21
Probing behaviour in open interviews : A field experiment on the effects of Probing Tactics on Quality and Content of the Received Information
Moerman, G. (2010) · Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) · Cited by 20
Correspondence Analysis: A New Method for Analyzing Qualitative Data in Architecture
Habib, F., Etesam, I., Ghoddusifar, S. H., & Mohajeri, N. (2012) · Springer eBooks · doi:10.1007/s00004-012-0129-1 · Cited by 24
Correction
Lombard, M., Snyder‐Duch, J., & Bracken, C. C. (2003) · Human Communication Research · doi:10.1111/j.1468-2958.2003.tb00850.x · Cited by 20
A softer kind of hard news? Data journalism and the digital renewal of public service news in Sweden
Widholm, A., & Appelgren, E. (2022) · New Media & Society · doi:10.1177/1461444820975411 · Cited by 26

Authors: Lombard, M., Snyder-Duch, J., & Bracken, C. C.
Affiliations: Temple University (US)
Cleveland State University (US)
Venue: Human Communication Research
Publisher: Oxford University Press (OUP)
Published: 2002-10
Volume: 28
Issue: 4
Pages: 587-604
ISSN: 0360-3989 (ISSN-L)
1468-2958
DOI: 10.1111/j.1468-2958.2002.tb00826.x
OpenAlex: W2160375265
Cited by: 3,068
References: 42
Citations by year: 2026: 234 · 2025: 173 · 2024: 136 · 2023: 143 · 2022: 212 · 2021: 238 · 2020: 206 · 2019: 206 · 2018: 174 · 2017: 168 · 2016: 174 · 2015: 153 · 2014: 168 · 2013: 158 · 2012: 117
FWCI: 19.75
Type: journal article
Language: en
Open access: closed
Licence: doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 4718 d)
Locations: Human Communication Research (publishedVersion)
EngagedScholarship @ Cleveland State University (Cleveland State University) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Social Sciences › Communication › News Media Framing and Political Communication
Social Sciences › General Social Sciences › Computational and Text Analysis Methods
Keywords: intercoder reliability, inter-coder agreement, content analysis, mass communication research, reporting practices, percent agreement, reliability index, coding procedures, research guidelines

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks