Cited by 3,068Reliability and Agreement in MeasurementNews Media Framing and Political CommunicationComputational and Text Analysis Methods

The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.

Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability

Lombard, Matthew, Snyder-Duch, Jennifer, Bracken, Cheryl Campanella·2002·Human Communication Research

DOI 10.1111/j.1468-2958.2002.tb00826.x

Open this paper in CoChat — free account

Abstract

As a method specifically intended for the study of messages, content analysis is fundamental to mass communication research. Intercoder reliability, more specifically termed intercoder agreement, is a measure of the extent to which independent judges make the same coding decisions in evaluating the characteristics of messages, and is at the heart of this method. Yet there are few standard and accessible guidelines available regarding the appropriate procedures to use to assess and report intercoder reliability, or software tools to calculate it. As a result, it seems likely that there is little consistency in how this critical element of content analysis is assessed and reported in published mass communication studies. Following a review of relevant concepts, indices, and tools, a content analysis of 200 studies utilizing content analysis published in the communication literature between 1994 and 1998 is used to characterize practices in the field. The results demonstrate that mass communication researchers often fail to assess (or at least report) intercoder reliability and often rely on percent agreement, an overly liberal index. Based on the review and these results, concrete guidelines are offered regarding procedures for assessment and reporting of this important aspect of content analysis.

Integrity signals

Registry

Crossref · 10.1111/j.1468-2958.2002.tb00826.x

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,351
The Content Analysis Guidebook
Neuendorf, K. A. (2017) · doi:10.4135/9781071802878 · Cited by 9,286 · cited 10×
“), but this technique has also been questioned (Neuendorf, 2002). With the coding data in hand, the researcher calculates and reports one or more indices of reliability. Popping (1988) identified 39 different “agreement indices” for coding nominal categories, which excludes several techniques for ratio and interval le…”
BackgroundMethodInfluential
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Content Analysis for the Social Sciences and Humanities.
Parker, E. B., & Holsti, O. R. (1970) · American Sociological Review · doi:10.2307/2093233 · Cited by 4,553
Content Analysis in Communication Research.
Pool, I. D. S., & Berelson, B. (1952) · American Sociological Review · doi:10.2307/2088029 · Cited by 3,106
Content Analysis for the Social Sciences and Humanities
Parker, S. R. (1970) · Sociology · doi:10.1177/003803857000400231 · Cited by 2,178
Handbook of Research Methods in Social and Personality Psychology
West, T., Reis, H. T., Judd, C. M., Banaji, M. R., Crandall, C., Giner-Sorolla, R., Biernat, M., Fiedler, K., Ermark, F., Tepper, S. J., et al. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009170123 · Cited by 2,134

Show all 42 references

Research works printed but not linked: 2

Lacy S., 1996, Journalism & Mass Communication Quarterly, 73, 969
Perreault W. D., 1989, Journal of Marketing Research, 26, 135, 10.1177/002224378902600201 · DOI · Paper page

Sorted by citations

Items 501–600 of 1,005

Approaches to Language Variation: Goals and Objectives of the Spanish Heritage Language Syllabus
Beaudrie, S. M. (2015) · Heritage Language Journal · doi:10.46538/hlj.12.1.1 · Cited by 48
Analyzing Dataset Annotation Quality Management in the Wild
Klie, J.-C., de Castilho, R. E., & Gurevych, I. (2024) · Computational Linguistics · doi:10.1162/coli_a_00516 · Cited by 66
Patterns and trends in event tourism study topics over 30 years
Kim, J., Boo, S., & Kim, Y. (2013) · International Journal of Event and Festival Management · doi:10.1108/17582951311307520 · Cited by 48
Bringing it all back home? Social media practices by Swedish municipalities
Larsson, A. O. (2013) · European Journal of Communication · doi:10.1177/0267323113502277 · Cited by 48
Quantitative content analysis procedures to analyse students’ reflective essays: A methodological review of psychometric and edumetric aspects
Poldner, E., Simons, P. R. J., Wijngaards, G., & van der Schaaf, M. F. (2011) · Educational Research Review · doi:10.1016/j.edurev.2011.11.002 · Cited by 53
Reputation Repair at the Expense of Providing Instructing and Adjusting Information Following Crises
Kim, S., Avery, E. J., & Lariscy, R. W. (2011) · International Journal of Strategic Communication · doi:10.1080/1553118x.2011.566903 · Cited by 50
Measuring Consumer Perceptions of Business Ethical Behavior in Two Muslim Countries
Tsalikis, J., & Lassar, W. M. (2009) · Journal of Business Ethics · doi:10.1007/s10551-008-9986-7 · Cited by 48
Triangulation and the importance of establishing valid methods for food safety culture evaluation
Jespersen, L., & Wallace, C. A. (2017) · Food Research International · doi:10.1016/j.foodres.2017.07.009 · Cited by 48
A systems approach to extraordinarily major coal mine accidents in China from 1997 to 2011: an application of the HFACS approach
Zhang, Y., Jing, L., Bai, Q., Liu, T., & Feng, Y. (2017) · International Journal of Occupational Safety and Ergonomics · doi:10.1080/10803548.2017.1415404 · Cited by 48
Business and Human Rights in South Africa: An Analysis of Antecedents of Human Rights Due Diligence
Hamann, R., Sinha, P. N., Kapfudzaruwa, F., & Schild, C. (2009) · Journal of Business Ethics · doi:10.1007/s10551-009-0293-8 · Cited by 48
Developing Tourism Education Through Social Media
Hajli, N., & Lin, X. (2014) · Tourism Planning & Development · doi:10.1080/21568316.2014.883426 · Cited by 48
Transnational Representation in EU National Parliaments: Concept, Case Study, Research Agenda
Kinski, L., & Crum, B. (2019) · Political Studies · doi:10.1177/0032321719848565 · Cited by 55
Another Perspective on MBA Program Alignment: An Investigation of Learning Goals
Costigan, R. D., & Brink, K. E. (2014) · Academy of Management Learning and Education · doi:10.5465/amle.2013.0315 · Cited by 47
Integrating reproductive planning with primary health care: An exploration among low-income, minority women and men
Dunlop, A. L., Logue, K. M., Miranda, M. C., & Narayan, D. A. (2010) · Sexual & Reproductive Healthcare · doi:10.1016/j.srhc.2010.01.001 · Cited by 47
How Collaborative Approaches to Environmental Problem Solving View Indigenous Peoples: A Systematic Review
von der Porten, S., & de Loë, R. C. (2014) · Society & Natural Resources · doi:10.1080/08941920.2014.918232 · Cited by 52
Health care development: integrating transaction cost theory with social support theory
Hajli, N., Shanmugam, M., Hajli, A., Khani, A. H. A., & Wang, Y. (2014) · Informatics for Health and Social Care · doi:10.3109/17538157.2014.924950 · Cited by 50
Social media research: The application of supervised machine learning in organizational communication research.
van Zoonen, W., & van der Meer, T. G. L. A. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.05.028 · Cited by 46
Stakeholder Communication in 140 Characters or Less: A Study of Community Sport Foundations
Anagnostopoulos, C., Gillooly, L., Cook, D., Parganas, P., & Chadwick, S. (2016) · VOLUNTAS International Journal of Voluntary and Nonprofit Organizations · doi:10.1007/s11266-016-9802-4 · Cited by 47
The Cognitive Therapy Scale and Cognitive Therapy Scale-Revised as Measures of Therapist Competence in Cognitive Behavior Therapy for Depression: Relations with Short and Long Term Outcome
Kazantzis, N., Clayton, X., Cronin, T. J., Farchione, D., Limburg, K., & Dobson, K. S. (2018) · Cognitive Therapy and Research · doi:10.1007/s10608-018-9919-4 · Cited by 48
11. Content Analysis
Macnamara, J. (2018) · De Gruyter eBooks · doi:10.1515/9783110481129-012 · Cited by 47
Employee Experience: Construct Clarification, Conceptualization and Validation of a New Scale
Yadav, M., & Vihari, N. S. (2021) · FIIB Business Review · doi:10.1177/23197145211012501 · Cited by 46
Media coverage on electromagnetic fields and health: Content analysis of Dutch newspaper articles and websites
Claassen, L., Smid, T., Woudenberg, F., & Timmermans, D. R. M. (2012) · Health Risk & Society · doi:10.1080/13698575.2012.716820 · Cited by 49
Examining the meso-level domains of the interrogation taxonomy.
Kelly, C. E., Redlich, A. D., & Miller, J. C. (2014) · Psychology Public Policy and Law · doi:10.1037/law0000034 · Cited by 46
Signaling Service Quality via Website e-CRM Features
Tian, J., & Wang, S. (2014) · Journal of Hospitality & Tourism Research · doi:10.1177/1096348014525634 · Cited by 49
The Indonesia Public Information Disclosure Act (UU-KIP): Its Challenges and Responses
Lubis, M., Kusumasari, T. F., & Hakim, L. (2018) · International Journal of Electrical and Computer Engineering (IJECE) · doi:10.11591/ijece.v8i1.pp94-103 · Cited by 46
The impact of maturing food safety culture and a pathway to economic gain
Jespersen, L., Butts, J. N., Holler, G., Taylor, J., Harlan, D., Griffiths, M. W., & Wallace, C. A. (2018) · Food Control · doi:10.1016/j.foodcont.2018.11.041 · Cited by 46
The West Wingand Depictions of the American Presidency: Expanding the Domains of Framing in Political Communication
Holbert, R. L., Tschida, D. A., Dixon, M. A., Cherry, K. L., Steuber, K. R., & Airne, D. (2005) · Communication Quarterly · doi:10.1080/01463370500102228 · Cited by 46
Content Analysis in Political Communication
Benoit, W. L., & Ohio University (2010) · Routledge eBooks · doi:10.4324/9780203938669-24 · Cited by 46
Knowledge-Based Innovation: Emergence and Embedding of New Practice Areas in Management Consulting FirmsPreprint
Gardner, H. K., Anand, N., & Morris, T. (2007) · SSRN Electronic Journal · Cited by 46
Does Corporate Social Responsibility Hit the Mark? A Stakeholder Oriented Methodology for CSR Assessment
Calabrese, A., Costa, R. M. D. S., Menichini, T., & Rosati, F. (2013) · Knowledge and Process Management · doi:10.1002/kpm.1406 · Cited by 45
“Dude I’ve Never Felt This Way Towards a Celebrity Death”: Parasocial Grieving and the Collective Mourning of Kobe Bryant on Reddit
Bingaman, J. (2020) · OMEGA - Journal of Death and Dying · doi:10.1177/0030222820971531 · Cited by 45
The process of processing: exploring the validity of Neisser's perceptual cycle model with accounts from critical decision-making in the cockpit
Plant, K. L., & Stanton, N. A. (2014) · Ergonomics · doi:10.1080/00140139.2014.991765 · Cited by 45
Emotional and Informational Support Messages in an Online Hospice Support Community
Buis, L. R. (2008) · CIN Computers Informatics Nursing · doi:10.1097/01.ncn.0000336461.94939.97 · Cited by 45
A one year follow-up of illness management and recovery: Participants' accounts of its impact and uniqueness.
Roe, D., Hasson‐Ohayon, I., Salyers, M. P., & Kravetz, S. (2009) · Psychiatric Rehabilitation Journal · doi:10.2975/32.4.2009.285.291 · Cited by 45
A Qualitative Evaluation of Engagement and Attrition in a Nurse Home Visiting Program: From the Participant and Provider Perspective
Beasley, L. O., Ridings, L. E., Smith, T. J., Shields, J. D., Silovsky, J. F., Beasley, W. H., & Bard, D. (2017) · Prevention Science · doi:10.1007/s11121-017-0846-5 · Cited by 50
Multimodal strategies of emotional governance: a critical analysis of ‘nudge’ tactics in health policy
Mulderrig, J. (2017) · Critical Discourse Studies · doi:10.1080/17405904.2017.1382381 · Cited by 45
Simulation-Based Research in Information Systems
Beese, J., Haki, K., Aier, S., & Winter, R. (2018) · Business & Information Systems Engineering · doi:10.1007/s12599-018-0529-1 · Cited by 48
Risk management committee and risk management disclosure: evidence from Australia
Jia, J., Li, Z., & Munro, L. A. (2019) · Pacific Accounting Review · doi:10.1108/par-11-2018-0097 · Cited by 45
Autoencoder Neural Networks versus External Auditors: Detecting Unusual Journal Entries in Financial Statement Audits
Schultz, M., & Tropmann-Frick, M. (2020) · Hawaii International Conference on System Sciences (HICSS) · doi:10.24251/hicss.2020.666 · Cited by 45
Identification of key cyberbullies: A text mining and social network analysis approach
Choi, Y., Jeon, B.-J., & Kim, H. (2020) · Telematics and Informatics · doi:10.1016/j.tele.2020.101504 · Cited by 45
Differentiation of Social Marketing and Cause-Related Marketing in US Professional Sport
Pharr, J. R., & Lough, N. (2012) · Sport Marketing Quarterly · doi:10.1177/106169341202100205 · Cited by 45
From Victim to Perpetrator: Evolution of Risk Frames Related to Human–Cormorant Conflict in the Great Lakes
Muter, B. A., Gore, M. L., & Riley, S. J. (2009) · Human Dimensions of Wildlife · doi:10.1080/10871200903045210 · Cited by 44
Measuring What is Top of MindPreprint
Haaland, I., Roth, C., Stantcheva, S., & Wohlfart, J. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4827419 · Cited by 47
“I see your garbage”: Participatory practices and literacy privilege on “Grammar Nazi” Facebook pages in different sociolinguistic contexts
Švelch, J., & Sherman, T. (2017) · New Media & Society · doi:10.1177/1461444817719087 · Cited by 44
Embracing socioscientific issues-based teaching and decision-making in teacher professional development
Cebesoy, Ü. B., & Rundgren, S.-N. C. (2021) · Educational Review · doi:10.1080/00131911.2021.1931037 · Cited by 44
Web content analysis of e‐grocery retailers: a longitudinal study
Lim, H., Widdows, R., & Hooker, N. H. (2009) · International Journal of Retail & Distribution Management · doi:10.1108/09590550910988020 · Cited by 44
The use of sports references in marketing of food and beverage products in supermarkets
Bragg, M. A., Liu, P. J., Roberto, C. A., Sarda, V., Harris, J. L., & Brownell, K. D. (2012) · Public Health Nutrition · doi:10.1017/s1368980012003163 · Cited by 43
Managing by E-Mail: What E-mail Can Do for Engineering Project Management
Wasiak, J., Hicks, B. J., Newnes, L., Loftus, C., Dong, A., & Burrow, L. (2011) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2010.2090160 · Cited by 44
Application of two under-researched typologies in crisis communication: Ethics of justice vs. care and public relations vs. legal strategies
Tao, W., & Kim, S. (2017) · Public Relations Review · doi:10.1016/j.pubrev.2017.06.003 · Cited by 44
Investigating written procedures in process safety: Qualitative data analysis of interviews from high risk facilities
Sasangohar, F., Peres, S. C., Williams, J. P., Smith, A., & Mannan, M. S. (2017) · Process Safety and Environmental Protection · doi:10.1016/j.psep.2017.09.010 · Cited by 44
Cameras for conservation: wildlife photography and emotional engagement with biodiversity and nature
Hanisch, E., Johnston, R., & Longnecker, N. E. (2019) · Human Dimensions of Wildlife · doi:10.1080/10871209.2019.1600206 · Cited by 51
Transforming manufacturing to be ‘good for planet and people’, through enabling lean and green thinking in small and medium-sized enterprises
Caldera, S., Desha, C., & Dawes, L. A. (2019) · Sustainable Earth Reviews · doi:10.1186/s42055-019-0011-z · Cited by 52
A voice for the voiceless?
Figenschou, T. U. (2010) · Global Media and Communication · doi:10.1177/1742766510362023 · Cited by 44
Press media coverage effects on destinations – A Monetary Public Value (MPV) analysis
Castelltort, M., & Mäder, G. (2009) · Tourism Management · doi:10.1016/j.tourman.2009.06.007 · Cited by 49
Agency policy preferences, congressional letter-marking and the allocation of distributive policy benefits
Mills, R. W., Kalaf‐Hughes, N., & MacDonald, J. A. (2015) · Journal of Public Policy · doi:10.1017/s0143814x15000252 · Cited by 43
Temporal and Location Variations, and Link Categories for the Dissemination of COVID-19–Related Information on Twitter During the SARS-CoV-2 Outbreak in Europe: Infoveillance Study
Pobiruchin, M., Zowalla, R., & Wiesner, M. (2020) · Journal of Medical Internet Research · doi:10.2196/19629 · Cited by 43
Systematic map of conservation psychology
Wallen, K., & Landon, A. C. (2020) · Conservation Biology · doi:10.1111/cobi.13623 · Cited by 52
Gambling, cryptocurrency, and financial trading app marketing in English Premier League football: A frequency analysis of in-game logos
Torrance, J., Heath, C., Andrade, M., & Newall, P. W. S. (2023) · Journal of Behavioral Addictions · doi:10.1556/2006.2023.00066 · Cited by 43
His ideas are in my head: peer-to-peer teacher observations as professional development
Hamilton, E. R. (2012) · Professional Development in Education · doi:10.1080/19415257.2012.726202 · Cited by 56
Comparing the quality of pro- and anti-vaccination online information: a content analysis of vaccination-related webpages
Sak, G., Diviani, N., Allam, A., & Schulz, P. J. (2015) · BMC Public Health · doi:10.1186/s12889-016-2722-9 · Cited by 43
Preparing the next generation of sustainability scientists
Killion, A. K., Sterle, K., Bondank, E. N., Drabik, J. R., Bera, A., Alian, S., Goodrich, K. A., Hale, M. R., Myer, R. A., Phung, Q., et al. (2018) · Ecology and Society · doi:10.5751/es-10395-230439 · Cited by 46
The content analysis methodology. Uses and applications in communication research on Spanish-speaking countries
Piñeiro-Naval, V. (2020) · Communication & Society · doi:10.15581/003.33.3.1-15 · Cited by 51
Key performance indicators disclosure in the context of the EU directive: when does stakeholder pressure matter?
Krasodomska, J., & Zarzycka, E. (2020) · Meditari Accountancy Research · doi:10.1108/medar-05-2020-0876 · Cited by 43
“Trans Enough”: Examining the Boundaries of Transgender-Identity Membership
Sutherland, D. K. (2021) · Social Problems · doi:10.1093/socpro/spab031 · Cited by 43
Online Reactions to the Muhammad Cartoons: YouTube and the Virtual Ummah
al-Rawi, A. (2015) · Journal for the Scientific Study of Religion · doi:10.1111/jssr.12191 · Cited by 24
Utilizing artificial intelligence to support analyzing self-regulated learning: A preliminary mixed-methods evaluation from a human-centered perspective
Wang, C.-Y., & Lin, J. J. H. (2023) · Computers in Human Behavior · doi:10.1016/j.chb.2023.107721 · Cited by 64
Application of additive manufacturing for a sustainable healthcare sector: Mapping current research and establishing future research agenda
Priyadarshini, J., Singh, R. K., Mishra, R., & Dora, M. K. (2023) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.122686 · Cited by 43
The Effective Research-Based Characteristics of Professional Development of the National Science Foundation’s GK-12 Program
Cormas, P. C., & Barufaldi, J. P. (2011) · Journal of Science Teacher Education · doi:10.1007/s10972-011-9228-1 · Cited by 42
‘Excuse me, sir. Please don’t smoke here’. A qualitative study of social enforcement of smoke-free policies in Indonesia
Kaufman, M. R., Merritt, A. P., Rimbatmaja, R., & Cohen, J. E. (2014) · Health Policy and Planning · doi:10.1093/heapol/czu103 · Cited by 42
Reconceptualizing foregrounding
Bálint, K., Hakemulder, F., Kuijpers, M. M., Doicaru, M. M., & Tan, E. S. (2016) · Scientific Study of Literature · doi:10.1075/ssol.6.2.02bal · Cited by 41
Comparison of online marketing techniques on food and beverage companies’ websites in six countries
Bragg, M. A., Eby, M. R., Arshonsky, J., Bragg, A., & Ogedegbe, G. G. (2017) · Globalization and Health · doi:10.1186/s12992-017-0303-z · Cited by 43
A Robot that Encourages Self-disclosure by Hug
Shiomi, M., Nakata, A., Kanbara, M., & Hagita, N. (2017) · Lecture notes in computer science · doi:10.1007/978-3-319-70022-9_32 · Cited by 40
Institutional Analysis in Climate Change Adaptation Research: A Systematic Literature Review
Bisaro, A., Roggero, M., & Villamayor‐Tomás, S. (2018) · Ecological Economics · doi:10.1016/j.ecolecon.2018.04.016 · Cited by 47
Social Media, Opinion Polls, and the Use of Persuasive Messages During the 2016 US Election Primaries
Rossini, P., Hemsley, J., Tanupabrungsun, S., Zhang, F., & Stromer‐Galley, J. (2018) · Social Media + Society · doi:10.1177/2056305118784774 · Cited by 42
Content analysis in library and information research: An analysis of trends
Armann-Keown, V., & Patterson, L. (2020) · Library & Information Science Research · doi:10.1016/j.lisr.2020.101048 · Cited by 42
The effect of app store strategy on app rating: The moderating role of hedonic and utilitarian mobile apps
Tafesse, W. (2021) · International Journal of Information Management · doi:10.1016/j.ijinfomgt.2020.102299 · Cited by 42
Moving Beyond Business as Usual Toward Regenerative Business Practice in Small and Medium-Sized Enterprises
Caldera, S., Hayes, S., Dawes, L. A., & Desha, C. (2022) · Frontiers in Sustainability · doi:10.3389/frsus.2022.799359 · Cited by 50
Can LLMs Replace Manual Annotation of Software Engineering Artifacts?
Ahmed, T., Dévanbu, P., Treude, C., & Pradel, M. (2025) · International Conference on Mining Software Repositories (MSR) · doi:10.1109/msr66628.2025.00086 · Cited by 105
Net Inclusion: New Media’s Impact on Deliberative Politics in China
Lewis, O. A. (2013) · Journal of Contemporary Asia · doi:10.1080/00472336.2013.769387 · Cited by 41
Road Safety Differences between Priority-Controlled Intersections and Right-Hand Priority Intersections
Ceunynck, T. D., Polders, E., Daniëls, S., Hermans, E., Brijs, T., & Wets, G. (2013) · Transportation Research Record Journal of the Transportation Research Board · doi:10.3141/2365-06 · Cited by 40
Interactive learning in an urban environmental education online course
Li, Y., Krasny, M. E., & Russ, A. (2014) · Environmental Education Research · doi:10.1080/13504622.2014.989961 · Cited by 48
Adolescent Perceptions of Dating Violence: A Qualitative Study
Taylor, S., Calkins, C. A., Xia, Y. R., & Dalla, R. L. (2017) · Journal of Interpersonal Violence · doi:10.1177/0886260517726969 · Cited by 44
Changes in Pre-service Science Teachers’ Understandings After Being Involved in Explicit Nature of Science and Socioscientific Argumentation Processes
Kutluca, A. Y., & Aydın, A. (2017) · Science & Education · doi:10.1007/s11191-017-9919-x · Cited by 44
"Should I Worry?" A Cross-Cultural Examination of Account Security Incident Response
Redmiles, E. M. (2019) · IEEE Symposium on Security and Privacy (S&P) · doi:10.1109/sp.2019.00059 · Cited by 41
Facebook Groups on Chronic Obstructive Pulmonary Disease: Social Media Content Analysis
Apperson, A., Stellefson, M., Paige, S. R., Chaney, B. H., Chaney, J., Wang, M., & Mohan, A. (2019) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph16203789 · Cited by 43
Perspectives of Former Students with ASD from Australia and New Zealand on Their University Experience
Anderson, A. H., Stephenson, J., & Carter, M. (2020) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-020-04386-7 · Cited by 27
The Robustness of Corporate Social Responsibility and Brand Loyalty Relation: A Meta-Analytic Examination
Aljarah, A., & Ibrahim, B. (2020) · Journal of Promotion Management · doi:10.1080/10496491.2020.1746464 · Cited by 49
Using Virtual Reality to Stimulate Healthy and Environmentally Friendly Food Consumption among Children: An Interview Study
Smit, E. S., Meijers, M. H. C., & van der Laan, L. N. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18031088 · Cited by 41
Using an Immersive Virtual Reality Design Tool to Support Cognitive Action and Creativity: Educational Insights from Fashion Designers
Lee, J. H., Yang, E. K., & Sun, Z. Y. (2021) · The Design Journal · doi:10.1080/14606925.2021.1912902 · Cited by 48
A Minimal Design of a Human Infant Presence: A Case Study Toward Interactive Doll Therapy for Older Adults With Dementia
Sumioka, H., Yamato, N., Shiomi, M., & Ishiguro, H. (2021) · Frontiers in Robotics and AI · doi:10.3389/frobt.2021.633378 · Cited by 41
A Sequential Analysis of Externalizing in Narrative Therapy with Children
Ramey, H. L., Tarulli, D., Frijters, J. C., & Fisher, L. (2009) · Contemporary Family Therapy · doi:10.1007/s10591-009-9095-5 · Cited by 41
The making of four ideologies of globalization
de Wilde, P. (2018) · European Political Science Review · doi:10.1017/s1755773918000164 · Cited by 42
Towards an ecological understanding of Chinese international students’ intercultural interactions in multicultural contexts: Friendships, inhibiting factors and effects on global competence
Meng, Q., Jing-fu, L., & Zhu, C. (2019) · Current Psychology · doi:10.1007/s12144-019-00280-3 · Cited by 46
Why Are Elites More Cosmopolitan than Masses?
Strijbis, O., Teney, C., & Helbling, M. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108652698.002 · Cited by 42
A Systematic and Comparative Review of Behavior Change Strategies in Stress Management Apps: Opportunities for Improvement
Alhasani, M., Mulchandani, D., Oyebode, O., Baghaei, N., & Orji, R. (2022) · Frontiers in Public Health · doi:10.3389/fpubh.2022.777567 · Cited by 43
An empirical, accessible definition of “ghosting” as a relationship dissolution method
Kay, C., & Courtice, E. L. (2022) · Personal Relationships · doi:10.1111/pere.12423 · Cited by 43
Sustainability disclosure and reporting by municipally owned water utilities
Ligorio, L., Caputo, F., & Venturelli, A. (2022) · Utilities Policy · doi:10.1016/j.jup.2022.101382 · Cited by 40
Media coverage of digitalization in agriculture - an analysis of media content
Mohr, S., & Höhler, J. (2022) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2022.122238 · Cited by 44
Voices of Homeless Alcoholics Who Frequent Bellevue Hospital: A Qualitative Study
McCormack, R. P., Hoffman, L. F., Norman, M., Goldfrank, L. R., & Norman, E. M. (2014) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2014.05.025 · Cited by 40
A Comparative Analysis of European Press Coverage of Children and the Internet
Haddon, L., & Stald, G. (2009) · Journal of Children and Media · doi:10.1080/17482790903233432 · Cited by 40

Authors: Lombard, M., Snyder-Duch, J., & Bracken, C. C.
Affiliations: Temple University (US)
Cleveland State University (US)
Venue: Human Communication Research
Publisher: Oxford University Press (OUP)
Published: 2002-10
Volume: 28
Issue: 4
Pages: 587-604
ISSN: 0360-3989 (ISSN-L)
1468-2958
DOI: 10.1111/j.1468-2958.2002.tb00826.x
OpenAlex: W2160375265
Cited by: 3,068
References: 42
Citations by year: 2026: 234 · 2025: 173 · 2024: 136 · 2023: 143 · 2022: 212 · 2021: 238 · 2020: 206 · 2019: 206 · 2018: 174 · 2017: 168 · 2016: 174 · 2015: 153 · 2014: 168 · 2013: 158 · 2012: 117
FWCI: 19.75
Type: journal article
Language: en
Open access: closed
Licence: doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 4718 d)
Locations: Human Communication Research (publishedVersion)
EngagedScholarship @ Cleveland State University (Cleveland State University) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Social Sciences › Communication › News Media Framing and Political Communication
Social Sciences › General Social Sciences › Computational and Text Analysis Methods
Keywords: intercoder reliability, inter-coder agreement, content analysis, mass communication research, reporting practices, percent agreement, reliability index, coding procedures, research guidelines

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks