Cited by 3,068Reliability and Agreement in MeasurementNews Media Framing and Political CommunicationComputational and Text Analysis Methods

The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.

Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability

Lombard, Matthew, Snyder-Duch, Jennifer, Bracken, Cheryl Campanella·2002·Human Communication Research

DOI 10.1111/j.1468-2958.2002.tb00826.x

Open this paper in CoChat — free account

Abstract

As a method specifically intended for the study of messages, content analysis is fundamental to mass communication research. Intercoder reliability, more specifically termed intercoder agreement, is a measure of the extent to which independent judges make the same coding decisions in evaluating the characteristics of messages, and is at the heart of this method. Yet there are few standard and accessible guidelines available regarding the appropriate procedures to use to assess and report intercoder reliability, or software tools to calculate it. As a result, it seems likely that there is little consistency in how this critical element of content analysis is assessed and reported in published mass communication studies. Following a review of relevant concepts, indices, and tools, a content analysis of 200 studies utilizing content analysis published in the communication literature between 1994 and 1998 is used to characterize practices in the field. The results demonstrate that mass communication researchers often fail to assess (or at least report) intercoder reliability and often rely on percent agreement, an overly liberal index. Based on the review and these results, concrete guidelines are offered regarding procedures for assessment and reporting of this important aspect of content analysis.

Integrity signals

Registry

Crossref · 10.1111/j.1468-2958.2002.tb00826.x

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,351
The Content Analysis Guidebook
Neuendorf, K. A. (2017) · doi:10.4135/9781071802878 · Cited by 9,286 · cited 10×
“), but this technique has also been questioned (Neuendorf, 2002). With the coding data in hand, the researcher calculates and reports one or more indices of reliability. Popping (1988) identified 39 different “agreement indices” for coding nominal categories, which excludes several techniques for ratio and interval le…”
BackgroundMethodInfluential
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Content Analysis for the Social Sciences and Humanities.
Parker, E. B., & Holsti, O. R. (1970) · American Sociological Review · doi:10.2307/2093233 · Cited by 4,553
Content Analysis in Communication Research.
Pool, I. D. S., & Berelson, B. (1952) · American Sociological Review · doi:10.2307/2088029 · Cited by 3,106
Content Analysis for the Social Sciences and Humanities
Parker, S. R. (1970) · Sociology · doi:10.1177/003803857000400231 · Cited by 2,178
Handbook of Research Methods in Social and Personality Psychology
West, T., Reis, H. T., Judd, C. M., Banaji, M. R., Crandall, C., Giner-Sorolla, R., Biernat, M., Fiedler, K., Ermark, F., Tepper, S. J., et al. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009170123 · Cited by 2,134

Show all 42 references

Research works printed but not linked: 2

Lacy S., 1996, Journalism & Mass Communication Quarterly, 73, 969
Perreault W. D., 1989, Journal of Marketing Research, 26, 135, 10.1177/002224378902600201 · DOI · Paper page

Sorted by citations

Items 701–800 of 1,005

Intercultural communicative competence in higher education through telecollaboration: typology and development
Gutiérrez‐Santiuste, E., & Real, M. R. (2023) · Education and Information Technologies · doi:10.1007/s10639-023-11751-3 · Cited by 33
The advantages of an ADHD classification from the perspective of teachers
Wienen, A. W., Sluiter, M. N., Thoutenhoofd, E. D., de Jonge, P., & Batstra, L. (2019) · European Journal of Special Needs Education · doi:10.1080/08856257.2019.1580838 · Cited by 33
Entrepreneurship in the Policy Process: Linking Behavior and Context through a Systematic Review of the Policy Entrepreneurship Literature
Aviram, N. F., Beeri, I., & Cohen, N. (2019) · Public Administration Review · doi:10.1111/puar.13089 · Cited by 32
Seeking a deeper level of responsibility for inclusive (eco)tourism duty and the pinnacle of practice
Fennell, D. A., & Garrod, B. (2021) · Journal of Sustainable Tourism · doi:10.1080/09669582.2021.1951278 · Cited by 33
Acquired Codes of Meaning in Data Visualization and Infographics: Beyond Perceptual Primitives
Byrne, L., Angus, D. J., & Wiles, J. (2015) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2015.2467321 · Cited by 34
Comparing nursing handover and documentation: forming one set of patient information
Johnson, M., Sanchez, P., Suominen, H., Basilakis, J., Dawson, L., Kelly, B., & Hanlen, L. (2013) · International Nursing Review · doi:10.1111/inr.12072 · Cited by 33
Emerging Port Authority communication strategies: Assessing the determinants of disclosure in the annual report
Parola, F., Satta, G., Penco, L., & Profumo, G. (2013) · Research in Transportation Business & Management · doi:10.1016/j.rtbm.2013.04.005 · Cited by 34
A qualitative study of the factors that influence mothers when choosing drinks for their young children
Hoare, A., Virgo‐Milton, M., Boak, R., Gold, L. H., Waters, E., Gussy, M. G., Calache, H., Smith, M. A., & de Silva, A. M. (2014) · BMC Research Notes · doi:10.1186/1756-0500-7-430 · Cited by 33
Differences in quality between Thai and international research articles in ELT
Jaroongkhongdach, W., Todd, R. W., Keyuravong, S., & Hall, D. (2012) · Journal of English for Academic Purposes · doi:10.1016/j.jeap.2012.04.006 · Cited by 35
Salt. UK consumers’ perceptions and consumption patterns
Kenten, C., Boulay, A., & Rowe, G. (2013) · Appetite · doi:10.1016/j.appet.2013.06.095 · Cited by 34
The Seven Deadly Sins of Communication Research
Neuman, W. R., Davidson, R., Joo, S.-H., Park, Y. J., & Williams, A. E. (2008) · Journal of Communication · doi:10.1111/j.1460-2466.2008.00382.x · Cited by 33
Uncovering the Nature of Information Processing of Men and Women Online: The Comparison of Two Models Using the Think-Aloud Method
Arcand, M., & Nantel, J. A. (2012) · Journal of theoretical and applied electronic commerce research · doi:10.4067/s0718-18762012000200010 · Cited by 33
“Drunk in Love”: The Portrayal of Risk Behavior in Music Lyrics
Holody, K. J., Anderson, C. N., Craig, C., & Flynn, M. A. (2016) · Journal of Health Communication · doi:10.1080/10810730.2016.1222032 · Cited by 33
The Development of a Systematic Coding System for Elementary Students’ Drawings of Engineers
Weber, N. L., Duncan, D., Dyehouse, M. A., Ströbel, J., & Diefes‐Dux, H. A. (2011) · Journal of Pre-College Engineering Education Research (J-PEER) · doi:10.7771/2157-9288.1030 · Cited by 32
External auditing and accountability in the Tanzanian local government authorities
Mzenzi, S. I., & Gaspar, A. F. (2015) · Managerial Auditing Journal · doi:10.1108/maj-04-2014-1028 · Cited by 32
Measuring Stakeholder Participation in Evaluation
Daigneault, P., Jacob, S., & Tremblay, J. (2012) · Evaluation Review · doi:10.1177/0193841x12458103 · Cited by 32
Narrative quality and disturbance pre‐ and post‐emotion‐focused therapy for child abuse trauma
Mundorf, E. S. H., & Paivio, S. C. (2011) · Journal of Traumatic Stress · doi:10.1002/jts.20707 · Cited by 35
Technological Implications of Supply Chain Practices in Agri-Food Sector: A Review
Mor, R. S., Singh, S., Bhardwaj, A., & Singh, L. P. (2015) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.22034/2015.2.03 · Cited by 32
Measuring clinical competencies in facilitating group-based rehabilitation interventions: development of a new competency checklist
Wong, D. K., Grace, N., Baker, K. S., & McMahon, G. (2019) · Clinical Rehabilitation · doi:10.1177/0269215519831048 · Cited by 33
Preservice Teachers' Community-Based Field Experiences
Hamilton, E. R., & Margot, K. C. (2019) · Frontiers in Education · doi:10.3389/feduc.2019.00115 · Cited by 43
The Characteristics, Activities and Goals of Environmental Organizations Engaged in Advocacy Within the Australian Environmental Movement
Gulliver, R., Fielding, K. S., & Louis, W. R. (2019) · Environmental Communication · doi:10.1080/17524032.2019.1697326 · Cited by 32
Toward Operationalizing Equity in Water Infrastructure Services: Developing a Definition of Water Equity
Osman, K., & Faust, K. M. (2021) · ACS ES&T Water · doi:10.1021/acsestwater.1c00125 · Cited by 35
The Mutual Influence of the World Health Organization (WHO) and Twitter Users During COVID-19: Network Agenda-Setting Analysis
Tahamtan, I., Potnis, D. D., Mohammadi, E., Singh, V., & Miller, L. E. (2022) · Journal of Medical Internet Research · doi:10.2196/34321 · Cited by 36
Women Scientists on TikTok: New Opportunities to Become Visible and Challenge Gender Stereotypes
Huber, B., & Baena, L. Q. (2023) · Media and Communication · doi:10.17645/mac.v11i1.6070 · Cited by 32
Conceptualizing Beauty: A Content Analysis of U.S. and French Women’s Fashion Magazine Advertisements
Morris, P. K., & Nichols, K. (2013) · Online Journal of Communication and Media Technologies · doi:10.29333/ojcmt/2410 · Cited by 32
Design and blueprinting for total quality management implementation in service organisations
Calabrese, A., & Corbò, M. (2014) · Total Quality Management & Business Excellence · doi:10.1080/14783363.2014.881970 · Cited by 32
Are pictures worth a thousand room nights? Success factors for hotel web site design
Stringam, B. B., & Gerdes, J. H. (2010) · Journal of Hospitality and Tourism Technology · doi:10.1108/17579881011023007 · Cited by 31
Exploring the Impact of Toxic Attitudes and a Toxic Environment on the Veterinary Healthcare Team
Moore, I. C., Coe, J. B., Adams, C. L., Conlon, P. D., & Sargeant, J. M. (2015) · Frontiers in Veterinary Science · doi:10.3389/fvets.2015.00078 · Cited by 41
The role of Compensatory Health Beliefs in eating behavior change: A mixed method study
Amrein, M. A., Rackow, P., Inauen, J., Radtke, T., & Scholz, U. (2017) · Appetite · doi:10.1016/j.appet.2017.04.016 · Cited by 31
What Institutional Websites Reveal About Diversity-Related Partnerships Between Academic and Student Affairs
LePeau, L. A., Hurtado, S. S., & Davis, R. J. (2017) · Innovative Higher Education · doi:10.1007/s10755-017-9412-0 · Cited by 31
#CleftProud
Stock, N. M., Martindale, A., & Cunniffe, C. (2018) · The Cleft Palate-Craniofacial Journal · doi:10.1177/1055665618764737 · Cited by 34
“That’s not what was originally agreed to”: Perceptions, outcomes, and legal contextualization of non-consensual condom removal in a Canadian sample
Czechowski, K., Courtice, E. L., Samosh, J., Davies, J., & Shaughnessy, K. (2019) · PLoS ONE · doi:10.1371/journal.pone.0219297 · Cited by 31
A Method for Measuring Systems Thinking Learning
Taylor, S., Calvo‐Amodio, J., & WELL, J. A. (2020) · Systems · doi:10.3390/systems8020011 · Cited by 31
An investigation of elementary teachers' pedagogical content knowledge for socioscientific argumentation: The effect of a learning and teaching experience
Kutluca, A. Y. (2021) · Science Education · doi:10.1002/sce.21624 · Cited by 31
What you see is what you get? Measuring companies' projected employer image attributes via companies' employment webpages
Theurer, C. P., Schäpers, P., Tumasjan, A., Welpe, I. M., & Lievens, F. (2021) · Human Resource Management · doi:10.1002/hrm.22085 · Cited by 41
Child Pedestrian Safety: Study of Street-Crossing Behaviour of Primary School Children with Adult Supervision
Riaz, M. S., Cuenen, A., Polders, E., Akram, M. B., Houda, M., Janssens, D., & Azab, M. (2022) · Sustainability · doi:10.3390/su14031503 · Cited by 31
Market-based instruments and sustainable innovation:A systematic literature review and critique
Mazaheri, M., Roca, J. B., Markus, A., & Walrave, B. (2022) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.133947 · Cited by 35
The influence mechanism of the relationship between entrepreneurial learning and entrepreneurial intention
Lin, C., Pan, Y., Yu, Y., Feng, L., & Chen, Z. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1023808 · Cited by 35
Analysis of mathematical tasks in Turkish elementary school mathematics textbooks
Özgeldi, M., & Esen, Y. D. (2010) · Procedia - Social and Behavioral Sciences · doi:10.1016/j.sbspro.2010.03.322 · Cited by 31
The Place of International Human Resource Management in International Business
Welch, D. E., & Björkman, I. (2014) · Management International Review · doi:10.1007/s11575-014-0226-3 · Cited by 34
Does television reflect the evolution of scientific knowledge? The case of attention deficit hyperactivity disorder coverage on French television
Bourdaa, M., Konsman, J. P., Sécail, C., Venturini, T., Veyrat-Masson, I., & Gonon, F. (2013) · Public Understanding of Science · doi:10.1177/0963662513484842 · Cited by 32
Variation in visitor perceptions of a polar bear enclosure based on the presence of natural vs. un‐natural enrichment items
Kutska, D. (2008) · Zoo Biology · doi:10.1002/zoo.20226 · Cited by 31
What's for Sale at Canadian Universities? A Mixed‐Methods Analysis of Promotional Strategies
Milian, R. P. (2016) · Higher Education Quarterly · doi:10.1111/hequ.12108 · Cited by 31
Understanding Dutch practice nurses' adherence to evidence-based smoking cessation guidelines and their needs for web-based adherence support: results from semistructured interviews
de Ruijter, D., Smit, E. S., de Vries, H., Goossens, L., & Hoving, C. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-014154 · Cited by 31
The Institutionalization of Integrity in Local Government
Hoekstra, A., & Kaptein, M. (2012) · Public Integrity · doi:10.2753/pin1099-9922150101 · Cited by 31
Charismatic Communication Skill, Media Legitimacy, and Electoral Success
Sheafer, T. (2008) · Journal of Political Marketing · doi:10.1080/15377850802063983 · Cited by 31
Indexing reliability for condition survey data
Taylor, J., & Watkinson, D. E. (2007) · Journal of the Institute of Conservation · doi:10.1080/01410096.2007.9995223 · Cited by 31
Subtle ways of stigmatization among professionals: the subjective experience of consumers and their family members.
Amsalem, D., Hasson-Ohayon, I., Gothelf, D., & Roe, D. (2018) · Psychiatric Rehabilitation Journal · doi:10.1037/prj0000310 · Cited by 30
Satires, narratives and journalistic divides: Discourses on free speech in Western and Islamic news media
Khan, M. K., Wu, F. Q., Pratt, C. B., & Akhtar, N. (2019) · The Social Science Journal · doi:10.1016/j.soscij.2019.05.012 · Cited by 30
Advancing Reproducibility and Accountability of Unsupervised Machine Learning in Text Mining: Importance of Transparency in Reporting Preprocessing and Algorithm Selection
Valtonen, L., Mäkinen, S., & Kirjavainen, J. (2022) · Organizational Research Methods · doi:10.1177/10944281221124947 · Cited by 31
The Choice of Insider or Outsider Top Executives in Acquired Companies
Angwin, D., & Meadows, M. (2009) · Long Range Planning · doi:10.1016/j.lrp.2009.05.005 · Cited by 30
Injury prevention and risk communication: a mental models approach
Austin, L., & Fischhoff, B. (2011) · Injury Prevention · doi:10.1136/injuryprev-2011-040079 · Cited by 30
The Elephant in the Room: The Invisibility of Poverty in Research on Type 2 Diabetes
Chaufan, C., & Weitz, R. (2009) · Humanity & Society · doi:10.1177/016059760903300106 · Cited by 29
Unethical behavior in organizations: empirical findings that challenge CSR and egoism theory
Overall, J. S. (2016) · Business Ethics A European Review · doi:10.1111/beer.12110 · Cited by 30
Smart grid electricity system planning and climate disruptions: A review of climate and energy discourse post-Superstorm Sandy
Feldpausch-Parker, A. M., Peterson, T. R., Stephens, J. C., & Wilson, E. J. (2017) · Renewable and Sustainable Energy Reviews · doi:10.1016/j.rser.2017.06.015 · Cited by 30
Exploring Ways to Support Preservice Teachers’ Use of UDL in Planning and Instruction
Lowrey, K. A., Classen, A. I., & Sylvest, A. (2019) · Journal of Educational Research and Practice · doi:10.5590/jerap.2019.09.1.19 · Cited by 30
Mapping Persian Twitter: Networks and mechanism of political communication in Iranian 2017 presidential election
Kermani, H., & Adham, M. (2021) · Big Data & Society · doi:10.1177/20539517211025568 · Cited by 33
Linking Sustainability, Embeddedness and Marketing Strategies: A Study on the Craft Beer Sector in Italy
Cipollaro, M., Fabbrizzi, S., Sottini, V. A., Fabbri, B., & Menghini, S. (2021) · Sustainability · doi:10.3390/su131910903 · Cited by 30
Commentary-A Dissenting View on So-Called Paradoxes of Reliability Coefficients
Salmon, C. T. (2012) · Routledge eBooks · doi:10.4324/9780203113653-24 · Cited by 29
Effectiveness of Social Video Platforms in Promoting COVID-19 Vaccination Among Youth: A Content-Specific Analysis of COVID-19 Vaccination Topic Videos on Bilibili
Gao, H., Yin, H., Peng, L., & Wang, H. (2022) · Risk Management and Healthcare Policy · doi:10.2147/rmhp.s374420 · Cited by 30
The game ontology project: supporting learning while contributing authentically to game studies
Zagal, J. P., & Bruckman, A. S. (2008) · International Conference of Learning Sciences · doi:10.22318/icls2008.2.499 · Cited by 30
Informing Dissemination Research
Strekalova, Y. A. (2014) · Science Communication · doi:10.1177/1075547014555025 · Cited by 30
Characteristics of innovation: a customer-centric view of barriers to the adoption of a renewable energy system
Tapaninen, A., Seppanen, M., & Mäkinen, S. (2009) · International Journal of Agile Systems and Management · doi:10.1504/ijasm.2009.023250 · Cited by 29
Content Analysis of Trends in Print Magazine Tobacco Advertisements
Banerjee, S. C., Shuk, E., Greene, K. L., & Ostroff, J. S. (2015) · Tobacco Regulatory Science · doi:10.18001/trs.1.2.1 · Cited by 30
Exploring Division-I Student-Athletes’ Memorable Messages From Their Anticipatory Socialization
Cranmer, G. A., & Myers, S. A. (2016) · Communication Quarterly · doi:10.1080/01463373.2016.1197292 · Cited by 30
A Narrative Evaluation of a Psychoeducation and a Therapeutic Alliance Intervention for Parents of Persons with a Severe Mental Illness
Levy‐Frank, I., Hasson‐Ohayon, I., Kravetz, S., & Roe, D. (2012) · Family Process · doi:10.1111/j.1545-5300.2012.01398.x · Cited by 30
Scope of Self: Toward a Model of Television's Effects on Self-Complexity in Adolescence
Harrison, K. (2006) · Communication Theory · doi:10.1111/j.1468-2885.2006.00270.x · Cited by 30
RFID as enabler for the boundless real-time organisation: empirical insights from Germany
Leimeister, J. M., Knebel, U., & Krcmar, H. (2007) · International Journal of Networking and Virtual Organisations · doi:10.1504/ijnvo.2007.012082 · Cited by 30
What do Teachers do to Show They Care? Learning From the Voices of Early Adolescents
Whitehead, J., Schonert-Reichl, K. A., Oberle, E., & Boyd, L. A. (2022) · Journal of Adolescent Research · doi:10.1177/07435584221076055 · Cited by 29
AI ChatBots’ solutions to mathematical problems in interactive e-textbooks: Affordances and constraints from the eyes of students and teachers
Ergene, Ö., & ERGENE, B. Ç. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-13121-z · Cited by 41
The advantages of lexicon-based sentiment analysis in an age of machine learning
van der Veen, A. M., & Bleich, E. (2025) · PLoS ONE · doi:10.1371/journal.pone.0313092 · Cited by 51
Reasons for Comfort and Discomfort with Pharmacological Enhancement of Cognitive, Affective, and Social Domains
Cabrera, L. Y., Fitz, N. S., & Reiner, P. B. (2014) · Neuroethics · doi:10.1007/s12152-014-9222-3 · Cited by 29
Exploring Dimensions of Teachers’ OCB from Stakeholder’s Perspective: A Study in India
Shaheen, M., Gupta, R., & Kumar, Y. (2016) · The Qualitative Report · doi:10.46743/2160-3715/2016.2357 · Cited by 33
How to augment the learning impact of computer simulations? The designs and effects of interactivity and scaffolding
Chang, H. (2016) · Interactive Learning Environments · doi:10.1080/10494820.2016.1250222 · Cited by 32
Effects of a Dyad's Cultural Intelligence on Global Virtual Collaboration
Li, Y., Rau, P. P., Li, H., & Maedche, A. (2017) · IEEE Transactions on Professional Communication · doi:10.1109/tpc.2016.2632842 · Cited by 29
Reliability in evaluator-based tests: using simulation-constructed models to determine contextually relevant agreement thresholds
Beckler, D. T., Thumser, Z. C., Schofield, J. S., & Marasco, P. D. (2018) · BMC Medical Research Methodology · doi:10.1186/s12874-018-0606-7 · Cited by 31
Shared Space: How North American Olympic Broadcasters Framed Gender on Instagram
Johnson, R. G., Romney, M., Hull, K., & Pegoraro, A. L. (2020) · Communication & Sport · doi:10.1177/2167479520932896 · Cited by 29
Analysis of the projected image of tourism destinations on photographs: the case of Iran on Instagram
Gorji, A. S., Almeida‐García, F., & Melé, P. M. (2021) · Anatolia · doi:10.1080/13032917.2021.2001665 · Cited by 35
Characterising feedback cultures in higher education: an analysis of strategy documents from 134 UK universities
Winstone, N. (2022) · Higher Education · doi:10.1007/s10734-022-00818-8 · Cited by 40
The political irruption of short video: Is TikTok a new window for Spanish parties?
Gamir-Ríos, J., & Castillo, S. S. (2022) · Communication & Society · doi:10.15581/003.35.2.37-52 · Cited by 31
‘Supporting socially shared regulation during collaborative task-oriented reading’
Kielstra, J. G. G. M. A., Molenaar, I., van Steensel, R., & Verhoeven, L. T. W. (2022) · International Journal of Computer-Supported Collaborative Learning · doi:10.1007/s11412-022-09365-x · Cited by 30
Hashtag feminism in a blocked context: The mechanisms of unfolding and disrupting #rape on Persian Twitter
Kermani, H., & Hooman, N. (2022) · New Media & Society · doi:10.1177/14614448221128827 · Cited by 38
Public Health and Legal Arguments in Favor of a Policy to Cap the Portion Sizes of Sugar-Sweetened Beverages
Roberto, C. A., & Pomeranz, J. L. (2015) · American Journal of Public Health · doi:10.2105/ajph.2015.302862 · Cited by 30
Assessing the reliability of student evaluations of teaching: choosing the right coefficient
Morley, D. D. (2013) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2013.796508 · Cited by 31
Comparing portrayals of beauty in outdoor advertisements across six cultures: Bulgaria, Hong Kong, Japan, Poland, South Korea, and Turkey
Morris, P. K. (2014) · Asian Journal of Communication · doi:10.1080/01292986.2014.885535 · Cited by 29
How newspapers represent environmental risk: the case of carcinogenic hazards in South Korea
Hove, T. B., Paek, H., Yun, M., & Jwa, B. (2014) · Journal of Risk Research · doi:10.1080/13669877.2014.923025 · Cited by 36
Medium and Message: Globalization and innovation in the production field of Indian fashion
Khaire, M. V., & Hall, E. V. (2016) · Organization Studies · doi:10.1177/0170840615622061 · Cited by 29
The construction of urgency discourse around mega-projects: the Israeli case
van Wijk, J., & Fischhendler, I. (2016) · Policy Sciences · doi:10.1007/s11077-016-9262-0 · Cited by 29
Promoting explicit instruction of strategies for self-regulated learning: evaluating a teacher professional development program in primary education
Sins, P. H. M., de Leeuw, R. R., de Brouwer, J., & Vrieling, E. (2023) · Metacognition and Learning · doi:10.1007/s11409-023-09368-5 · Cited by 36
Quality and Safety in Nursing: Recommendations From a Systematic Review
Patrician, P. A., Campbell, C. M., Javed, M., Williams, K. M., Foots, L., Hamilton, W. M., House, S. L., & Swiger, P. A. (2024) · Journal for Healthcare Quality · doi:10.1097/jhq.0000000000000430 · Cited by 54
Reality and newsworthiness: Press coverage of International Terrorism by China and the United States
Zhang, D., Shoemaker, P. J., & Wang, X. (2013) · Asian Journal of Communication · doi:10.1080/01292986.2013.764904 · Cited by 28
Eating disorder questions in Yahoo! Answers: Information, conversation, or reflection?
Bowler, L., Oh, J. S., He, D., Mattern, E., & Jeng, W. (2012) · Proceedings of the American Society for Information Science and Technology · doi:10.1002/meet.14504901052 · Cited by 28
Corporate social identity: an analysis of the Indian banking sector
Pratihari, S. K., & Uzma, S. H. (2018) · International Journal of Bank Marketing · doi:10.1108/ijbm-03-2017-0046 · Cited by 28
Why do consumers use Facebook brand pages? A case study of a leading fast-food brand fan page in Egypt
Gaber, H. R., ElSamadicy, A. M., & Wright, L. T. (2019) · Journal of Global Scholars of Marketing Science · doi:10.1080/21639159.2019.1622434 · Cited by 34
Measuring fidelity of delivery of the Community Occupational Therapy in Dementia-UK intervention
Walton, H., Tombor, I., Burgess, J., Groarke, H., Swinson, T., Wenborn, J., Spector, A. E., Orrell, M. W., Mountain, G. A., & Michie, S. (2019) · BMC Geriatrics · doi:10.1186/s12877-019-1385-7 · Cited by 31
Human-wildlife interactions for tourism: a systematic review
Dou, X., & Day, J. (2020) · Journal of Hospitality and Tourism Insights · doi:10.1108/jhti-01-2020-0007 · Cited by 28
Are the concerns destroying mental health of college students?: A qualitative analysis portraying experiences amidst COVID‐19 ambiguities
Gupta, R., & Agrawal, R. (2021) · Analyses of Social Issues and Public Policy · doi:10.1111/asap.12232 · Cited by 27
On the perceived usefulness of risk descriptions for decision-making in disaster risk management
Lin, L., Nilsson, A., Sjölin, J., Abrahamsson, M., & Tehler, H. (2015) · Reliability Engineering & System Safety · doi:10.1016/j.ress.2015.04.012 · Cited by 29
Where has the doctor gone? The mediazation of medicine on Dutch television, 1961—2000
Verhoeven, P. (2008) · Public Understanding of Science · doi:10.1177/0963662506075352 · Cited by 28
An Evaluation of a University Peer-Mentoring Training Programme
Terrion, J. L., Philion, R., & Leonard, D. (2007) · International journal of evidence based coaching and mentoring · doi:10.1177/174183050700500105 · Cited by 28

Authors: Lombard, M., Snyder-Duch, J., & Bracken, C. C.
Affiliations: Temple University (US)
Cleveland State University (US)
Venue: Human Communication Research
Publisher: Oxford University Press (OUP)
Published: 2002-10
Volume: 28
Issue: 4
Pages: 587-604
ISSN: 0360-3989 (ISSN-L)
1468-2958
DOI: 10.1111/j.1468-2958.2002.tb00826.x
OpenAlex: W2160375265
Cited by: 3,068
References: 42
Citations by year: 2026: 234 · 2025: 173 · 2024: 136 · 2023: 143 · 2022: 212 · 2021: 238 · 2020: 206 · 2019: 206 · 2018: 174 · 2017: 168 · 2016: 174 · 2015: 153 · 2014: 168 · 2013: 158 · 2012: 117
FWCI: 19.75
Type: journal article
Language: en
Open access: closed
Licence: doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 4718 d)
Locations: Human Communication Research (publishedVersion)
EngagedScholarship @ Cleveland State University (Cleveland State University) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Social Sciences › Communication › News Media Framing and Political Communication
Social Sciences › General Social Sciences › Computational and Text Analysis Methods
Keywords: intercoder reliability, inter-coder agreement, content analysis, mass communication research, reporting practices, percent agreement, reliability index, coding procedures, research guidelines

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks