Cited by 3,068Reliability and Agreement in MeasurementNews Media Framing and Political CommunicationComputational and Text Analysis Methods

The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.

Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability

Lombard, Matthew, Snyder-Duch, Jennifer, Bracken, Cheryl Campanella·2002·Human Communication Research

DOI 10.1111/j.1468-2958.2002.tb00826.x

Open this paper in CoChat — free account

Abstract

As a method specifically intended for the study of messages, content analysis is fundamental to mass communication research. Intercoder reliability, more specifically termed intercoder agreement, is a measure of the extent to which independent judges make the same coding decisions in evaluating the characteristics of messages, and is at the heart of this method. Yet there are few standard and accessible guidelines available regarding the appropriate procedures to use to assess and report intercoder reliability, or software tools to calculate it. As a result, it seems likely that there is little consistency in how this critical element of content analysis is assessed and reported in published mass communication studies. Following a review of relevant concepts, indices, and tools, a content analysis of 200 studies utilizing content analysis published in the communication literature between 1994 and 1998 is used to characterize practices in the field. The results demonstrate that mass communication researchers often fail to assess (or at least report) intercoder reliability and often rely on percent agreement, an overly liberal index. Based on the review and these results, concrete guidelines are offered regarding procedures for assessment and reporting of this important aspect of content analysis.

Integrity signals

Registry

Crossref · 10.1111/j.1468-2958.2002.tb00826.x

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,351
The Content Analysis Guidebook
Neuendorf, K. A. (2017) · doi:10.4135/9781071802878 · Cited by 9,286 · cited 10×
“), but this technique has also been questioned (Neuendorf, 2002). With the coding data in hand, the researcher calculates and reports one or more indices of reliability. Popping (1988) identified 39 different “agreement indices” for coding nominal categories, which excludes several techniques for ratio and interval le…”
BackgroundMethodInfluential
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Content Analysis for the Social Sciences and Humanities.
Parker, E. B., & Holsti, O. R. (1970) · American Sociological Review · doi:10.2307/2093233 · Cited by 4,553
Content Analysis in Communication Research.
Pool, I. D. S., & Berelson, B. (1952) · American Sociological Review · doi:10.2307/2088029 · Cited by 3,106
Content Analysis for the Social Sciences and Humanities
Parker, S. R. (1970) · Sociology · doi:10.1177/003803857000400231 · Cited by 2,178
Handbook of Research Methods in Social and Personality Psychology
West, T., Reis, H. T., Judd, C. M., Banaji, M. R., Crandall, C., Giner-Sorolla, R., Biernat, M., Fiedler, K., Ermark, F., Tepper, S. J., et al. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009170123 · Cited by 2,134

Show all 42 references

Research works printed but not linked: 2

Lacy S., 1996, Journalism & Mass Communication Quarterly, 73, 969
Perreault W. D., 1989, Journal of Marketing Research, 26, 135, 10.1177/002224378902600201 · DOI · Paper page

Sorted by citations

Items 801–900 of 1,005

The Impact of HIPAA Authorization on Willingness to Participate in Clinical Research
Dunlop, A. L., Graham, T., Leroy, Z. C., Glanz, K., & Dunlop, B. W. (2007) · Annals of Epidemiology · doi:10.1016/j.annepidem.2007.05.006 · Cited by 28
Media Framing of Financial Mechanisms for Resolving Human–Predator Conflict in Namibia
Rust, N. A. (2015) · Human Dimensions of Wildlife · doi:10.1080/10871209.2015.1037027 · Cited by 28
Research Design and the Narrative Policy Framework
Pierce, J. J., Smith‐Walter, A., & Peterson, H. L. (2014) · Palgrave Macmillan US eBooks · doi:10.1057/9781137485861_2 · Cited by 28
Impression management and self-presentation dissimulation in Portuguese chairman’s statements
Oliveira, J. D. S., Azevedo, G., & Borges, F. (2016) · Corporate Communications An International Journal · doi:10.1108/ccij-11-2015-0074 · Cited by 29
Unpacking the Effects of Competing Mandates on Agency Performance
Carrigan, C. (2018) · Public Administration Review · doi:10.1111/puar.12912 · Cited by 33
Is a Consistent Message Achievable?: Defining “Message Consistency” for Weather Enterprise Researchers and Practitioners
Williams, C. A., & Eosco, G. M. (2020) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-18-0250.1 · Cited by 33
Tobacco Industry Lifestyle Magazines Targeted to Young Adults
Cortese, D. K., Lewis, M. J., & Ling, P. M. (2009) · Journal of Adolescent Health · doi:10.1016/j.jadohealth.2009.02.008 · Cited by 28
Happily Ever After? A Content Analysis of Romantic Ideals in Disney Princess Films
Hefner, V., Firchau, R.-J., Norton, K., & Shevel, G. (2017) · Communication Studies · doi:10.1080/10510974.2017.1365092 · Cited by 50
Measuring Media Reputation
Zhang, X. (2015) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699015610065 · Cited by 27
Accountability and opposition to globalization in international assemblies
de Wilde, P., Junk, W. M., & Palmtag, T. (2015) · European Journal of International Relations · doi:10.1177/1354066115604032 · Cited by 27
Agreement is overrated: A plea for correlation to assess human evaluation reliability
Amidei, J., Piwek, P., & Willis, A. (2019) · International Conference on Natural Language Generation · doi:10.18653/v1/w19-8642 · Cited by 27
President Trump vs. CEOs: a comparison of presidential and corporate agenda building
Lan, X., Tarasevich, S., Proverbs, P., Myślik, B., & Kiousis, S. K. (2020) · Journal of Public Relations Research · doi:10.1080/1062726x.2020.1719494 · Cited by 27
Management of risks associated with the disclosure of future-oriented information in integrated reports
Lakshan, A. M. I., Low, M., & de Villiers, C. (2021) · Sustainability Accounting Management and Policy Journal · doi:10.1108/sampj-03-2019-0114 · Cited by 27
Differences in public perceptions of geothermal energy based on EGS technology in Korea after the Pohang earthquake: National vs. local
Baek, H., Chung, J., & Yun, G. W. (2021) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2021.121027 · Cited by 27
An Information Security Performance Measurement Tool for Senior Managers: Balanced Scorecard Integration for Security Governance and Control Frameworks
Herath, T. C., Herath, H. S. B., & Cullum, D. (2022) · Information Systems Frontiers · doi:10.1007/s10796-022-10246-9 · Cited by 44
Do I really need all this work to find vulnerabilities?
Elder, S., Zahan, N., Shu, R., Metro, M., Kozarev, V., Menzies, T., & Williams, L. A. (2022) · Empirical Software Engineering · doi:10.1007/s10664-022-10179-6 · Cited by 28
How anger and fear influence policy narratives: Advocacy and regulation of oil and gas drilling in Colorado
Pierce, J. J., Miller‐Stevens, K., Hicks, I., Zilly, D. C., Rangaraj, S., & Rao, E. (2022) · Review of Policy Research · doi:10.1111/ropr.12519 · Cited by 27
Teeth whitening, boot camp, and a brewery tour: a practical analysis of ‘deal of the day’
Boon, E., Wiid, R., & DesAutels, P. (2012) · Journal of Public Affairs · doi:10.1002/pa.1415 · Cited by 27
UNIVERSITY STUDENTS’ UNDERSTANDING OF THERMAL PHYSICS IN EVERYDAY CONTEXTS
Georgiou, H., & Sharma, M. D. (2011) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-011-9320-1 · Cited by 27
Where are the Young Men in HIV Prevention Efforts? Comments on HIV Prevention Programs and Research from Young Men Who Sex with Men in Los Angeles County
Holloway, I. W., Cederbaum, J. A., Ajayi, A., & SHOPTAW, S. J. (2012) · The Journal of Primary Prevention · doi:10.1007/s10935-012-0282-z · Cited by 27
Promoting Health (Implicitly)? A Longitudinal Content Analysis of Implicit Health Information in Cigarette Advertising, 1954–2003
Paek, H., Reid, L. N., Choi, H., & Jeong, H. J. (2010) · Journal of Health Communication · doi:10.1080/10810730.2010.514033 · Cited by 28
Evaluation of a tailored training programme to improve the assessment and treatment of trauma in an Early Intervention in Psychosis (EIP) service
Walters, S., Hogg, L. I., & Gillmore, C. (2016) · Psychosis · doi:10.1080/17522439.2015.1131324 · Cited by 27
Inner Source in Platform-Based Product Engineering
Riehle, D., Capraro, M., Kips, D., & Horn, L. (2016) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2016.2554553 · Cited by 27
A Novel Sequential Mixed-method Technique for Contrastive Analysis of Unscripted Qualitative Data
Cabrera, L. Y., & Reiner, P. B. (2016) · Sociological Methods & Research · doi:10.1177/0049124116661575 · Cited by 28
Identifying behaviors that generate positive interactions between science museums and people on Twitter
Baker, S. C. (2016) · Museum Management and Curatorship · doi:10.1080/09647775.2016.1264882 · Cited by 28
Reasons for declining computerized insulin protocol recommendations: Application of a framework
Sward, K. A., Orme, J. F., Sorenson, D. K., Baumann, L. A., & Morris, A. H. (2008) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2008.04.002 · Cited by 27
Methodological Rigor in Quantitative Research
Marquart, F. (2017) · The International Encyclopedia of Communication Research Methods · doi:10.1002/9781118901731.iecrm0221 · Cited by 27
#sustainablefashion on Instagram: A content and network analysis of user‐generated posts
Skinner, E. A., Busque, B. L., Dorrian, J., & Litchfield, C. A. (2023) · Journal of Consumer Behaviour · doi:10.1002/cb.2182 · Cited by 26
Human-GenAI interaction for active learning in STEM education: State-of-the-art and future directions
Otto, S., Lavi, R., & Bertel, L. B. (2025) · Computers & Education · doi:10.1016/j.compedu.2025.105444 · Cited by 39
AMATEUR SOURCES BREAKING THE NEWS, METASOURCES AUTHORIZING THE NEWS OF GADDAFI’S DEATH
Kristensen, N. N., & Mortensen, M. (2013) · Digital Journalism · doi:10.1080/21670811.2013.790610 · Cited by 26
Towards a strong career learning environment: results from a Dutch longitudinal study
Draaisma, A., Meijers, F., & Kuijpers, M. A. C. T. (2016) · British Journal of Guidance and Counselling · doi:10.1080/03069885.2016.1217979 · Cited by 26
From human invaders to problem bears: A media content analysis of grizzly bear conservation
Hughes, C., Foote, A. L., Yarmey, N. T., Hwang, C., Thorlakson, J. J. D., & Nielsen, S. E. (2020) · Conservation Science and Practice · doi:10.1111/csp2.176 · Cited by 26
When Politics Meets Pandemic: How Prime Minister Netanyahu and a Small Team Communicated Health and Risk Information to the Israeli Public During the Early Stages of COVID-19
Gesser‐Edelsburg, A., & Hijazi, R. (2020) · Risk Management and Healthcare Policy · doi:10.2147/rmhp.s280952 · Cited by 26
Brands with personalities – good for businesses, but bad for public health? A content analysis of how food and beverage brands personify themselves on Twitter
Greene, T., Seet, C., Barrio, A. R., McIntyre, D., Kelly, B., & Bragg, M. A. (2021) · Public Health Nutrition · doi:10.1017/s1368980021001439 · Cited by 26
Using Phenomenological Methodology with Thematic Analysis to Examine and Reflect on Commonalities of Instructors’ Experiences in MOOCs
Chang, C., & Wang, Y.-H. (2021) · Education Sciences · doi:10.3390/educsci11050203 · Cited by 26
Teachers’ use of open questions: investigating the various functions of open questions as a mediating tool in early literacy education
Svanes, I. K., & Andersson-Bakken, E. (2021) · Education Inquiry · doi:10.1080/20004508.2021.1985247 · Cited by 39
Examining COVID-19 Tweet Diffusion Using an Integrated Social Amplification of Risk and Issue-Attention Cycle Framework
Lee, E. W. J., Zheng, H., Goh, D. H., Lee, C. S., & Theng, Y. L. (2023) · Health Communication · doi:10.1080/10410236.2023.2170201 · Cited by 27
Coding Issues in Modality Analysis
Popping, R., & Roberts, C. W. (2009) · Field Methods · doi:10.1177/1525822x09333433 · Cited by 26
The use of tags and tag clouds to discern credible content in online health message forums
O'Grady, L. A., Wathen, C. N., Charnaw-Burger, J., Betel, L., Shachak, A., Luke, R., Hockema, S. A., & Jadad, A. R. (2011) · International Journal of Medical Informatics · doi:10.1016/j.ijmedinf.2011.10.001 · Cited by 26
WHO IS THE LADY IN THE WINDOW?
Cantrell, T. H., & Bachmann, I. (2008) · Journalism Studies · doi:10.1080/14616700801999253 · Cited by 26
Use of Survey Research in Top Mass Communication Journals 2001–2010 And the Total Survey Error Paradigm
Ha, L. S., Hu, X. M., Fang, L., Henize, S., Park, S., Stana, A., & Zhang, X. (2015) · Review of Communication · doi:10.1080/15358593.2015.1014401 · Cited by 27
Confronting barriers and recognizing opportunities: Developing effective community-based environmental monitoring programs to meet the needs of Aboriginal communities
McKay, A. J., & Johnson, C. J. (2017) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2017.01.002 · Cited by 26
Learning on Lean Production: A Review of Opinion and Research within Environmental Constraints
Mor, R. S., Singh, S., & Bhardwaj, A. (2015) · Operations and Supply Chain Management An International Journal · doi:10.31387/oscm0230161 · Cited by 26
Twenty Years of Social Studies Textbook Content Analysis: Still “Decidedly Disappointing”?
Chu, Y. (2017) · The Social Studies · doi:10.1080/00377996.2017.1360240 · Cited by 28
Retail supply chain responsiveness
Sandberg, E., & Jafari, H. (2018) · International Journal of Productivity and Performance Management · doi:10.1108/ijppm-11-2017-0315 · Cited by 26
Representations of nature of science in U.S. science standards: A historical account with contemporary implications
Summers, R., Alameh, S., Brunner, J. L., Maddux, J. M., Wallon, R. C., & Abd‐El‐Khalick, F. (2019) · Journal of Research in Science Teaching · doi:10.1002/tea.21551 · Cited by 26
Climate Change in the Mainstream Turkish Press: Coverage Trends and Meaning Dimensions in the First Attention Cycle
Üzelgün, M. A., & Castro, P. (2015) · Mass Communication & Society · doi:10.1080/15205436.2015.1027407 · Cited by 26
An Observational Investigation of Reverse Engineers' ProcessesPreprint
Votipka, D., Rabin, S. M., Micinski, K., Foster, J. S., & Mazurek, M. L. (2019) · arXiv (Cornell University) · doi:10.48550/arxiv.1912.00317 · Cited by 26
An activity theory perspective on contradictions in flipped mathematics classrooms at the university level
Fredriksen, H., & Hadjerrouit, S. (2020) · International Journal of Mathematical Education in Science and Technology · doi:10.1080/0020739x.2019.1591533 · Cited by 27
Normative feedback for parents of college students: Piloting a parent based intervention to correct misperceptions of students' alcohol use and other parents' approval of drinking
LaBrie, J. W., Napper, L. E., & Hummer, J. F. (2013) · Addictive Behaviors · doi:10.1016/j.addbeh.2013.08.036 · Cited by 25
Mixed methods research in sport marketing
Abeza, G., O’Reilly, N., Dottori, M., Séguin, B., & Nzindukiyimana, O. (2015) · International Journal of Multiple Research Approaches · doi:10.1080/18340806.2015.1076758 · Cited by 25
The Unlearning of Managerial Skills: A Qualitative Study of Executive Officers
Matsuo, M. (2017) · European Management Review · doi:10.1111/emre.12122 · Cited by 33
Financial statement users’ institutional logic
Durocher, S., & Fortin, A. (2021) · Journal of Accounting and Public Policy · doi:10.1016/j.jaccpubpol.2021.106819 · Cited by 25
“More like a friend than a teacher”: ideal teachers and the gig economy for online language learning
Curran, N. M. (2021) · Computer Assisted Language Learning · doi:10.1080/09588221.2021.1976801 · Cited by 25
Persuasive Apps for Sustainable Waste Management: A Comparative Systematic Evaluation of Behavior Change Strategies and State-of-the-Art
Nkwo, M. S., Suruliraj, B., & Orji, R. (2021) · Frontiers in Artificial Intelligence · doi:10.3389/frai.2021.748454 · Cited by 29
Role of personal values on revisiting green hotels: a hierarchical value map approach
Sreen, N., Mukherjee, S., Jebarajakirthy, C., Kumar, S., & Sharma, H. (2022) · Tourism Recreation Research · doi:10.1080/02508281.2022.2076190 · Cited by 25
Identifying pluralistic approaches in language subjects in Denmark, Norway, and Sweden – A comparative curriculum analysis
Drachmann, N., Haukås, Å., & Lundberg, A. (2023) · Language Culture and Curriculum · doi:10.1080/07908318.2022.2156528 · Cited by 28
Social media impact of tourism managers: a decision tree approach in happiness, social marketing and sustainability
Coronil, A. G., Blanco‐Moreno, S., Pesántez, L., & Montoya, G. A. G. (2023) · Journal of Management Development · doi:10.1108/jmd-04-2023-0131 · Cited by 45
Cultural adaptation of web design services as critical success factor for business excellence
Calabrese, A., Capece, G., Pillo, F. D., & Martino, F. (2014) · Cross Cultural Management An International Journal · doi:10.1108/ccm-09-2012-0070 · Cited by 25
Staying In or Going Out?
Larsson, A. O. (2012) · Journalism Practice · doi:10.1080/17512786.2012.748514 · Cited by 25
HR measurement as an instrument of the HR department in its exchange relationship with top management: A qualitative study based on resource dependence theory
Amalou-Döpke, L., & Süß, S. (2014) · Scandinavian Journal of Management · doi:10.1016/j.scaman.2014.09.003 · Cited by 25
Identifying patterns of collaborative knowledge exploration in online asynchronous discussions
Lee, S. W., & Tsai, C. (2010) · Instructional Science · doi:10.1007/s11251-010-9131-8 · Cited by 27
Applying the Health Belief Model to Examine News Coverage Regarding Steroids in Sports by ABC, CBS, and NBC Between March 1990 and May 2008
Quick, B. L. (2010) · Health Communication · doi:10.1080/10410231003698929 · Cited by 26
Motivation, opportunity, and ability: Understanding new habits and changes adopted for weight management
Willmott, T. J., & Parkinson, J. E. (2017) · International Journal of Consumer Studies · doi:10.1111/ijcs.12340 · Cited by 25
Why We Blog: Homeschooling Mothers of Gifted Children
Jolly, J. L., & Matthews, M. S. (2017) · Roeper Review · doi:10.1080/02783193.2017.1289579 · Cited by 25
Crisis Communication in Institutions of Higher Education: Richard Spencer at the University of Florida
Thelen, P. D., & Robinson, K. L. (2019) · Communication Quarterly · doi:10.1080/01463373.2019.1616586 · Cited by 25
On common terms with shared risks – Studying the communication of risk between local, regional and national authorities in Sweden
Månsson, P., Abrahamsson, M., Hassel, H., & Tehler, H. (2015) · International Journal of Disaster Risk Reduction · doi:10.1016/j.ijdrr.2015.08.003 · Cited by 24
The Principles of Data-Centric AI (DCAI)Preprint
Jarrahi, M. H., Memariani, A., & Guha, S. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2211.14611 · Cited by 25
Investigating the Reasons behind Companion Animal Relinquishment: A Systematic Content Analysis of Shelter Records for Cats and Dogs, 2018–2023
Kisley, M. A., Chung, E. J., & Levitt, H. (2024) · Animals · doi:10.3390/ani14172606 · Cited by 35
Reliability of laryngostroboscopic evaluation on lesion size and glottal configuration: A revisit
Yiu, E. M. ‐., Lau, V. C. Y., Ma, E., Chan, K. M. K., & Barrett, E. A. M. (2013) · The Laryngoscope · doi:10.1002/lary.24521 · Cited by 24
Analyzing the Multiple Dimensions of Negotiation Processes
Filzmoser, M., Hippmann, P., & Vetschera, R. (2016) · Group Decision and Negotiation · doi:10.1007/s10726-016-9477-7 · Cited by 24
“Rare place where I feel normal”: Perceptions of a social support conference among parents of and people with Moebius syndrome
Bogart, K. R., Frandrup, E., Locke, T., Thompson, H., Weber, N., Yates, J., Zike, N., & Hemmesch, A. R. (2017) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2017.03.014 · Cited by 24
E-Service Performance of Apparel E-Retailing Websites
Kim, J.-H., Kim, M., & Lennon, S. J. (2017) · International Journal of Service Science Management Engineering and Technology · doi:10.4018/ijssmet.2018010103 · Cited by 24
Analyzing the factors that influence U.S. public support for exporting natural gas
Pierce, J. J., Boudet, H. S., Zanocco, C. M., & Hillyard, M. (2018) · Energy Policy · doi:10.1016/j.enpol.2018.05.066 · Cited by 24
From Conception to Start-Up: Who and What Affect Female Entrepreneurship
Lin, T.-L., Lu, T.-Y., Hsieh, M.-C., & Liu, H.-Y. (2018) · Contemporary Management Research · doi:10.7903/cmr.17957 · Cited by 24
Policy entrepreneurship in developing countries: A systematic review of the literature
Aviram, N. F., Cohen, N., & Beeri, I. (2019) · Public Administration and Development · doi:10.1002/pad.1852 · Cited by 25
Engagement or control? The impact of the Chinese environmental protection bureaus’ burgeoning online presence in local environmental governance
Goron, C., & Bolsover, G. (2019) · Journal of Environmental Planning and Management · doi:10.1080/09640568.2019.1628716 · Cited by 24
In Their Own Words: Experiences of Caregivers of Adults With Cancer as Expressed on Social Media
Bloom, R. D., Beck, S. L., Chou, W. S., Reblin, M., & Ellington, L. (2019) · Oncology nursing forum · doi:10.1188/19.onf.617-630 · Cited by 25
Operations strategy of cloud-based firms: achieving firm growth in the Big Data era
Shou, Y., Zhao, X., & Chen, L. (2019) · International Journal of Operations & Production Management · doi:10.1108/ijopm-01-2019-0089 · Cited by 24
The focus, function and framing of feedback information: linguistic and content analysis of in-text feedback comments
Derham, C., Balloo, K., & Winstone, N. (2021) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2021.1969335 · Cited by 29
Engaging Your Feelings: Emotion Contagion and Public Engagement on Nonprofit Organizations’ Facebook Sites
Li, Z. C., Ji, Y. G., Tao, W., & Chen, Z. F. (2021) · Nonprofit and Voluntary Sector Quarterly · doi:10.1177/08997640211057398 · Cited by 33
Exploring the factors affecting the adoption of blockchain technology in the supply chain and logistic industry
Mthimkhulu, A., & Jokonya, O. (2022) · Journal of Transport and Supply Chain Management · doi:10.4102/jtscm.v16i0.750 · Cited by 29
What do users care about? Research on user behavior of mobile interactive video advertising
Gu, C., Lin, S., Sun, J. L., Yang, C. K., Chen, J., Jiang, Q., Miao, W., & Wei, W. (2022) · Heliyon · doi:10.1016/j.heliyon.2022.e10910 · Cited by 29
Social network dynamics, bots, and community-based online misinformation spread: Lessons from anti-refugee and COVID-19 misinformation cases
Zhen, L., Yan, B., Tang, J. L., Nan, Y., & Yang, A. (2022) · The Information Society · doi:10.1080/01972243.2022.2139031 · Cited by 24
Emerging technologies and shifting consumer motives: Projecting the future of the top-tier sports media product
Geissler, D., Beiderbeck, D., Schmidt, S. L., & Schreyer, D. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2024.123366 · Cited by 27
Collaborative 3D learning games for future learning: teachers’ instructional practices to enhance shared knowledge construction among students
Hämäläinen, R., & Oksanen, K. (2013) · Technology Pedagogy and Education · doi:10.1080/1475939x.2013.838451 · Cited by 25
Source Selection in Product Metaphor Generation: The Effects of Salience and Relatedness
Cila, N., Hekkert, P., & Visch, V. (2014) · Research Repository (Delft University of Technology) · Cited by 24
Inquiry-based Instruction with Archived, Online Data: An Intervention Study with Preservice Teachers
Uçar, S., Trundle, K. C., & Krissek, L. A. (2010) · Research in Science Education · doi:10.1007/s11165-009-9164-7 · Cited by 27
Comparison of Social Support Content Within Online Communities for High- and Low-Survival-Rate Cancers
Buis, L. R., & Whitten, P. S. (2011) · CIN Computers Informatics Nursing · doi:10.1097/ncn.0b013e318214093b · Cited by 24
Enhancing Clients’ Communication Regarding Goals for Using Psychiatric Medications
Deegan, P. E., Carpenter-Song, E. A., Drake, R. E., Naslund, J. A., Luciano, A., & Hutchison, S. L. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201600418 · Cited by 24
Identifying Effective and Sustainable Measures for Community-Based Environmental Monitoring
McKay, A. J., & Johnson, C. J. (2017) · Environmental Management · doi:10.1007/s00267-017-0887-3 · Cited by 24
Open access megajournals: The publisher perspective (Part 1: Motivations)
Wakeling, S., Spezi, V. C. L., Fry, J., Creaser, C., Pinfield, S., & Willett, P. (2017) · Learned Publishing · doi:10.1002/leap.1117 · Cited by 20
U.S. Sport Management Programs in Business Schools: Trends and Key Issues
Zaharia, N., Kaburakis, A., & Pierce, D. A. (2016) · Sport Management Education Journal · doi:10.1123/smej.2015-0007 · Cited by 23
Perpetrating The Myth: Exploring Media Accounts of Rape Myths on “Women’s” Networks
Merken, S., & James, V. (2019) · Deviant Behavior · doi:10.1080/01639625.2019.1603531 · Cited by 23
Including Communication in the Nursing Classroom: A Content Analysis of Communication Competence and Interprofessional Communication in Nursing Fundamentals Textbooks
Carmack, H. J., & Harville, K. (2019) · Health Communication · doi:10.1080/10410236.2019.1654179 · Cited by 23
Understanding Coping Mechanisms: An Investigation Into the Strategies Students Use to Avoid, Manage, or Alleviate Food Insecurity
Brescia, S. A., & Cuite, C. L. (2019) · Journal of College and Character · doi:10.1080/2194587x.2019.1669463 · Cited by 23
The proof of the intervention is in the implementation; a systematic review about implementation fidelity of classroom-based interventions facilitating social participation of students with social-emotional problems or behavioural difficulties
de Leeuw, R. R., de Boer, A., & Minnaert, A. E. M. G. (2020) · International Journal of Educational Research Open · doi:10.1016/j.ijedro.2020.100002 · Cited by 28
Students’ voices about the extra educational support they receive in regular education
de Boer, A., & Kuijper, S. J. M. (2020) · European Journal of Special Needs Education · doi:10.1080/08856257.2020.1790884 · Cited by 23
Development and validation of a behavioural video coding scheme for detecting mental workload in manual assembly
Acker, B. B. V., Parmentier, D. D., Conradie, P. D., Hove, S. V., Biondi, A., Bombeke, K., Vlerick, P., & Saldien, J. (2020) · Ergonomics · doi:10.1080/00140139.2020.1811400 · Cited by 23
Worth a Thousand Words: The Study of Visual Gendered Self-Presentation on Twitter
Mattan, A. J. A., & Small, T. A. (2021) · Canadian Journal of Political Science · doi:10.1017/s0008423921000032 · Cited by 23

Authors: Lombard, M., Snyder-Duch, J., & Bracken, C. C.
Affiliations: Temple University (US)
Cleveland State University (US)
Venue: Human Communication Research
Publisher: Oxford University Press (OUP)
Published: 2002-10
Volume: 28
Issue: 4
Pages: 587-604
ISSN: 0360-3989 (ISSN-L)
1468-2958
DOI: 10.1111/j.1468-2958.2002.tb00826.x
OpenAlex: W2160375265
Cited by: 3,068
References: 42
Citations by year: 2026: 234 · 2025: 173 · 2024: 136 · 2023: 143 · 2022: 212 · 2021: 238 · 2020: 206 · 2019: 206 · 2018: 174 · 2017: 168 · 2016: 174 · 2015: 153 · 2014: 168 · 2013: 158 · 2012: 117
FWCI: 19.75
Type: journal article
Language: en
Open access: closed
Licence: doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 4718 d)
Locations: Human Communication Research (publishedVersion)
EngagedScholarship @ Cleveland State University (Cleveland State University) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Social Sciences › Communication › News Media Framing and Political Communication
Social Sciences › General Social Sciences › Computational and Text Analysis Methods
Keywords: intercoder reliability, inter-coder agreement, content analysis, mass communication research, reporting practices, percent agreement, reliability index, coding procedures, research guidelines

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks