Cited by 3,068Reliability and Agreement in MeasurementNews Media Framing and Political CommunicationComputational and Text Analysis Methods

The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.

Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability

Lombard, Matthew, Snyder-Duch, Jennifer, Bracken, Cheryl Campanella·2002·Human Communication Research

DOI 10.1111/j.1468-2958.2002.tb00826.x

Open this paper in CoChat — free account

Abstract

As a method specifically intended for the study of messages, content analysis is fundamental to mass communication research. Intercoder reliability, more specifically termed intercoder agreement, is a measure of the extent to which independent judges make the same coding decisions in evaluating the characteristics of messages, and is at the heart of this method. Yet there are few standard and accessible guidelines available regarding the appropriate procedures to use to assess and report intercoder reliability, or software tools to calculate it. As a result, it seems likely that there is little consistency in how this critical element of content analysis is assessed and reported in published mass communication studies. Following a review of relevant concepts, indices, and tools, a content analysis of 200 studies utilizing content analysis published in the communication literature between 1994 and 1998 is used to characterize practices in the field. The results demonstrate that mass communication researchers often fail to assess (or at least report) intercoder reliability and often rely on percent agreement, an overly liberal index. Based on the review and these results, concrete guidelines are offered regarding procedures for assessment and reporting of this important aspect of content analysis.

Integrity signals

Registry

Crossref · 10.1111/j.1468-2958.2002.tb00826.x

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

A Coefficient of Agreement for Nominal Scales
Cohen, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000104 · Cited by 42,398
Content Analysis: An Introduction to its Methodology.
Shelley, M., & Krippendorff, K. (1984) · Journal of the American Statistical Association · doi:10.2307/2288384 · Cited by 24,351
The Content Analysis Guidebook
Neuendorf, K. A. (2017) · doi:10.4135/9781071802878 · Cited by 9,286 · cited 10×
“), but this technique has also been questioned (Neuendorf, 2002). With the coding data in hand, the researcher calculates and reports one or more indices of reliability. Popping (1988) identified 39 different “agreement indices” for coding nominal categories, which excludes several techniques for ratio and interval le…”
BackgroundMethodInfluential
A concordance correlation coefficient to evaluate reproducibility.
Lin, L. I.-K. (1989) · Biometrics · doi:10.2307/2532051 · Cited by 8,785
Weighted kappa: nominal scale agreement provision for scaled disagreement or partial credit
Cohen, J. (1968) · Psychological Bulletin · doi:10.1037/h0026256 · Cited by 8,736
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733
Content Analysis for the Social Sciences and Humanities.
Parker, E. B., & Holsti, O. R. (1970) · American Sociological Review · doi:10.2307/2093233 · Cited by 4,553
Content Analysis in Communication Research.
Pool, I. D. S., & Berelson, B. (1952) · American Sociological Review · doi:10.2307/2088029 · Cited by 3,106
Content Analysis for the Social Sciences and Humanities
Parker, S. R. (1970) · Sociology · doi:10.1177/003803857000400231 · Cited by 2,178
Handbook of Research Methods in Social and Personality Psychology
West, T., Reis, H. T., Judd, C. M., Banaji, M. R., Crandall, C., Giner-Sorolla, R., Biernat, M., Fiedler, K., Ermark, F., Tepper, S. J., et al. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009170123 · Cited by 2,134

Show all 42 references

Research works printed but not linked: 2

Lacy S., 1996, Journalism & Mass Communication Quarterly, 73, 969
Perreault W. D., 1989, Journal of Marketing Research, 26, 135, 10.1177/002224378902600201 · DOI · Paper page

Sorted by citations

Items 601–700 of 1,005

Ranking the substantive problems in the Dutch Cost–Benefit Analysis practice
Mouter, N., Annema, J. A., & van Wee, B. (2013) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2013.01.020 · Cited by 40
Can consumers recognize misleading advertising content in a media rich online environment?
Mitra, A. M., Raymond, M. A., & Hopkins, C. D. (2008) · Psychology and Marketing · doi:10.1002/mar.20230 · Cited by 40
Provider Portrayals and Patient–Provider Communication in Drama and Reality Medical Entertainment Television Shows
Jain, P., & Slater, M. D. (2013) · Journal of Health Communication · doi:10.1080/10810730.2012.757388 · Cited by 40
Generative sensing in design evaluation
Dong, A., Garbuio, M., & Lovallo, D. P. (2016) · Design Studies · doi:10.1016/j.destud.2016.01.003 · Cited by 40
Risk Ranking: Investigating Expert and Public Differences in Evaluating Food Safety Hazards
Webster, K. D., Jardine, C., Cash, S. B., & McMullen, L. M. (2010) · Journal of Food Protection · doi:10.4315/0362-028x-73.10.1875 · Cited by 40
Working the fringes: The role of letters to the editor in advancing non-standard media narratives about climate change
Young, N. (2011) · Public Understanding of Science · doi:10.1177/0963662511414983 · Cited by 40
What happens abroad, stays abroad? Exploring how corporate social irresponsibility in domestic and international markets influences corporate reputation
Nardella, G., Surdu, I., & Brammer, S. (2022) · Journal of World Business · doi:10.1016/j.jwb.2022.101420 · Cited by 35
Analysing effective social media communication in higher education institutions
Capriotti, P., & Zeler, I. (2023) · Humanities and Social Sciences Communications · doi:10.1057/s41599-023-02187-8 · Cited by 39
Communities of Public Service Support
Meijer, A. J., Grimmelikhuijsen, S., & Brandsma, G. J. (2011) · Government Information Quarterly · doi:10.1016/j.giq.2011.06.004 · Cited by 39
Mental Health Resources for LGBT Collegians: A Content Analysis of College Counseling Center Web Sites
Wright, P. J., & McKinley, C. J. (2010) · Journal of Homosexuality · doi:10.1080/00918369.2011.533632 · Cited by 39
(De-)Centralisation and Attribution of Blame and Credit
Mortensen, P. B. (2013) · Local Government Studies · doi:10.1080/03003930.2012.742015 · Cited by 39
A Longitudinal Content Analysis of Gender and Ethnicity Portrayals on ESPN’s SportsCenter From 1999 to 2009
Turner, J. S. (2013) · Communication & Sport · doi:10.1177/2167479513496222 · Cited by 39
News Media Logic on the Move?
Karidi, M. (2017) · Journalism Studies · doi:10.1080/1461670x.2016.1266281 · Cited by 39
Competing and conflicting messages via online news media: Potential impacts of claims that the Great Barrier Reef is dying
Eagle, L. C., Hay, R., & Low, D. (2018) · Ocean & Coastal Management · doi:10.1016/j.ocecoaman.2018.03.037 · Cited by 39
The role of organizational identification and the desire to succeed in employees’ use of personal twitter accounts for work
van Zoonen, W., & Treem, J. W. (2019) · Computers in Human Behavior · doi:10.1016/j.chb.2019.06.008 · Cited by 41
Gesture and speech elicitation for 3D CAD modeling in conceptual design
Khan, S., & Tunçer, B. (2019) · Automation in Construction · doi:10.1016/j.autcon.2019.102847 · Cited by 39
Sport, gender, and national interest during the Olympics: A comparative analysis of media representations in Central and Eastern Europe
Antunovic, D., & Bartoluci, S. (2022) · International Review for the Sociology of Sport · doi:10.1177/10126902221095686 · Cited by 39
The perceived usability of the learning management system during the COVID-19 pandemic: Integrating system usability scale, technology acceptance model, and task-technology fit
Chuenyindee, T., Montenegro, L. D., Ong, A. K. S., Prasetyo, Y. T., Nadlifatin, R., Ayuwati, I. D., Sittiwatethanasiri, T., & Robas, K. P. E. (2022) · Work · doi:10.3233/wor-220015 · Cited by 44
Internet-based Ecotourism Marketing: Evaluating Canadian Sensitivity to Ecotourism Tenets
Donohoe, H., & Needham, R. D. (2008) · Journal of Ecotourism · doi:10.2167/joe185.0 · Cited by 39
An exploratory study of public reports to investigate patterns and themes of requests for sexual images of minors online
Quayle, E., & Newman, E. (2016) · Crime Science · doi:10.1186/s40163-016-0050-0 · Cited by 38
Whom to represent? National parliamentary representation during the eurozone crisis
Kinski, L. (2016) · Journal of European Public Policy · doi:10.1080/13501763.2016.1253764 · Cited by 41
Slacktivist USA and Authoritarian China? Comparing Two Political Public Spheres With a Random Sample of Social Media Users
Bolsover, G. (2018) · Policy & Internet · doi:10.1002/poi3.186 · Cited by 38
UNTANGLING A COMPLEX MEDIA SYSTEM
Moe, H., & Larsson, A. O. (2013) · Information Communication & Society · doi:10.1080/1369118x.2013.783607 · Cited by 38
Comparing Climate Change Coverage in Canadian English and French-Language Print Media: Environmental Values, Media Cultures, and the Narration of Global Warming
Young, N., & Dugas, E. (2012) · The Canadian Journal of Sociology · doi:10.29173/cjs9733 · Cited by 38
Cold War redux in US–Russia relations? The effects of US media framing and public opinion of the 2008 Russia–Georgia war
Bayülgen, O., & Arbatli, E. (2013) · Communist and Post-Communist Studies · doi:10.1016/j.postcomstud.2013.08.003 · Cited by 38
Dominant Cognitive Frames and the Innovative Power of Social Networks
D’Andreta, D., Marabelli, M., Newell, S., Scarbrough, H., & Swan, J. A. (2016) · Organization Studies · doi:10.1177/0170840615613374 · Cited by 38
Retail Chains’ Corporate Social Responsibility Communication
Utgård, J. (2015) · Journal of Business Ethics · doi:10.1007/s10551-015-2952-2 · Cited by 38
Examining the role of patients’ experiences as a resource for choice and decision-making in health care: a creative, interdisciplinary mixed-method study in digital health
Ziébland, S., powell, J. A., Briggs, P., Jenkinson, C., Wyke, S., Sillence, E., Harris, P. R., Perera, R., Mazanderani, F., Martin, A., et al. (2016) · Programme Grants for Applied Research · doi:10.3310/pgfar04170 · Cited by 38
Mobile phone‐based interactive voice response as a tool for improving access to healthcare in remote areas in Ghana – an evaluation of user experiences
Brinkel, J., May, J., Krumkamp, R., Lamshöft, M., Kreuels, B., Owusu‐Dabo, E., Mohammed, A., Marinović, A. B., Dako‐Gyeke, P., Krämer, A., et al. (2017) · Tropical Medicine & International Health · doi:10.1111/tmi.12864 · Cited by 38
Demonisation and electoral support for populist radical right parties: A temporary effect
van Heerden, S. C., & van der Brug, W. (2017) · Electoral Studies · doi:10.1016/j.electstud.2017.04.002 · Cited by 38
Seeing and not seeing the Syrian crisis: New visibility and the visual framing of the Syrian conflict in seven newspapers and their online editions
Pantti, M. (2013) · JOMEC Journal · doi:10.18573/j.2013.10259 · Cited by 38
Inter-rater reliability of AMSTAR is dependent on the pair of reviewers
Pieper, D., Jacobs, A., Weikert, B., Fishta, A., & Wegewitz, U. E. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0380-y · Cited by 40
Exploring the behavioral patterns transformation of learners in different 3D modeling teaching strategies
Huang, T., Chen, M., & Lin, C. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2017.08.028 · Cited by 38
The Evaluation of Complex Infrastructure Projects
Gerrits, L., & Verweij, S. (2018) · Edward Elgar Publishing eBooks · doi:10.4337/9781783478422 · Cited by 60
Student in the shell: The robotic body and student engagement
Lei, M., Clemente, I. M., & Hu, Y. (2018) · Computers & Education · doi:10.1016/j.compedu.2018.11.008 · Cited by 38
Sampling Television Programs for Content Analysis of Sex on TV: How Many Episodes are Enough?
Manganello, J. A., Franzini, A. R., & Jordan, A. (2008) · The Journal of Sex Research · doi:10.1080/00224490701629514 · Cited by 38
A randomized controlled trial of the judicious use of safety behaviors during exposure therapy
Blakey, S. M., Abramowitz, J. S., Buchholz, J. L., Jessup, S. C., Jacoby, R. J., Reuman, L., & Pentel, K. Z. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.11.010 · Cited by 37
Institutional theory in international business studies: the period of period of 1990–2018
Şahin, K. T., & Mert, K. (2022) · International journal of organizational analysis · doi:10.1108/ijoa-09-2021-2945 · Cited by 58
Analyzing Methods, Data Collection, and Trustworthiness in Self-Study Research: A Content Analysis of the First 19 Volumes of Studying Teacher Education
Butler, B. M., & Horton, R. B. (2024) · Studying Teacher Education · doi:10.1080/17425964.2024.2367978 · Cited by 37
Evaluation of the fidelity of an interactive face-to-face educational intervention to improve general practitioner management of back pain
French, S. D., Green, S., Francis, J., Buchbinder, R., O’Connor, D. A., Grimshaw, J., & Michie, S. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-007886 · Cited by 37
Gaining Perspective on What We've Lost: The Reliability of Encoded Anecdotes in Historical Ecology
Al-Abdulrazzak, D., Naidoo, R., Palomares, M. L. D., & Pauly, D. F. (2012) · PLoS ONE · doi:10.1371/journal.pone.0043386 · Cited by 37
Directors' remuneration: A comparison of Italian and UK non-financial listed firms' disclosure
Melis, A., Gaia, S., & Carta, S. (2014) · The British Accounting Review · doi:10.1016/j.bar.2014.08.004 · Cited by 37
Commercialism and Election Framing: A Content Analysis of Twelve Newspapers in the 2011 Irish General Election
McMenamin, I., Flynn, R., O’Malley, E., & Rafter, K. (2012) · The International Journal of Press/Politics · doi:10.1177/1940161212468031 · Cited by 37
Mapping EU agencies as political entrepreneurs
Wood, M. (2017) · European Journal of Political Research · doi:10.1111/1475-6765.12232 · Cited by 37
Foraging dynamics are associated with social status and context in mouse social hierarchies
Lee, W., Yang, E., & Curley, J. P. (2018) · PeerJ · doi:10.7717/peerj.5617 · Cited by 38
Healthy Leadership and Workplace Health Promotion as a Pre-Requisite for Organizational Health
Koinig, I., & Diehl, S. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18179260 · Cited by 42
A qualitative approach to the evaluation of psychosocial interventions for persons with severe mental illness.
Hasson‐Ohayon, I., Roe, D., & Kravetz, S. (2006) · Psychological Services · doi:10.1037/1541-1559.3.4.262 · Cited by 39
Framing Serbia: the effects of news framing on public support for EU enlargement
Lecheler, S. K., & de Vreese, C. H. (2010) · European Political Science Review · doi:10.1017/s1755773909990233 · Cited by 37
Quantitative discursive institutionalism: a comparison of labour market policy discourse across Western Europe
Wueest, B., & Fossati, F. (2014) · Journal of European Public Policy · doi:10.1080/13501763.2014.976834 · Cited by 36
Obstruction, delay, and transnationalism: Examining the online climate change counter-movement.
McKie, R. (2021) · Energy Research & Social Science · doi:10.1016/j.erss.2021.102217 · Cited by 31
Mathematical Modelling Abilities of Artificial Intelligence Tools: The Case of ChatGPT
Spreitzer, C., Straser, O., Zehetmeier, S., & Maaß, K. (2024) · Education Sciences · doi:10.3390/educsci14070698 · Cited by 50
Gender, Race, and Risk: Intersectional Risk Management in the Sale of Sex Online
Moorman, J. D., & Harrison, K. (2015) · The Journal of Sex Research · doi:10.1080/00224499.2015.1065950 · Cited by 42
Unusual location and unexpected execution in advertising: A content analysis and test of effectiveness in ambient advertisements
Hutter, K. (2014) · Journal of Marketing Communications · doi:10.1080/13527266.2014.970823 · Cited by 36
Assessing the Reporting of Reliability in Published Content Analyses: 1985–2010
Lovejoy, J., Watson, B. R., Lacy, S. R., & Riffe, D. (2014) · Communication Methods and Measures · doi:10.1080/19312458.2014.937528 · Cited by 43
The Role of Beliefs and Motivation in Asynchronous Online Learning in College-Level Classes
Xie, K., & Huang, S.-K. (2014) · Journal of Educational Computing Research · doi:10.2190/ec.50.3.b · Cited by 35
The impact of anonymity and issue controversiality on the quality of online discussion
Berg, J. (2016) · Journal of Information Technology & Politics · doi:10.1080/19331681.2015.1131654 · Cited by 37
Smoking Selfies: Using Instagram to Explore Young Women’s Smoking Behaviors
Cortese, D. K., Szczypka, G., Emery, S., Wang, S., Hair, E. C., & Vallone, D. (2018) · Social Media + Society · doi:10.1177/2056305118790762 · Cited by 36
Evaluating marketer generated content popularity on brand fan pages – A multilevel modelling approach
Chandrasekaran, S., Annamalai, B., & De, S. K. (2019) · Telematics and Informatics · doi:10.1016/j.tele.2019.101266 · Cited by 35
Digital Diplomacy via Social Networks: A Cross-National Analysis of Governmental Usage of Facebook and Twitter for Digital Engagement
Ittefaq, M. (2019) · DOAJ (DOAJ: Directory of Open Access Journals) · doi:10.17477/jcea.2019.18.1.049 · Cited by 36
Online decision aids: the role of decision-making styles and decision-making stages
Virdi, P., Kalro, A. D., & Sharma, D. (2020) · International Journal of Retail & Distribution Management · doi:10.1108/ijrdm-02-2019-0068 · Cited by 37
Which Factors Promote and Inhibit the Technology Acceptance of Immersive Virtual Reality Technology in Teaching-Learning Contexts? Results of an Expert Survey
Pletz, C. (2021) · International Journal of Emerging Technologies in Learning (iJET) · doi:10.3991/ijet.v16i13.20521 · Cited by 40
Managing the online customer experience and subsequent consumer responses across the customer journey: A review and future research agenda
Koronaki, E., Vlachvei, A., & Panopoulos, A. (2023) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2023.101242 · Cited by 44
Peer Portal: Quality enhancement in thesis writing using self-managed peer review on a mass scale
Aghaee, N., & Hansson, H. (2013) · The International Review of Research in Open and Distributed Learning · doi:10.19173/irrodl.v14i1.1394 · Cited by 36
Twitter: a content analysis of personal information
Humphreys, L., Gill, P., & Krishnamurthy, B. (2013) · Information Communication & Society · doi:10.1080/1369118x.2013.848917 · Cited by 36
Looking for New Forms of Legitimacy in Asia
Castelló, I., & Galang, R. M. N. (2012) · Business & Society · doi:10.1177/0007650312469864 · Cited by 39
Sexual Fantasies and Gender/Sex: A Multimethod Approach with Quantitative Content Analysis and Hormonal Responses
Goldey, K. L., Avery, L. R., & van Anders, S. M. (2013) · The Journal of Sex Research · doi:10.1080/00224499.2013.798611 · Cited by 36
Media and social amplification of risk: BSE and H1N1 cases in South Korea
Chung, J., & Yun, G. W. (2013) · Disaster Prevention and Management An International Journal · doi:10.1108/09653561311325299 · Cited by 36
RETRACTED: Online Consumer Complaints About Southeast Asian Luxury Hotels
Memarzadeh, F., & Chang, H. J. (2014) · Journal of Hospitality Marketing & Management · doi:10.1080/19368623.2014.893222 · Cited by 36
Retracted
Making Sense of Misfortune
Hunzaker, M. B. F. (2014) · Social Psychology Quarterly · doi:10.1177/0190272514521219 · Cited by 37
INTERRATER RELIABILITY IN SECOND LANGUAGE META-ANALYSES
Norouzian, R. (2021) · Studies in Second Language Acquisition · doi:10.1017/s0272263121000061 · Cited by 35
Innovation in youth mental health services in A ustralia: common characteristics across the first headspace centres
Rickwood, D., Dyke, N. V., & Telford, N. R. (2013) · Early Intervention in Psychiatry · doi:10.1111/eip.12071 · Cited by 35
Textual Cues in Direct-to-Consumer Prescription Drug Advertising: Motivators to Communicate with Physicians
Young, H. N., & Cline, R. J. W. (2005) · Journal of Applied Communication Research · doi:10.1080/00909880500278012 · Cited by 35
Preconsent education about research processes improved African Americans’ willingness to participate in clinical research
Dunlop, A. L., Leroy, Z. C., Logue, K. M., Glanz, K., & Dunlop, B. W. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.11.008 · Cited by 35
Exploring fishing dependence in gulf coast communities
Jacob, S., Weeks, P., Blount, B., & Jepson, M. (2010) · Marine Policy · doi:10.1016/j.marpol.2010.06.003 · Cited by 35
Basic Content Analysis
Drisko, J. W., & Maschi, T. M. (2015) · doi:10.1093/acprof:oso/9780190215491.003.0002 · Cited by 35
Indicators of Informal and Formal Decision-making about a Socioscientific Issue
Dauer, J. M., Lute, M. L., & Straka, O. (2016) · International Journal of Education in Mathematics Science and Technology · doi:10.18404/ijemst.05787 · Cited by 35
Conceptual Advances in Consumers’ Semantic and Episodic Brand Memories: A Mixed Methods Exploration
Herz, M. F., & Brunk, K. H. (2016) · Psychology and Marketing · doi:10.1002/mar.20974 · Cited by 35
Gender Representation on Gender-Targeted Television Channels: A Comparison of Female- and Male-Targeted TV Channels in the Netherlands
Daalmans, S., Kleemans, M., & Sadza, A. J. C. (2017) · Sex Roles · doi:10.1007/s11199-016-0727-6 · Cited by 35
Echo chambers and social mediators in public advocacy issue networks
Tsai, W. S., Tao, W., Chuan, C., & Hong, C. (2020) · Public Relations Review · doi:10.1016/j.pubrev.2020.101882 · Cited by 36
An analysis of thematic structure of research trends in occupational health and safety concerning safety culture and environmental management
Sharma, R. S., & Mishra, D. K. (2020) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2020.125346 · Cited by 35
A Systematic Review of the Effect of Gamification on Adherence Across Disciplines
Croon, R. D., Geuens, J., Verbert, K., & Abeele, V. V. (2021) · Lecture notes in computer science · doi:10.1007/978-3-030-77277-2_14 · Cited by 38
Collaborative and Transformational Leadership in the Environmental Realm
Ardoin, N., Gould, R. K., Kelsey, E., & Fielding-Singh, P. (2015) · Journal of Environmental Policy & Planning · doi:10.1080/1523908x.2014.954075 · Cited by 32
Media coverage and government policy of nuclear power in the People's Republic of China
Wang, Y., Li, N., & Li, J. (2014) · Progress in Nuclear Energy · doi:10.1016/j.pnucene.2014.07.007 · Cited by 36
A 15-Year Review of ABC, CBS, and NBC News Coverage of Organ Donation: Implications for Organ Donation Campaigns
Quick, B. L., Kim, D. K., & Meyer, K. R. (2009) · Health Communication · doi:10.1080/10410230802676516 · Cited by 35
What Do Social Media Say About Makeovers? A Content Analysis of Cosmetic Surgery Videos and Viewers’ Responses on YouTube
Wen, N., Chia, S. C., & Xiaoming, H. (2014) · Health Communication · doi:10.1080/10410236.2014.913220 · Cited by 35
Adolescent motivation to attend youth programs: A mixed-methods investigation
Akiva, T., & Horner, C. G. (2016) · Applied Developmental Science · doi:10.1080/10888691.2015.1127162 · Cited by 35
Knowledge spillovers between R&D-driven incumbents and start-ups in open innovation: a systematic review and nomological network
Jha, S., & Basu, S. (2024) · Journal of Knowledge Management · doi:10.1108/jkm-05-2024-0563 · Cited by 34
Central Role of Relatedness in Alaska Native Youth Resilience: Preliminary Themes from One Site of the Circumpolar Indigenous Pathways to Adulthood (CIPA) Study
Wexler, L. M., Moses, J., Hopper, K. J., Joule, L., & Garoutte, J. (2013) · American Journal of Community Psychology · doi:10.1007/s10464-013-9605-3 · Cited by 34
Searching for Answers--Knowledge Exchange through Social Media in Organizations
Seebach, C. (2012) · Hawaii International Conference on System Sciences (HICSS) · doi:10.1109/hicss.2012.514 · Cited by 34
Can I get pregnant from oral sex? Sexual health misconceptions in e-mails to a reproductive health website
Wynn, L. L., Foster, A. M., & Trussell, J. (2008) · Contraception · doi:10.1016/j.contraception.2008.08.009 · Cited by 31
Advancing perspectives of sustainability and large-scale implementation of design teams in Ghana's polytechnics: Issues and opportunities
Bakah, M. A. B., Voogt, J. M., & Pieters, J. M. (2011) · International Journal of Educational Development · doi:10.1016/j.ijedudev.2011.11.002 · Cited by 34
Using video-stimulated recall to investigate teacher awareness of explicit and implicit gendered thoughts on classroom interactions
Consuegra, E., Engels, N., & Willegems, V. (2016) · Teachers and Teaching · doi:10.1080/13540602.2016.1158958 · Cited by 34
The Quality of Representative Claims: Uncovering a Weakness in the Defense of the Liberal World Order
de Wilde, P. (2019) · Political Studies · doi:10.1177/0032321719845199 · Cited by 40
What Makes a Competent International Project Manager in Emerging and Developing Countries?
Li, Y., Sun, T., Shou, Y., & Sun, H. F. (2020) · Project Management Journal · doi:10.1177/8756972820901387 · Cited by 38
Meta-analysis of controlled trials testing horticultural therapy for the improvement of cognitive function
Tu, H., & Chiu, P.-Y. (2020) · Scientific Reports · doi:10.1038/s41598-020-71621-7 · Cited by 34
A Robot That Encourages Self-Disclosure to Reduce Anger Mood
Akiyoshi, T., Nakanishi, J., Ishiguro, H., Sumioka, H., & Shiomi, M. (2021) · IEEE Robotics and Automation Letters · doi:10.1109/lra.2021.3102326 · Cited by 36
Encouraging Greater Student Inquiry Engagement in Science Through Motivational Support by Online Scientist‐Mentors
Scogin, S. C., & Stuessy, C. L. (2015) · Science Education · doi:10.1002/sce.21145 · Cited by 40
Fundamental Psychometric Considerations in Assessment
Wasserman, J. D., & Bracken, B. A. (2012) · Wiley eBooks · doi:10.1002/9781118133880.hop210003 · Cited by 35
Augmenting the effect of virtual labs with "teacher demonstration" and "student critique" instructional designs to scaffold the development of scientific literacy
Liu, C., Wen, C., Chang, H., Chang, M.-H., Lai, P.-H., Chiang, S. F., Yang, C., & Hwang, F.-K. (2022) · Instructional Science · doi:10.1007/s11251-021-09571-4 · Cited by 33
Document Analysis
Kutsyuruba, B. (2023) · Springer texts in education · doi:10.1007/978-3-031-04394-9_23 · Cited by 65

Authors: Lombard, M., Snyder-Duch, J., & Bracken, C. C.
Affiliations: Temple University (US)
Cleveland State University (US)
Venue: Human Communication Research
Publisher: Oxford University Press (OUP)
Published: 2002-10
Volume: 28
Issue: 4
Pages: 587-604
ISSN: 0360-3989 (ISSN-L)
1468-2958
DOI: 10.1111/j.1468-2958.2002.tb00826.x
OpenAlex: W2160375265
Cited by: 3,068
References: 42
Citations by year: 2026: 234 · 2025: 173 · 2024: 136 · 2023: 143 · 2022: 212 · 2021: 238 · 2020: 206 · 2019: 206 · 2018: 174 · 2017: 168 · 2016: 174 · 2015: 153 · 2014: 168 · 2013: 158 · 2012: 117
FWCI: 19.75
Type: journal article
Language: en
Open access: closed
Licence: doi.wiley.com/10.1002/tdm_license_1.1 (tdm, 4718 d)
Locations: Human Communication Research (publishedVersion)
EngagedScholarship @ Cleveland State University (Cleveland State University) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
Social Sciences › Communication › News Media Framing and Political Communication
Social Sciences › General Social Sciences › Computational and Text Analysis Methods
Keywords: intercoder reliability, inter-coder agreement, content analysis, mass communication research, reporting practices, percent agreement, reliability index, coding procedures, research guidelines

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Content Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks