The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Reliability in content analysis: some common misconceptions and recommendations.
Open accessAbstract
In a recent article published in this journal, Lombard, Snyder-Duch, and Bracken (2002) surveyed 200 content analyses for their reporting of reliability tests; compared the virtues and drawbacks of five popular reliability measures; and proposed guidelines and standards for their use. Their discussion revealed that numerous misconceptions circulate in the content analysis literature regarding how these measures behave and can aid or deceive content analysts in their effort to ensure the reliability of their data. This paper proposes three conditions for statistical measures to serve as indices of the reliability of data and examines the mathematical structure and the behavior of the five coefficients discussed by the authors, plus two others. It compares common beliefs about these coefficients with what they actually do and concludes with alternative recommendations for testing reliability in content analysis and similar data-making efforts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“For the 6 moderator variables, Krippendorff’s alpha ranged from 0.81 to 0.99, and therefore above the acceptable level (Krippendorff, 2004).”
From The Power of Feedback Revisited: A Meta-Analysis of Educational Feedback Research (2020) · cites this paper as Krippendorff, 2004
The cited source says what the claim attributes to it.
In the citing paper
“Krippendorff's (2004) criterion of significance is therefore satisfied here too.”
From Weighted Krippendorff's alpha is a more reliable metrics for multi-coders ordinal annotations: experimental studies on emotion, opinion and coreference annotation (2014) · cites this paper as Krippendorff's (2004)
The cited source says what the claim attributes to it.
In the citing paper
“Krippendorff's α α α α (Krippendorff, 2004) considers chance independently from coders like Scott's π, but data reliability is estimated depending on disagreement instead of agreement:”
From Weighted Krippendorff's alpha is a more reliable metrics for multi-coders ordinal annotations: experimental studies on emotion, opinion and coreference annotation (2014) · cites this paper as Krippendorff, 2004
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The criterion of data significance -at least five chance agreements per category -proposed by (Krippendorff, 2004) is greatly satisfied for the valence annotation (3 categories).”
From Weighted Krippendorff's alpha is a more reliable metrics for multi-coders ordinal annotations: experimental studies on emotion, opinion and coreference annotation (2014) · cites this paper as Krippendorff, 2004
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 13
- Bennett, E. M., Alpert, R., & Goldstein, A. C. (1954). Communications through limited response questioning. Public Opinion Quarterly, 18, 303-308.
- Craig, R. T. (1981). Generalization of Scott"s index of intercoder agreement. Public Opinion Quarterly, 45, 260-264.
- Goodman, L. A, & Kruskal, W. H. (1954). Measures of association for cross classifications. Journal of the American Statistical Association, 49, 732-764.
- Holsti, O. R. (1969). Content analysis for the social sciences and humanities. Reading, MA: Addison- Wesley.
- Hughes, M. A., & Garrett, D. E. (1990). Intercoder reliability estimation -Approaches in marketing: A generalizability theory framework for quantitative data. Journal of Marketing Research, 27, 185- 195.
- Krippendorff, K. (1970). Bivariate agreement coefficients for reliability data. In E. R. Borgatta & G. W. Bohrnstedt (Eds.), Sociological methodology 1970 (pp. 139-150). San Francisco, CA: Jossey Bass.
- Krippendorff, K. (2004). Content analysis: An introduction to its methodology. Second Edition. Thousand Oaks, CA: Sage.
- Maxwell, A. E. (1970). Comparing the classification of subjects by two independent judges. British Journal of Psychiatry, 116, 651-655.
- Osgood, C. E. (1959). The representational model and relevant research. In I. de Sola Pool (Ed.), Trends in content analysis (pp. 33-88). Urbana: University of Illinois Press.
- Potter, W. J., & Levine-Donnerstein, D. (1999). Rethinking validity and reliability in content analysis. Journal of Applied Communication Research, 27, 258-284.
- Riffe, D., & Freitag, A. (1996, August). Twenty-five years of content analyses in Journalism & Mass Communication Quarterly. Paper presented to the annual convention of the Association for Education in Journalism and Mass Communication, Anaheim, CA, cited in D. Riffe, S. Lacy, & F. G. Fico (1998). Analyzing media messages. Mahwah, NJ: Erlbaum.
- Scott, W. A. (1955). Reliability of content analysis: The case of nominal scale coding. Public Opinion Quarterly, 19, 321-325.
- Zwick, R. (1988). Another look at interrater agreement. Psychological Bulletin, 103, 347-387.
Cited by
Sorted by citations
Items 801–900 of 1,010
Frisby, C. M. (2017) · Advances in Journalism and Communication · doi:10.4236/ajc.2017.52010 · Cited by 23
Analysis of content strategies of selected brand tweets and its influence on information diffusion
Sridevi, P., Niduthavolu, S., & Vedanthachari, L. N. (2020) · Journal of Advances in Management Research · doi:10.1108/jamr-06-2020-0107 · Cited by 23
Whose rationality? Muddling through the messy emotional reality of financial decision-making
Dibb, S., Merendino, A., Aslam, H., Appleyard, L., & Brambley, W. (2020) · Journal of Business Research · doi:10.1016/j.jbusres.2020.10.041 · Cited by 30
Solid waste indicators in local sustainability assessment: a literature review
Cetrulo, N. M., Cetrulo, T. B., DIAS, S. L. F. G., & Ramos, T. B. (2020) · Ambiente & sociedade · doi:10.1590/1809-4422asoc20190028r3vu2020l5ao · Cited by 23
Findings of the WOAH 5 Shared Task on Fine Grained Hateful Memes Detection
Mathias, L., Nie, S., Davani, A. M., Kiela, D., Prabhakaran, V., Vidgen, B., & Talat, Z. (2021) · Workshop on Online Abuse and Harms (WOAH) · doi:10.18653/v1/2021.woah-1.21 · Cited by 27
Intellectual capital disclosure on Twitter – empirical evidence from the world’s largest companies
Bryl, Ł., Fijałkowska, J., & Hadro, D. (2021) · Meditari Accountancy Research · doi:10.1108/medar-02-2021-1211 · Cited by 23
Wamba, S. F., Akter, S., & Guthrie, C. H. (2020) · Systèmes d information & management · doi:10.3917/sim.202.0007 · Cited by 23
NEREL-BIO: a dataset of biomedical abstracts annotated with nested named entities
Loukachevitch, N., Manandhar, S., Baral, E., Рожков, І. М., Braslavski, P., Ivanov, V. V., Batura, T. V., & Tutubalina, E. V. (2023) · Bioinformatics · doi:10.1093/bioinformatics/btad161 · Cited by 26
When guilt works: a comprehensive meta-analysis of guilt appeals
Peng, W., Huang, Q. E., Mao, B., Lun, D., Malova, E., Simmons, J. V., & Carcioppolo, N. (2023) · Frontiers in Psychology · doi:10.3389/fpsyg.2023.1201631 · Cited by 23
Sharma, H., Srivastava, P. R., Jasimuddin, S. M., Zhang, Z., & Jebabli, I. (2023) · Tourism Review · doi:10.1108/tr-10-2022-0517 · Cited by 24
Mills, M. T. (2015) · Language Speech and Hearing Services in Schools · doi:10.1044/2015_lshss-14-0070 · Cited by 23
Reporting suicide: Interpreting media guidelines
Machlin, A., Skehan, J., Sweet, M. A., Wake, A. N., Fletcher, J. R., Spittal, M. J., & Pirkis, J. (2012) · RMIT Research Repository (RMIT University Library) · Cited by 23
Pedagogical content knowledge for computer science in German teacher education curricula
Hubwieser, P., Berges, M., Magenheim, J., Schaper, N., Bröker, K., Margaritis, M., Schubert, S. E., & Ohrndorf, L. (2013) · WiPSE '13 · doi:10.1145/2532748.2532753 · Cited by 25
Kaye, S., & Osteen, P. J. (2011) · Children and Youth Services Review · doi:10.1016/j.childyouth.2011.06.020 · Cited by 23
Willey, I., & Tanimoto, K. (2014) · Journal of Second Language Writing · doi:10.1016/j.jslw.2014.09.010 · Cited by 23
Ruiz, E. M., Pitarque, S., Fondevila-McDonald, Y., & Martín-Bustamante, M. (2015) · Safety Science · doi:10.1016/j.ssci.2015.05.005 · Cited by 23
An Empirical Investigation of Corporate Identity Communication on Hong Kong Hotels’ Websites
Mohammed, I., Guillet, B. D., Schuckert, M. R., & Law, R. (2015) · Journal of Hospitality Marketing & Management · doi:10.1080/19368623.2016.1096875 · Cited by 23
Engaging students in school participatory practice through Facebook: The story of a failure
Manca, S., & Grion, V. (2016) · British Journal of Educational Technology · doi:10.1111/bjet.12527 · Cited by 23
#WhoAmI in 160 Characters? Classifying Social Identities Based on Twitter Profile Descriptions
Priante, A., Hiemstra, D., Broek, T. A. V. D., Saeed, A., Ehrenhard, M., & Need, A. (2016) · Workshop on Natural Language Processing and Computational Social Science (NLP+CSS) · doi:10.18653/v1/w16-5608 · Cited by 23
Observer error and its impact on ancestry estimation using dental morphology
Pilloud, M. A., Adams, D. M., & Hefner, J. T. (2018) · International Journal of Legal Medicine · doi:10.1007/s00414-018-1985-3 · Cited by 25
Reisman, A., Brimsek, E., & Hollywood, C. (2019) · Cognition and Instruction · doi:10.1080/07370008.2019.1632861 · Cited by 23
Web-based impression management? Salient features for CSR disclosure prominence
Chong, S., & Rahman, A. R. (2019) · Sustainability Accounting Management and Policy Journal · doi:10.1108/sampj-08-2018-0221 · Cited by 23
The Architecture of Paradiplomacy Regime in Indonesia: A Content Analysis
Surwandono, S., & Maksum, A. (2020) · Global Jurnal Politik Internasional · doi:10.7454/global.v22i1.443 · Cited by 23
How can researchers track tourists? A bibliometric content analysis of tourist tracking techniques
Padrón‐Ávila, H., & Martín, R. H. (2020) · European Journal of Tourism Research · doi:10.54055/ejtr.v26i.1932 · Cited by 23
Egypt’s image as a tourist destination: an exploratory analysis of DMO’s social media platforms
Marzouk, A. M. (2021) · Leisure/Loisir · doi:10.1080/14927713.2021.1971554 · Cited by 23
Goyanes, M., Lopezosa, C., & Piñeiro-Naval, V. (2025) · Scientometrics · doi:10.1007/s11192-025-05377-0 · Cited by 22
Balancing social and political strategies in emerging markets: Evidence from India
Rao‐Nicholson, R., Khan, Z., & Marinova, S. T. (2018) · Business Ethics A European Review · doi:10.1111/beer.12206 · Cited by 22
Robeers, T., & den Bulck, H. V. (2018) · Athens Journal of Sports · doi:10.30958/ajspo.5-4-7 · Cited by 22
Berland, A., Roman, L. A., & Vogt, J. (2019) · Forests · doi:10.3390/f10040349 · Cited by 22
Providing a greater precision of Situational Awareness of urban floods through Multimodal Fusion
da Costa, T. A. G., Meneguette, R. I., & Ueyama, J. (2021) · Expert Systems with Applications · doi:10.1016/j.eswa.2021.115923 · Cited by 22
Anton, E., Oesterreich, T. D., & Teuteberg, F. (2022) · Information & Management · doi:10.1016/j.im.2022.103619 · Cited by 27
Not all bad news is harmful to a good reputation: evidence from the most visible companies in the US
Cho, C. H., Fabrizi, M., Pilonato, S., & Ricceri, F. (2022) · Journal of Management & Governance · doi:10.1007/s10997-022-09645-6 · Cited by 22
Gambarelli, G., Aldo Gangemi, A., & Tripodi, R. (2023) · IEEE Access · doi:10.1109/access.2023.3240089 · Cited by 24
Stage-Gate Hybridization Beyond Agile: Conceptual Review, Synthesis, and Research Agenda
Cocchi, N., Dosi, C., & Vignoli, M. (2023) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2023.3282269 · Cited by 22
Evaluating Urban Heat Mitigation across Networks of Plans
Keith, L., Meerow, S., Jensen, L., Trego, S., Schmidt, E. L., & Berke, P. R. (2023) · Journal of Planning Education and Research · doi:10.1177/0739456x231215780 · Cited by 22
A Content Analysis of Reliability in Advertising Content Analysis Studies.
Wang, W. (2011) · Digital Commons - East Tennessee State University (East Tennessee State University) · Cited by 22
Psychotherapists’ Stereotypes of Heterosexual, Gay, and Bisexual Men
Mohr, J. J., Chopp, R. M., & Wong, S. J. (2013) · Sexual and Gender Diversity in Social Services · doi:10.1080/10538720.2013.751885 · Cited by 24
Partnering for Success and Sustainability in Community-Based Child Obesity Intervention
Grow, H. M., Hencz, P., Verbovski, M. J., Gregerson, L., Liu, L. L., Dossett, L., Larison, C. L., & Saelens, B. E. (2014) · Family & Community Health · doi:10.1097/fch.0000000000000010 · Cited by 22
Welle, I., Berclaz, M., Lacasa, M., & Niveau, G. (2016) · Journal of Forensic and Legal Medicine · doi:10.1016/j.jflm.2016.08.001 · Cited by 22
Parikh, A. A., Behnke, C., Almanza, B., Nelson, D., & Vorvoreanu, M. (2016) · Journal of Foodservice Business Research · doi:10.1080/15378020.2016.1219170 · Cited by 22
Correcting Measurement Error in Content Analysis
Bachl, M., & Scharkow, M. (2017) · Communication Methods and Measures · doi:10.1080/19312458.2017.1305103 · Cited by 22
Grisot, C. (2017) · Journal of Pragmatics · doi:10.1016/j.pragma.2017.06.020 · Cited by 23
Assessing sustainability curriculum: from transmissive to transformative approaches
Gaard, G., Blades, J. J., & Wright, M. (2017) · International Journal of Sustainability in Higher Education · doi:10.1108/ijshe-11-2015-0186 · Cited by 22
Frisby, C. M., & Behm‐Morawitz, E. (2019) · Media Watch · doi:10.15655/mw/2019/v10i1/49562 · Cited by 22
Gruzd, A. A., Kumar, P., Abul‐Fottouh, D., & Haythornthwaite, C. (2020) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-020-09376-y · Cited by 22
Valle, M. E. D., Sijtsma, R., Stegeman, H. M., & Borge, R. (2020) · Javnost - The Public · doi:10.1080/13183222.2020.1794408 · Cited by 28
News Media Framing of Grassroots Innovations in Denmark, the Netherlands and Sweden
Magnusson, D., Sperling, K., Veenman, S. A., & Oteman, M. (2021) · Environmental Communication · doi:10.1080/17524032.2021.1880460 · Cited by 22
Important non-academic attributes in Australian initial teacher education
Sheridan, L., Coleman, B., & Durksen, T. L. (2021) · The Australian Educational Researcher · doi:10.1007/s13384-021-00443-x · Cited by 26
The ‘3CE2CE’ Framework—Change Management Towards a Circular Economy: Opportunities for Agribusiness
Yang, N.-H. N., Bertassini, A. C., Mendes, J. A. J., & Gerólamo, M. C. (2021) · Circular Economy and Sustainability · doi:10.1007/s43615-021-00057-6 · Cited by 25
Flocke, S. A., Step, M. M., Antognoli, E., Lawson, P. J., Smith, S., Jackson, B., Krejci, S. A., Parran, T. V., & Marsh, S. (2014) · Preventive Medicine · doi:10.1016/j.ypmed.2014.10.020 · Cited by 22
Zarkada, A. K., & Polydorou, C. (2013) · Emerald Group Publishing Limited eBooks · doi:10.1108/s1877-6361(2013)0000011009 · Cited by 22
Peleg, R., & Baram‐Tsabari, A. (2017) · Journal of Science Education and Technology · doi:10.1007/s10956-017-9698-9 · Cited by 22
Examining the legitimacy of Sukuk structure via Shariah pronouncements
Ahmed, E. R., Islam, M. A., & Amran, A. (2019) · Journal of Islamic marketing · doi:10.1108/jima-03-2018-0050 · Cited by 22
Tong, F., Tang, S., Irby, B. J., Lara‐Alecio, R., & Guerrero, C. L. (2019) · International Journal of Educational Research · doi:10.1016/j.ijer.2019.101514 · Cited by 22
Creativity in the West and the East: A Meta-Analysis of Cross-Cultural Differences
Barth, P., & Stadtmann, G. (2024) · Creativity Research Journal · doi:10.1080/10400419.2024.2369442 · Cited by 25
Human-Machine Engagement (HME): Conceptualization, Typology of Forms, Antecedents, and Consequences
Azer, J., & Alexander, M. (2024) · Journal of Service Research · doi:10.1177/10946705241296782 · Cited by 25
Informal teacher leadership: lessons from shepherd leadership
Dami, Z. A. (2021) · International Journal of Leadership in Education · doi:10.1080/13603124.2021.1884749 · Cited by 21
The importance of fit: a predictive model of cause marketing effects
Rego, M. M., & Hamilton, M. A. (2021) · The Journal of Marketing Theory and Practice · doi:10.1080/10696679.2021.1901594 · Cited by 21
Braylan, A., Alonso, O., & Lease, M. (2022) · International World Wide Web Conference (WWW) · doi:10.1145/3485447.3512242 · Cited by 21
Use of test doubles in Android testing
Fazzini, M., Choi, C., Copia, J. M., Lee, G., Kakehi, Y., Gorla, A., & Orso, A. (2022) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3510003.3510175 · Cited by 21
What Can the Realization Tree Assessment Tool Reveal About Explorative Classroom Discussions?
Weingarden, M., & Heyd-Metzuyanim, E. (2023) · Journal for Research in Mathematics Education · doi:10.5951/jresematheduc-2020-0084 · Cited by 18
How not who: Message strategies adopted by celebrities v/s social media influencers
Sharma, D. (2023) · Journal of Marketing Communications · doi:10.1080/13527266.2023.2220326 · Cited by 21
Eriksson, A., Pettersson, R., & Wall-Reinius, S. (2023) · Scandinavian Journal of Hospitality and Tourism · doi:10.1080/15022250.2023.2231892 · Cited by 21
Sentiment Analysis for the Natural Environment: A Systematic Review
Ibrohim, M. O., Bosco, C., & Basile, V. (2023) · ACM Computing Surveys · doi:10.1145/3604605 · Cited by 24
Grizzard, M., Shaw, A. Z., Dolan, E. A., Anderson, K. B., Hahn, L., & Prabhu, S. (2016) · Media Psychology · doi:10.1080/15213269.2016.1227266 · Cited by 21
The Arts and Health Communication in Uganda: A Light Under the Table
Sonke, J. K., Pesata, V., Nakazibwe, V., Ssenyonjo, J., Lloyd, R., Espino, D. P., Nieves, M., Khandakji, S., Hahn, P., & Kerrigan, M. (2017) · Health Communication · doi:10.1080/10410236.2016.1266743 · Cited by 21
Challenges in the industrial implementation of generative design systems: An exploratory study
Nordin, A. (2017) · Artificial intelligence for engineering design analysis and manufacturing · doi:10.1017/s0890060416000536 · Cited by 21
The dark side of e-petitions? Exploring anonymous signatures
Berg, J. (2017) · First Monday · doi:10.5210/fm.v22i2.6001 · Cited by 21
de Bruyn, L. L. (2018) · Soil Use and Management · doi:10.1111/sum.12466 · Cited by 21
Zhuang, J., Hitt, R., Goldbort, J. G., Gonzalez, M., & Rodriguez, A. M. (2019) · Health Communication · doi:10.1080/10410236.2019.1584739 · Cited by 21
Engaging publics in the mobile era: A study of Chinese charitable foundations’ use of WeChat
Qu, Y. (2019) · Public Relations Review · doi:10.1016/j.pubrev.2019.101815 · Cited by 21
A Usability Evaluation of Let's Encrypt and Certbot
Tiefenau, C., von Zezschwitz, E., Häring, M., Krombholz, K., & Smith, M. (2019) · ACM SIGSAC Conference on Computer and Communications Security (CCS) · doi:10.1145/3319535.3363220 · Cited by 21
Rego, M. M., Hamilton, M. A., & Rogers, D. (2020) · Journal of Nonprofit & Public Sector Marketing · doi:10.1080/10495142.2020.1726253 · Cited by 21
DeCillia, B., & McCurdy, P. M. (2020) · Canadian Review of Sociology/Revue canadienne de sociologie · doi:10.1111/cars.12304 · Cited by 25
SuperMat: construction of a linked annotated dataset from superconductors-related publications
Foppiano, L., Dieb, S., Suzuki, A., de Castro, P. B., Iwasaki, S., Uzuki, A., Echevarría, M. G. E., Meng, Y., Terashima, K., Romary, L., et al. (2021) · Science and Technology of Advanced Materials Methods · doi:10.1080/27660400.2021.1918396 · Cited by 21
Pintak, L., Bowe, B. J., & Albright, J. (2021) · Journalism & Mass Communication Quarterly · doi:10.1177/10776990211031567 · Cited by 21
Bouabida, K., Malas, K., Talbot, A., Desrosiers, M.-È., Lavoie, F., Lebouché, B., Taghizadeh, N., Normandin, L., Vialaron, C., Fortin, O., et al. (2022) · Journal of Personalized Medicine · doi:10.3390/jpm12040529 · Cited by 21
Wagenlehner, F. M. E., Fröhlich, O., Bschleipfer, T., Weidner, W., & Perletti, G. (2013) · World Journal of Urology · doi:10.1007/s00345-013-1150-z · Cited by 21
Critical Theory as an Approach to the Ethics of Information Security
Stahl, B. C., Doherty, N. F., Shaw, M. C., & Janicke, H. (2013) · Science and Engineering Ethics · doi:10.1007/s11948-013-9496-6 · Cited by 33
McAndrews, C., Beyer, K. M. M., Guse, C. E., & Layde, P. M. (2016) · Accident Analysis & Prevention · doi:10.1016/j.aap.2016.09.008 · Cited by 21
Westerski, A. (2013) · doi:10.20868/upm.thesis.14622 · Cited by 21
Wirth, J., Weber-Reuter, X.-L., Schuster, C., Fleischer, J., Leutner, D., & Stebner, F. (2025) · Educational Psychology Review · doi:10.1007/s10648-024-09983-x · Cited by 23
Eicke, A., Sabel, C. A., & Nüesch, S. (2025) · Journal of Product Innovation Management · doi:10.1111/jpim.70001 · Cited by 21
Updating the School Counseling Research Agenda: A Delphi Study
Villares, E., & Dimmitt, C. (2017) · Counselor Education and Supervision · doi:10.1002/ceas.12071 · Cited by 20
Email Newsletters: An Analysis of Content From Nine Top News Organizations
Seely, N., & Spillman, M. (2021) · Electronic News · doi:10.1177/19312431211037681 · Cited by 20
Public opinion on megaprojects over time: findings from four megaprojects in the UK
Kundu, O., James, A. D., & Rigby, J. (2021) · Public Management Review · doi:10.1080/14719037.2021.2003107 · Cited by 20
ContrXT: Generating contrastive explanations from any text classifier
Malandri, L., Mercorio, F., Mezzanzanica, M., Nobani, N., & Seveso, A. (2021) · Information Fusion · doi:10.1016/j.inffus.2021.11.016 · Cited by 20
Marketing Management in the Hotel Industry: A Systematic Literature Review by Using Text Mining
Horng, J., Liu, C.-H. S., Chou, S.-F., Yu, T., & Hu, D.-C. (2022) · Sustainability · doi:10.3390/su14042344 · Cited by 23
Online and Offline Battles: Usage of Different Political Conflict Frames
van der Goot, E. S., Kruikemeier, S., de Ridder, J., & Vliegenthart, R. (2022) · The International Journal of Press/Politics · doi:10.1177/19401612221096633 · Cited by 20
Henn, R., Terzidis, O., Kuschel, K., Leiva, J. C., & Alsua, C. (2022) · Small Enterprise Research · doi:10.1080/13215906.2022.2134191 · Cited by 20
Minhas, S., & Salawu, A. (2024) · Journal of Asian and African Studies · doi:10.1177/00219096241243061 · Cited by 20
Hu, X., & Bi, H. (2024) · Thinking Skills and Creativity · doi:10.1016/j.tsc.2024.101695 · Cited by 22
Citizen participation and the uses of mobile technology in radio broadcasting
Rosales, R. G. (2012) · Telematics and Informatics · doi:10.1016/j.tele.2012.04.006 · Cited by 20
Carlo, J., & Yoo, Y. (2007) · Information and organization · doi:10.1016/j.infoandorg.2007.05.002 · Cited by 17
Construction and validation of the Dynamic Parkinson Gait Scale (DYPAGS)
Crémers, J., Ba, R. P., Delvaux, V., & Garraux, G. (2012) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2012.03.012 · Cited by 20
Visualizing intellectual capital using service-dominant logic
Davey, H., Alsemgeest, R., O’Reilly-Schwass, S., Davey, H., & FitzPatrick, M. (2017) · International Journal of Contemporary Hospitality Management · doi:10.1108/ijchm-12-2015-0733 · Cited by 20
Reliability and Perceived Value of Sentiment Analysis for Twitter Data
Jussila, J., Vuori, V., Okkonen, J., & Helander, N. (2017) · Springer proceedings in business and economics · doi:10.1007/978-3-319-56288-9_7 · Cited by 20
Developing Serious Games with Integrated Debriefing
Grund, C. K., & Schelkle, M. (2019) · Business & Information Systems Engineering · doi:10.1007/s12599-019-00579-2 · Cited by 20
Celebrity Cancer on Twitter: Mapping a Novel Opportunity for Cancer Prevention
Vos, S. C., Sutton, J. N., Gibson, C. B., & Butts, C. T. (2019) · Cancer Control · doi:10.1177/1073274819825826 · Cited by 20
Metadata
- Authors
- Krippendorff, K.
- Corresponding author
- Krippendorff, K.
- ORCID
- Krippendorff, K.
- Venue
- Human Communication Research
- Publisher
- Oxford University Press (OUP)
- Published
- 2004-07-01
- Volume
- 30
- Issue
- 3
- Pages
- 411-433
- ISSN
- 0360-3989 (ISSN-L)
- 1468-2958
- OpenAlex
- W4243989635
- Cited by
- 1,027
- References
- 0
- Citations by year
- 2026: 42 · 2025: 100 · 2024: 108 · 2023: 108 · 2022: 124 · 2021: 135 · 2020: 105 · 2019: 57 · 2018: 44 · 2017: 29 · 2016: 41 · 2015: 25 · 2014: 26 · 2013: 21 · 2012: 15
- FWCI
- 5.93
- Type
- journal article
- Language
- en
- Open access
- green
- repository.upenn.edu
- Locations
- Human Communication Research (publishedVersion)
- ScholarlyCommons (University of Pennsylvania) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- inter-rater reliability, reliability coefficients, interobserver agreement, reporting reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
