The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Reliability in content analysis: some common misconceptions and recommendations.
Open accessAbstract
In a recent article published in this journal, Lombard, Snyder-Duch, and Bracken (2002) surveyed 200 content analyses for their reporting of reliability tests; compared the virtues and drawbacks of five popular reliability measures; and proposed guidelines and standards for their use. Their discussion revealed that numerous misconceptions circulate in the content analysis literature regarding how these measures behave and can aid or deceive content analysts in their effort to ensure the reliability of their data. This paper proposes three conditions for statistical measures to serve as indices of the reliability of data and examines the mathematical structure and the behavior of the five coefficients discussed by the authors, plus two others. It compares common beliefs about these coefficients with what they actually do and concludes with alternative recommendations for testing reliability in content analysis and similar data-making efforts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“For the 6 moderator variables, Krippendorff’s alpha ranged from 0.81 to 0.99, and therefore above the acceptable level (Krippendorff, 2004).”
From The Power of Feedback Revisited: A Meta-Analysis of Educational Feedback Research (2020) · cites this paper as Krippendorff, 2004
The cited source says what the claim attributes to it.
In the citing paper
“Krippendorff's (2004) criterion of significance is therefore satisfied here too.”
From Weighted Krippendorff's alpha is a more reliable metrics for multi-coders ordinal annotations: experimental studies on emotion, opinion and coreference annotation (2014) · cites this paper as Krippendorff's (2004)
The cited source says what the claim attributes to it.
In the citing paper
“Krippendorff's α α α α (Krippendorff, 2004) considers chance independently from coders like Scott's π, but data reliability is estimated depending on disagreement instead of agreement:”
From Weighted Krippendorff's alpha is a more reliable metrics for multi-coders ordinal annotations: experimental studies on emotion, opinion and coreference annotation (2014) · cites this paper as Krippendorff, 2004
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“The criterion of data significance -at least five chance agreements per category -proposed by (Krippendorff, 2004) is greatly satisfied for the valence annotation (3 categories).”
From Weighted Krippendorff's alpha is a more reliable metrics for multi-coders ordinal annotations: experimental studies on emotion, opinion and coreference annotation (2014) · cites this paper as Krippendorff, 2004
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Research works printed but not linked: 13
- Bennett, E. M., Alpert, R., & Goldstein, A. C. (1954). Communications through limited response questioning. Public Opinion Quarterly, 18, 303-308.
- Craig, R. T. (1981). Generalization of Scott"s index of intercoder agreement. Public Opinion Quarterly, 45, 260-264.
- Goodman, L. A, & Kruskal, W. H. (1954). Measures of association for cross classifications. Journal of the American Statistical Association, 49, 732-764.
- Holsti, O. R. (1969). Content analysis for the social sciences and humanities. Reading, MA: Addison- Wesley.
- Hughes, M. A., & Garrett, D. E. (1990). Intercoder reliability estimation -Approaches in marketing: A generalizability theory framework for quantitative data. Journal of Marketing Research, 27, 185- 195.
- Krippendorff, K. (1970). Bivariate agreement coefficients for reliability data. In E. R. Borgatta & G. W. Bohrnstedt (Eds.), Sociological methodology 1970 (pp. 139-150). San Francisco, CA: Jossey Bass.
- Krippendorff, K. (2004). Content analysis: An introduction to its methodology. Second Edition. Thousand Oaks, CA: Sage.
- Maxwell, A. E. (1970). Comparing the classification of subjects by two independent judges. British Journal of Psychiatry, 116, 651-655.
- Osgood, C. E. (1959). The representational model and relevant research. In I. de Sola Pool (Ed.), Trends in content analysis (pp. 33-88). Urbana: University of Illinois Press.
- Potter, W. J., & Levine-Donnerstein, D. (1999). Rethinking validity and reliability in content analysis. Journal of Applied Communication Research, 27, 258-284.
- Riffe, D., & Freitag, A. (1996, August). Twenty-five years of content analyses in Journalism & Mass Communication Quarterly. Paper presented to the annual convention of the Association for Education in Journalism and Mass Communication, Anaheim, CA, cited in D. Riffe, S. Lacy, & F. G. Fico (1998). Analyzing media messages. Mahwah, NJ: Erlbaum.
- Scott, W. A. (1955). Reliability of content analysis: The case of nominal scale coding. Public Opinion Quarterly, 19, 321-325.
- Zwick, R. (1988). Another look at interrater agreement. Psychological Bulletin, 103, 347-387.
Cited by
Sorted by citations
Items 401–500 of 1,010
The Role of Digital School-Home Communication in Teacher Well-Being
Kuusimäki, A.-M., Uusitalo‐Malmivaara, L., & Tirri, K. A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02257 · Cited by 50
Business and Human Rights Scholarship in Social Issues in Management: An Analytical Review
Schrempf‐Stirling, J., & Buren, H. J. V. (2019) · Business and Human Rights Journal · doi:10.1017/bhj.2019.23 · Cited by 50
Carle, M. S., & Flynn, A. B. (2020) · Chemistry Education Research and Practice · doi:10.1039/c9rp00203k · Cited by 50
Bonina, C., Berzosa, D. L., & Scarlata, M. (2020) · Information Systems Journal · doi:10.1111/isj.12290 · Cited by 57
Factors influencing corporate social responsibility disclosures in Nepalese banks
Bidari, G., & Djajadikerta, H. G. (2020) · Asian Journal of Accounting Research · doi:10.1108/ajar-03-2020-0013 · Cited by 50
Yousaf, S., Razzaq, A., & Fan, X. (2021) · Journal Of Vacation Marketing · doi:10.1177/1356766721993861 · Cited by 51
Rabbi, M. F., Oláh, J., Popp, J., Máté, D., & Kovács, S. (2021) · Foods · doi:10.3390/foods10123073 · Cited by 50
Donkor, A., Djajadikerta, H. G., Roni, S. M., & Trireksani, T. (2022) · Sustainability Accounting Management and Policy Journal · doi:10.1108/sampj-03-2021-0116 · Cited by 50
Media Frames for Black Bear Management Stories during Issue Emergence in New York
Siemer, W. F., Decker, D. J., & Shanahan, J. E. (2007) · Human Dimensions of Wildlife · doi:10.1080/10871200701195415 · Cited by 51
Wilson, R., Rochon, E. A., Mihailidis, A., & Léonard, C. (2013) · Journal of Communication Disorders · doi:10.1016/j.jcomdis.2013.01.004 · Cited by 53
Moon, A. C., Moeller, R., Gere, A. R., & Shultz, G. V. (2019) · Chemistry Education Research and Practice · doi:10.1039/c9rp00005d · Cited by 49
Disclosure of genetic information to family members: a systematic review of normative documents
Phillips, A., Borry, P., Hoyweghen, I. V., & Vears, D. F. (2021) · Genetics in Medicine · doi:10.1038/s41436-021-01248-0 · Cited by 49
Agency in Earth System Governance
Betsill, M. M., Benney, T. M., Gerlak, A. K., Brown, C., Chan, S., Enechi, O., Mitchell, R., Möller, I., Patterson, J., Scobie, M., et al. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108688277 · Cited by 52
Wu, Q., Sang, Y., Wang, D., & Lu, Z. (2022) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3577199 · Cited by 49
Eldesouky, A., & Díaz, F. J. M. (2014) · Spanish Journal of Agricultural Research · doi:10.5424/sjar/2014122-5520 · Cited by 50
Poldner, E., Simons, P. R. J., Wijngaards, G., & van der Schaaf, M. F. (2011) · Educational Research Review · doi:10.1016/j.edurev.2011.11.002 · Cited by 53
Wang, X., Laffey, J. M., Xing, W., Ma, Y., & Stichter, J. P. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.09.006 · Cited by 49
Exploring uncertainty perception as a driver of design activity
Cash, P. J., & Kreye, M. E. (2017) · Design Studies · doi:10.1016/j.destud.2017.10.004 · Cited by 49
Transfer Learning for Risk Classification of Social Media Posts: Model Evaluation Study
Howard, D., Maslej, M. M., Lee, J., Ritchie, J., Woollard, G., & French, L. (2020) · Journal of Medical Internet Research · doi:10.2196/15371 · Cited by 52
Violent Female Action Characters in Contemporary American Cinema
Gilpatric, K. (2010) · Sex Roles · doi:10.1007/s11199-010-9757-7 · Cited by 49
Probing the integration of land use and watershed planning in a shifting governance regime
Plummer, R., de Grosbois, D., de Loë, R., & Velaniškis, J. (2011) · Water Resources Research · doi:10.1029/2010wr010213 · Cited by 48
Problems in Evaluating Grammatical Error Detection Systems
Chodorow, M. S., Dickinson, M., Israel, R., & Tetreault, J. (2012) · Cited by 48
Chory, R. M., Horan, S. M., & Houser, M. L. (2017) · Innovative Higher Education · doi:10.1007/s10755-017-9388-9 · Cited by 48
Hovden, J. F., & Mjelde, H. L. (2019) · Javnost - The Public · doi:10.1080/13183222.2019.1589285 · Cited by 48
Cooperative and competitive behaviour among passengers during the costa concordia disaster
Bartolucci, A., Casareale, C., & Drury, J. (2020) · Safety Science · doi:10.1016/j.ssci.2020.105055 · Cited by 51
Mihailidis, P. (2015) · E-Learning and Digital Media · doi:10.1177/2042753016631868 · Cited by 47
Wang, Y., Zhang, W., & Zhou, R. (2022) · Applied Ergonomics · doi:10.1016/j.apergo.2022.103695 · Cited by 47
Pérez, J., Díaz, J., Berrocal, J., López-Viana, R., & González-Prieto, Á. (2022) · Computing · doi:10.1007/s00607-022-01104-2 · Cited by 47
Díaz, J., Pérez, J., Gallardo, C., & González-Prieto, Á. (2022) · Journal of Systems and Software · doi:10.1016/j.jss.2022.111520 · Cited by 47
The unbearable (technical) unreliability of automated facial emotion recognition
Cabitza, F., Campagner, A., & Mattioli, M. (2022) · Big Data & Society · doi:10.1177/20539517221129549 · Cited by 58
Inequalities Between Kappa and Kappa-Like Statistics for k × k Tables
Warrens, M. J. (2009) · Psychometrika · doi:10.1007/s11336-009-9138-8 · Cited by 47
Alexander, S. M., & Quinn, M. S. (2011) · Human Dimensions of Wildlife · doi:10.1080/10871209.2011.599050 · Cited by 47
How management innovations are successfully implemented? An organizational routines’ perspective
Lin, H., Chen, M., & Su, J. (2017) · Journal of Organizational Change Management · doi:10.1108/jocm-07-2016-0124 · Cited by 58
Barnes, M. E., & Brownell, S. E. (2017) · Science Education · doi:10.1002/sce.21317 · Cited by 47
PAGAN: Video Affect Annotation Made Easy
Melhárt, D., Liapis, A., & Yannakakis, G. N. (2019) · International Conference on Affective Computing and Intelligent Interaction and workshops · doi:10.1109/acii.2019.8925434 · Cited by 47
Dano, H., Altınay, S., Arnould, L., Blétard, N., Colpaert, C., Dedeurwaerdere, F., Dessauvagie, B. F., Duwel, V., Floris, G., Fox, S. B., et al. (2019) · Modern Pathology · doi:10.1038/s41379-019-0367-9 · Cited by 47
Photographs depicting CSR: captured reality or creative illusion?
Chong, S., Narayan, A. K., & Ali, I. (2019) · Pacific Accounting Review · doi:10.1108/par-10-2017-0086 · Cited by 46
Grassa, R., Moumen, N., & Hussainey, K. (2020) · Pacific-Basin Finance Journal · doi:10.1016/j.pacfin.2020.101327 · Cited by 46
Relationship between journal impact factor and the thoroughness and helpfulness of peer reviews
Severin, A., Strinzel, M., Egger, M., Barros, T. F., Sokolov, A., Vilstrup, J. T., & Müller, S. (2023) · PLoS Biology · doi:10.1371/journal.pbio.3002238 · Cited by 46
Examining the meso-level domains of the interrogation taxonomy.
Kelly, C. E., Redlich, A. D., & Miller, J. C. (2014) · Psychology Public Policy and Law · doi:10.1037/law0000034 · Cited by 46
van Zoonen, W., & van der Meer, T. G. L. A. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.05.028 · Cited by 46
Bateman, J. A., Veloso, F. O. D., Wildfeuer, J., Cheung, F. H., & Guo, N. S. (2016) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqw024 · Cited by 46
MOOC Success Factors: Proposal of an Analysis Framework
Azevedo, J., & Marques, M. (2017) · Journal of Information Technology Education Innovations in Practice · doi:10.28945/3861 · Cited by 46
Alsaleh, A. A. (2018) · School Leadership and Management · doi:10.1080/13632434.2018.1467888 · Cited by 46
Communicating the family firm brand: Antecedents and performance effects
Beck, S., Prügl, R., & Walter, K. (2019) · European Management Journal · doi:10.1016/j.emj.2019.04.008 · Cited by 46
Agile Stage‐Gate Management (ASGM) for physical products
Salvato, J. J., & Laplume, A. O. (2020) · R and D Management · doi:10.1111/radm.12426 · Cited by 46
American public opinion, advocacy, and policy in Congress: what the public wants and what it gets
(2014) · Choice Reviews Online · doi:10.5860/choice.52-1106 · Cited by 46
Paul-Hus, A., & Desrochers, N. (2019) · PLOS ONE · doi:10.1371/journal.pone.0226727 · Cited by 46
Topic models do not model topics: epistemological remarks and steps towards best practices
Shadrova, A. (2021) · Journal of Data Mining & Digital Humanities · doi:10.46298/jdmdh.7595 · Cited by 57
The Fundamental Principles of Social Sciences
Bhandari, M. P. (2023) · Business Ethics and Leadership · doi:10.21272/bel.7(2).73-86.2023 · Cited by 45
NLPositionality: Characterizing Design Biases of Datasets and Models
Santy, S., Liang, J. T., Bras, R. J. L., Reinecke, K., & Sap, M. (2023) · Proceedings of the conference - Association for Computational Linguistics. Meeting · doi:10.18653/v1/2023.acl-long.505 · Cited by 74
Communicating sustainability priorities in the museum sector
Wickham, M., & Lehman, K. (2015) · Journal of Sustainable Tourism · doi:10.1080/09669582.2015.1042483 · Cited by 45
The Proteus Effect in Dyadic Communication
Heide, B. L. V. D., Schumaker, E. M., Peterson, A., & Jones, E. B. (2012) · Communication Research · doi:10.1177/0093650212438097 · Cited by 49
Brown, A., & Knight, T. (2015) · Journal of Aging Studies · doi:10.1016/j.jaging.2015.08.003 · Cited by 45
Strategies of Successful Synthesis Solutions: Mapping, Mechanisms, and More
Bodé, N. E., & Flynn, A. B. (2016) · Journal of Chemical Education · doi:10.1021/acs.jchemed.5b00900 · Cited by 45
A Review of Research Needs for Pollinators in Managed Conifer Forests
Rivers, J. W., Galbraith, S. M., Cane, J. H., Schultz, C. B., Ulyshen, M. D., & Kormann, U. G. (2018) · Journal of Forestry · doi:10.1093/jofore/fvy052 · Cited by 45
Why are many businesses instilling a DevOps culture into their organization?
Díaz, J., López-Fernández, D., Pérez, J., & González-Prieto, Á. (2021) · Empirical Software Engineering · doi:10.1007/s10664-020-09919-3 · Cited by 45
Valentini, C. (2020) · Corporate Communications An International Journal · doi:10.1108/ccij-01-2020-0030 · Cited by 45
Exploration of Waste Plastic Bottles Use in Construction
Dadzie, D. K., Kaliluthin, A. K., & Kumar, D. (2020) · Civil Engineering Journal · doi:10.28991/cej-2020-03091616 · Cited by 45
Dehnert, M. (2020) · BuR - Business Research · doi:10.1007/s40685-020-00136-8 · Cited by 48
Factors affecting intercoder reliability: a Monte Carlo experiment
Feng, G. C. (2012) · Quality & Quantity · doi:10.1007/s11135-012-9745-9 · Cited by 47
An Empirical Analysis on Legitimacy of Sukuk: An Insight of Malaysian Sukuk
Ahmed, E. R., Islam, M. A., & Ariffin, K. H. K. (2015) · Asian Social Science · doi:10.5539/ass.v11n13p84 · Cited by 44
News Media Framing of Negative Campaigning
Pedersen, R. T. (2014) · Mass Communication & Society · doi:10.1080/15205436.2013.858749 · Cited by 44
Kipkoech, S. R., & Rono, L. (2016) · Journals & Books Hosting (International Knowledge Sharing Platform) · Cited by 44
Adolescent Perceptions of Dating Violence: A Qualitative Study
Taylor, S., Calkins, C. A., Xia, Y. R., & Dalla, R. L. (2017) · Journal of Interpersonal Violence · doi:10.1177/0886260517726969 · Cited by 44
Paradoxical transparency? Capital market responses to exploration and exploitation disclosure
Matthews, L., Heyden, M., & Zhou, D. (2022) · Research Policy · doi:10.1016/j.respol.2021.104396 · Cited by 37
Environmental scanning the future of event design
Adema, K. L., & Roehl, W. S. (2009) · International Journal of Hospitality Management · doi:10.1016/j.ijhm.2009.10.017 · Cited by 44
Systematic and Random Disagreement and the Reliability of Nominal Data
Krippendorff, K. (2008) · Communication Methods and Measures · doi:10.1080/19312450802467134 · Cited by 44
Self-citationReconciling Passive and Motivated Learning
Elenbaas, M., de Vreese, C. H., Schuck, A. R. T., & Boomgaarden, H. G. (2012) · Communication Research · doi:10.1177/0093650212467032 · Cited by 44
Markov, Č., & Yoon, Y. (2020) · Ageing and Society · doi:10.1017/s0144686x20000549 · Cited by 52
Limited engagement of SMEs with social media: A structuration and sensemaking perspective
Meier, A., & Peters, M. (2023) · Information & Management · doi:10.1016/j.im.2023.103853 · Cited by 53
On the Actual Risk of Bystander Intervention
Liebst, L. S., Heinskou, M. B., & Ejbye‐Ernst, P. (2018) · Journal of Research in Crime and Delinquency · doi:10.1177/0022427817710776 · Cited by 43
Putting the Pieces Together: A Review of HR Differentiation Literature and a Multilevel Model
Marescaux, E., Winne, S. D., & Brebels, L. (2021) · Journal of Management · doi:10.1177/0149206320987286 · Cited by 43
Behavioral and cognitive differences in early childhood related to prenatal marijuana exposure
Murnan, A., Keim, S. A., Yeates, K. O., Boone, K. M., Sheppard, K. W., & Klebanoff, M. A. (2021) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2021.101348 · Cited by 43
Development and Validation of a Virtual Reality Simulator
Johnson, S. J., Guediri, S., Kilkenny, C., & Clough, P. (2011) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720811425042 · Cited by 43
Jacobs, G., & Hoste, V. (2021) · Language Resources and Evaluation · doi:10.1007/s10579-021-09562-4 · Cited by 45
Supporting the well-being of new university teachers through teacher professional development
Gast, I., Neelen, M., Delnoij, L. E. C., Menten, M., Mihai, A., & Grohnert, T. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.866000 · Cited by 54
Continuous Integration and Delivery Practices for Cyber-Physical Systems: An Interview-Based Study
Zampetti, F., Tamburri, D. A., Panichella, S., Panichella, A., Canfora, G., & Penta, M. D. (2022) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3571854 · Cited by 42
Nicolò, G., Aversano, N., Sannino, G., & Polcini, P. T. (2022) · Corporate Governance · doi:10.1108/cg-05-2022-0224 · Cited by 42
New Interpretations of Cohen’s Kappa
Warrens, M. J. (2014) · Journal of Mathematics · doi:10.1155/2014/203907 · Cited by 42
Consolation in the aftermath of robberies resembles post-aggression consolation in chimpanzees
Lindegaard, M. R., Liebst, L. S., Bernasco, W., Heinskou, M. B., Philpot, R., Levine, M., & Verbeek, P. (2017) · PLoS ONE · doi:10.1371/journal.pone.0177725 · Cited by 42
Exploring high impact scholarship in research on student's evaluation of teaching (SET)
Spooren, P., Vandermoere, F., Vanderstraeten, R., & Pepermans, K. (2017) · Educational Research Review · doi:10.1016/j.edurev.2017.09.001 · Cited by 45
Trireksani, T., Zeng, Y., & Djajadikerta, H. G. (2021) · Australian Journal of Public Administration · doi:10.1111/1467-8500.12469 · Cited by 42
Using the theory of successful intelligence as a framework for developing assessments in AP physics
Stemler, S. E., Sternberg, R. J., Grigorenko, E. L., Jarvin, L., & Sharpes, K. M. (2009) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2009.04.001 · Cited by 42
Just a guy in pajamas? Framing the blogs in mainstream US newspaper coverage (1999—2005)
Jones, J., & Himelboim, I. (2010) · New Media & Society · doi:10.1177/1461444809342524 · Cited by 42
A corpus for studying addressing behaviour in multi-party dialogues
Jovanović, N., den Akker, R. O., & Nijholt, A. (2006) · Computers and the Humanities · doi:10.1007/s10579-006-9006-4 · Cited by 42
What Kind of Islamophobia? Representation of Muslims and Islam in Italian and Spanish Media
Cervi, L., Tejedor, S., & Gracia, M. (2021) · Religions · doi:10.3390/rel12060427 · Cited by 41
Intellectual capital information and stock recommendations: impression management?
Abhayawansa, S. A., & Guthrie, J. (2012) · Journal of Intellectual Capital · doi:10.1108/14691931211248945 · Cited by 41
Promoting online deliberation quality: cognitive cues matter
Manosevitch, I., Steinfeld, N., & Lev‐On, A. (2014) · Information Communication & Society · doi:10.1080/1369118x.2014.899610 · Cited by 41
Tweeting to the Target: Candidates’ Use of Strategic Messages and @Mentions on Twitter
Hemsley, J., Stromer‐Galley, J., Semaan, B., & Tanupabrungsun, S. (2018) · Journal of Information Technology & Politics · doi:10.1080/19331681.2017.1338634 · Cited by 41
Understanding How and Why Developers Seek and Analyze API-Related Opinions
Uddin, G., Baysal, O., Guerrouj, L., & Khomh, F. (2019) · IEEE Transactions on Software Engineering · doi:10.1109/tse.2019.2903039 · Cited by 41
Examining the Stock Price Effect of Corruption Risk in the Supply Chain
Kim, S., & Wagner, S. M. (2020) · Decision Sciences · doi:10.1111/deci.12487 · Cited by 41
Hu, B.-Y., Li, Y.-H., Zhang, X., Roberts, S., & Vitiello, G. (2021) · Teaching and Teacher Education · doi:10.1016/j.tate.2020.103253 · Cited by 40
Evacuation Behavior in a Subway Train Emergency: A Video-based Analysis
Philpot, R., & Levine, M. (2021) · Environment and Behavior · doi:10.1177/00139165211031193 · Cited by 42
Open Source Intelligence for Malicious Behavior Discovery and Interpretation
Huang, Y.-T., Lin, C., Guo, Y.-R., Lo, K.-C., Sun, Y. S., & Chen, M. C. (2021) · IEEE Transactions on Dependable and Secure Computing · doi:10.1109/tdsc.2021.3119008 · Cited by 41
A theoretical framework for consolidation in humanitarian logistics
Vaillancourt, A. (2016) · Journal of Humanitarian Logistics and Supply Chain Management · doi:10.1108/jhlscm-01-2015-0001 · Cited by 41
Nicolò, G., Peña, F. J. A., Ferullo, D. V., & Martínez-Martínez, D. (2023) · Business Ethics the Environment & Responsibility · doi:10.1111/beer.12584 · Cited by 40
The effects of social media posts’ characteristics on customer engagement: Evidence from WeChat
Xu, Y., Chen, W., & Ow, T. T. (2023) · Information & Management · doi:10.1016/j.im.2023.103854 · Cited by 40
Metadata
- Authors
- Krippendorff, K.
- Corresponding author
- Krippendorff, K.
- ORCID
- Krippendorff, K.
- Venue
- Human Communication Research
- Publisher
- Oxford University Press (OUP)
- Published
- 2004-07-01
- Volume
- 30
- Issue
- 3
- Pages
- 411-433
- ISSN
- 0360-3989 (ISSN-L)
- 1468-2958
- OpenAlex
- W4243989635
- Cited by
- 1,027
- References
- 0
- Citations by year
- 2026: 42 · 2025: 100 · 2024: 108 · 2023: 108 · 2022: 124 · 2021: 135 · 2020: 105 · 2019: 57 · 2018: 44 · 2017: 29 · 2016: 41 · 2015: 25 · 2014: 26 · 2013: 21 · 2012: 15
- FWCI
- 5.93
- Type
- journal article
- Language
- en
- Open access
- green
- repository.upenn.edu
- Locations
- Human Communication Research (publishedVersion)
- ScholarlyCommons (University of Pennsylvania) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- inter-rater reliability, reliability coefficients, interobserver agreement, reporting reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
