The Content Analysis Guidebook
Abstract
List of Boxes List of Tables and Figures Foreword Acknowledgments 1. Defining Content Analysis Is Content Analysis Easy? Is It Something That Anyone Can Do? A Six-Part Definition of Content Analysis 2. Milestones in the History of Content Analysis The Growing Popularity of Content Analysis Milestones of Content Analysis Research 3. Beyond Description: An Integrative Model of Content Analysis The Language of the Scientific Method How Content Analysis Is Done: Flowchart for the Typical Process of Content-Analysis Research Approaches to Content Analysis The Integrative Model of Content Analysis Evaluation With the Integrative Model of Content Analysis 4. Message Units and Sampling Units Defining the Population Archives Medium Management Sampling Sample Size 5. Variables and Predictions Identifying Critical Variables Hypotheses, Predictions, and Research Questions 6. Measurement Techniques Defining Measurement Validity, Reliability, Accuracy, and Precision Types of Validity Assessment Operationalization Computer Coding Selection of a Computer Text Content Analysis Program Human Coding Index Construction in Content Analysis 7. Reliability Intercoder Reliability Standards and Practices Issues in the Assessment of Reliability Pilot and Final Reliabilities Intercoder Reliability Coefficients: Issues and Comparisons Calculating Intercoder Reliability Coefficients Treatment of Variables That Do Not Achieve an Acceptable Level of Reliability The Use of Multiple Coders Advanced and Specialty Issues in Reliatbility Coefficient Selection 8. Results and Reporting Data Handling and Transformations Hypothesis Tesing Selecting the Appropriate Statistical Tests Frequencies Co-Occurences and In-Context Occurrences Time Lines Bivariate Relationships Multivariate Relationships 9. Contexts Psychometric Applications of Content Analysis Open-Ended Written and Pictorial Responses Linguistics and Semantic Networks Stylometrics and Computer Literary Analysis Interaction Analysis Other Interpersonal Behaviors Violence in the Media Gender Roles Minority Portrayals Advertising News Political Communication Web Analyses Other Applied Contexts Commercial and Other Client-Based Applications of Content Analysis Future Directions Resource 1: Message Archives - P.D. Skalski General Collections Film, Television and Radio Archives Literary and General Corpora Other Archives Resource 2: Using NEXIS for Text Acquisition for Content Analysis Resource 3: Computer Content Analysis Software - P.D. Skalski Part I. Quantitative Computer Text Analysis Programs Part II. VBPro How-To Guide and Executional Flowchart Resource 4: An Introduction to PRAM--A Program for Reliability Assessment With Multiple Coders Resource 5: The Content Analysis Guidebook Online Content Analysis Resources Bibliographies Message Archives and Corpora Reliability Human Coding Sample Materials Computer Content Analysis References Author Index Subject Index About the Authors
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Content analysis of transcripts from thinking aloud sessions, field notes, and feedback interviews was coded using predetermined codes related to usability issues after each iterative cycle.
“Content analysis [77] of transcripts from the thinking aloud sessions, field notes, and feedback interviews was coded using predetermined codes related to usability issues (navigation, content, layout, learnability, errors, and satisfaction) after each iterative cycle.”
Cited by
Sorted by citations
The qualitative content analysis process
Elo, S., & Kyngäs, H. (2008) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2007.04569.x · Cited by 22,617 · see citing works
“The truth is that this method is as easy or as difficult as the researcher determines it to be (Neundorf 2002).”
BackgroundMethodConceptualizing the circular economy: An analysis of 114 definitions
Kirchherr, J., Reike, D., & Hekkert, M. (2017) · Resources, Conservation and Recycling · doi:10.1016/j.resconrec.2017.09.005 · Cited by 8,550 · see citing works
Mayring, P. (2008) · Forum qualitative Sozialforschung · doi:10.17169/fqs-1.2.1089 · Cited by 6,273 · see citing works
How to plan and perform a qualitative study using content analysis
Bengtsson, M. (2016) · NursingPlus Open · doi:10.1016/j.npls.2016.01.001 · Cited by 4,616 · see citing works
“This method summarizes rather than reports all details concerning a message set, and the researcher seeks to answer questions about how many (Krippendorff, 2004; Neuendorf, 2002).”
BackgroundMethodInfluentialQualitative Content Analysis: A Focus on Trustworthiness
Elo, S., Kääriäinen, M., Kanste, O., Pölkki, T., Utriainen, K., & Kyngäs, H. (2014) · Sage Open · doi:10.1177/2158244014522633 · Cited by 4,395 · see citing works
“In nursing science, the number of methods concerning content analysis published in books and scientific articles has increased considerably over the last decade (Elo & Kyngäs, 2008; Harwood & Garry, 2003; Hsieh & Shannon, 2005; Neuendorf, 2002; Schreier, 2012).”
BackgroundMethodInfluentialIntercoder Reliability in Qualitative Research: Debates and Practical Guidelines
O’Connor, C., & Joffe, H. (2020) · International Journal of Qualitative Methods · doi:10.1177/1609406919899220 · Cited by 3,871 · see citing works
“For instance, practitioners of content analysis often present ICR as a fundamental imperative of that method (Lombard et al., 2002; Neuendorf, 2002).”
BackgroundText as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political Texts
Grimmer, J., & Stewart, B. M. (2013) · Political Analysis · doi:10.1093/pan/mps028 · Cited by 3,297 · see citing works
“For more on the schemes—including how to assess coder agreement and practical guides to scheme creation—see Krippendorff (2004); Neuendorf (2002); Weber (1990) and the documentation available in the ReadMe software (Hopkins et al. 2010).”
MethodContent Analysis in Mass Communication: Assessment and Reporting of Intercoder Reliability
Lombard, M., Snyder-Duch, J., & Bracken, C. C. (2002) · Human Communication Research · doi:10.1111/j.1468-2958.2002.tb00826.x · Cited by 3,068 · see citing works
“), but this technique has also been questioned (Neuendorf, 2002). With the coding data in hand, the researcher calculates and reports one or more indices of reliability. Popping (1988) identified 39 different “agreement indices” for coding nominal categories, which excludes several techniques for ratio and interval le…”
BackgroundMethodInfluentialQualitative Content Analysis: Theoretical Background and Procedures
Mayring, P. (2014) · Advances in mathematics education · doi:10.1007/978-94-017-9181-6_13 · Cited by 2,349 · see citing works
Qualitative content analysis: theoretical foundation, basic procedures and software solution
Mayring, P. (2014) · Social Science Open Access Repository (GESIS – Leibniz Institute for the Social Sciences) · Cited by 2,173 · see citing works
Reliability in content analysis: some common misconceptions and recommendations.
Krippendorff, K. (2004) · Human Communication Research · doi:10.1093/hcr/30.3.411 · Cited by 1,027 · see citing works
“Neuendorf (2002) used this terminology, but only in passing.”
Content Analysis: A Flexible Methodology
White, M. D., & Marsh, E. (2006) · Library trends · doi:10.1353/lib.2006.0053 · Cited by 2,007 · see citing works
“One way of corroborating face validity is to have judges work backwards from the measure to determine the concept being measured (Neuendorf, 2002, p. 115).”
BackgroundResultInfluentialInter-Coder Agreement for Computational Linguistics
Artstein, R., & Poesio, M. (2008) · Computational Linguistics · doi:10.1162/coli.07-034-r2 · Cited by 1,665 · see citing works
“For intention-based segmentation, Passonneau and Litman (1993) in the pre-K days reported an overall percentage agreement with majority opinion of 89%, but the agreement on boundaries was only 70%.”
QUALITATIVE RESEARCH METHODOLOGY IN SOCIAL SCIENCES AND RELATED SUBJECTS
MOHAJAN, H. K. (2018) · Journal of Economic Development, Environment and People · doi:10.26458/jedep.v7i1.571 · Cited by 1,478 · see citing works
“At present it has a long history of use in communication, journalism, sociology, psychology, and business [Neundorf, 2002; Akşan & Baki, 2017].”
Pluye, P., & Hong, Q. N. (2014) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-032013-182440 · Cited by 1,363 · see citing works
Sovacool, B. K. (2014) · Energy Research & Social Science · doi:10.1016/j.erss.2014.02.003 · Cited by 1,295 · see citing works
Mayring, P., & Fenzl, T. (2014) · Handbuch Methoden der empirischen Sozialforschung · doi:10.1007/978-3-531-18939-0_38 · Cited by 1,262 · see citing works
Conducting content‐analysis based literature reviews in supply chain management
Seuring, S. A., & Gold, S. (2012) · Supply Chain Management An International Journal · doi:10.1108/13598541211258609 · Cited by 1,276 · see citing works
Stahl, G. K., Maznevski, M. L., Voigt, A., & Jonsen, K. (2010) · Journal of International Business Studies · doi:10.1057/jibs.2009.85 · Cited by 1,248 · see citing works
Climate change and journalistic norms: A case-study of US mass-media coverage
Boykoff, M., & Boykoff, J. (2007) · Geoforum · doi:10.1016/j.geoforum.2007.01.008 · Cited by 992 · see citing works
Consumers’ perceptions and preferences for local food: A review
Feldmann, C., & Hamm, U. (2014) · Food Quality and Preference · doi:10.1016/j.foodqual.2014.09.014 · Cited by 1,019 · see citing works
A review of modeling approaches for sustainable supply chain management
Seuring, S. A. (2012) · Decision Support Systems · doi:10.1016/j.dss.2012.05.053 · Cited by 1,004 · see citing works
“A content analysis was conducted to systematically assess the papers [55, 56, 63].”
MethodAnalyzing brain networks with PCA and conditional Granger causality
Zhou, Z., Chen, Y., Ding, M., Wright, P. K., Lu, Z., & Liu, Y. (2008) · Human Brain Mapping · doi:10.1002/hbm.20661 · Cited by 978 · see citing works
Best Practices in Quantitative Methods
Osborne, J. W. (2008) · Sage eBooks · doi:10.4135/9781412995627 · Cited by 961 · see citing works
Content analysis schemes to analyze transcripts of online asynchronous discussion groups: A review
Wever, B. D., Schellens, T., Valcke, M., & Keer, H. V. (2005) · Computers & Education · doi:10.1016/j.compedu.2005.04.005 · Cited by 940 · see citing works
“Krippendorff (cid:1) s alpha takes into account the magnitude of the misses, adjusting for whether the variable is measured as nominal, ordinal, interval, or ratio (Krippendorff, 1980; Lombard et al., 2002; Neuendorf, 2002).”
BackgroundInfluentialDeterminants of voluntary CSR disclosure: empirical evidence from Germany
Gamerschlag, R., Möller, K., & Verbeeten, F. (2011) · Review of Managerial Science · doi:10.1007/s11846-010-0052-3 · Cited by 926 · see citing works
“Its objective lies in generating a numerically based summary of a chosen message set (Krippendorff 2004; Neuendorf 2002).”
BackgroundMethodInfluentialAre Investors Influenced By How Earnings Press Releases Are Written?
Henry, E. (2008) · Journal of Business Communication · doi:10.1177/0021943608319388 · Cited by 920 · see citing works
“Using term frequency counts to capture the content of a document is commonly used for textual analysis in the social sciences, where such techniques fall into the general category of analysis referred to as content analysis (Neuendorf, 2002).”
Applying LDA Topic Modeling in Communication Research: Toward a Valid and Reliable Methodology
Maier, D., Waldherr, A., Miltner, P., Wiedemann, G., Niekler, A., Keinert, A., Pfetsch, B., Heyer, G., Reber, U., Häußler, T., et al. (2018) · Communication Methods and Measures · doi:10.1080/19312458.2018.1430754 · Cited by 849 · see citing works
“These challenges particularly affect the approach’s reliability and validity, both of which are core criteria for content analysis in communication research (Neuendorf, 2017), but they have, nevertheless, received little attention thus far.”
BackgroundChatGPT in higher education: considerations for academic integrity and student learning
(2023) · Journal of Applied Learning & Teaching · doi:10.37074/jalt.2023.6.1.17 · Cited by 853 · see citing works
Conducting systematic literature review in operations management
Thomé, A. M. T., Scavarda, L. F., & Scavarda, A. (2016) · Production Planning & Control · doi:10.1080/09537287.2015.1129464 · Cited by 858 · see citing works
A Method of Automated Nonparametric Content Analysis for Social Science
Hopkins, D. J., & King, G. (2010) · American Journal of Political Science · doi:10.1111/j.1540-5907.2009.00428.x · Cited by 765 · see citing works
“ods now joining projects based on hand coding, and have increased at least sixfold from 1980 to 2002 (Neuendorf 2002).”
BackgroundThe Role of Smartphones in Mediating the Touristic Experience
Wang, D., Park, S., & Fesenmaier, D. R. (2011) · Journal of Travel Research · doi:10.1177/0047287511426341 · Cited by 795 · see citing works
“Following Neuendorf (2002), the 202 qualified customer reviews were manually assessed/coded using two sets of constructs: information needs and the outcomes of the use of smartphones (see Table 4).”
BackgroundMethodA Practical Guide to Collaborative Qualitative Data Analysis
Richards, K. A. R., & Hemphill, M. A. (2017) · Journal of Teaching in Physical Education · doi:10.1123/jtpe.2017-0084 · Cited by 806 · see citing works
Forman, J., & Damschroder, L. (2007) · Advances in Bioethics · doi:10.1016/s1479-3709(07)11003-7 · Cited by 808 · see citing works
Corporate Greening Through ISO 14001: A Rational Myth?
Boiral, O. (2007) · Organization Science · doi:10.1287/orsc.1060.0224 · Cited by 740 · see citing works
“The reliability of the qualitative data categorization process has been debated by some authors (Miles and Huberman 1994, Neuendorf 2002, Morse et al 2002).”
BackgroundComputational Grounded Theory: A Methodological Framework
Nelson, L. K. (2017) · Sociological Methods & Research · doi:10.1177/0049124117729703 · Cited by 702 · see citing works
“The researcher then typically trains research assistants to code text into these predetermined categories (see, e.g., Krippendorff 2013; Neuendorf 2001; Saldana 2015).”
BackgroundGaur, A. S., & Kumar, M. (2017) · Journal of World Business · doi:10.1016/j.jwb.2017.11.003 · Cited by 648 · see citing works
Allison, T. H., Davis, B. C., Short, J. C., & Webb, J. W. (2014) · Entrepreneurship Theory and Practice · doi:10.1111/etap.12108 · Cited by 700 · see citing works
“For example, future studies might employ constant comparative analysis (e.g., Neuendorf, 2001) to explore how other intrinsic and extrinsic cues may affect fundraising outcomes.”
BackgroundFailure to Detect Mismatches Between Intention and Outcome in a Simple Decision Task
Johansson, P., Hall, L., Sikström, S., & Olsson, A. (2005) · Science · doi:10.1126/science.1111709 · Cited by 683 · see citing works
Determinants of Perceived Web Site Interactivity
Song, J. H., & Zinkhan, G. M. (2008) · Journal of Marketing · doi:10.1509/jmkg.72.2.99 · Cited by 665 · see citing works
Hawkins, K. A. (2009) · Comparative Political Studies · doi:10.1177/0010414009331721 · Cited by 664 · see citing works
Scaling Policy Preferences from Coded Political Texts
Lowe, W., Benoit, K. R., Mikhaylov, S., & Laver, M. (2011) · Legislative Studies Quarterly · doi:10.1111/j.1939-9162.2010.00006.x · Cited by 654 · see citing works
“text remains manual content analysis (Krippendorff, 2004; Neuendorf, 2002 ).”
MethodShort, J. C., Broberg, J. C., Cogliser, C. C., & Brigham, K. H. (2010) · Organizational Research Methods · doi:10.1177/1094428109335949 · Cited by 644 · see citing works
“External validity continues to be a key concern in management research methods (Savall, Zardet, Bonnet, & Pe´ron, 2008; Scandura & Williams, 2000), and techniques for establishing external validity can be readily applied to research using content analysis (Neuendorf, 2002).”
BackgroundMethodInfluentialMethods for Evaluating Interactive Information Retrieval Systems with Users
Kelly, D. (2009) · Foundations and Trends® in Information Retrieval · doi:10.1561/1500000012 · Cited by 638 · see citing works
“At its inception, it was intended as a quantitative method, although there are now a number of variations, interpretations and uses of content analysis [201].”
MethodSample Selection in Systematic Literature Reviews of Management Research
Hiebl, M. R. W. (2023) · Organizational Research Methods · doi:10.1177/1094428120986851 · Cited by 635 · see citing works
“This translates into an intercoder agreement5 of 99.6%—as defined by Neuendorf (2017), an acceptable level of agreement.”
BackgroundInfluentialCore issues in sustainable supply chain management – a Delphi study
Seuring, S. A., & Müller, M. (2007) · Business Strategy and the Environment · doi:10.1002/bse.607 · Cited by 628 · see citing works
Wansink, B. C., & Sobal, J. (2006) · Environment and Behavior · doi:10.1177/0013916506295573 · Cited by 631 · see citing works
“The qualitative data collected during the postexperiment debriefings was coded using content analysis procedures (Neuendorf, 2002; Webber, 1989).”
MethodThe Impact of Knowledge Coordination on Virtual Team Performance over Time1
Kanawattanachai, P., & Yoo, Y. (2007) · MIS Quarterly · doi:10.2307/25148820 · Cited by 635 · see citing works
“According to Neuendorf (2002), the unit of analysis for content coding can either be determined in advance (an etic approach) or generated during the analysis (an emic approach).”
MethodDisclosure Tone and Shareholder Litigation
Rogers, J. L., Buskirk, A. V., & Zechman, S. L. C. (2011) · The Accounting Review · doi:10.2308/accr-10137 · Cited by 569 · see citing works
Comparing focus groups and individual interviews: findings from a randomized study
Guest, G., Namey, E., Taylor, J., Eley, N. T., & McKenna, K. (2017) · International Journal of Social Research Methodology · doi:10.1080/13645579.2017.1281601 · Cited by 638 · see citing works
“The first phase of the analysis was deductive in that analysts were instructed to look for, and code, only sensitive and personal disclosures in the data (Krippendorf, 2012; Neuendorf, 2002).”
MethodSoenens, B., Vansteenkiste, M., Lens, W., Luyckx, K., Goossens, L., Beyers, W., & Ryan, R. M. (2007) · Developmental Psychology · doi:10.1037/0012-1649.43.3.633 · Cited by 608 · see citing works
“To assess whether the items tapping autonomy support could be reliably classified into two categories (PVF and PI), we first performed a formal content analysis (Neuendorf, 2002), followed by an exploratory factor analysis and a CFA.”
MethodA literature review and perspectives in reverse logistics
Agrawal, S., Singh, R. K., & Murtaza, Q. (2015) · Resources Conservation and Recycling · doi:10.1016/j.resconrec.2015.02.009 · Cited by 624 · see citing works
How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App Reviews
Guzmán, E., & Maalej, W. (2014) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2014.6912257 · Cited by 611 · see citing works
“The methodological cornerstone for the creation of the truth set was the use of content analysis techniques as described by Neuendorf [20] and by Maalej and Robillard [16].”
MethodThe Supply of Corporate Social Responsibility Disclosures Among U.S. Firms
Holder‐Webb, L., Cohen, J. R., Nath, L., & Wood, D. (2008) · Journal of Business Ethics · doi:10.1007/s10551-008-9721-4 · Cited by 612 · see citing works
“70 or 70 percent are considered reliable (Frey et al. 2000; Neuendorf 2002).”
InfluentialThe Constructionist Approach to Framing: Bringing Culture Back In
Gorp, B. V. (2006) · Journal of Communication · doi:10.1111/j.0021-9916.2007.00329.x · Cited by 594 · see citing works
“How could one possibly measure these structures and, at the same time, fulfill the criteria of reliability, reproducibility, and validity? This can be achieved by accepting a heuristic principle, namely that a series of manifest variables can represent a latent concept (Neuendorf, 2002).”
BackgroundCognitive Processes of Opportunity Recognition: The Role of Structural Alignment
Grégoire, D. A., Barr, P. S., & Shepherd, D. A. (2010) · Organization Science · doi:10.1287/orsc.1090.0462 · Cited by 582 · see citing works
“These results indicate acceptable levels of interrater reliability (cf. Lombard et al. 2002, Neuendorf 2002).”
MethodResultNeumann, P., Winkelhaus, S., Grosse, E. H., & Glock, C. H. (2020) · International Journal of Production Economics · doi:10.1016/j.ijpe.2020.107992 · Cited by 611 · see citing works
Náfrádi, L., Nakamoto, K., & Schulz, P. J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0186458 · Cited by 555 · see citing works
User feedback in the appstore: An empirical study
Pagano, D., & Maalej, W. (2013) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2013.6636712 · Cited by 541 · see citing works
“To explore the feedback content and find included topics, two researchers independently performed a manual content analysis [11] of a random sample from our data set.”
MethodContent analysis: What are they talking about?
Strijbos, J.-W., Martens, R. L., Prins, F. J., & Jochems, W. M. G. (2005) · Computers & Education · doi:10.1016/j.compedu.2005.04.002 · Cited by 545 · see citing works
“Neuendorf (2002) even states that “Without the establishment of reliability, content analyses measures are useless.””
The Cognitive Perspective in Entrepreneurship: An Agenda for Future Research
Grégoire, D. A., Corbett, A. C., & McMullen, J. S. (2010) · Journal of Management Studies · doi:10.1111/j.1467-6486.2010.00922.x · Cited by 539 · see citing works
Stepchenkova, S. O., & Zhan, F. (2012) · Tourism Management · doi:10.1016/j.tourman.2012.08.006 · Cited by 542 · see citing works
“Content analysis was selected as the primary method due to its ability to manage qualitative material in a systematic, verifiable, and replicable way (Krippendorff, 2004; Neuendorf, 2002).”
BackgroundMethodCraighead, C. W., Ketchen, D. J., Wowak, K. D., & Hult, G. T. M. (2011) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2011.2136437 · Cited by 526 · see citing works
“agreement, the remaining articles were evaluated primarily by one researcher, but questionable articles were discussed [46].”
BackgroundAssessing ExxonMobil’s climate change communications (1977–2014)
Supran, G. J., & Орескес, Н. (2017) · Environmental Research Letters · doi:10.1088/1748-9326/aa815f · Cited by 525 · see citing works
Media Content Analysis: Its Uses, Benefits and Best Practice Methodology
Macnamara, J. (2005) · UTS ePRESS (University of Technology Sydney) · Cited by 519 · see citing works
Lifting the lid on the use of content analysis to investigate intellectual capital disclosures
BEATTIE, V. A., & Thomson, S. J. (2007) · Accounting Forum · doi:10.1016/j.accfor.2007.02.001 · Cited by 501 · see citing works
“The generic issues that arise in content analysis are well covered in texts such as Krippendorff (1980), Boyatzis (1998) and Neuendorf (2002).”
BackgroundWeigel, F. K., & Hazen, B. T. (2013) · Advances in healthcare information systems and administration book series · doi:10.4018/978-1-4666-4619-3.ch008 · Cited by 497 · see citing works
Organizing for Society: A Typology of Social Entrepreneuring Models
Mair, J., Battilana, J., & Cárdenas, J. (2012) · Journal of Business Ethics · doi:10.1007/s10551-012-1414-3 · Cited by 489 · see citing works
Lettl, C. U., Herstatt, C., & Gemuenden, H. G. (2006) · R and D Management · doi:10.1111/j.1467-9310.2006.00431.x · Cited by 465 · see citing works
“Neuendorf, K.A. (2002) The Content Analysis Guide-”
Gößling, S. (2020) · Transportation Research Part D Transport and Environment · doi:10.1016/j.trd.2020.102230 · Cited by 463 · see citing works
Getting children to eat more fruit and vegetables: A systematic review
Knai, C., Pomerleau, J., Lock, K., & McKee, M. (2005) · Preventive Medicine · doi:10.1016/j.ypmed.2005.11.012 · Cited by 461 · see citing works
“It was calculated using percent agreement (Neuendorf, 2002) whereby PA0 = Total agreements/n (here PA0 = 74/77 = 0.”
MethodThe visual dehumanisation of refugees
Bleiker, R., Campbell, D. A., Hutchison, E., & Nicholson, X. (2013) · Australian Journal of Political Science · doi:10.1080/10361146.2013.840769 · Cited by 464 · see citing works
“We do, however, eschew the claims to objectivity that are sometimes associated with this method (Neuendorf 2002: 10–12).”
MethodBug report, feature request, or simply praise? On automatically classifying app reviews
Maalej, W., & Nabil, H. (2015) · IEEE International Requirements Engineering Conference (RE) · doi:10.1109/re.2015.7320414 · Cited by 463 · see citing works
“First, we created a coding guide [25] that precisely defines the review types with detailed examples.”
MethodThe Research Design Maze: Understanding Paradigms, Cases, Methods and Methodologies
Wahyuni, D. (2012) · Swinburne figshare (Swinburne University of Technology) · Cited by 455 · see citing works
Abdelal, R., Herrera, Y. M., Johnston, A. I., & McDermott, R. (2006) · Perspectives on Politics · doi:10.1017/s1537592706060440 · Cited by 493 · see citing works
Issues and Best Practices in Content Analysis
Lacy, S. R., Watson, B. R., Riffe, D., & Lovejoy, J. (2015) · Journalism & Mass Communication Quarterly · doi:10.1177/1077699015607338 · Cited by 478 · see citing works
“From Berelson (1952) and Holsti (1969), through Krippendorff (1980), Riffe, Lacy, and Fico (1998), and Neuendorf (2002), texts have aimed to explain and codify standards for content analysis data generation and reporting.”
BackgroundMeyer, E. C., Ritholz, M. D., Burns, J. P., & Truog, R. D. (2006) · PEDIATRICS · doi:10.1542/peds.2005-0144 · Cited by 451 · see citing works
Environmental Education Research
(2010) · Environmental Education Research · doi:10.1080/13504622.2010.529990 · Cited by 443 · see citing works
New Categories Are Not Enough: Rethinking the Measurement of Sex and Gender in Social Surveys
Westbrook, L., & Saperstein, A. (2015) · Gender & Society · doi:10.1177/0891243215584758 · Cited by 434 · see citing works
A reconceptualization of fear of failure in entrepreneurship
Cacciotti, G., Hayton, J. C., Mitchell, J., & Giazitzoglu, A. (2016) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2016.02.002 · Cited by 434 · see citing works
“(Neuendorf, 2002), thus supporting our coding of the Canadian interview data.”
ResultUnderstanding Audit Quality: Insights from Audit Professionals and Investors
Christensen, B. E., Glover, S. M., Omer, T. C., et al. (2015) · Contemporary Accounting Research · doi:10.1111/1911-3846.12212 · Cited by 429 · see citing works
“According to Neuendorf (2002), a Kappa measure between 0.40 and 0.70 is acceptable, while above 0.80 is ideal.”
InfluentialThe constructionist approach to framing: Bringing culture back in
Gorp, B. V. (2007) · Cited by 428 · see citing works
Entrepreneurship Education Research Revisited: The Case of Higher Education
Béchard, J., & Grégoire, D. A. (2005) · Academy of Management Learning and Education · doi:10.5465/amle.2005.16132536 · Cited by 423 · see citing works
“80 threshold generally accepted in the content-analysis literature (cf. Lombard et al., 2002; Neuendorf, 2002).”
BackgroundGorp, B. V. (2005) · European Journal of Communication · doi:10.1177/0267323105058253 · Cited by 425 · see citing works
A typology of circular start-ups: An Analysis of 128 circular business models
Henry, M., Bauwens, T., Hekkert, M. P., & Kirchherr, J. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.118528 · Cited by 426 · see citing works
“In case of diverging coding results, the coding rules were reconsidered, possibly leading to their modification e a good practice to enhance reliability in manual coding (e.g. Hruschka et al., 2004; Neuendorf, 2016).”
Comparing success and engagement in gamified learning experiences via Kahoot and Quizizz
Orhan Göksün, D., & Gürsoy, G. (2019) · Computers & Education · doi:10.1016/j.compedu.2019.02.015 · Cited by 418 · see citing works
Effects of green supply chain integration and green innovation on environmental and cost performance
Wong, C. Y., Wong, C. W. Y., & Boon‐itt, S. (2020) · International Journal of Production Research · doi:10.1080/00207543.2020.1756510 · Cited by 427 · see citing works
“These results indicate a sufficient level of coding reliability (Neuendorf 2002).”
BackgroundArtificial intelligence and computer science in education: From kindergarten to university
Kandlhofer, M., Steinbauer, G., Hirschmugl-Gaisch, S., & Huber, P. (2016) · 2016 IEEE Frontiers in Education Conference (FIE) · doi:10.1109/fie.2016.7757570 · Cited by 437 · see citing works
“A content analysis [54] was performed after transcribing all recorded interviews and summarizing inherent quantitative data.”
MethodHenry, E., & Leone, A. J. (2015) · The Accounting Review · doi:10.2308/accr-51161 · Cited by 371 · see citing works
Stahl, G. K., & Tung, R. L. (2014) · Journal of International Business Studies · doi:10.1057/jibs.2014.68 · Cited by 399 · see citing works
“Content-analytical Approach In this study, we adopted a deductive, a priori content-analytic approach, which involves establishing categories prior to the analysis based on some theory or rationale (Neuendorf, 2002; Weber, 1990).”
BackgroundMethodInfluentialNigam, A., & Ocasio, W. C. (2009) · Organization Science · doi:10.1287/orsc.1090.0490 · Cited by 397 · see citing works
“Cohen’s kappa for individual codes were all above 0.73 indicating good agreement by chance and above the threshold of 0.70 suggested for content analysis (Neuendorf 2002, Krippendorff 2004).”
InfluentialVarianten qualitativer Inhaltsanalyse: Ein Wegweiser im Dickicht der Begrifflichkeiten
Schreier, M. (2013) · Forum qualitative Sozialforschung · doi:10.17169/fqs-15.1.2043 · Cited by 409 · see citing works
Anxiety in Chinese EFL students at different proficiency levels
Liu, M. (2006) · System · doi:10.1016/j.system.2006.04.004 · Cited by 386 · see citing works
The Impact of Media Bias: How Editorial Slant Affects Voters
Druckman, J. N., & Parkin, M. (2005) · The Journal of Politics · doi:10.1111/j.1468-2508.2005.00349.x · Cited by 373 · see citing works
“Importantly, our reliability statistics range from .82 to .98 with an average of .90, thereby exceeding the .80 standard (see Neuendorf 2002, 143; Riffe, Lacy, and Fico 1998, 131).”
BackgroundIntroduction to Applied Thematic Analysis
Guest, G., MacQueen, K. M., & Namey, E. (2012) · Sage eBooks · doi:10.4135/9781483384436.n1 · Cited by 412 · see citing works
“Further reading on how to do confirmatory qualitative research using a thematic approach, also known as classic content analysis , can be found in several comprehensive works, including Krippendorf (2004), Weber (1990), and Neuendorf (2001).”
MethodBEATTIE, V. A. (2014) · The British Accounting Review · doi:10.1016/j.bar.2014.05.001 · Cited by 371 · see citing works
Assessing the rigor of case study research in supply chain management
Seuring, S. A. (2008) · Supply Chain Management An International Journal · doi:10.1108/13598540810860967 · Cited by 369 · see citing works
Colwell, S. R., & Joshi, A. W. (2011) · Business Strategy and the Environment · doi:10.1002/bse.732 · Cited by 382 · see citing works
Influence of Facebook brand-page posts on online engagement
Luarn, P., Lin, Y.-F., & Chiu, Y.-P. (2015) · Online Information Review · doi:10.1108/oir-01-2015-0029 · Cited by 370 · see citing works
Stakeholder Relationships, Engagement, and Sustainability Reporting
Herremans, I. M., Nazari, J. A., & Mahmoudian, F. (2015) · Journal of Business Ethics · doi:10.1007/s10551-015-2634-0 · Cited by 379 · see citing works
- Authors
- Neuendorf, K. A.
- Corresponding author
- Neuendorf, Kimberly A.
- Venue
- Sage eBooks
- Publisher
- SAGE Publications, Inc
- Published
- 2017
- OpenAlex
- W1568955415
- Cited by
- 9,286
- References
- 0
- Citations by year
- 2026: 135 · 2025: 271 · 2024: 474 · 2023: 569 · 2022: 571 · 2021: 609 · 2020: 603 · 2019: 628 · 2018: 474 · 2017: 488 · 2016: 490 · 2015: 538 · 2014: 532 · 2013: 561 · 2012: 482
- FWCI
- 317.83
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Sage eBooks (publishedVersion)
- Topics
- Social Sciences › General Social Sciences › Computational and Text Analysis Methods
- Social Sciences › Education › Qualitative Research Methods and Applications
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Reliability and Agreement in Measurement
- Keywords
- content analysis, sampling units, measurement validity, measurement reliability, intercoder reliability, coding, corpora, interaction analysis, media violence, gender roles in media, advertising, political communication, website analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
