The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Quantifying Qualitative Analyses of Verbal Data: A Practical Guide
Abstract
This article provides one example of a method of analyzing qualitative data in an objective and quantifiable way. Although the application of the method is illustrated in the context of verbal data such as explanations, interviews, problem-solving protocols, and retrospective reports, in principle, the mechanics of the method can be adapted for coding other types of qualitative data, such as gestures and videotapes. The mechanics of the method are outlined in 8 concrete steps. Although verbal analyses can be used for many purposes, the main goal of the analyses discussed here is to formulate an understanding of the representation of the knowledge used in cognitive performances and how that representation changes with learning. This can be contrasted with another method of analyzing verbal protocols, the goal of which is to validate the cognitive processes of human performance, often as embodied in a computational model.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Telling more than we can know: Verbal reports on mental processes.
Nisbett, R. E., & Wilson, T. D. (1977) · Psychological Review · doi:10.1037/0033-295x.84.3.231 · Cited by 11,317
Weber, R. (1990) · doi:10.4135/9781412983488 · Cited by 7,750
Basic objects in natural categories
Rosch, E., Mervis, C. B., Gray, W. D., Johnson, D. M., & Boyes-Braem, P. (1976) · Cognitive Psychology · doi:10.1016/0010-0285(76)90013-x · Cited by 5,643
Protocol Analysis: Verbal Reports as Data
Ericsson, K. A., & Simon, H. A. (1993) · doi:10.7551/mitpress/5657.001.0001 · Cited by 3,537
Self‐Explanations: How Students Study and Use Examples in Learning to Solve Problems
Chi, M. T. H., Bassok, M., Lewis, M. W., Reimann, P., & Glaser, R. (1989) · Cognitive Science · doi:10.1207/s15516709cog1302_1 · Cited by 1,714
Three aspects of cognitive development
Siegler, R. S. (1976) · Cognitive Psychology · doi:10.1016/0010-0285(76)90016-5 · Cited by 666
Research works printed but not linked: 37
- Chi, M. T. H. (1985). Interactive roles of knowledge and strategies in the development of organized sofling and recall. In S. Chipman, J. Segal, & R. Glaser (Eds.), Thinking Md learning skills: Current research and open questions (Vol. 2, pp. 457-485). Hillsdale, NJ: Lawrence Erlbaurn Associates, Inc.
- Chi, M. T. H. (1992). Conceptual change within and across ontological categories: Examples from learning and discovery in science. In R. Giere (Ed.), Cognitive models of science: Minnesota studies in the philosophy of science (pp. 129-186). Minneapolis: University of Minnesota Press.
- Chi M. T. H., 1981, Cognitive Science, 5, 121, 10.1207/s15516709cog0502_2 · DOI · Paper page
- Chi M. T. H., 1989, Merrill-Palmer Quarterly., 35, 2762
- 10.1037//0012-1649.19.1.29 · DOI
- 10.1016/0959-4752(94)90017-5 · DOI · Paper page
- Chi M. T. H., 1991, The Journal of the Learning Sciences, 1, 69, 10.1207/s15327809jls0101_4 · DOI · Paper page
- Collins A. M., 1969, Journal of Verbal Learning and Verbal Behavior, 8, 240, 10.1016/S0022-5371(69)80069-1 · DOI · Paper page
- de Leeuw, N. (1993). Students' beliefs about the circulatory system: Are misconceptions universal? In W. Kintsch (Ed.), Proceedings of the Fiffeenfh Annual Conference of the Cognitive Science Society (pp. 389-393). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
- diSessa A., 1993, Cognition and Instruction, 10, 105, 10.1080/07370008.1985.9649008 · DOI · Paper page
- 10.1037//0033-295X.87.3.215 · doi:10.1037//0033-295x.87.3.215
- Ericsson, K. A, & Simon, H. (1984). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.
- Fisher, C. (1987). Advancing the study of programming with computer-aided protocol analysis. In G. Olson, E. Soloway, & S. Sheppard (Eds.), Empirical studies ofprogrammers: Second workshop (pp. 198-216). Norwood, NJ: Ablex.
- Fisher K., 1990, Journal of Research in Science Teaching, 27, 1001, 10.1002/tea.3660271008 · DOI
- Fox, B. (1991). Cognitive and interactional aspects of correction in tutoring. In P. Goodyear (Ed.), Teaching knowledge and intelligent tutoring (pp. 149-172). Norwood, NJ: Ablex.
- Geiwitz, I., Klatsky, R. L. & McCloskey, B. P. (1988). Knowledge acquisition techniques for expert systems: Conceptual and empirical comparisons (Final report). Fort Monmouth, NJ: U.S. Army Electronics Command. · DOI
- Gobbo C., 1986, Cognitive Development, 1, 221, 10.1016/S0885-2014(86)80002-8 · DOI · Paper page
- 10.1037//0033-295X.100.2.279 · DOI · Paper page
- Johnson-Laird, P. N. (1983). Mental models. Cambridge, MA: Harvard University Press.
- Jordan B., 1995, The Journal of the Learning Sciences, 4, 39, 10.1207/s15327809jls0401_2 · DOI · Paper page
- McCloskey, M. (1983). Naive theories of motion. In D. Gentner & A. L. Stevens (Eds.), Mental models (pp. 299-324). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
- 10.1016/0749-596X(85)90057-9 · DOI
- Newell, A. & Simon, H. A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice Hall.
- 10.1037//0033-295X.84.3.231 · doi:10.1037//0033-295x.84.3.231 · Paper page
- Olson, J. R. & Biolsi, K. (1991). Techniques for representing expert knowledge. In K. A. Ericsson & J. Smith (Eds.), Toward a general theory of expertise (pp. 240-285). Cambridge, MA: Cambridge University Press.
- 10.1016/S0364-0213(86)80010-6 · DOI · Paper page
- Pirolli, P. & Anderson, J. R. (1985). The role of learning from examples in the acquisition of recursive programming skills. C W i t I d i ~ Journal of Psychology, 39,240-272. · DOI · Paper page
- Ranney, M. (1994). Relative consistency and subjects' "theories" in domains such as naive physics: Common research difficulties illustrated by Cooke and Breedin. Memory & Cognition, 22.494499. · doi:10.3758/bf03200872
- Renkl, A. (1997). Learning from worked-out examples: A study on individual differences. Cognitive Science, 21. · doi:10.1207/s15516709cog2101_1 · Paper page
- 10.1016/0010-0285(75)90024-9 · DOI · Paper page
- Salter, W. J. (1983). Tacit theories of economics. In Proceedings of the Fijth Annual Conference of the Cognitive Science Sociery. Rochester, NY: Cognitive Science Society.
- Schofield, J. W. & Anderson, K. (1987). Combining quantitative and qualitative components of research on ethnic identity and intergroup relations. In J. S. Phinney & M. J. Rotheram (Eds.), Children's ethnic socialization: Pluralism and development. Newbury Park, CA: Sage.
- 10.1016/0010-0285(90)90003-M · DOI · Paper page
- Simon, D. P. & Simon. H. A. (1978). Individual differences in solving physics problems. In R. Siegler (Ed.), Children's thinking: What develops? (pp. 325-348). Hillsdale. NJ: Lawrence Erlbaum Associates, Inc.
- Slotta, J. D. & Chi, M. T. H. (1996). Understanding constraint-based processes: A precursor to conceptual change in physics. In G. W. Cottrell (Ed.), Proceedings of the Eighteenth Annual Conference of the Cognitive Science Society (pp. 306-31 1). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
- Slotta J. D., 1995, Cognition and Instruction, 13, 373400, 10.1207/s1532690xci1303_2 · DOI · Paper page
- Sternberg S., 1966, Science, 133, 652454
Cited by
Commonsense Conceptions of Emergent Processes: Why Some Misconceptions Are Robust
Chi, M. T. H. (2005) · Journal of the Learning Sciences · doi:10.1207/s15327809jls1402_1 · Cited by 894
Kapur, M. (2008) · Cognition and Instruction · doi:10.1080/07370000802212669 · Cited by 867
Chi, M. T. H., Siler, S. A., Jeong, H., Yamauchi, T., & Hausmann, R. G. (2001) · Cognitive Science · doi:10.1207/s15516709cog2504_1 · Cited by 855
Guidelines for establishing reliability when coding narrative data
Syed, M., & Nelson, S. C. (2015) · Emerging Adulthood · doi:10.1177/2167696815587648 · Cited by 801
Epistemological Understanding as a Metacognitive Process: Thinking Aloud During Online Searching
Hofer, B. K. (2004) · Educational Psychologist · doi:10.1207/s15326985ep3901_5 · Cited by 573
Metadata
- Authors
- Chi, M. T. H.
- Venue
- Journal of the Learning Sciences
- Publisher
- Informa UK Limited
- Published
- 1997-07
- Volume
- 6
- Issue
- 3
- Pages
- 271-315
- ISSN
- 1050-8406 (ISSN-L)
- 1532-7809
- OpenAlex
- W1967971235
- Cited by
- 1,764
- References
- 6
- FWCI
- 87.55
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.