Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat
Sign Up
Cited by 1,764

The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.

Quantifying Qualitative Analyses of Verbal Data: A Practical Guide

Chi, Michelene T.H.·1997·Journal of the Learning Sciences
DOI 10.1207/s15327809jls0603_1
Open this paper in CoChat — free account

Abstract

This article provides one example of a method of analyzing qualitative data in an objective and quantifiable way. Although the application of the method is illustrated in the context of verbal data such as explanations, interviews, problem-solving protocols, and retrospective reports, in principle, the mechanics of the method can be adapted for coding other types of qualitative data, such as gestures and videotapes. The mechanics of the method are outlined in 8 concrete steps. Although verbal analyses can be used for many purposes, the main goal of the analyses discussed here is to formulate an understanding of the representation of the knowledge used in cognitive performances and how that representation changes with learning. This can be contrasted with another method of analyzing verbal protocols, the goal of which is to validate the cognitive processes of human performance, often as embodied in a computational model.

Overview

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1207/s15327809jls0603_1

Cites

6 of 6 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 6 references

Research works printed but not linked: 37

  1. Chi, M. T. H. (1985). Interactive roles of knowledge and strategies in the development of organized sofling and recall. In S. Chipman, J. Segal, & R. Glaser (Eds.), Thinking Md learning skills: Current research and open questions (Vol. 2, pp. 457-485). Hillsdale, NJ: Lawrence Erlbaurn Associates, Inc.
  2. Chi, M. T. H. (1992). Conceptual change within and across ontological categories: Examples from learning and discovery in science. In R. Giere (Ed.), Cognitive models of science: Minnesota studies in the philosophy of science (pp. 129-186). Minneapolis: University of Minnesota Press.
  3. Chi M. T. H., 1981, Cognitive Science, 5, 121, 10.1207/s15516709cog0502_2 · DOI · Paper page
  4. Chi M. T. H., 1989, Merrill-Palmer Quarterly., 35, 2762
  5. 10.1037//0012-1649.19.1.29 · DOI
  6. 10.1016/0959-4752(94)90017-5 · DOI · Paper page
  7. Chi M. T. H., 1991, The Journal of the Learning Sciences, 1, 69, 10.1207/s15327809jls0101_4 · DOI · Paper page
  8. Collins A. M., 1969, Journal of Verbal Learning and Verbal Behavior, 8, 240, 10.1016/S0022-5371(69)80069-1 · DOI · Paper page
  9. de Leeuw, N. (1993). Students' beliefs about the circulatory system: Are misconceptions universal? In W. Kintsch (Ed.), Proceedings of the Fiffeenfh Annual Conference of the Cognitive Science Society (pp. 389-393). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
  10. diSessa A., 1993, Cognition and Instruction, 10, 105, 10.1080/07370008.1985.9649008 · DOI · Paper page
  11. 10.1037//0033-295X.87.3.215 · doi:10.1037//0033-295x.87.3.215
  12. Ericsson, K. A, & Simon, H. (1984). Protocol analysis: Verbal reports as data. Cambridge, MA: MIT Press.
  13. Fisher, C. (1987). Advancing the study of programming with computer-aided protocol analysis. In G. Olson, E. Soloway, & S. Sheppard (Eds.), Empirical studies ofprogrammers: Second workshop (pp. 198-216). Norwood, NJ: Ablex.
  14. Fisher K., 1990, Journal of Research in Science Teaching, 27, 1001, 10.1002/tea.3660271008 · DOI
  15. Fox, B. (1991). Cognitive and interactional aspects of correction in tutoring. In P. Goodyear (Ed.), Teaching knowledge and intelligent tutoring (pp. 149-172). Norwood, NJ: Ablex.
  16. Geiwitz, I., Klatsky, R. L. & McCloskey, B. P. (1988). Knowledge acquisition techniques for expert systems: Conceptual and empirical comparisons (Final report). Fort Monmouth, NJ: U.S. Army Electronics Command. · DOI
  17. Gobbo C., 1986, Cognitive Development, 1, 221, 10.1016/S0885-2014(86)80002-8 · DOI · Paper page
  18. 10.1037//0033-295X.100.2.279 · DOI · Paper page
  19. Johnson-Laird, P. N. (1983). Mental models. Cambridge, MA: Harvard University Press.
  20. Jordan B., 1995, The Journal of the Learning Sciences, 4, 39, 10.1207/s15327809jls0401_2 · DOI · Paper page
  21. McCloskey, M. (1983). Naive theories of motion. In D. Gentner & A. L. Stevens (Eds.), Mental models (pp. 299-324). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
  22. 10.1016/0749-596X(85)90057-9 · DOI
  23. Newell, A. & Simon, H. A. (1972). Human problem solving. Englewood Cliffs, NJ: Prentice Hall.
  24. 10.1037//0033-295X.84.3.231 · doi:10.1037//0033-295x.84.3.231 · Paper page
  25. Olson, J. R. & Biolsi, K. (1991). Techniques for representing expert knowledge. In K. A. Ericsson & J. Smith (Eds.), Toward a general theory of expertise (pp. 240-285). Cambridge, MA: Cambridge University Press.
  26. 10.1016/S0364-0213(86)80010-6 · DOI · Paper page
  27. Pirolli, P. & Anderson, J. R. (1985). The role of learning from examples in the acquisition of recursive programming skills. C W i t I d i ~ Journal of Psychology, 39,240-272. · DOI · Paper page
  28. Ranney, M. (1994). Relative consistency and subjects' "theories" in domains such as naive physics: Common research difficulties illustrated by Cooke and Breedin. Memory & Cognition, 22.494499. · doi:10.3758/bf03200872
  29. Renkl, A. (1997). Learning from worked-out examples: A study on individual differences. Cognitive Science, 21. · doi:10.1207/s15516709cog2101_1 · Paper page
  30. 10.1016/0010-0285(75)90024-9 · DOI · Paper page
  31. Salter, W. J. (1983). Tacit theories of economics. In Proceedings of the Fijth Annual Conference of the Cognitive Science Sociery. Rochester, NY: Cognitive Science Society.
  32. Schofield, J. W. & Anderson, K. (1987). Combining quantitative and qualitative components of research on ethnic identity and intergroup relations. In J. S. Phinney & M. J. Rotheram (Eds.), Children's ethnic socialization: Pluralism and development. Newbury Park, CA: Sage.
  33. 10.1016/0010-0285(90)90003-M · DOI · Paper page
  34. Simon, D. P. & Simon. H. A. (1978). Individual differences in solving physics problems. In R. Siegler (Ed.), Children's thinking: What develops? (pp. 325-348). Hillsdale. NJ: Lawrence Erlbaum Associates, Inc.
  35. Slotta, J. D. & Chi, M. T. H. (1996). Understanding constraint-based processes: A precursor to conceptual change in physics. In G. W. Cottrell (Ed.), Proceedings of the Eighteenth Annual Conference of the Cognitive Science Society (pp. 306-31 1). Mahwah, NJ: Lawrence Erlbaum Associates, Inc.
  36. Slotta J. D., 1995, Cognition and Instruction, 13, 373400, 10.1207/s1532690xci1303_2 · DOI · Paper page
  37. Sternberg S., 1966, Science, 133, 652454

Cited by

Metadata

Authors
Chi, M. T. H.
Venue
Journal of the Learning Sciences
Publisher
Informa UK Limited
Published
1997-07
Volume
6
Issue
3
Pages
271-315
ISSN
  • 1050-8406 (ISSN-L)
  • 1532-7809
DOI
10.1207/s15327809jls0603_1
OpenAlex
W1967971235
Cited by
1,764
References
6
FWCI
87.55
Type
journal article
Language
en
Open access
closed

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.