Comparing comprehension measured by multiple-choice and open-ended questions.
The DOI matches its Crossref record; 36 of the 37 references it cites were found in a registry or an index.
Abstract
This study compared the nature of text comprehension as measured by multiple-choice format and open-ended format questions. Participants read a short text while explaining preselected sentences. After reading the text, participants answered open-ended and multiple-choice versions of the same questions based on their memory of the text content. The results indicated that performance on open-ended questions was correlated with the quality of self-explanations, but performance on multiple-choice questions was correlated with the level of prior knowledge related to the text. These results suggest that open-ended and multiple-choice format questions measure different aspects of comprehension processes. The results are discussed in terms of dual process theories of text comprehension.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Indeed, verifying and falsifying suggestions is a different cognitive task than independently gathering findings and deducing a diagnosis15,16.”
From Non-task expert physicians benefit from correct explainable AI advice when reviewing X-rays (2023) · cites this paper as [15]
Citations
Cites
(1998) · Cited by 4,875
The role of knowledge in discourse comprehension: A construction-integration model.
Kintsch, W. (1988) · Psychological Review · doi:10.1037/0033-295x.95.2.163 · Cited by 4,363
The Nature of Recollection and Familiarity: A Review of 30 Years of Research
Yonelinas, A. P. (2002) · Journal of Memory and Language · doi:10.1006/jmla.2002.2864 · Cited by 3,840 · cited 1×
“This is because the target information or its variant is present as a part of the answer options (see Yonelinas, 2002 for discussions on recollection and familiarity).”
BackgroundTheoretical Models and Processes of Reading
Barnett, M. A., Singer, H., & Ruddell, R. B. (1987) · The Modern Language Journal · doi:10.2307/326762 · Cited by 3,086
Test-Enhanced Learning: Taking Memory Tests Improves Long-Term Retention
Roediger, H. L., & Karpicke, J. D. (2006) · Psychological Science · doi:10.1111/j.1467-9280.2006.01693.x · Cited by 2,867
Levels of processing versus transfer appropriate processing
Morris, C. D., Bransford, J. D., & Franks, J. J. (1977) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(77)80016-9 · Cited by 2,296 · cited 1×
“Further, note that the transfer appropriate processing perspective (Morris et al., 1977) states that memory retrieval is best when the nature of the encoding process corresponds to the nature of the retrieval process.”
BackgroundMcNamara, D. S., Kintsch, E., Songer, N. B., & Kintsch, W. (1996) · Cognition and Instruction · doi:10.1207/s1532690xci1401_1 · Cited by 1,341
Self-citationEliciting Self‐Explanations Improves Understanding
Chi, M. T. H., De Leeuw, N., Chiu, M., & Lavancher, C. (1994) · Cognitive Science · doi:10.1207/s15516709cog1803_3 · Cited by 757
Learning from texts: Effects of prior knowledge and text coherence
McNamara, D. S., & Kintsch, W. (1996) · Discourse Processes · doi:10.1080/01638539609544975 · Cited by 745 · cited 3×
“We presented the prior knowledge questions at the end of the experiment to avoid exposing participants to topic-related questions that could influence participants’ reading behaviour (see McNamara & Kintsch, 1996).”
BackgroundSelf-citationToward an Interactive Model of Reading
Rumelhart, D. (2013) · Theoretical Models and Processes of Reading · doi:10.1598/0710.29 · Cited by 628
Cited by
Hamilton, D., McKechnie, J., Edgerton, E., & Wilson, C. (2021) · Journal of Computers in Education · doi:10.1007/s40692-020-00169-2 · Cited by 1,081
Elgort, I., & Warren, P. (2014) · Language Learning · doi:10.1111/lang.12052 · Cited by 240
Connor Desai, S., & Reimers, S. (2019) · Behavior Research Methods · doi:10.3758/s13428-018-1066-z · Cited by 127
“This finding is particularly interesting in light of the fact that responses to open and closed questions might be supported by different underlying retrieval processes (Fisher, Brewer, & Mitchell, 2009; Ozuru et al., 2013; Shapiro, 2006).”
BackgroundStuijfzand, S., Creswell, C., Field, A. P., Pearcey, S., & Dodd, H. (2018) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12822 · Cited by 151
“These response formats require active and passive information generation, respectively, which may influence responses and subsequent conclusions regarding bias (Ozuru, Best, Bell, Witherspoon, & McNamara, 2007; Ozuru, Briner, Kurby, & McNamara, 2013).”
A systematic review of pedagogical agent research: Similarities, differences and unexplored aspects
Dai, L., Jung, M. M., Postma, M., & Louwerse, M. M. (2022) · Computers & Education · doi:10.1016/j.compedu.2022.104607 · Cited by 128
Metadata
- Authors
- Ozuru, Y., Briner, S., Kurby, C. A., & McNamara, D. S.
- Affiliations
- University of Illinois Chicago (US)
- Grand Valley State University (US)
- Arizona State University (US)
- Venue
- Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale
- Published
- 2013-09
- Volume
- 67
- Issue
- 3
- Pages
- 215-227
- ISSN
- 1196-1961 (ISSN-L)
- 1878-7290
- OpenAlex
- W2202297923
- Cited by
- 134
- References
- 37
- Citations by year
- 2026: 14 · 2025: 7 · 2024: 12 · 2023: 12 · 2022: 17 · 2021: 18 · 2020: 10 · 2019: 13 · 2018: 10 · 2017: 7 · 2016: 5 · 2015: 6 · 2014: 3
- FWCI
- 9.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Canadian Journal of Experimental Psychology/Revue canadienne de psychologie expérimentale (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Reading and Literacy Development
- Life Sciences › Neuroscience › Cognitive Neuroscience › Memory Processes and Influences
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Visual and Cognitive Learning Processes
- Keywords
- text comprehension, multiple-choice questions, open-ended questions, self-explanation, prior knowledge, dual-process theory, reading comprehension
- MeSH terms
- Choice Behavior, Female, Humans, Language, Male, Surveys and Questionnaires, Reading, Mental Recall, Semantics, Statistics as Topic, Students, Universities, Vocabulary, Knowledge, Comprehension, Self Report
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Comparing comprehension measured by multiple-choice and open-ended questions. https://app.cochat.ai/papers/10.1037/a0032918
- The paper
- Ozuru, Y., Briner, S., Kurby, C. A., & McNamara, D. S. (2013). Comparing comprehension measured by multiple-choice and open-ended questions. Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale. https://doi.org/10.1037/a0032918
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.