The DOI matches its Crossref record; 105 of the 105 references it cites were found in a registry or an index.
Visual Narrative Structure
Open accessAbstract
Narratives are an integral part of human expression. In the graphic form, they range from cave paintings to Egyptian hieroglyphics, from the Bayeux Tapestry to modern day comic books (Kunzle, 1973; McCloud, 1993). Yet not much research has addressed the structure and comprehension of narrative images, for example, how do people create meaning out of sequential images? This piece helps fill the gap by presenting a theory of Narrative Grammar. We describe the basic narrative categories and their relationship to a canonical narrative arc, followed by a discussion of complex structures that extend beyond the canonical schema. This demands that the canonical arc be reconsidered as a generative schema whereby any narrative category can be expanded into a node in a tree structure. Narrative “pacing” is interpreted as a reflection of various patterns of this embedding: conjunction, left‐branching trees, center‐embedded constituencies, and others. Following this, diagnostic methods are proposed for testing narrative categories and constituency. Finally, we outline the applicability of this theory beyond sequential images, such as to film and verbal discourse, and compare this theory with previous approaches to narrative and discourse.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
ASPECTS OF THE THEORY OF SYNTAX
Chomsky, N. (1964) · doi:10.21236/ad0616323 · Cited by 13,587
Reading images: the grammar of visual design
(1996) · Choice Reviews Online · doi:10.5860/choice.34-1950 · Cited by 8,742
Chomsky, N. (1957) · doi:10.1515/9783112316009 · Cited by 7,885
Halliday, M. A. K., & Hasan, R. (2014) · Routledge eBooks · doi:10.4324/9781315836010 · Cited by 6,082
Strategies of Discourse Comprehension
Staczek, J. J., van Dijk, T. A., & Kintsch, W. (1985) · The Modern Language Journal · doi:10.2307/326517 · Cited by 5,395
Clark, H. H. (1996) · doi:10.1017/cbo9780511620539 · Cited by 5,123
A FRAMEWORK FOR REPRESENTING KNOWLEDGE
Minsky, M. (1988) · Readings in Cognitive Science · doi:10.1016/b978-1-4832-1446-7.50018-2 · Cited by 4,536
SCRIPTS, PLANS, GOALS, AND UNDERSTANDING
Schank, R. C., & Abelson, R. P. (1988) · Readings in Cognitive Science · doi:10.1016/b978-1-4832-1446-7.50019-4 · Cited by 4,535
Language, Context, and Text: Aspects of Language in a Social-Semiotic Perspective
Meyer, C. F., Halliday, M. A. K., & Hasan, R. (1987) · TESOL Quarterly · doi:10.2307/3586740 · Cited by 4,135
Narrative Analysis: Oral Versions of Personal Experience1
Labov, W., & Waletzky, J. (1997) · Journal of Narrative and Life History · doi:10.1075/jnlh.7.02nar · Cited by 3,300
Foundations of Language: Brain, Meaning, Grammar, Evolution
Jackendoff, R. (2002) · doi:10.1093/acprof:oso/9780198270126.001.0001 · Cited by 3,244
Scripts, Plans, Goals, and Understanding
Schank, R. C., & Abelson, R. P. (2013) · Psychology Press eBooks · doi:10.4324/9780203781036 · Cited by 3,155
Understanding Comics: The Invisible Art
Manning, A. D. (1998) · IEEE Transactions on Professional Communication · doi:10.1109/tpc.1998.661632 · Cited by 3,139
The psychology of computer vision
Rosenfeld, A. (1976) · Artificial Intelligence · doi:10.1016/0004-3702(76)90008-4 · Cited by 2,966
Situation models in language comprehension and memory
Zwaan, R. A., & Radvansky, G. A. (1998) · Psychological Bulletin · doi:10.1037/0033-2909.123.2.162 · Cited by 2,877
Using language: Communicative acts
Clark, H. H. (1996) · Cited by 2,721
Using language: Index of names
Clark, H. H. (1996) · Cited by 2,720
The Psychology of Learning and Motivation
Ross, B. H. (2012) · Cited by 2,632
Bergum, B. O., Long, J., & Baddeley, A. (1982) · The American Journal of Psychology · doi:10.2307/1422199 · Cited by 2,226
Boer, S. E., & Jackendoff, R. (1985) · The Philosophical Review · doi:10.2307/2184719 · Cited by 2,170
Toward a Cognitive Semantics: Typology and Process in Concept Structuring
Talmy, L. (2000) · The MIT Press eBooks · doi:10.7551/mitpress/6848.001.0001 · Cited by 2,111
Remembrance of things parsed: Story structure and recall
Mandler, J. M., & Johnson, N. S. (1977) · Cognitive Psychology · doi:10.1016/0010-0285(77)90006-8 · Cited by 2,085
Force Dynamics in Language and Cognition
Talmy, L. (1988) · Cognitive Science · doi:10.1207/s15516709cog1201_2 · Cited by 2,024
Foundations of Language: Brain, Meaning, Grammar, Evolution
Jackendoff, R. S. (2002) · Cited by 1,858
Basic notions of information structure
Krifka, M. (2008) · Acta Linguistica Hungarica · doi:10.1556/aling.55.2008.3-4.2 · Cited by 1,695
Rumelhart, D. E. (1975) · Representation and Understanding · doi:10.1016/b978-0-12-108550-6.50013-6 · Cited by 1,671
Essays on the Verbal and Visual Arts
Robins, R. H., & Helm, J. (1968) · Man · doi:10.2307/2798565 · Cited by 1,657
O'Brien, C., Bordwell, D., & Branigan, E. (1986) · SubStance · doi:10.2307/3684717 · Cited by 1,483
Cognitive structures in comprehension and memory of narrative discourse
Thorndyke, P. W. (1977) · Cognitive Psychology · doi:10.1016/0010-0285(77)90005-6 · Cited by 1,420
The temporal structure of spoken language understanding
Marslen-Wilson, W., & Tyler, L. K. (1980) · Cognition · doi:10.1016/0010-0277(80)90015-3 · Cited by 1,295
The transformation of experience in narrative syntax
Labov, W. (1972) · Medical Entomology and Zoology · Cited by 1,183
New Directions in Discourse Processing
MacWhinney, B., & Freedle, R. O. (1980) · Language · doi:10.2307/413771 · Cited by 1,155
What's new? Acquiring New information as a process in comprehension
Haviland, S. E., & Clark, H. H. (1974) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(74)80003-4 · Cited by 1,151
Asher, N. M., & Lascarides, A. (2003) · HAL · Cited by 1,115
Bordwell, D. (2013) · Routledge eBooks · doi:10.4324/9781315002163 · Cited by 1,099
Culicover, P. W., & Jackendoff, R. (2005) · doi:10.1093/acprof:oso/9780199271092.001.0001 · Cited by 1,079
(1984) · Medical Entomology and Zoology · Cited by 1,076
Causal thinking and the representation of narrative events
Trabasso, T., & van den Broek, P. (1985) · Journal of Memory and Language · doi:10.1016/0749-596x(85)90049-x · Cited by 1,069
Herman, D. (2009) · Wiley eBooks · doi:10.1002/9781444305920 · Cited by 1,002
Coherence, reference, and the theory of grammar
Kehler, A. (2002) · Cited by 939
The Construction of Situation Models in Narrative Comprehension: An Event-Indexing Model
Zwaan, R. A., Langston, M. C., & Graesser, A. C. (1995) · Psychological Science · doi:10.1111/j.1467-9280.1995.tb00513.x · Cited by 925
Language Comprehension as Structure Building
Gernsbacher, M. A. (1990) · doi:10.21236/ada221854 · Cited by 906
RHETORICAL STRUCTURE THEORY: A THEORY OF TEXT ORGANIZATION
Mann, W. C. (1987) · Cited by 892
Language Comprehension As Structure Building
Gernsbacher, M. A. (2013) · Psychology Press eBooks · doi:10.4324/9780203772157 · Cited by 888
Russian Formalist Criticism: Four Essays
Hughes, R. P., Lemon, L. T., & Reis, M. J. (1968) · The Slavic and East European Journal · doi:10.2307/304032 · Cited by 811
The Immersed Experiencer: Toward An Embodied Theory Of Language Comprehension
Zwaan, R. A. (2003) · Psychology of Learning and Motivation · doi:10.1016/s0079-7421(03)44002-4 · Cited by 796
Routledge encyclopedia of narrative theory
(2005) · Choice Reviews Online · doi:10.5860/choice.43-0024 · Cited by 770
Learning and Comprehension of Text
Bernhardt, E. B., Mandl, H., Stein, N. L., & Trabasso, T. (1988) · The Modern Language Journal · doi:10.2307/328249 · Cited by 695
Investigating differences in general comprehension skill.
Gernsbacher, M. A., Varner, K. R., & Faust, M. E. (1990) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037//0278-7393.16.3.430 · Cited by 670
Narrative comprehension and film
(1993) · Choice Reviews Online · doi:10.5860/choice.30-4904 · Cited by 610
The thetic/categorical distinction revisited
SASSE, H.-J. (1987) · Linguistics · doi:10.1515/ling.1987.25.3.511 · Cited by 601
Hoey, M. (1991) · Medical Entomology and Zoology · Cited by 564
Discourse in Cognitive Grammar
Langacker, R. W. (2001) · Cognitive Linguistics · doi:10.1515/cogl.12.2.143 · Cited by 554
Narrative Theory and the Cognitive Sciences
Herman, D. (2001) · Narrative Inquiry · doi:10.1075/ni.11.1.01her · Cited by 552
Metz, C. (1974) · De Gruyter eBooks · doi:10.1515/9783110816044 · Cited by 547
Balas, B. J., Nelson, C. A., Westerlund, A., Vogel-Farley, V., Riggins, T., & Kuefner, D. (2010) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.001.2010 · Cited by 542
On the coherence and structure of discourse
Hobbs, J. R. (1985) · Center for the Study of Language and Information eBooks · Cited by 525
A code in the node: The use of a story schema in retrieval∗
Mandler, J. M. (1978) · Discourse Processes · doi:10.1080/01638537809544426 · Cited by 456
Narrative Comprehension and Film
Branigan, E. (2013) · Routledge eBooks · doi:10.4324/9781315003108 · Cited by 444
Literacy, Language and Learning
Brumfit, C., Olson, D. R., Torrance, N., & Hildyard, A. (1986) · British Journal of Educational Studies · doi:10.2307/3121333 · Cited by 420
Stories are to entertain: A structural-affect theory of stories
Brewer, W. F., & Lichtenstein, E. H. (1982) · Journal of Pragmatics · doi:10.1016/0378-2166(82)90021-2 · Cited by 399
The perceptual organization of ongoing behavior
Newtson, D., & Engquist, G. (1976) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(76)90076-7 · Cited by 394
Athanasopoulos, P., & Bylund, E. (2024) · The Routledge Handbook of Second Language Acquisition, Morphosyntax, and Semantics · doi:10.4324/9781003412373-45 · Cited by 381
Influences of semantic and syntactic context on open- and closed-class words
Van Petten, C., & Kutas, M. (1991) · Memory & Cognition · doi:10.3758/bf03198500 · Cited by 363
The capacity for music: What is it, and what’s special about it?
Jackendoff, R., & Lerdahl, F. (2006) · Cognition · doi:10.1016/j.cognition.2005.11.005 · Cited by 362
Causal Cohesion and Story Coherence
Trabasso, T., Secco, T., & Broek, P. V. D. (2026) · Routledge eBooks · doi:10.4324/9781042014804-4 · Cited by 357
The dimensions of topiccomment
Jacobs, J. (2001) · Linguistics · doi:10.1515/ling.2001.027 · Cited by 356
Segmentation in reading and film comprehension.
Zacks, J. M., Speer, N. K., & Reynolds, J. R. (2009) · Journal of Experimental Psychology: General · doi:10.1037/a0015305 · Cited by 349
Story and Discourse: Narrative Structure in Fiction and Film
Chatman, S. (2019) · Cornell University Press eBooks · doi:10.1515/9781501741616 · Cited by 332
Arijon, D. (1976) · Medical Entomology and Zoology · Cited by 318
Point of view in narrative comprehension, memory, and production
Black, J. B., Turner, T. J., & Bower, G. H. (1979) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(79)90118-x · Cited by 294
The Impact of Continuity Editing in Narrative Film on Event Segmentation: Cognitive Science
Magliano, J. P., & Zacks, J. M. (2011) · Cognitive Science · doi:10.1111/j.1551-6709.2011.01202.x · Cited by 270
Proteus in Quotation-Land: Mimesis and the Forms of Reported Discourse
Sternberg, M. (1982) · Poetics Today · doi:10.2307/1772069 · Cited by 253
Bordwell, D. (2008) · Medical Entomology and Zoology · Cited by 249
Surface information loss in comprehension
Gernsbacher, M. A. (1985) · Cognitive Psychology · doi:10.1016/0010-0285(85)90012-x · Cited by 245
The brain’s cutting-room floor: segmentation of narrative cinema
Zacks, J. M. (2010) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2010.00168 · Cited by 238
Weak quantitative standards in linguistics research
Gibson, E., & Fedorenko, E. (2010) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2010.03.005 · Cited by 230
Indexing space and time in film understanding
Magliano, J. P., Miller, J., & Zwaan, R. A. (2001) · Applied Cognitive Psychology · doi:10.1002/acp.724 · Cited by 228
An Evaluation of Story Grammars*
Black, J. B., & Wilensky, R. (1979) · Cognitive Science · doi:10.1207/s15516709cog0303_2 · Cited by 225
Comprehension and memory of narrative texts: Inferences and coherence.
van den Broek, P. (1994) · Cited by 221
(Pea)nuts and bolts of visual narrative: Structure and meaning in sequential image comprehension
Cohn, N., Paczynski, M., Jackendoff, R. S., Holcomb, P. J., & Kuperberg, G. R. (2012) · Cognitive Psychology · doi:10.1016/j.cogpsych.2012.01.003 · Cited by 208
Self-citationThe effects of organization and instructional set on story memory∗
Stein, N. L., & Nezworski, T. (1978) · Discourse Processes · doi:10.1080/01638537809544433 · Cited by 197
Temporal changes as event boundaries: Processing and memory consequences of narrative time shifts☆
Speer, N. K., & Zacks, J. M. (2005) · Journal of Memory and Language · doi:10.1016/j.jml.2005.02.009 · Cited by 195
On the psychological validity of story structure
Mandler, J. M., & Goodman, M. S. (1982) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(82)90746-0 · Cited by 189
Telling stories: language, narrative, and social life
(2011) · Choice Reviews Online · doi:10.5860/choice.48-2511 · Cited by 188
Generating predictive inferences while viewing a movie
Magliano, J. P., Dijkstra, K., & Zwaan, R. A. (1996) · Discourse Processes · doi:10.1080/01638539609544973 · Cited by 173
Episodes as chunks in narrative memory
Black, J. B., & Bower, G. H. (1979) · Journal of Verbal Learning and Verbal Behavior · doi:10.1016/s0022-5371(79)90173-7 · Cited by 167
Event schemas, story schemas, and story grammars
Brewer, W. F., & Lichtenstein, E. (1980) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 157
Discourse organization in the comprehension of temporal order in narrative texts
Ohtsuka, K., & Brewer, W. F. (1992) · Discourse Processes · doi:10.1080/01638539209544815 · Cited by 114
The Notions of Information Structure
Féry, C., Fanselow, G., & Krifka, M. (2007) · Cited by 105
Is There More Than One Way to Recall a Story?
Mandler, J. M., & DeForest, M. (1979) · Child Development · doi:10.1111/j.1467-8624.1979.tb02442.x · Cited by 102
The story schema : universal and culture-specific properties
Brewer, W. F. (1984) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 92
The limits of time and transitions: challenges to theories of sequential image comprehension
Cohn, N. (2010) · Studies in Comics · doi:10.1386/stic.1.1.127/1 · Cited by 86
Self-citationToward a Structural Psychology of Cinema
Carroll, J. M. (1980) · Mouton eBooks · doi:10.1515/9783110825619 · Cited by 85
Empirical Evidence for Narrative Structure*
Gee, J. C., & Grosjean, F. (1984) · Cognitive Science · doi:10.1207/s15516709cog0801_3 · Cited by 71
The story of grammars and the grammar of stories
de Beaugrande, R. (1982) · Journal of Pragmatics · doi:10.1016/0378-2166(82)90014-5 · Cited by 69
What's wrong with story grammars
Garnham, A. (1983) · Cognition · doi:10.1016/0010-0277(83)90037-9 · Cited by 64
Todorov, T. (1968) · Langages · doi:10.3406/lgge.1968.2355 · Cited by 59
On the psychological reality of story structure
Mandler, J. M. (1987) · Discourse Processes · doi:10.1080/01638538709544656 · Cited by 53
Cohn, N. (2007) · Public Journal of Semiotics · doi:10.37693/pjos.2007.1.8814 · Cited by 51
Self-citationThe Coherence of Visual Narratives
KRAFT, R. N., CANTOR, P., & GOTTDIENER, C. (1991) · Communication Research · doi:10.1177/009365091018005002 · Cited by 44
Relatedness: Aspects of Textual Connectivity in Comics
Saraceni, M. (2016) · Bloomsbury Publishing Plc eBooks · doi:10.5040/9781474283670.ch-005 · Cited by 41
Cohn, N., Taylor-Weiner, A. N., & Grossman, S. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00349 · Cited by 30
Self-citationA different kind of cultural frame: An analysis of panels in American comics and Japanese manga
Cohn, N. (2011) · Image & narrative · Cited by 27
Self-citationKeeping an Eye on Things: Attention, Tracking and Coherence-Building
Bridgeman, T. (2004) · DalSpace (Dalhousie University) · Cited by 4
Research works printed but not linked: 43
- Block B., 2008, The visual story
- Bordwell D., 1997, Film art: An introduction
- Bridgeman T., 2005, The Francophone Bande Desinée, 115, 10.1163/9789401201964_010 · doi:10.1163/9789401201964_010
- Brown B., 2002, Cinematography theory and practice
- 10.1017/CBO9780511613142 · doi:10.1017/cbo9780511613142
- Butcher S. H., 1902, The poetics of Aristotle
- Chatman S., 1978, Story and discourse
- Cohn N., 2003, Early writings on visual language
- Cohn N., 2010, Manga: An anthology of global and cultural perspectives, 187
- Cohn N.(2012).Structure meaning and constituency in visual narrative comprehension. Doctoral Dissertation Medford MA:Tufts University.
- Colin M., 1995, The film spectator: From sign to mind, 45
- 10.1016/j.tics.2010.03.012 · doi:10.1016/j.tics.2010.03.012
- Duncan R., 2000, Academic forum, 71
- Eisenstein S., 1942, Film sense
- Eisner W., 1985, Comics & sequential art
- Engelhardt Y., 2002, The language of graphics
- Engelhardt Y., 2007, Syntactic structures in graphics, Computational Visualistics and Picture Morphology, 5, 23
- 10.1016/S0022-5371(65)80081-0 · doi:10.1016/s0022-5371(65)80081-0
- Freytag G., 1894, Technique of the drama
- Gee J. P., 1983, Narrative/story structure, pausing, and American Sign Language, Discourse Processes, 6, 243
- Genette G., 1980, Narrative discourse
- 10.1037/0278-7393.16.3.430 · DOI
- Herman D., 2009, Cognitive poetics: Goals, gains and gaps, 30
- Hinds J., 1976, Aspects of Japanese discourse
- Jackendoff R., 1977, X‐bar syntax: A study of phrase structure
- Jackendoff R., 1990, Semantic structures
- 10.2307/1773182 · doi:10.2307/1773182
- Kunzle D., 1973, The history of the comic strip
- Labov W., 1972, Language in the inner city, 354
- Lefèvre P., 2000, Narration in comics, Image [&] Narrative, 1
- Madden M., 2008, Drawing words and writing pictures
- 10.2307/1128960 · doi:10.2307/1128960
- McCloud S., 2006, Making comics
- Primus B., 1993, Handbuch syntax, 880, 10.1515/9783110095869.1.13.880 · doi:10.1515/9783110095869.1.13.880
- Saraceni M., 2000, Language beyond language: Comics as verbo‐visual texts
- Saraceni M., 2001, The graphic novel, 167
- Stainbrook E. J., 2003, Reading comics: A theoretical analysis of textuality and discourse in the comics medium
- Sternberg M., 2001, How narrativity makes a difference, Narrative, 9, 115
- Talmy L., 1995, Deixis in narrative: A cognitive science perspective, 421
- Talmy L., 2000, Toward a cognitive semantics
- Talmy L., 2000, Toward a cognitive semantics
- Yamazaki M., 1984, On the art of the no drama: The major treatises of Zeami, 10.1515/9780691213309 · doi:10.1515/9780691213309
- Zacks J. M., 2011, Art and the senses, 435
Cited by
Navigating Comics: An Empirical and Theoretical Approach to Strategies of Reading Comic Page Layouts
Cohn, N. (2013) · Frontiers in Psychology · doi:10.3389/fpsyg.2013.00186 · Cited by 126
Self-citationCohn, N. (2014) · Frontiers in Psychology · doi:10.3389/fpsyg.2014.00680 · Cited by 77
Self-citationSocrates: Data Story Generation via Adaptive Machine-Guided Elicitation of User Feedback
Wu, G., Guo, S., Hoffswell, J., Chan, G. Y.-Y., Rossi, R. A., & Koh, E. (2023) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2023.3327363 · Cited by 15
Metadata
- Authors
- Cohn, N.
- Venue
- Cognitive Science
- Publisher
- Wiley
- Published
- 2012-11-19
- Volume
- 37
- Issue
- 3
- Pages
- 413-452
- ISSN
- 0364-0213 (ISSN-L)
- 1551-6709
- OpenAlex
- W2057342209
- Cited by
- 313
- References
- 105
- FWCI
- 184.79
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.