The DOI matches its Crossref record; 93 of the 93 references it cites were found in a registry or an index.
Issues in the Classification of Multimodal Communication Signals
Abstract
Communication involves complex behavior in multiple sensory channels, or "modalities." We provide an overview of multimodal communication and its costs and benefits, place examples of signals and displays from an array of taxa, sensory systems, and functions into our signal classification system, and consider issues surrounding the categorization of multimodal signals. The broadest level of classification is between signals with redundant and nonredundant components, with finer distinctions in each category. We recommend that researchers gather information on responses to each component of a multimodal signal as well as the response to the signal as a whole. We discuss the choice of categories, whether to categorize signals on the basis of the signal or the response, and how to classify signals if data are missing. The choice of behavioral assay may influence the outcome, as may the context of the communicative event. We also consider similarities and differences between multimodal and unimodal composite signals and signals that are sequentially, rather than simultaneously, multimodal.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The expression of the emotions in man and animals.
Darwin, C. (1872) · J. Murray eBooks · doi:10.1037/10001-000 · Cited by 11,657
Hearing lips and seeing voices
MCGURK, H., & MACDONALD, J. (1976) · Nature · doi:10.1038/264746a0 · Cited by 6,183
Some Experiments on the Recognition of Speech, with One and with Two Ears
Cherry, E. C. (1953) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907229 · Cited by 4,549
Visual Contribution to Speech Intelligibility in Noise
Sumby, W. H., & Pollack, I. (1954) · The Journal of the Acoustical Society of America · doi:10.1121/1.1907309 · Cited by 2,583
Principles of animal communication
(2012) · Choice Reviews Online · doi:10.5860/choice.49-5059 · Cited by 2,529
Signals, Signal Conditions, and the Direction of Evolution
Endler, J. A. (1992) · The American Naturalist · doi:10.1086/285308 · Cited by 1,960
(1994) · Choice Reviews Online · doi:10.5860/choice.31-4365 · Cited by 1,882
Symposia of the Zoological Society of London
Saunders, G., White, P. C. L., Rayner, J. M. V., & Harris, S. (1993) · Cited by 1,402
Receiver psychology and the evolution of animal signals
Guilford, T., & Dawkins, M. S. (1991) · Animal Behaviour · doi:10.1016/s0003-3472(05)80600-1 · Cited by 1,019
(2004) · Medical Entomology and Zoology · Cited by 978
The bimodal perception of speech in infancy
Kuhl, P. K., & Meltzoff, A. N. (1982) · Science · doi:10.1126/science.7146899 · Cited by 919
Why have birds got multiple sexual ornaments?
Moller, A. P., & Pomiankowski, A. (1993) · Behavioral Ecology and Sociobiology · doi:10.1007/bf00173774 · Cited by 841
Exploitation of Sexual Signals by Predators and Parasitoids
Zuk, M., & Kolluru, G. R. (1998) · The Quarterly Review of Biology · doi:10.1086/420412 · Cited by 836
Animal signals: information or manipulation?
Dawkins, R., & Krebs, J. R. (1978) · Cited by 823
Adaptations for Acoustic Communication in Birds: Sound Transmission and Signal Detection
WILEY, R. H., & RICHARDS, D. G. (1982) · Acoustic Communication in Birds · doi:10.1016/b978-0-08-092416-8.50014-0 · Cited by 774
Receiver psychology and the evolution of multicomponent signals
Rowe, C. (1999) · Animal Behaviour · doi:10.1006/anbe.1999.1242 · Cited by 704
Partan, S., & Marler, P. (1999) · Science · doi:10.1126/science.283.5406.1272 · Cited by 688
Self-citationGoodall, J. R. (1997) · Cited by 683
Some general comments on the evolution and design of animal communication systems
Endler, J. A. (1993) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1993.0060 · Cited by 663
Multiple displays in animal communication: ‘backup signals’ and ‘multiple messages’
Johnstone, R. A. (1996) · Philosophical Transactions of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rstb.1996.0026 · Cited by 627
Perceiving talking faces: from speech perception to a behavioral principle
Massaro, D. W. (1997) · Medical Entomology and Zoology · Cited by 615
Smith, W. J. (1977) · Harvard University Press eBooks · doi:10.4159/9780674043794 · Cited by 543
Comparative Studies of the Behaviour of Gulls (Laridae): a Progress Report1)
Tinbergen, N. (1960) · Behaviour · doi:10.1163/156853960x00098 · Cited by 501
Just, T., & Hartmann, M. (1937) · American Midland Naturalist · doi:10.2307/2420591 · Cited by 453
Cephalopod chromatophores: neurobiology and natural history
MESSENGER, J. B. (2001) · Biological Reviews · doi:10.1017/s1464793101005772 · Cited by 414 · cited 2×
“The flexibility proffered by neural control of numerous skin chromatophores, for example, allows the male Caribbean reef squid (Sepioteuthis sepioidea) to simultaneously produce a dark display on one side to attract females and a silver display on the other side to ward off competing males (Messenger 2001).”
BackgroundThe Origin and Evolution of the Calls and Facial Expressions of the Primates
Andrew, R. J. (1963) · Behaviour · doi:10.1163/156853963x00220 · Cited by 348
Female visual displays affect the development of male song in the cowbird
West, M. J., & King, A. P. (1988) · Nature · doi:10.1038/334244a0 · Cited by 342
Honesty, perception and population divergence in sexually selected traits
(1993) · Proceedings of the Royal Society of London. Series B: Biological Sciences · doi:10.1098/rspb.1993.0089 · Cited by 331
Perceiving Talking Faces: From Speech Perception to a Behavioral Principle
Plant, G. (1999) · Ear and Hearing · doi:10.1097/00003446-199904000-00011 · Cited by 326
The energetic cost of display in male sage grouse
Vehrencamp, S. L., Bradbury, J. W., & Gibson, R. M. (1989) · Animal Behaviour · doi:10.1016/s0003-3472(89)80120-4 · Cited by 321
THE EVOLUTION OF MATE PREFERENCES FOR MULTIPLE SEXUAL ORNAMENTS
Iwasa, Y., & Pomiankowski, A. (1994) · Evolution · doi:10.1111/j.1558-5646.1994.tb01367.x · Cited by 317
Washburn, S. L. (1978) · Scientific American · doi:10.1038/scientificamerican0978-194 · Cited by 288
Perceiving affect from the voice and the face
Massaro, D. W., & Egan, P. B. (1996) · Psychonomic Bulletin & Review · doi:10.3758/bf03212421 · Cited by 285
The Behavior of Communicating: An Ethological Approach
Smith, W. J. B. (1980) · Cited by 278
Marler, P. (1967) · Science · doi:10.1126/science.157.3790.769 · Cited by 275
Self-citationThe logical analysis of animal communication
Marler, P. (1961) · Journal of Theoretical Biology · doi:10.1016/0022-5193(61)90032-7 · Cited by 274
Self-citationBekoff, M. (1972) · The Quarterly Review of Biology · doi:10.1086/407400 · Cited by 273
Individual colour patches as multicomponent signals
Grether, G. F., Kolluru, G. R., & Nersissian, K. (2004) · Biological Reviews · doi:10.1017/s1464793103006390 · Cited by 263
A GENE MUTATION WHICH CHANGES A BEHAVIOR PATTERN
Bastock, M. (1956) · Evolution · doi:10.1111/j.1558-5646.1956.tb02868.x · Cited by 263
Ryan, M. J., & Rand, A. S. (1990) · Evolution · doi:10.1111/j.1558-5646.1990.tb05200.x · Cited by 257
Bimodal signal requisite for agonistic behavior in a dart-poison frog,Epipedobatesfemoralis
Narins, P. M., Hödl, W., & Grabul, D. S. (2003) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0237165100 · Cited by 252
Bat Predation and Its Influence on Calling Behavior in Neotropical Katydids
Belwood, J. J., & Morris, G. K. (1987) · Science · doi:10.1126/science.238.4823.64 · Cited by 248
Variable female preferences drive complex male displays
Coleman, S. W., Patricelli, G. L., & Borgia, G. (2004) · Nature · doi:10.1038/nature02419 · Cited by 243
Uetz, G. W., & Roberts, J. A. (2002) · Brain, Behavior and Evolution · doi:10.1159/000064909 · Cited by 242
Hidden colour aversions in domestic chicks triggered by pyrazine odours of insect warning displays
Rowe, C., & Guilford, T. (1996) · Nature · doi:10.1038/383520a0 · Cited by 229
Communication in Monkeys and Apes
Marler, P. (1965) · Cited by 227
Self-citationMessage, Meaning, and Context in Ethology
Smith, W. J. (1965) · The American Naturalist · doi:10.1086/282382 · Cited by 225
Facial expressions linked to monkey calls
Ghazanfar, A. A., & Logothetis, N. K. (2003) · Nature · doi:10.1038/423937a · Cited by 216
Honest advertisement of multiple qualities using multiple signals
Johnstone, R. A. (1995) · Journal of Theoretical Biology · doi:10.1016/s0022-5193(05)80006-2 · Cited by 206
Multimodal signals in ant communication
Hölldobler, B. (1999) · Journal of Comparative Physiology A: Sensory, Neural, and Behavioral Physiology · doi:10.1007/s003590050313 · Cited by 204
How honeybees perceive communication dances, studied by means of a mechanical model
Michelsen, A., Andersen, B. B., Storm, J., Kirchner, W. H., & Lindauer, M. (1992) · Behavioral Ecology and Sociobiology · doi:10.1007/bf00166696 · Cited by 197
FUNCTIONAL ASPECTS OF DROSOPHILA COURTSHIP
EWING, A. W. (1983) · Biological Reviews · doi:10.1111/j.1469-185x.1983.tb00390.x · Cited by 184
Scheffer, S. J., Uetz, G. W., & Stratton, G. E. (1996) · Behavioral Ecology and Sociobiology · doi:10.1007/s002650050212 · Cited by 172
Die Paarbildung bei einigen Cichliden: I. Die Paarbildung bei Astatotilapia strigigena Pfeffer
Seitz, A. (1940) · Zeitschrift für Tierpsychologie · doi:10.1111/j.1439-0310.1940.tb00617.x · Cited by 166
Møller, A. P., Saino, N., Taramino, G., Galeotti, P., & Ferrario, S. (1998) · The American Naturalist · doi:10.1086/286114 · Cited by 166
STEIN, B. E., & MEREDITH, M. A. (1990) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1990.tb48891.x · Cited by 164
Evolution of Facial Musculature and Facial Expression.
(1932) · Journal of the American Medical Association · doi:10.1001/jama.1932.02730380092044 · Cited by 161
Markl, H. S., & H�lldobler, B. (1978) · Behavioral Ecology and Sociobiology · doi:10.1007/bf00354979 · Cited by 160
Singing and cryptic speciation insects
Henry, C. S. (1994) · Trends in Ecology & Evolution · doi:10.1016/0169-5347(94)90061-2 · Cited by 154
Marples, N. M., van Veelen, W., & Brakefield, P. M. (1994) · Animal Behaviour · doi:10.1006/anbe.1994.1322 · Cited by 152
Zuk, M., Ligon, J. D., & Thornhill, R. (1992) · Animal Behaviour · doi:10.1016/s0003-3472(05)80312-4 · Cited by 151
Amplifiers and the handicap principle in sexual selection: a different emphasis
Hasson, O. (1989) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.1989.0006 · Cited by 151
The role of articulation in the production of rhesus monkey, Macaca mulatta, vocalizations
Hauser, M., Evans, C., & Marler, P. (1993) · Animal Behaviour · doi:10.1006/anbe.1993.1054 · Cited by 149
Self-citationSeismic signals in a courting male jumping spider (Araneae:Salticidae)
Elias, D. O., Mason, A. C., Maddison, W. P., & Hoy, R. R. (2003) · Journal of Experimental Biology · doi:10.1242/jeb.00634 · Cited by 139
Nowicki, S., & Marler, P. (1988) · Music Perception An Interdisciplinary Journal · doi:10.2307/40285408 · Cited by 138
Self-citationFeature Weighting in Species Song Recognition By the Field Sparrow (Spizella Pusilla)
Nelson, D. A. (1988) · Behaviour · doi:10.1163/156853988x00142 · Cited by 135
Partan, S. R. (2002) · Behaviour · doi:10.1163/15685390260337877 · Cited by 133
Self-citationThe chemistry of social regulation: multicomponent signals in ant societies.
Hölldobler, B. (1995) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.92.1.19 · Cited by 131
Odour and colour as cues for taste-avoidance learning in domestic chicks
ROPER, T. J., & Marples, N. M. (1997) · Animal Behaviour · doi:10.1006/anbe.1996.0384 · Cited by 119
The function of concurrent signals: visual and chemical communication in snapping shrimp
Hughes, M. (1996) · Animal Behaviour · doi:10.1006/anbe.1996.0170 · Cited by 118
Vocal Affect Signaling: A Comparative Approach
Scherer, K. R. (1985) · Advances in the study of behavior · doi:10.1016/s0065-3454(08)60490-8 · Cited by 117
RESPONSES TO MULTIPLE CHEMICAL CUES BY THE CRAYFISH ORCONECTES VIRILIS
Hazlett, B. A. (1999) · Behaviour · doi:10.1163/156853999501261 · Cited by 102
Schneider, S. S., & Lewis, L. A. (2004) · Apidologie · doi:10.1051/apido:2004006 · Cited by 101
Multisensory integration: perceptual grouping by eye and ear
King, A. J., & Calvert, G. A. (2001) · Current Biology · doi:10.1016/s0960-9822(01)00175-0 · Cited by 99
Sound improves visual discrimination learning in avian predators
Rowe, C. (2002) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2002.2012 · Cited by 99
Rybak, F., Sureau, G., & Aubin, T. (2002) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2001.1919 · Cited by 98
Ultraviolet visual sensitivity in desert iguanas: implications for pheromone detection
Alberts, A. C. (1989) · Animal Behaviour · doi:10.1016/s0003-3472(89)80072-7 · Cited by 96
Perceptual biases for multimodal cues in chimpanzee (Pan troglodytes) affect recognition
Parr, L. A. (2004) · Animal Cognition · doi:10.1007/s10071-004-0207-1 · Cited by 80
The influence of sensory information on patch residence time in wolf spiders (Araneae: Lycosidae)
Persons, M. H., & Uetz, G. W. (1996) · Animal Behaviour · doi:10.1006/anbe.1996.0133 · Cited by 77
Noller, P. (1985) · Journal of Nonverbal Behavior · doi:10.1007/bf00987557 · Cited by 71
Display, Timing and Function of Wing Movements Accompanying Antiphonal Duets of Cichladusa Guttata
Todt, D., & Fiebelkorn, A. (1980) · Behaviour · doi:10.1163/156853980x00069 · Cited by 63
Terrick, T. D., Mumme, R. L., & Burghardt, G. M. (1995) · Animal Behaviour · doi:10.1006/anbe.1995.0118 · Cited by 56
Some determinants of response summation
Aydin, A., & Pearce, J. M. (1997) · Animal Learning & Behavior · doi:10.3758/bf03199029 · Cited by 54
Visual and acoustic communication in non-human animals: a comparison
Rosenthal, G. G., & Ryan, M. J. (2000) · Journal of Biosciences · doi:10.1007/bf02703937 · Cited by 54
Partan, S. R., Yelda, S., Price, V. L., et al. (2005) · Animal Behaviour · doi:10.1016/j.anbehav.2005.03.002 · Cited by 51
Self-citationFusani, L., Hutchison, R. E., & Hutchison, J. B. (1997) · Behaviour · doi:10.1163/156853997x00566 · Cited by 44
Modes of vocal variation in Sykes's monkey (Cercopithecus albogularis) squeals.
Brown, C. H., & Cannito, M. P. (1995) · Journal of comparative psychology · doi:10.1037/0735-7036.109.4.398 · Cited by 42
Visual and Chemical Composite Signaling Effects of Sceloporus Lizard Fecal Boli
Duvall, D., Graves, B. M., & Carpenter, G. C. (1987) · Copeia · doi:10.2307/1445568 · Cited by 38
de Gelder, B., & Vroomen, J. (2000) · Cognition & Emotion · doi:10.1080/026999300378842 · Cited by 31
Hassler, C., & Brockmann, H. J. (2001) · Journal of Chemical Ecology · doi:10.1023/a:1012291206831 · Cited by 29
The Display of the Blue‐black Grassquit: The Acoustic Advantage of Getting High
Wilczynski, W., Ryan, M. J., & Brenowitz, E. A. (1989) · Ethology · doi:10.1111/j.1439-0310.1989.tb00741.x · Cited by 27
Rowe, C. (1999) · Science · doi:10.1126/science.284.5415.741h · Cited by 13
Overview: Animal acoustic communication and the role of the physical environment.
Rundus, A. S., & Hart, L. A. (2002) · Journal of comparative psychology · doi:10.1037//0735-7036.116.2.120 · Cited by 12
Cited by
Neuronal oscillations and visual amplification of speech
Schroeder, C. E., Lakatos, P., Kajikawa, Y., Partan, S., & Puce, A. (2008) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2008.01.002 · Cited by 498
Self-citationDynamics of multiple signalling systems: animal communication in a world in flux
Bro-Jørgensen, J. (2010) · Trends in Ecology & Evolution · doi:10.1016/j.tree.2009.11.003 · Cited by 379
An introduction to multimodal communication
Higham, J. P., & Hebets, E. A. (2013) · Behavioral Ecology and Sociobiology · doi:10.1007/s00265-013-1590-x · Cited by 281
de Groot, J. H. B., Semin, G. R., & Smeets, M. A. M. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033731 · Cited by 71
Dobson, S. D. (2009) · American Journal of Physical Anthropology · doi:10.1002/ajpa.20902 · Cited by 61
Metadata
- Authors
- Partan, S. R., & Marler, P.
- Venue
- The American Naturalist
- Publisher
- University of Chicago Press
- Published
- 2005-08
- Volume
- 166
- Issue
- 2
- Pages
- 231-245
- ISSN
- 0003-0147 (ISSN-L)
- 1537-5323
- OpenAlex
- W2176910270
- Cited by
- 596
- References
- 93
- FWCI
- 18.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.