In a Blink of an Eye and a Switch of a Transistor: Cortically Coupled Computer Vision
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
Our society's information technology advancements have resulted in the increasingly problematic issue of information overload—i.e., we have more access to information than we can possibly process. This is nowhere more apparent than in the volume of imagery and video that we can access on a daily basis—for the general public, availability of YouTube video and Google Images, or for the image analysis professional tasked with searching security video or satellite reconnaissance. Which images to look at and how to ensure we see the images that are of most interest to us, begs the question of whether there are smart ways to triage this volume of imagery. Over the past decade, computer vision research has focused on the issue of ranking and indexing imagery. However, computer vision is limited in its ability to identify interesting imagery, particularly as “interesting” might be defined by an individual. In this paper we describe our efforts in developing brain–computer interfaces (BCIs) which synergistically integrate computer vision and human vision so as to construct a system for image triage. Our approach exploits machine learning for real-time decoding of brain signals which are recorded noninvasively via electroencephalography (EEG). The signals we decode are specific for events related to imagery attracting a user's attention. We describe two architectures we have developed for this type of cortically coupled computer vision and discuss potential applications and challenges for the future.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Speed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Natural Image Statistics and Neural Representation
Simoncelli, E. P., & Olshausen, B. A. (2001) · Annual Review of Neuroscience · doi:10.1146/annurev.neuro.24.1.1193 · Cited by 2,460 · cited 1×
“More recently the problem of invariance has been considered from a statistical perspective, with the idea that Bnatural scene statistics[ may hold the key to how our visual systems learn and represent these invariances [ 1 ].”
BackgroundThe P300: Where in the Brain Is It Produced and What Does It Tell Us?
Linden, D. E. J. (2005) · The Neuroscientist · doi:10.1177/1073858405280524 · Cited by 833 · cited 1×
“It reflects a perceptual “orienting response” or shift of atten tion which can be driven by the content of the sensory input stream [16].”
BackgroundMiyawaki, Y., Uchida, H., Yamashita, O., Sato, M.-A., Morito, Y., Tanabe, H. C., Sadato, N., & Kamitani, Y. (2008) · Neuron · doi:10.1016/j.neuron.2008.11.004 · Cited by 543 · cited 1×
“Also assume the state of the database can be characterized by a utility function, U which quantifies how Bordered[ the database is with respect to the interest of the person, p, searching the data at a given time, t; UðD0jp; tÞ.”
BackgroundCortical origins of response time variability during rapid discrimination of visual objects
Gerson, A. D., Parra, L. C., & Sajda, P. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.06.026 · Cited by 103
Self-citation
Cited by
EEGNet: A Compact Convolutional Network for EEG-based Brain-Computer Interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2016) · arXiv · doi:10.48550/arxiv.1611.08024 · Cited by 5,105
EEGNet: a compact convolutional neural network for EEG-based brain-computer interfaces
Lawhern, V. J., Solon, A. J., Waytowich, N. R., Gordon, S. M., Hung, C. P., & Lance, B. J. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aace8c · Cited by 5,115
“When the image presentation rate increases to 2 Hz or more, it is commonly referred to as rapid serial visual presentation (RSVP), which has been used in several BCIs for large image database triage [43,48,49]. The EEG data used here has been previously described in [49]; a brief description is given below. 18 partici…”
MethodOpen Access Dataset for EEG+NIRS Single-Trial Classification
Shin, J., von Luhmann, A., Blankertz, B., Kim, D.-W., Jeong, J., Hwang, H.-J., & Muller, K.-R. (2017) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2016.2628057 · Cited by 287
Brain–Computer Interface Technologies in the Coming Decades
Lance, B. J., Kerick, S. E., Ries, A. J., Oie, K. S., & McDowell, K. (2012) · Proceedings of the IEEE · doi:10.1109/jproc.2012.2184830 · Cited by 231
“Prototype BCIs are currently being used to augment the computer vision algorithms to help operators find objects within an environment [37].”
BackgroundA review of rapid serial visual presentation-based brain–computer interfaces
Lees, S., Dayan, N., Cecotti, H., McCullagh, P., Maguire, L., Lotte, F., & Coyle, D. (2018) · Journal of Neural Engineering · doi:10.1088/1741-2552/aa9817 · Cited by 149
Metadata
- Authors
- Sajda, P., Pohlmeyer, E., Wang, J., Parra, L. C., Christoforou, C., Dmochowski, J., Hanna, B., Bahlmann, C., Singh, M. K., & Chang, S.-F.
- Venue
- Proceedings of the IEEE
- Published
- 2010-03
- Volume
- 98
- Issue
- 3
- Pages
- 462-478
- ISSN
- 0018-9219 (ISSN-L)
- 1558-2256
- OpenAlex
- W2108027679
- Cited by
- 153
- References
- 5
- FWCI
- 6.34
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.