Closing the loop in cortically-coupled computer vision: a brain–computer interface for searching image databases
The DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
We describe a closed-loop brain-computer interface that re-ranks an image database by iterating between user generated 'interest' scores and computer vision generated visual similarity measures. The interest scores are based on decoding the electroencephalographic (EEG) correlates of target detection, attentional shifts and self-monitoring processes, which result from the user paying attention to target images interspersed in rapid serial visual presentation (RSVP) sequences. The highest scored images are passed to a semi-supervised computer vision system that reorganizes the image database accordingly, using a graph-based representation that captures visual similarity between images. The system can either query the user for more information, by adaptively resampling the database to create additional RSVP sequences, or it can converge to a 'done' state. The done state includes a final ranking of the image database and also a 'guess' of the user's chosen category of interest. We find that the closed-loop system's re-rankings can substantially expedite database searches for target image categories chosen by the subjects. Furthermore, better reorganizations are achieved than by relying on EEG interest rankings alone, or if the system were simply run in an open loop format without adaptive resampling.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Brain–computer interfaces for communication and control
Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., & Vaughan, T. M. (2002) · Clinical Neurophysiology · doi:10.1016/s1388-2457(02)00057-3 · Cited by 7,927
Updating P300: An integrative theory of P3a and P3b
Polich, J. (2007) · Clinical Neurophysiology · doi:10.1016/j.clinph.2007.04.019 · Cited by 7,919
Conflict monitoring and anterior cingulate cortex: an update
Botvinick, M. M., Cohen, J. D., & Carter, C. S. (2004) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2004.10.003 · Cited by 3,623 · cited 1×
“This late component has a topology that is somewhat consistent with self-monitoring activity, such as the error-related negativity (ERN), which is often associated with perceived error and/or conflict [53, 54].”
BackgroundSpeed of processing in the human visual system
Thorpe, S., Fize, D., & Marlot, C. (1996) · Nature · doi:10.1038/381520a0 · Cited by 3,538
Farwell, L. A., & Donchin, E. (1988) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(88)90149-6 · Cited by 3,228
A review of classification algorithms for EEG-based brain–computer interfaces
Lotte, F., Congedo, M., Lécuyer, A., Lamarche, F., & Arnaldi, B. (2007) · Journal of Neural Engineering · doi:10.1088/1741-2560/4/2/r01 · Cited by 2,665
Learning to control a brain–machine interface for reaching and grasping by primates
Carmena, J. M., Lebedev, M. A., Crist, R. E., O'Doherty, J. E., Santucci, D. M., Dimitrov, D. F., Patil, P. G., Henriquez, C. S., & Nicolelis, M. A. L. (2003) · PLoS Biology · doi:10.1371/journal.pbio.0000042 · Cited by 1,761
Temporary suppression of visual processing in an RSVP task: an attentional blink?
Raymond, J. E., Shapiro, K. L., & Arnell, K. M. (1992) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037/0096-1523.18.3.849 · Cited by 1,649 · cited 1×
“While in this work subjects who appeared to generate eye movements preferentially following target images were eliminated, no attempt was made to address the consequences of the other subjects blinking and thus missing a target, or perhaps missing a target due to an attentional blink [56] resulting from the appearance…”
BackgroundControl of a two-dimensional movement signal by a noninvasive brain-computer interface in humans
Wolpaw, J. R., & McFarland, D. J. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0403504101 · Cited by 1,512
Brain–computer interfaces in neurological rehabilitation
Daly, J. J., & Wolpaw, J. R. (2008) · The Lancet Neurology · doi:10.1016/s1474-4422(08)70223-0 · Cited by 1,149
Cited by
Online and Offline Domain Adaptation for Reducing BCI Calibration Effort
Wu, D. (2017) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2016.2608931 · Cited by 114
Cecotti, H., Eckstein, M. P., & Giesbrecht, B. (2014) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2014.2302898 · Cited by 109
“search [14]–[18], and face recognition tasks [19].”
MethodMarathe, A. R., Lawhern, V. J., Wu, D., Slayback, D., & Lance, B. J. (2016) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2015.2502323 · Cited by 64
Cecotti, H., & Ries, A. J. (2017) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2016.07.500 · Cited by 50
Matran-Fernandez, A., & Poli, R. (2017) · PLOS ONE · doi:10.1371/journal.pone.0178498 · Cited by 45
Metadata
- Authors
- Pohlmeyer, E. A., Wang, J., Jangraw, D. C., Lou, B., Chang, S.-F., & Sajda, P.
- Venue
- Journal of Neural Engineering
- Publisher
- IOP Publishing
- Published
- 2011-05-12
- Volume
- 8
- Issue
- 3
- Pages
- 036025
- ISSN
- 1741-2552 (ISSN-L)
- 1741-2560
- OpenAlex
- W2105126477
- Cited by
- 85
- References
- 17
- FWCI
- 2.26
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Closing the loop in cortically-coupled computer vision: a brain–computer interface for searching image databases. https://app.cochat.ai/papers/10.1088/1741-2560/8/3/036025
- The paper
- Pohlmeyer, E. A., Wang, J., Jangraw, D. C., Lou, B., Chang, S.-F., & Sajda, P. (2011). Closing the loop in cortically-coupled computer vision: a brain–computer interface for searching image databases. Journal of Neural Engineering. https://doi.org/10.1088/1741-2560/8/3/036025
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.