Towards the automated localisation of targets in rapid image-sifting by collaborative brain-computer interfaces
Open accessThe DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.
Abstract
The N2pc is a lateralised Event-Related Potential (ERP) that signals a shift of attention towards the location of a potential object of interest. We propose a single-trial target-localisation collaborative Brain-Computer Interface (cBCI) that exploits this ERP to automatically approximate the horizontal position of targets in aerial images. Images were presented by means of the rapid serial visual presentation technique at rates of 5, 6 and 10 Hz. We created three different cBCIs and tested a participant selection method in which groups are formed according to the similarity of participants' performance. The N2pc that is elicited in our experiments contains information about the position of the target along the horizontal axis. Moreover, combining information from multiple participants provides absolute median improvements in the area under the receiver operating characteristic curve of up to 21% (for groups of size 3) with respect to single-user BCIs. These improvements are bigger when groups are formed by participants with similar individual performance, and much of this effect can be explained using simple theoretical models. Our results suggest that BCIs for automated triaging can be improved by integrating two classification systems: one devoted to target detection and another to detect the attentional shifts associated with lateral targets.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


![Fig 3 Classification and merging steps for the MC-cBCI and LDA-cBCI ways of creating a collaborative BCI. Epochs corresponding to trial j are extracted from all the group members, Epi,j, i ∈ [1, N], where N is the group size. Each participant i has an individually tailored classifier, Cli. The outputs of the N classifiers in response to the individual epochs, Sci,j are merged either by averaging the scores (MC-cBCI approach) or through an LDA classifier (LDA-cBCI approach) in order to obtain a final group score, Scj, which is used to measure the group performance by means of the AUC.](https://figures.cochat.ai/paper-figures/96ba8aa10b0b49888feac2776bfa336a/towards-the-automated-localisation-of-targets-in-rapid-image-sifting-by-figure-3.jpg)



![Fig 7 Surface interpolation of the expected changes in the AUC (in percentage) over the AUC of the best member of the group, for different group sizes, according to the theoretical model, when the distributions of scores for both classes are given by normally distributed random variables, Si,c∼N(μc,σi²), with |μC1 = L − μC2 = R| = 1 and standard deviations σi ∈ [0.3, 4]. (A) Size 2. (B) Size 4. (C) Size 6. (D) Size 8.](https://figures.cochat.ai/paper-figures/cab4b97eb8024cd6b918be289a52b494/towards-the-automated-localisation-of-targets-in-rapid-image-sifting-by-figure-7.jpg)


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
1 retracted
Brain–computer interface–based communication in the completely locked-in State
Chaudhary, U., Xia, B., Silvoni, S., Cohen, L. G., & Birbaumer, N. (2017) · PLOS Biology · doi:10.1371/journal.pbio.1002593 · Cited by 235
RetractedThe meaning and use of the area under a receiver operating characteristic (ROC) curve.
Hanley, J. A., & McNeil, B. J. (1982) · Radiology · doi:10.1148/radiology.143.1.7063747 · Cited by 21,856
The use of the area under the ROC curve in the evaluation of machine learning algorithms
Bradley, A. P. (1997) · Pattern Recognition · doi:10.1016/s0031-3203(96)00142-2 · Cited by 7,217
Farwell, L. A., & Donchin, E. (1988) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(88)90149-6 · Cited by 3,228
The mental prosthesis: assessing the speed of a P300-based brain-computer interface
Donchin, E., Spencer, K. M., & Wijesinghe, R. (2000) · IEEE Transactions on Rehabilitation Engineering · doi:10.1109/86.847808 · Cited by 1,222
Spatial filtering during visual search: Evidence from human electrophysiology.
Luck, S. J., & Hillyard, S. A. (1994) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037//0096-1523.20.5.1000 · Cited by 1,121
The N2pc component as an indicator of attentional selectivity
Eimer, M. (1996) · Electroencephalography and Clinical Neurophysiology · doi:10.1016/0013-4694(96)95711-9 · Cited by 1,018
Bahrami, B., Olsen, K., Latham, P. E., Roepstorff, A., Rees, G., & Frith, C. D. (2010) · Science · doi:10.1126/science.1185718 · Cited by 738
Repetition blindness: Type recognition without token individuation
Kanwisher, N. G. (1987) · Cognition · doi:10.1016/0010-0277(87)90016-3 · Cited by 664
Recognition memory for a rapid sequence of pictures.
Potter, M. C., & Levy, E. I. (1969) · Journal of Experimental Psychology · doi:10.1037/h0027470 · Cited by 527
Shapiro, K. L., Raymond, J. E., & Arnell, K. M. (1994) · Journal of Experimental Psychology: Human Perception and Performance · doi:10.1037//0096-1523.20.2.357 · Cited by 522
Variability of eye movements when viewing dynamic natural scenes
Dorr, M., Martinetz, T., Gegenfurtner, K. R., & Barth, E. (2010) · Journal of Vision · doi:10.1167/10.10.28 · Cited by 450
Visual perception of rapidly presented word sequences of varying complexity
Forster, K. I. (1970) · Perception & Psychophysics · doi:10.3758/bf03210208 · Cited by 344
An Asynchronously Controlled EEG-Based Virtual Keyboard: Improvement of the Spelling Rate
Scherer, R., Muller, G. R., Neuper, C., Graimann, B., & Pfurtscheller, G. (2004) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2004.827062 · Cited by 340
Eimer, M., & Kiss, M. (2008) · Journal of Cognitive Neuroscience · doi:10.1162/jocn.2008.20099 · Cited by 332
Theoretical Overview of P3a and P3b
Polich, J. (2003) · Detection of Change · doi:10.1007/978-1-4615-0294-4_5 · Cited by 293
CHI '06 Extended Abstracts on Human Factors in Computing Systems
(2006) · doi:10.1145/1125451 · Cited by 279
Cortically coupled computer vision for rapid image search
Gerson, A. D., Parra, L. C., & Sajda, P. (2006) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2006.875550 · Cited by 258
CHI '08 Extended Abstracts on Human Factors in Computing Systems
(2008) · doi:10.1145/1358628 · Cited by 243
A novel hybrid BCI speller based on the incorporation of SSVEP into the P300 paradigm
Yin, E., Zhou, Z., Jiang, J., Chen, F., Liu, Y., & Hu, D. (2013) · Journal of Neural Engineering · doi:10.1088/1741-2560/10/2/026012 · Cited by 225
de Oliveira, R. M., Vicente Miranda, H., Francelle, L., Pinho, R., Szegö, É. M., Martinho, R., Munari, F., Lázaro, D. F., Moniot, S., Guerreiro, P., et al. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2000374 · Cited by 209
Luck, S. J. (2011) · Oxford Handbooks Online · doi:10.1093/oxfordhb/9780195374148.013.0161 · Cited by 200
Attentional capture by task-irrelevant fearful faces is revealed by the N2pc component
Eimer, M., & Kiss, M. (2007) · Biological Psychology · doi:10.1016/j.biopsycho.2006.06.008 · Cited by 189
Decision accuracy in complex environments is often maximized by small group sizes
Kao, A. B., & Couzin, I. D. (2014) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2013.3305 · Cited by 187
Brain Activity-Based Image Classification From Rapid Serial Visual Presentation
Bigdely-Shamlo, N., Vankov, A., Ramirez, R. R., & Makeig, S. (2008) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2008.2003381 · Cited by 177
A Speedy Hybrid BCI Spelling Approach Combining P300 and SSVEP
Yin, E., Zhou, Z., Jiang, J., Chen, F., Liu, Y., & Hu, D. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2013.2281976 · Cited by 167
In a Blink of an Eye and a Switch of a Transistor: Cortically Coupled Computer Vision
Sajda, P., Pohlmeyer, E., Wang, J., Parra, L. C., Christoforou, C., Dmochowski, J., Hanna, B., Bahlmann, C., Singh, M. K., & Chang, S.-F. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2009.2038406 · Cited by 153
A Collaborative Brain-Computer Interface for Improving Human Performance
Wang, Y., & Jung, T.-P. (2011) · PLoS ONE · doi:10.1371/journal.pone.0020422 · Cited by 147
P300-Based BCI Mouse With Genetically-Optimized Analogue Control
Citi, L., Poli, R., Cinel, C., & Sepulveda, F. (2008) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2007.913184 · Cited by 145
Self-citationSpatiotemporal Linear Decoding of Brain State
Parra, L., Christoforou, C., Gerson, A., Dyrholm, M., Luo, A., Wagner, M., Philiastides, M., & Sajda, P. (2008) · IEEE Signal Processing Magazine · doi:10.1109/msp.2008.4408447 · Cited by 135
Jolicœur, P., Sessa, P., Dell’Acqua, R., & Robitaille, N. (2006) · The European Journal of Cognitive Psychology · doi:10.1080/09541440500423210 · Cited by 116
Relationships between the resting-state network and the P3: Evidence from a scalp EEG study
Li, F., Liu, T., Wang, F., Li, H., Gong, D., Zhang, R., Jiang, Y., Tian, Y., Guo, D., Yao, D., et al. (2015) · Scientific Reports · doi:10.1038/srep15129 · Cited by 114
Pohlmeyer, E. A., Wang, J., Jangraw, D. C., Lou, B., Chang, S.-F., & Sajda, P. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/8/3/036025 · Cited by 85
Natural language processing with dynamic classification improves P300 speller accuracy and bit rate
Speier, W. F., Arnold, C. W., Lu, J., Taira, R. K., & Pouratian, N. (2011) · Journal of Neural Engineering · doi:10.1088/1741-2560/9/1/016004 · Cited by 82
A framework for rapid visual image search using single-trial brain evoked responses
Huang, Y., Erdogmus, D., Pavel, M., Mathan, S. A., & Hild, K. E. (2011) · Neurocomputing · doi:10.1016/j.neucom.2010.12.025 · Cited by 82
Combining brain computer interfaces with vision for object categorization
Kapoor, A., Shenoy, P., & Tan, D. (2008) · 2008 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2008.4587618 · Cited by 70
Neural decoding of collective wisdom with multi-brain computing
Eckstein, M. P., Das, K., Pham, B. T., Peterson, M., Abbey, C. K., Sy, J. L., & Giesbrecht, B. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.07.009 · Cited by 68
Marathe, A. R., Lawhern, V. J., Wu, D., Slayback, D., & Lance, B. J. (2016) · IEEE Transactions on Neural Systems and Rehabilitation Engineering · doi:10.1109/tnsre.2015.2502323 · Cited by 64
The duration of the attentional blink in natural scenes depends on stimulus category
Einhäuser, W., Koch, C., & Makeig, S. (2007) · Vision Research · doi:10.1016/j.visres.2006.12.007 · Cited by 60
Collaborative Brain-Computer Interface for Aiding Decision-Making
Poli, R., Valeriani, D., & Cinel, C. (2014) · PLoS ONE · doi:10.1371/journal.pone.0102693 · Cited by 58
Self-citationNako, R., Wu, R., Smith, T. J., & Eimer, M. (2014) · Journal of Experimental Psychology Human Perception & Performance · doi:10.1037/a0036885 · Cited by 57
Poolman, P., Frank, R. M., Luu, P., Pederson, S. M., & Tucker, D. M. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2008.03.031 · Cited by 50
A novel task-oriented optimal design for P300-based brain–computer interfaces
Zhou, Z., Yin, E., Liu, Y., Jiang, J., & Hu, D. (2014) · Journal of Neural Engineering · doi:10.1088/1741-2560/11/5/056003 · Cited by 48
What makes cast shadows hard to see?
Porter, G., Tales, A., & Leonards, U. (2010) · Journal of Vision · doi:10.1167/10.3.13 · Cited by 45
Brain–Computer Interfaces for Detection and Localization of Targets in Aerial Images
Matran-Fernandez, A., & Poli, R. (2017) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2016.2583200 · Cited by 45
Self-citationTowards cooperative brain-computer interfaces for space navigation
Poli, R., Cinel, C., Matran-Fernandez, A., Sepulveda, F., & Stoica, A. (2013) · Proceedings of the 2013 international conference on Intelligent user interfaces · doi:10.1145/2449396.2449417 · Cited by 44
Self-citationStudy on an online collaborative BCI to accelerate response to visual targets
Yuan, P., Wang, Y., Wu, W., Xu, H., Gao, X., & Gao, S. (2012) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2012.6346284 · Cited by 42
Locating user attention using eye tracking and EEG for spatio-temporal event selection
Putze, F., Hild, J., Kärgel, R., Herff, C., Redmann, A., Beyerer, J., & Schultz, T. (2013) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/2449396.2449415 · Cited by 39
Korczowski, L., Congedo, M., & Jutten, C. (2015) · 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2015.7318721 · Cited by 33
Possible sources of perceptual errors in P300-based speller paradigm
Cinel, C., Poli, R., & Citi, L. (2004) · Open Access at Essex (University of Essex) · Cited by 30
Self-citationRapid image analysis using neural signals
Mathan, S., Erdogmus, D., Huang, Y., Pavel, M., Ververs, P., Carciofini, J., Dorneich, M., & Whitlow, S. (2008) · CHI '08 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1358628.1358849 · Cited by 28
Activation of New Attentional Templates for Real-world Objects in Visual Search
Nako, R., Smith, T. J., & Eimer, M. (2014) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00747 · Cited by 25
Valeriani, D., Poli, R., & Cinel, C. (2015) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2015.7146551 · Cited by 22
Self-citationImproving decision-making based on visual perception via a collaborative brain-computer interface
Poli, R., Cinel, C., Sepulveda, F., & Stoica, A. (2013) · IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision Support · doi:10.1109/cogsima.2013.6523816 · Cited by 20
Self-citationCollaborative brain-computer interfaces for target localisation in rapid serial visual presentation
Matran‐Fernandez, A., & Poli, R. (2014) · Computer Science and Electronic Engineering Conference · doi:10.1109/ceec.2014.6958567 · Cited by 20
Self-citationA collaborative Brain-Computer Interface to improve human performance in a visual search task
Valeriani, D., Poli, R., & Cinel, C. (2015) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2015.7146599 · Cited by 18
Self-citationCollaborative brain-computer interfaces for the automatic classification of images
Matran‐Fernandez, A., Poli, R., & Cinel, C. (2013) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2013.6696128 · Cited by 18
Self-citationCecotti, H., & Rivet, B. (2014) · Brain Sciences · doi:10.3390/brainsci4020335 · Cited by 18
Multimodal target detection using single trial evoked EEG responses in single and dual-tasks
Cecotti, H., Kasper, R. W., Elliott, J. C., Eckstein, M. P., & Giesbrecht, B. (2011) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/iembs.2011.6091557 · Cited by 17
Towards a brain computer interface based on the N2pc event-related potential
Awni, H., Norton, J. J. S., Umunna, S., Federmeier, K. D., & Bretl, T. W. (2013) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2013.6696110 · Cited by 16
Multi-brain fusion and applications to intelligence analysis
Stoica, A., Matran‐Fernandez, A., Andreou, D., Poli, R., Cinel, C., Iwashita, Y., & Padgett, C. W. (2013) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.2016456 · Cited by 14
Self-citationComplementary computing for visual tasks: Meshing computer vision with human visual processing
Kapoor, A., Tan, D. S., Shenoy, P., & Horvitz, E. (2008) · International Conference on Automatic Face and Gesture Recognition · doi:10.1109/afgr.2008.4813390 · Cited by 13
Integration of Automated Neural Processing into an Army-Relevant Multitasking Simulation Environment
Touryan, J., Ries, A. J., Weber, P., & Gibson, L. (2013) · Lecture notes in computer science · doi:10.1007/978-3-642-39454-6_83 · Cited by 7
HA, T. T. (2010) · Cambridge University Press eBooks · doi:10.1017/cbo9780511778681.004 · Cited by 7
Training and Transfer of Training in Rapid Visual Search for Camouflaged Targets
Neider, M. B., Ang, C. W., Voss, M. W., Carbonari, R. S., & Kramer, A. F. (2013) · PLoS ONE · doi:10.1371/journal.pone.0083885 · Cited by 7
Cecotti, H., & Rivet, B. (2014) · IEEE International Conference on Acoustics Speech and Signal Processing · doi:10.1109/icassp.2014.6853961 · Cited by 7
Rapid face recognition based on single-trial event-related potential detection over multiple brains
Jiang, L., Wang, Y., Cai, B., Wang, Y., Chen, W., & Zheng, X. (2015) · International IEEE/EMBS Conference on Neural Engineering · doi:10.1109/ner.2015.7146571 · Cited by 6
A multi-instance learning approach to filtering images for presentation to analysts
Birisan, M., & Beling, P. A. (2014) · Environment Systems & Decisions · doi:10.1007/s10669-014-9512-7 · Cited by 5
Electrophysiology of Kansei: Recent Advances in Event-Related Brain Potential Research
Nittono, H. (2008) · Cited by 2
Research works printed but not linked: 1
- Yuan P, Wang Y, Wu W, Xu H, Gao X, Gao S. Study on an online collaborative BCI to accelerate response to visual targets. In: Proceedings of 34nd IEEE EMBS Conference; 2012. · DOI
Cited by
Transfer Learning for Brain–Computer Interfaces: A Euclidean Space Data Alignment Approach
He, H., & Wu, D. (2020) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2019.2913914 · Cited by 569
“It contained EEG data from 11 healthy subjects upon rapid presentation of images at 5, 6, and 10 Hz [21].”
MethodNeurotechnologies for Human Cognitive Augmentation: Current State of the Art and Future Prospects
Cinel, C., Valeriani, D., & Poli, R. (2019) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2019.00013 · Cited by 178
Self-citationA Survey of Cutting-edge Multimodal Sentiment Analysis
Singh, U., Abhishek, K., & Azad, H. K. (2024) · ACM Computing Surveys · doi:10.1145/3652149 · Cited by 134
Recent Approaches on Classification and Feature Extraction of EEG Signal: A Review
Pooja, Pahuja, S., & Veer, K. (2021) · Robotica · doi:10.1017/s0263574721000382 · Cited by 132
Beyond Flexible: Unveiling the Next Era of Flexible Electronic Systems
Kim, M. S., Almuslem, A. S., Babatain, W., Bahabry, R. R., Das, U. K., El‐Atab, N., Ghoneim, M. T., Hussain, A. M., Kutbee, A. T., Nassar, J. M., et al. (2024) · Advanced Materials · doi:10.1002/adma.202406424 · Cited by 121
Metadata
- Authors
- Matran-Fernandez, A., & Poli, R.
- Affiliations
- University of Essex (GB)
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-05-31
- Volume
- 12
- Issue
- 5
- Pages
- e0178498
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC5451058
- OpenAlex
- W2616977573
- Cited by
- 45
- References
- 69
- Citations by year
- 2026: 2 · 2025: 5 · 2024: 6 · 2023: 4 · 2022: 6 · 2021: 7 · 2020: 6 · 2019: 5 · 2018: 4
- FWCI
- 2.35
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Open Access at Essex (University of Essex) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Engineering and Physical Sciences Research Council (EP/K004638/1)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
- Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
- Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
- Keywords
- N2pc, event-related potentials, target localization, rapid serial visual presentation, aerial imagery, automated triage, attentional shift, target detection
- MeSH terms
- Adult, Automation, Evoked Potentials, Female, Humans, Male, Photic Stimulation, Task Performance and Analysis, Young Adult, Brain-Computer Interfaces
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.