CoChat

Towards the automated localisation of targets in rapid image-sifting by collaborative brain-computer interfaces

Open access
Matran-Fernandez, Ana, Poli, Riccardo · 2017 · PLOS ONE

The DOI matches its Crossref record; 69 of the 69 references it cites were found in a registry or an index.

Abstract

The N2pc is a lateralised Event-Related Potential (ERP) that signals a shift of attention towards the location of a potential object of interest. We propose a single-trial target-localisation collaborative Brain-Computer Interface (cBCI) that exploits this ERP to automatically approximate the horizontal position of targets in aerial images. Images were presented by means of the rapid serial visual presentation technique at rates of 5, 6 and 10 Hz. We created three different cBCIs and tested a participant selection method in which groups are formed according to the similarity of participants' performance. The N2pc that is elicited in our experiments contains information about the position of the target along the horizontal axis. Moreover, combining information from multiple participants provides absolute median improvements in the area under the receiver operating characteristic curve of up to 21% (for groups of size 3) with respect to single-user BCIs. These improvements are bigger when groups are formed by participants with similar individual performance, and much of this effect can be explained using simple theoretical models. Our results suggest that BCIs for automated triaging can be improved by integrating two classification systems: one devoted to target detection and another to detect the attentional shifts associated with lateral targets.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1371/journal.pone.0178498

Cites

69 of 69 references verified0 citation errors · 0 not checkable

Statistics

Figures

Fig 1 Processing and classification pipeline for the single-user and the collaborative BCIs.
Fig 1 Processing and classification pipeline for the single-user and the collaborative BCIs.CC BY · PubMed Central
Fig 2 Examples of target and non-target images from our experiment. (A) Target. (B) Distractor. The target has been highlighted for presentation purposes. Satellite imagery for this manuscript was extracted from The Gateway to Astronaut Photography of Earth, image ID ISS040-E-033077. These images are for illustrative purposes only. The images used in the experiment were extracted from Google (Google, BlueSky).
Fig 2 Examples of target and non-target images from our experiment. (A) Target. (B) Distractor. The target has been highlighted for presentation purposes. Satellite imagery for this manuscript was extracted from The Gateway to Astronaut Photography of Earth, image ID ISS040-E-033077. These images are for illustrative purposes only. The images used in the experiment were extracted from Google (Google, BlueSky).CC BY · PubMed Central
Fig 3 Classification and merging steps for the MC-cBCI and LDA-cBCI ways of creating a collaborative BCI. Epochs corresponding to trial j are extracted from all the group members, Epi,j, i ∈ [1, N], where N is the group size. Each participant i has an individually tailored classifier, Cli. The outputs of the N classifiers in response to the individual epochs, Sci,j are merged either by averaging the scores (MC-cBCI approach) or through an LDA classifier (LDA-cBCI approach) in order to obtain a final group score, Scj, which is used to measure the group performance by means of the AUC.
Fig 3 Classification and merging steps for the MC-cBCI and LDA-cBCI ways of creating a collaborative BCI. Epochs corresponding to trial j are extracted from all the group members, Epi,j, i ∈ [1, N], where N is the group size. Each participant i has an individually tailored classifier, Cli. The outputs of the N classifiers in response to the individual epochs, Sci,j are merged either by averaging the scores (MC-cBCI approach) or through an LDA classifier (LDA-cBCI approach) in order to obtain a final group score, Scj, which is used to measure the group performance by means of the AUC.CC BY · PubMed Central
Fig 4 Grand-averaged difference plot of the contralateral minus the ipsilateral waveforms recorded at electrode sites PO7 and PO8 across lateral targets from the training set of one split.
Fig 4 Grand-averaged difference plot of the contralateral minus the ipsilateral waveforms recorded at electrode sites PO7 and PO8 across lateral targets from the training set of one split.CC BY · PubMed Central
Fig 5 Grand-averaged contralateral minus ipsilateral waveforms recorded at PO7 and PO8 across all epochs from the training set of one split for a presentation rate of 10 Hz, separated depending on the distance (in number of images) to the previous target.
Fig 5 Grand-averaged contralateral minus ipsilateral waveforms recorded at PO7 and PO8 across all epochs from the training set of one split for a presentation rate of 10 Hz, separated depending on the distance (in number of images) to the previous target.CC BY · PubMed Central
Fig 6 Surface interpolation of the changes in the AUC (in percentage) over the AUC of the best member of the group, for different group sizes. (A) Size 2. (B) Size 4. (C) Size 6. (D) Size 8. The changes are calculated over the AUC of the best participant of a group, and plotted with respect to the mean (horizontal axis) and standard deviation (vertical axis) of the individual AUCs of that group.
Fig 6 Surface interpolation of the changes in the AUC (in percentage) over the AUC of the best member of the group, for different group sizes. (A) Size 2. (B) Size 4. (C) Size 6. (D) Size 8. The changes are calculated over the AUC of the best participant of a group, and plotted with respect to the mean (horizontal axis) and standard deviation (vertical axis) of the individual AUCs of that group.CC BY · PubMed Central
Fig 7 Surface interpolation of the expected changes in the AUC (in percentage) over the AUC of the best member of the group, for different group sizes, according to the theoretical model, when the distributions of scores for both classes are given by normally distributed random variables, Si,c∼N(μc,σi²), with |μC1 = L − μC2 = R| = 1 and standard deviations σi ∈ [0.3, 4]. (A) Size 2. (B) Size 4. (C) Size 6. (D) Size 8.
Fig 7 Surface interpolation of the expected changes in the AUC (in percentage) over the AUC of the best member of the group, for different group sizes, according to the theoretical model, when the distributions of scores for both classes are given by normally distributed random variables, Si,c∼N(μc,σi²), with |μC1 = L − μC2 = R| = 1 and standard deviations σi ∈ [0.3, 4]. (A) Size 2. (B) Size 4. (C) Size 6. (D) Size 8.CC BY · PubMed Central
Fig 8 Predicted vs real x-coordinate of targets for the best performer at this task using the sNN-BCI (participant 3, 6 Hz).
Fig 8 Predicted vs real x-coordinate of targets for the best performer at this task using the sNN-BCI (participant 3, 6 Hz).CC BY · PubMed Central
Fig 9 Predicted vs real x-coordinate of targets, for a group of size 7 at 6 Hz.
Fig 9 Predicted vs real x-coordinate of targets, for a group of size 7 at 6 Hz.CC BY · PubMed Central

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

1 retracted

Research works printed but not linked: 1

  1. Yuan P, Wang Y, Wu W, Xu H, Gao X, Gao S. Study on an online collaborative BCI to accelerate response to visual targets. In: Proceedings of 34nd IEEE EMBS Conference; 2012. · DOI

Cited by

See all 48

Metadata

Authors
Matran-Fernandez, A., & Poli, R.
Affiliations
University of Essex (GB)
Venue
PLOS ONE
Published
2017-05-31
Volume
12
Issue
5
Pages
e0178498
ISSN
1932-6203 (ISSN-L)
OpenAlex
W2616977573
Cited by
45
References
69
Citations by year
2026: 2 · 2025: 5 · 2024: 6 · 2023: 4 · 2022: 6 · 2021: 7 · 2020: 6 · 2019: 5 · 2018: 4
FWCI
2.35
Type
journal article
Language
en
Open access
Locations
  • PLoS ONE (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Open Access at Essex (University of Essex) (acceptedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Funders
Engineering and Physical Sciences Research Council (EP/K004638/1)
Topics
  • Life Sciences › Neuroscience › Cognitive Neuroscience › EEG and Brain-Computer Interfaces
  • Physical Sciences › Computer Science › Human-Computer Interaction › Gaze Tracking and Assistive Technology
  • Social Sciences › Human Factors and Ergonomics › Human-Automation Interaction and Safety
Keywords
N2pc, event-related potentials, target localization, rapid serial visual presentation, aerial imagery, automated triage, attentional shift, target detection
MeSH terms
Adult, Automation, Evoked Potentials, Female, Humans, Male, Photic Stimulation, Task Performance and Analysis, Young Adult, Brain-Computer Interfaces

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.