Cited by 59Visual Attention and Saliency DetectionNeuroscience and Neural EngineeringVisual perception and processing mechanisms

Image processing strategies based on saliency segmentation for object recognition under simulated prosthetic vision

Li, Heng, Su, Xiaofan, Wang, Jing, Kan, Han, Han, Tingting, Zeng, Yajie, Chai, Xinyu·2018·Artificial Intelligence in Medicine

Abstract

Background and objective Current retinal prostheses can only generate low-resolution visual percepts constituted of limited phosphenes which are elicited by an electrode array and with uncontrollable color and restricted grayscale. Under this visual perception, prosthetic recipients can just complete some simple visual tasks, but more complex tasks like face identification/object recognition are extremely difficult. Therefore, it is necessary to investigate and apply image processing strategies for optimizing the visual perception of the recipients. This study focuses on recognition of the object of interest employing simulated prosthetic vision.Method We used a saliency segmentation method based on a biologically plausible graph-based visual saliency model and a grabCut-based self-adaptive-iterative optimization framework to automatically extract foreground objects. Based on this, two image processing strategies, Addition of Separate Pixelization and Background Pixel Shrink, were further utilized to enhance the extracted foreground objects.Results i) The results showed by verification of psychophysical experiments that under simulated prosthetic vision, both strategies had marked advantages over Direct Pixelization in terms of recognition accuracy and efficiency. ii) We also found that recognition performance under two strategies was tied to the segmentation results and was affected positively by the paired-interrelated objects in the scene.Conclusion The use of the saliency segmentation method and image processing strategies can automatically extract and enhance foreground objects, and significantly improve object recognition performance towards recipients implanted a high-density implant.

Integrity signals

Registry

Crossref · 10.1016/j.artmed.2017.11.001

Cites

100 of 100 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Due to the complexity of saliency calculation, real-time performance is the limiting factor for visual prostheses.

    “However, due to the complexity of saliency calculation, real-time performance is the limiting factor for visual prostheses [185][186][187][188].”

Cites

Flagged first, then by citations

Cited by

Sorted by citations

Authors
Li, H., Su, X., Wang, J., Kan, H., Han, T., Zeng, Y., & Chai, X.
Affiliations
  • Shanghai Jiao Tong University (CN)
  • Shanghai Ocean University (CN)
Corresponding author
Chai, Xinyu
Venue
Artificial Intelligence in Medicine
Publisher
Elsevier BV
Published
2018-01
Volume
84
Pages
64-78
ISSN
0933-3657 (ISSN-L)
OpenAlex
W2767602077
Cited by
59
References
100
Citations by year
2026: 5 · 2025: 8 · 2024: 6 · 2023: 8 · 2022: 13 · 2021: 8 · 2020: 4 · 2019: 5 · 2018: 2
FWCI
1.25
Type
journal article
Language
en
Open access
closed
Locations
  • Artificial Intelligence in Medicine (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • National Natural Science Foundation of China (61273368, 61472247, 61773256)
  • Ministry of Education of the People's Republic of China (B08020)
  • National High-tech Research and Development Program (2009AA04Z326)
  • National Key Research and Development Program of China (2011CB707503)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Visual Attention and Saliency Detection
  • Life Sciences › Neuroscience › Cellular and Molecular Neuroscience › Neuroscience and Neural Engineering
  • Life Sciences › Neuroscience › Cognitive Neuroscience › Visual perception and processing mechanisms
Keywords
retinal prosthesis, simulated prosthetic vision, object recognition, GrabCut, foreground segmentation, pixelation, phosphenes
MeSH terms
Facial Recognition, Adult, Artificial Intelligence, Eye Movements, Female, Humans, Image Processing, Computer-Assisted, Male, Markov Chains, Phosphenes, Prosthesis Design, Vision, Ocular, Visual Perception, Persons with Visual Disabilities, Visually Impaired Persons, Recognition, Psychology, Young Adult, Visual Prosthesis

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review