Suitability of recent hardware accelerators (DSPs, FPGAs, and GPUs) for computer vision and image processing algorithms
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Abstract Computer vision and image processing algorithms form essential components of many industrial, medical, commercial, and research-related applications. Modern imaging systems provide high resolution images at high frame rates, and are often required to perform complex computations to process image data. However, in many applications rapid processing is required, or it is important to minimise delays for analysis results. In these applications, central processing units (CPUs) are inadequate, as they cannot perform the calculations with sufficient speed. To reduce the computation time, algorithms can be implemented in hardware accelerators such as digital signal processors (DSPs), field-programmable gate arrays (FPGAs), and graphics processing units (GPUs). However, the selection of a suitable hardware accelerator for a specific application is challenging. Numerous families of DSPs, FPGAs, and GPUs are available, and the technical differences between various hardware accelerators make comparisons difficult. It is also important to know what speed can be achieved using a specific hardware accelerator for a particular algorithm, as the choice of hardware accelerator may depend on both the algorithm and the application. The technical details of hardware accelerators and their performance have been discussed in previous publications. However, there are limitations in many of these presentations, including: inadequate technical details to enable selection of a suitable hardware accelerator; comparisons of hardware accelerators at two different technological levels; and discussion of old technologies. To address these issues, we introduce and discuss important considerations when selecting suitable hardware accelerators for computer vision and image processing tasks, and present a comprehensive review of hardware accelerators. We discuss the practical details of chip architectures, available tools and utilities, development time, and the relative advantages and disadvantages of using DSPs, FPGAs, and GPUs. We provide practical information about state-of-the-art DSPs, FPGAs, and GPUs as well as examples from the literature. Our goal is to enable developers to make a comprehensive comparison between various hardware accelerators, and to select a hardware accelerator that is most suitable for their specific application.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
In-Datacenter Performance Analysis of a Tensor Processing Unit
Jouppi, N. P., Young, C., Patil, N., Patterson, D., Agrawal, G., Bajwa, R., Bates, S., Bhatia, S., Boden, N., Borchers, A., et al. (2017) · Proceedings of the 44th Annual International Symposium on Computer Architecture · doi:10.1145/3079856.3080246 · Cited by 4,537
A survey on vision-based human action recognition
Poppe, R. (2010) · Image and Vision Computing · doi:10.1016/j.imavis.2009.11.014 · Cited by 2,242
Convolutional networks and applications in vision
LeCun, Y., Kavukcuoglu, K., & Farabet, C. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537907 · Cited by 2,213
A Review of 3d/2d Registration Methods for Image-Guided Interventions
Markelj, P., Tomaževič, D., Likar, B., & Pernuš, F. (2012) · Medical Image Analysis · doi:10.1016/j.media.2010.03.005 · Cited by 746
Graphics processing unit (GPU) programming strategies and trends in GPU computing
Brodtkorb, A. R., Hagen, T. R., & Sætra, M. L. (2013) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2012.04.003 · Cited by 283
A Survey of Medical Image Registration on Multicore and the GPU
Shams, R., Sadeghi, P., Kennedy, R., & Hartley, R. (2010) · IEEE Signal Processing Magazine · doi:10.1109/msp.2009.935387 · Cited by 198
Hybrid computing: CPU+GPU co-processing and its application to tomographic reconstruction
Agulleiro, J. I., Vázquez, F., Garzón, E. M., & Fernández, J. J. (2012) · Ultramicroscopy · doi:10.1016/j.ultramic.2012.02.003 · Cited by 34
Fast fingerprint identification using GPUs
Lastra, M., Carabaño, J., Gutiérrez, P. D., Benítez, J. M., & Herrera, F. (2015) · Information Sciences · doi:10.1016/j.ins.2014.12.052 · Cited by 32
GPU-accelerated large-size VHR images registration via coarse-to-fine matching
Zhang, Y., Zhou, P., Ren, Y., & Zou, Z. (2014) · Computers & Geosciences · doi:10.1016/j.cageo.2014.01.011 · Cited by 15
Birk, M., Balzer, M., Ruiter, N. V., & Becker, J. (2014) · Computers & Electrical Engineering · doi:10.1016/j.compeleceng.2013.11.033 · Cited by 7
Correlation ratio based volume image registration on GPUs
Li, A., Kumar, A., Ha, Y., & Corporaal, H. (2015) · Microprocessors and Microsystems · doi:10.1016/j.micpro.2015.04.002 · Cited by 6
Cited by
Trends in AI inference energy consumption: Beyond the performance-vs-parameter laws of deep learning
Desislavov, R., Martínez-Plumed, F., & Hernández-Orallo, J. (2023) · Sustainable Computing: Informatics and Systems · doi:10.1016/j.suscom.2023.100857 · Cited by 269
Zhu, H., Zhang, D., Goh, H. H., Wang, S., Ahmad, T., Mao, D., Liu, T., Zhao, H., & Wu, T. (2023) · Sustainable Cities and Society · doi:10.1016/j.scs.2022.104322 · Cited by 164
- Retracted
Metadata
- Authors
- HajiRassouliha, A., Taberner, A. J., Nash, M. P., & Nielsen, P. M. F.
- Venue
- Signal Processing: Image Communication
- Publisher
- Elsevier BV
- Published
- 2018-10
- Volume
- 68
- Pages
- 101-119
- ISSN
- 0923-5965 (ISSN-L)
- OpenAlex
- W2884002000
- Cited by
- 126
- References
- 12
- FWCI
- 11.28
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.