An FPGA-based stream processor for embedded real-time vision with Convolutional Networks
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
Many recent visual recognition systems can be seen as being composed of multiple layers of convolutional filter banks, interspersed with various types of non-linearities. This includes Convolutional Networks, HMAX-type architectures, as well as systems based on dense SIFT features or Histogram of Gradients. This paper describes a highly-compact and low power embedded system that can run such vision systems at very high speed. A custom board built around a Xilinx Virtex-4 FPGA was built and tested. It measures 70 × 80 mm, and the complete system-FPGA, camera, memory chips, flash-consumes 15 watts in peak, and is capable of more than 4 × 109multiply-accumulate operations per second in real vision application. This enables real-time implementations of object detection, object recognition, and vision-based navigation algorithms in small-size robots, micro-UAVs, and hand-held devices. Real-time face detection is demonstrated, with speeds of 10 frames per second at VGA resolution.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805 · cited 4×
“OCR [9], face/person detection [6, 12], object recognition [13], and robot navigation [10, 7]), ConvNets have many potential applications in micro-robots and other embedded vision systems that require low cost and highspeed implementations.”
BackgroundMethodInfluentialSelf-citationHistograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
CNP: An FPGA-based processor for Convolutional Networks
Farabet, C., Poulet, C., Han, J. Y., & LeCun, Y. (2009) · 2009 International Conference on Field Programmable Logic and Applications · doi:10.1109/fpl.2009.5272559 · Cited by 367 · cited 1×
“Our system can also be implemented in a low-end FPGA (Xilinx Spartan-3A DSP, as first introduced in [5]) and still reach decent performances.”
MethodSelf-citationAn analog neural network processor with programmable topology
Boser, B. E., Sackinger, E., Bromley, J., Le Cun, Y., & Jackel, L. D. (1991) · IEEE Journal of Solid-State Circuits · doi:10.1109/4.104196 · Cited by 142 · cited 2×
“10(9) multiplyaccumulate operations per second [1, 14].”
Self-citation
Research works printed but not linked: 13
- lecun, 2005, Off-road obstacle avoidance through end-to-end learning, Advances in Neural Information Processing Systems (NIPS 2005)
- 10.1109/CVPR.2006.200 · DOI · Paper page
- osadchy, 2007, Synergistic face detection and pose estimation with energy-based models, Journal of Machine Learning Research, 8, 1197
- 10.1109/CVPR.2007.383157 · DOI · Paper page
- 10.1109/72.129422 · DOI · Paper page
- 10.1109/CVPR.2005.254 · DOI · Paper page
- shoup, 1994, Parameterized convolution filtering in a field programmable gate array, Selected papers from the Oxford 1993 international workshop on field programmable logic and applications on More FPGAs, 274
- 10.1109/CVPR.2001.990517 · DOI · Paper page
- cope, 2006, Implementation of 2d convolution on fpga, gpu and cpu, Technical Report
- 10.1109/TPAMI.2004.97 · DOI · Paper page
- lecun, 1989, Generalization and network design strategies, Connectionism in Perspective
- hadsell, 2007, A multi-range vision strategy for autonomous offroad navigation, Proc Robotics and Applications (RA'07)
- 10.1109/MNNFS.1996.493811 · DOI · Paper page
Cited by
Convolutional networks and applications in vision
LeCun, Y., Kavukcuoglu, K., & Farabet, C. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537907 · Cited by 2,213
“An actual face detection application was demonstrated on this system, achieving 10fps on VGA images [52].”
MethodSelf-citationA Configurable Cloud-Scale DNN Processor for Real-Time AI
Fowers, J., Ovtcharov, K., Papamichael, M., Massengill, T., Liu, M., Lo, D., Alkalay, S., Haselman, M., Adams, L., Ghandi, M., et al. (2018) · 2018 ACM/IEEE 45th Annual International Symposium on Computer Architecture (ISCA) · doi:10.1109/isca.2018.00012 · Cited by 520
FPGA-Based Accelerators of Deep Learning Networks for Learning and Classification: A Review
Shawahna, A., Sait, S. M., & El-Maleh, A. (2019) · IEEE Access · doi:10.1109/access.2018.2890150 · Cited by 496
Deep learning in microscopy image analysis: a survey
Xing, F., Xie, Y., Su, H., Liu, F., & Yang, L. (2018) · IEEE Transactions on Neural Networks and Learning Systems · doi:10.1109/tnnls.2017.2766168 · Cited by 460
A 240 G-ops/s Mobile Coprocessor for Deep Neural Networks
Gokhale, V., Jin, J., Dundar, A., Martini, B., & Culurciello, E. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.106 · Cited by 300
Metadata
- Authors
- Farabet, C., Poulet, C., & LeCun, Y.
- Venue
- 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops
- Publisher
- IEEE
- Published
- 2009-09
- Pages
- 878-885
- OpenAlex
- W2067443156
- Cited by
- 50
- References
- 4
- FWCI
- 2.18
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An FPGA-based stream processor for embedded real-time vision with Convolutional Networks. https://app.cochat.ai/papers/10.1109/iccvw.2009.5457611
- The paper
- Farabet, C., Poulet, C., & LeCun, Y. (2009). An FPGA-based stream processor for embedded real-time vision with Convolutional Networks. 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops. https://doi.org/10.1109/iccvw.2009.5457611
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.