NeuFlow: A runtime reconfigurable dataflow processor for vision
The DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
In this paper we present a scalable dataflow hardware architecture optimized for the computation of general-purpose vision algorithms - neuFlow - and a dataflow compiler - luaFlow - that transforms high-level flow-graph representations of these algorithms into machine code for neuFlow. This system was designed with the goal of providing real-time detection, categorization and localization of objects in complex scenes, while consuming 10 Watts when implemented on a Xilinx Virtex 6 FPGA platform, or about ten times less than a laptop computer, and producing speedups of up to 100 times in real-world applications. We present an application of the system on street scene analysis, segmenting 20 categories on 500 × 375 frames at 12 frames per second on our custom hardware neuFlow.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Another option is to use field programable gate arrays (FPGAs), which consume much less energy than GPUs while providing an intermediate computing efficiency between CPUs and GPUs13–17.”
From Hardware implementation of memristor-based artificial neural networks (2024) · cites this paper as [14]
Citations
Cites
Gradient-based learning applied to document recognition
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998) · Proceedings of the IEEE · doi:10.1109/5.726791 · Cited by 58,805
Self-citationDistinctive Image Features from Scale-Invariant Keypoints
Lowe, D. G. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000029664.99615.94 · Cited by 55,589
Histograms of Oriented Gradients for Human Detection
Dalal, N., & Triggs, B. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.177 · Cited by 33,584
Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories
Lazebnik, S., Schmid, C., & Ponce, J. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06) · doi:10.1109/cvpr.2006.68 · Cited by 7,916
Efficient Graph-Based Image Segmentation
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000022288.19776.77 · Cited by 6,176
LabelMe: A Database and Web-Based Tool for Image Annotation
Russell, B. C., Torralba, A., Murphy, K. P., & Freeman, W. T. (2008) · International Journal of Computer Vision · doi:10.1007/s11263-007-0090-8 · Cited by 4,210
Kung (1982) · Computer · doi:10.1109/mc.1982.1653825 · Cited by 2,272
Learning methods for generic object recognition with invariance to pose and lighting
LeCun, Y., Huang, F. J., & Bottou, L. (2004) · Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004. · doi:10.1109/cvpr.2004.1315150 · Cited by 1,324
Self-citationStatic Scheduling of Synchronous Data Flow Programs for Digital Signal Processing
Lee, E. A., & Messerschmitt, D. G. (1987) · IEEE Transactions on Computers · doi:10.1109/tc.1987.5009446 · Cited by 1,318
Object Recognition with Features Inspired by Visual Cortex
Serre, T., Wolf, L., & Poggio, T. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.254 · Cited by 821
Why is Real-World Visual Object Recognition Hard?
Pinto, N., Cox, D. D., & DiCarlo, J. J. (2008) · PLoS Computational Biology · doi:10.1371/journal.pcbi.0040027 · Cited by 537
Multiclass Object Recognition with Sparse, Localized Features
Mutch, J., & Lowe, D. G. (2006) · 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 1 (CVPR'06) · doi:10.1109/cvpr.2006.200 · Cited by 453
CNP: An FPGA-based processor for Convolutional Networks
Farabet, C., Poulet, C., Han, J. Y., & LeCun, Y. (2009) · 2009 International Conference on Field Programmable Logic and Applications · doi:10.1109/fpl.2009.5272559 · Cited by 367 · cited 2×
“It can also perform on-the-fly subsampling (spatial pooling), and simple dot-products (linear classifiers) [10] • the middle row PTs contain general purpose operators, such as squaring and dividing for divisive normalization, and other mathematical operators • the bottom row PTs implement non-linear…”
BackgroundMethodSelf-citationA preliminary architecture for a basic data-flow processor
Dennis, J. B., & Misunas, D. P. (1998) · 25 years of the international symposia on Computer architecture (selected papers) · doi:10.1145/285930.286058 · Cited by 365
A dynamically configurable coprocessor for convolutional neural networks
Chakradhar, S., Sankaradas, M., Jakkula, V., & Cadambi, S. (2010) · Proceedings of the 37th annual international symposium on Computer architecture · doi:10.1145/1815961.1815993 · Cited by 343
Learning long‐range vision for autonomous off‐road driving
Hadsell, R., Sermanet, P., Ben, J., Erkan, A., Scoffier, M., Kavukcuoglu, K., Muller, U., & LeCun, Y. (2009) · Journal of Field Robotics · doi:10.1002/rob.20276 · Cited by 314
Self-citationHardware accelerated convolutional neural networks for synthetic vision systems
Farabet, C., Martini, B., Akselrod, P., Talay, S., LeCun, Y., & Culurciello, E. (2010) · Proceedings of 2010 IEEE International Symposium on Circuits and Systems · doi:10.1109/iscas.2010.5537908 · Cited by 231
Self-citationA preliminary architecture for a basic data-flow processor
Dennis, J. B., & Misunas, D. P. (1974) · ACM SIGARCH Computer Architecture News · doi:10.1145/641675.642111 · Cited by 156
Kim, J.-Y., Kim, M., Lee, S., et al. (2010) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2009.2031768 · Cited by 120
A highly scalable Restricted Boltzmann Machine FPGA implementation
Kim, S. K., McAfee, L. C., McMahon, P. L., & Olukotun, K. (2009) · 2009 International Conference on Field Programmable Logic and Applications · doi:10.1109/fpl.2009.5272262 · Cited by 80
A computation model with data flow sequencing
Adams, D. A. (1969) · Cited by 61
Performance Studies of Id on the Monsoon Dataflow System
Hicks, J. E., Chiou, D., Ang, B. S., et al. (1993) · Journal of Parallel and Distributed Computing · doi:10.1006/jpdc.1993.1065 · Cited by 54
Scalable learning for object detection with GPU hardware
Coates, A., Baumstarck, P., Le, Q. V., & Ng, A. Y. (2009) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2009.5354084 · Cited by 53
Diastolic arrays: throughput-driven reconfigurable computing
Cho, M. H., Cheng, C.-C., Kinsy, M. A., et al. (2008) · doi:10.5555/1509456.1509561 · Cited by 16
Diastolic arrays: Throughput-driven reconfigurable computing
Cho, M. H., Cheng, C.-C., Kinsy, M. A., et al. (2008) · doi:10.1109/iccad.2008.4681615 · Cited by 9
Research works printed but not linked: 5
- grangier, 2009, Deep convolutional networks for scene parsing, ICML 2009 Deep Learning Workshop, 114
- gaudiot, 1994, Stream data types for signal processing, Advances in Dataflow Architecture and Multithreading, 110,113
- corda, 2010, Building heterogeneous platforms for end-to-end online learning based on dataflow computing design, 114
- collobert, 2008, Torch, Workshop on Machine Learning Open Source Software, 113
- adams, 1969, A computation model with dataflow sequencing, PhD thesis, 110
Cited by
Learning Hierarchical Features for Scene Labeling
Farabet, C., Couprie, C., Najman, L., & LeCun, Y. (2013) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2012.231 · Cited by 2,620
Self-citationCourbariaux, M., Hubara, I., Soudry, D., El-Yaniv, R., & Bengio, Y. (2016) · arXiv · doi:10.48550/arxiv.1602.02830 · Cited by 2,106
ISAAC: a convolutional neural network accelerator with in-situ analog arithmetic in crossbars
Shafiee, A., Nag, A., Muralimanohar, N., Balasubramonian, R., Strachan, J. P., Hu, M., Williams, R. S., & Srikumar, V. (2016) · ACM SIGARCH Computer Architecture News · doi:10.1145/3007787.3001139 · Cited by 1,536
DaDianNao: A Machine-Learning Supercomputer
Chen, Y., Luo, T., Liu, S., Zhang, S., He, L., Wang, J., Li, L., Chen, T., Xu, Z., Sun, N., et al. (2014) · 2014 47th Annual IEEE/ACM International Symposium on Microarchitecture · doi:10.1109/micro.2014.58 · Cited by 1,492
DianNao: a small-footprint high-throughput accelerator for ubiquitous machine-learning
Chen, T., Du, Z., Sun, N., Wang, J., Wu, C., Chen, Y., & Temam, O. (2014) · Proceedings of the 19th international conference on Architectural support for programming languages and operating systems · doi:10.1145/2541940.2541967 · Cited by 1,297
Metadata
- Authors
- Farabet, C., Martini, B., Corda, B., Akselrod, P., Culurciello, E., & LeCun, Y.
- Affiliations
- Yale University (US)
- Courant Institute of Mathematical Sciences (US)
- Venue
- CVPR 2011 WORKSHOPS
- Publisher
- IEEE
- Published
- 2011-06
- Pages
- 109-116
- OpenAlex
- W2125203716
- Cited by
- 369
- References
- 25
- Citations by year
- 2026: 4 · 2025: 10 · 2024: 14 · 2023: 5 · 2022: 16 · 2021: 28 · 2020: 43 · 2019: 41 · 2018: 55 · 2017: 46 · 2016: 49 · 2015: 28 · 2014: 22 · 2013: 5 · 2012: 2
- FWCI
- 6.18
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Hardware and Architecture › Embedded Systems Design Techniques
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Neural Network Applications
- Physical Sciences › Engineering › Electrical and Electronic Engineering › Embedded Systems and FPGA Applications
- Keywords
- FPGA, vision algorithms, flow graphs, object detection, object localization, scene classification, low-power electronics, real-time image processing, Xilinx Virtex-6
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.