The DOI matches its Crossref record; 87 of the 87 references it cites were found in a registry or an index.
State-of-the-art in Heterogeneous Computing
Open accessAbstract
Node level heterogeneous architectures have become attractive during the last decade for several reasons: compared to traditional symmetric CPUs, they offer high peak performance and are energy and/or cost efficient. With the increase of fine-grained parallelism in high-performance computing, as well as the introduction of parallelism in workstations, there is an acute need for a good overview and understanding of these architectures. We give an overview of the state-of-the-art in heterogeneous computing, focusing on three commonly found architectures: the Cell Broadband Engine Architecture, graphics processing units (GPUs), and field programmable gate arrays (FPGAs). We present a review of hardware, available software tools, and an overview of state-of-the-art techniques and algorithms. Furthermore, we present a qualitative and quantitative comparison of the architectures, and give our view on the future of heterogeneous computing.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A Computational Approach to Edge Detection
Canny, J. (1986) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.1986.4767851 · Cited by 30,004
Computer Architecture: A Quantitative Approach
Hennessy, J. L., & Patterson, D. A. (1989) · UCLA - Biblioteca de Ciencias y Tecnologia Felix Morales Bueno · Cited by 9,375
International Organization for Standardization
(2015) · Encyclopedia of Astrobiology · doi:10.1007/978-3-662-44185-5_100574 · Cited by 6,716
Cramming More Components onto Integrated Circuits (1965)
Moore, G. (2021) · Ideas That Created the Future · doi:10.7551/mitpress/12274.003.0027 · Cited by 6,241
Cramming More Components Onto Integrated Circuits
Moore, G. E. (1998) · Proceedings of the IEEE · doi:10.1109/jproc.1998.658762 · Cited by 5,926
Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator
Matsumoto, M., & Nishimura, T. (1998) · ACM Transactions on Modeling and Computer Simulation · doi:10.1145/272991.272995 · Cited by 5,780
Computer architecture: a quantitative approach
Shute, M. (1993) · Microelectronics Journal · doi:10.1016/0026-2692(93)90111-q · Cited by 3,336
Using MPI: Portable parallel programming with the message-passing interface
(1995) · Computers & Mathematics with Applications · doi:10.1016/0898-1221(95)90199-x · Cited by 2,854
Backus, J. (1978) · Communications of the ACM · doi:10.1145/359576.359579 · Cited by 2,609
Learning openCV: computer vision with the openCV library
Bradski, G. R., & Kaehler, A. (2008) · CERN Document Server (European Organization for Nuclear Research) · Cited by 2,468
(2006) · Cited by 1,979
Some Computer Organizations and Their Effectiveness
Flynn, M. J. (1972) · IEEE Transactions on Computers · doi:10.1109/tc.1972.5009071 · Cited by 1,713
Amdahl's Law in the Multicore Era
Hill, M. D., & Marty, M. R. (2008) · Computer · doi:10.1109/mc.2008.209 · Cited by 1,262
Brook for GPUs: stream computing on graphics hardware
Buck, I., Foley, T., Horn, D., Sugerman, J., Fatahalian, K., Houston, M., & Hanrahan, P. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015800 · Cited by 1,155
Using OpenMP: portable shared memory parallel programming
(2008) · Choice Reviews Online · doi:10.5860/choice.46-0930 · Cited by 1,139
Owens, J. D., Houston, M., Luebke, D. P., Green, S., Stone, J. E., & Phillips, J. C. (2008) · Proceedings of the IEEE · Cited by 1,085
Iverson, K. E. (1962) · Proceedings of the May 1-3, 1962, spring joint computer conference on - AIEE-IRE '62 (Spring) · doi:10.1145/1460833.1460872 · Cited by 1,067
Hillis, W. D., & Steele, G. L. (1986) · Communications of the ACM · doi:10.1145/7902.7903 · Cited by 899
Computer Architecture, Fifth Edition: A Quantitative Approach
Hennessy, J. L., & Patterson, D. A. (2011) · Morgan Kaufmann Publishers Inc. eBooks · Cited by 880
Using OpenMP: Portable Shared Memory Parallel Programming (Scientific and Engineering Computation)
Chapman, B., Jost, G., & van der Pas, R. (2007) · The MIT Press eBooks · Cited by 797
Optimization of sparse matrix-vector multiplication on emerging multicore platforms
Williams, S., Oliker, L., Vuduc, R., Shalf, J., Yelick, K., & Demmel, J. (2007) · Proceedings of the 2007 ACM/IEEE conference on Supercomputing · doi:10.1145/1362622.1362674 · Cited by 791
Optimization of sparse matrix–vector multiplication on emerging multicore platforms
Williams, S., Oliker, L., Vuduc, R., Shalf, J., Yelick, K., & Demmel, J. (2009) · Parallel Computing · doi:10.1016/j.parco.2008.12.006 · Cited by 789
Larrabee: a many-core x86 architecture for visual computing
Seiler, L., Carmean, D., Sprangle, E., Forsyth, T., Abrash, M., Dubey, P., Junkins, S., Lake, A., Sugerman, J., Cavin, R., et al. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360617 · Cited by 771
OpenGL Programming Guide: The Official Guide to Learning OpenGL, Version 1.2
Woo, M., Neider, J., Davis, T. R., & Shreiner, D. (1999) · Medical Entomology and Zoology · Cited by 768
Benchmarking GPUs to tune dense linear algebra
Volkov, V. M., & Demmel, J. W. (2008) · doi:10.5555/1413370.1413402 · Cited by 701
Patterson, D., Anderson, T., Cardwell, N., Fromm, R., Keeton, K., Kozyrakis, C., Thomas, R., & Yelick, K. (1997) · IEEE Micro · doi:10.1109/40.592312 · Cited by 665
Dongarra, J. J., Meuer, H.-W., & Strohmaier, E. (1997) · Cited by 663
Using MPI: Portable parallel programming with the message-passing interface
(2000) · Computers & Mathematics with Applications · doi:10.1016/s0898-1221(00)90207-4 · Cited by 654
Munshi, A. (2009) · IEEE Hot Chips Symposium · doi:10.1109/hotchips.2009.7478342 · Cited by 648
An 80-Tile Sub-100-W TeraFLOPS Processor in 65-nm CMOS
Vangal, S. R., Howard, J., Ruhl, G., Dighe, S., Wilson, H., Tschanz, J., Finan, D., Singh, A., Jacob, T., Jain, S., et al. (2008) · IEEE Journal of Solid-State Circuits · doi:10.1109/jssc.2007.910957 · Cited by 626
Ecient Sparse Matrix-Vector Multiplication on CUDA
Bell, N., & Garland, M. (2008) · Cited by 574
Designing efficient sorting algorithms for manycore GPUs
Satish, N., Harris, M., & Garland, M. (2009) · 2009 IEEE International Symposium on Parallel & Distributed Processing · doi:10.1109/ipdps.2009.5161005 · Cited by 571
Parallel Prefix Sum (Scan) with CUDA
Harris, M. (2011) · Cited by 545
A class of parallel tiled linear algebra algorithms for multicore architectures
Buttari, A., Langou, J., Kurzak, J., & Dongarra, J. (2009) · Parallel Computing · doi:10.1016/j.parco.2008.10.002 · Cited by 529
3D finite difference computation on GPUs using CUDA
Micikevicius, P. (2009) · Proceedings of 2nd Workshop on General Purpose Processing on Graphics Processing Units · doi:10.1145/1513895.1513905 · Cited by 520
Scan Primitives for GPU Computing
Sengupta, S., Harris, M., Zhang, Y., & Owens, J. D. (2007) · eScholarship (California Digital Library) · doi:10.2312/eggh/eggh07/097-106 · Cited by 510
Benchmarking GPUs to tune dense linear algebra
Volkov, V., & Demmel, J. W. (2008) · 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1109/sc.2008.5214359 · Cited by 489
Stencil computation optimization and auto-tuning on state-of-the-art multicore architectures
Datta, K., Murphy, M., Volkov, V. M., Williams, S., Carter, J. T., Oliker, L., Patterson, D. A., Shalf, J. M., & Yelick, K. (2008) · IEEE International Conference on High Performance Computing, Data, and Analytics · doi:10.5555/1413370.1413375 · Cited by 462
Memory---Sequoia: programming the memory hierarchy
Fatahalian, K., Dally, W. J., Hanrahan, P., Horn, D. R., Knight, T. J., Leem, L., Houston, M., Park, J. Y., Erez, M., Ren, M., et al. (2006) · Proceedings of the 2006 ACM/IEEE conference on Supercomputing - SC '06 · doi:10.1145/1188455.1188543 · Cited by 452
GPUTeraSort: high performance graphics co-processor sorting for large database management
Govindaraju, N., Gray, J., Kumar, R., & Manocha, D. (2006) · Proceedings of the 2006 ACM SIGMOD international conference on Management of data · doi:10.1145/1142473.1142511 · Cited by 418
Prefix sums and their applications
Blelloch, G. E. (2018) · Figshare · doi:10.1184/r1/6608579 · Cited by 379
Cell Broadband Engine Architecture and its first implementation—A performance view
Chen, T., Raghavan, R., Dale, J. N., & Iwata, E. (2007) · IBM Journal of Research and Development · doi:10.1147/rd.515.0559 · Cited by 351
Stencil computation optimization and auto-tuning on state-of-the-art multicore architectures
Datta, K., Murphy, M., Volkov, V., Williams, S., Carter, J., Oliker, L., Patterson, D., Shalf, J., & Yelick, K. (2008) · 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1109/sc.2008.5222004 · Cited by 281
Maximally equidistributed combined Tausworthe generators
L’Ecuyer, P. (1996) · Mathematics of Computation · doi:10.1090/s0025-5718-96-00696-5 · Cited by 267
Memory---CellSs: a programming model for the cell BE architecture
Bellens, P., Perez, J. M., Badia, R. M., & Labarta, J. (2006) · Proceedings of the 2006 ACM/IEEE conference on Supercomputing - SC '06 · doi:10.1145/1188455.1188546 · Cited by 267
The Accuracy of Floating Point Summation
Higham, N. J. (1993) · SIAM Journal on Scientific Computing · doi:10.1137/0914050 · Cited by 266
Halfhill, T. R. (2009) · Cited by 265
Mollick, E. (2006) · IEEE Annals of the History of Computing · doi:10.1109/mahc.2006.45 · Cited by 259
SIMD-Oriented Fast Mersenne Twister: a 128-bit Pseudorandom Number Generator
Saito, M., & Matsumoto, M. (2008) · Monte Carlo and Quasi-Monte Carlo Methods 2006 · doi:10.1007/978-3-540-74496-2_36 · Cited by 257
High performance discrete Fourier transforms on graphics processors
Govindaraju, N. K., Lloyd, B., Dotsenko, Y., Smith, B. J., & Manferdelli, J. L. (2008) · doi:10.5555/1413370.1413373 · Cited by 240
Efficient implementation of sorting on multi-core SIMD CPU architecture
Chhugani, J., Nguyen, A. D., Lee, V. W., Macy, W., Hagog, M., Chen, Y.-K., Baransi, A., Kumar, S., & Dubey, P. (2008) · Proceedings of the VLDB Endowment · doi:10.14778/1454159.1454171 · Cited by 232
Loveman, D. B. (1993) · IEEE Parallel & Distributed Technology: Systems & Applications · doi:10.1109/88.219857 · Cited by 223
Optimization and Performance Modeling of Stencil Computations on Modern Microprocessors
Datta, K., Kamil, S., Williams, S., Oliker, L., Shalf, J., & Yelick, K. (2009) · SIAM Review · doi:10.1137/070693199 · Cited by 217
Fast matrix multiplies using graphics hardware
Larsen, E. S., & McAllister, D. (2001) · Proceedings of the 2001 ACM/IEEE conference on Supercomputing · doi:10.1145/582034.582089 · Cited by 216
Sequoia: Programming the Memory Hierarchy
Fatahalian, K., Knight, T., Houston, M., Erez, M., Horn, D., Leem, L., Park, J., Ren, M., Aiken, A., Dally, W., et al. (2006) · ACM/IEEE SC 2006 Conference (SC'06) · doi:10.1109/sc.2006.55 · Cited by 207
Entering the petaflop era: The architecture and performance of Roadrunner
BARKER, K. J., Davis, K., Hoisie, A., Kerbyson, D. J., Lang, M., Pakin, S., & Sancho, J. C. (2008) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1109/sc.2008.5217926 · Cited by 204
Entering the Petaflop Era: The Architecture and Performance of Roadrunner
BARKER, K. J., Davis, K., Hoisie, A., Kerbyson, D. J., Lang, M., Pakin, S., & Sancho, J. C. (2008) · Cited by 201
Thomas, D. B., Howes, L., & Luk, W. (2009) · Proceedings of the ACM/SIGDA international symposium on Field programmable gate arrays · doi:10.1145/1508128.1508139 · Cited by 179
High performance discrete Fourier transforms on graphics processors
Govindaraju, N. K., Lloyd, B., Dotsenko, Y., Smith, B., & Manferdelli, J. (2008) · 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis · doi:10.1109/sc.2008.5213922 · Cited by 177
Canny edge detection on NVIDIA CUDA
Luo, Y., & Duraiswami, R. (2008) · 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4563088 · Cited by 172
Optimizing Compiler for the CELL Processor
Eichenbergert, A. E., O'Brien, K., O'Brien, K., Wu, P., Chen, T., Oden, P. H., Prener, D. A., Shepherd, J. C., So, B., Sura, Z., et al. (2005) · 14th International Conference on Parallel Architectures and Compilation Techniques (PACT'05) · doi:10.1109/pact.2005.33 · Cited by 171
Auto-tuning 3-D FFT library for CUDA GPUs
Nukada, A., & Matsuoka, S. (2009) · International Conference for High Performance Computing, Networking, Storage and Analysis (SC) · doi:10.1145/1654059.1654090 · Cited by 157
Exploring weak scalability for FEM calculations on a GPU-enhanced cluster
Göddeke, D., Strzodka, R., Mohd-Yusof, J., McCormick, P. S., Buijssen, S. H. M., Grajewski, M., & Turek, S. (2007) · Parallel Computing · doi:10.1016/j.parco.2007.09.002 · Cited by 151
Dominik Göddeke, A., Strzodka, R., & Turek, S. (2007) · International Journal of Parallel Emergent and Distributed Systems · doi:10.1080/17445760601122076 · Cited by 149
Dynamic Creation of Pseudorandom Number Generators
Matsumoto, M., & Nishimura, T. (2000) · Springer eBooks · doi:10.1007/978-3-642-59657-5_3 · Cited by 143
Backus, J. (1983) · Springer eBooks · doi:10.1007/978-3-662-09507-2_10 · Cited by 134
Implicit and explicit optimizations for stencil computations
Kamil, S., Datta, K., Williams, S., Oliker, L., Shalf, J., & Yelick, K. (2006) · Proceedings of the 2006 workshop on Memory system performance and correctness · doi:10.1145/1178597.1178605 · Cited by 130
McCool, M. D., Toit, S. D., Popa, T., Chan, B., & Moule, K. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015801 · Cited by 122
GPU-accelerated real-time 3D tracking for humanoid locomotion and stair climbing
Michel, P., Chestnutt, J., Kagami, S., Nishiwaki, K., Kuffner, J., & Takeo Kanade, A. (2007) · IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) · doi:10.1109/iros.2007.4399104 · Cited by 114
Titanium Language Reference Manual
Hilfinger, P. N., Bonachea, D., Graham, S. L., Liblit, B., Pike, G., & Yelick, K. (2001) · Cited by 94
AA-Sort: A New Parallel Sorting Algorithm for Multi-Core SIMD Processors
Inoue, H., Moriyama, T., Komatsu, H., et al. (2007) · doi:10.1109/pact.2007.12 · Cited by 94
High-Performance Designs for Linear Algebra Operations on Reconfigurable Hardware
Zhuo, L., & Prasanna, V. K. (2008) · IEEE Transactions on Computers · doi:10.1109/tc.2008.55 · Cited by 79
FFTC: Fastest Fourier Transform for the IBM Cell Broadband Engine
Bader, D. A., & Agarwal, V. (2008) · Springer eBooks · doi:10.1007/978-3-540-77220-0_19 · Cited by 75
High-Performance Mixed-Precision Linear Solver for FPGAs
Sun, J., Peterson, G. D., & Storaasli, O. O. (2008) · IEEE Transactions on Computers · doi:10.1109/tc.2008.89 · Cited by 72
Self-citationAA-Sort: A New Parallel Sorting Algorithm for Multi-Core SIMD Processors
Inoue, H., Moriyama, T., Komatsu, H., et al. (2007) · Proceedings of the ... Conference on Parallel Architectures and Compilation Techniques/Proceedings of the Conference on Parallel Architectures and Compilation Techniques · doi:10.1109/pact.2007.4336211 · Cited by 71
High Quality Uniform Random Number Generation Using LUT Optimised State-transition Matrices
Thomas, D. B., & Luk, W. W. (2007) · The Journal of VLSI Signal Processing Systems for Signal Image and Video Technology · doi:10.1007/s11265-006-0014-9 · Cited by 54
GPU‐based Collision Detection for Deformable Parameterized Surfaces
Greß, A., Guthe, M., & Klein, R. (2006) · Computer Graphics Forum · doi:10.1111/j.1467-8659.2006.00969.x · Cited by 54
Araya‐Polo, M., Rubio, F., de la Cruz, R., Hanzich, M., Cela, J. M., & Scarpazza, D. P. (2009) · Scientific Programming · doi:10.1155/2009/382638 · Cited by 50
Exploring the viability of the Cell Broadband Engine for bioinformatics applications
Sachdeva, V., Kistler, M., Speight, E. W., & Tzeng, T.-H. K. (2008) · Parallel Computing · doi:10.1016/j.parco.2008.04.001 · Cited by 48
(2008) · Cited by 47
The memory behavior of cache oblivious stencil computations
Frigo, M., & Strumpen, V. (2007) · The Journal of Supercomputing · doi:10.1007/s11227-007-0111-y · Cited by 46
Fast computation of general Fourier Transforms on GPUS
Lloyd, D. B., Boyd, C., & Govindaraju, N. K. (2008) · IEEE International Conference on Multimedia and Expo (ICME) · doi:10.1109/icme.2008.4607357 · Cited by 43
Fast and exact solution of Total Variation models on the GPU
Pock, T., Unger, M., Cremers, D., & Bischof, H. (2008) · 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2008.4563099 · Cited by 37
Exploring the Viability of the Cell Broadband Engine for Bioinformatics Applications
Sachdeva, V., Kistler, M., Speight, E. W., & Tzeng, T.-H. K. (2007) · IEEE International Parallel and Distributed Processing Symposium (IPDPS) · doi:10.1109/ipdps.2007.370449 · Cited by 35
Pseudorandom number generation on the GPU
Sussman, M. A., Crutchfield, W. Y., & Papakipos, M. (2006) · doi:10.1145/1283900.1283914 · Cited by 32
Evaluating multi-core platforms for HPC data-intensive kernels
van Amesfoort, A. S., Vărbănescu, A. L., Sips, H. J., & van Nieuwpoort, R. V. (2009) · ACM International Conference on Computing Frontiers (CF) · doi:10.1145/1531743.1531777 · Cited by 32
Petascale computing with accelerators
Kistler, M., Gunnels, J. A., Brokenshire, D. A., & Benton, B. (2009) · ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming · doi:10.1145/1504176.1504212 · Cited by 24
Cited by
Prein, A. F., Langhans, W., Fosser, G., Ferrone, A., Ban, N., Goergen, K., Keller, M., Tölle, M., Gutjahr, O., Feser, F., et al. (2015) · Reviews of Geophysics · doi:10.1002/2014rg000475 · Cited by 1,445
Performance Analysis of Google Colaboratory as a Tool for Accelerating Deep Learning Applications
Carneiro, T., Medeiros Da Nobrega, R. V., Nepomuceno, T., Bian, G.-B., De Albuquerque, V. H. C., & Filho, P. P. R. (2018) · IEEE Access · doi:10.1109/access.2018.2874767 · Cited by 589
Graphics processing unit (GPU) programming strategies and trends in GPU computing
Brodtkorb, A. R., Hagen, T. R., & Sætra, M. L. (2013) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2012.04.003 · Cited by 283
Self-citation
Metadata
- Authors
- Brodtkorb, A. R., Dyken, C., Hagen, T. R., Hjelmervik, J. M., & Storaasli, O. O.
- Venue
- Scientific Programming
- Publisher
- Wiley
- Published
- 2010
- Volume
- 18
- Issue
- 1
- Pages
- 1-33
- ISSN
- 1058-9244 (ISSN-L)
- 1875-919X
- OpenAlex
- W2148802605
- Cited by
- 257
- References
- 87
- FWCI
- 43.22
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.