High performance imaging using large camera arrays
The DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
The advent of inexpensive digital image sensors and the ability to create photographs that combine information from a number of sensed images are changing the way we think about photography. In this paper, we describe a unique array of 100 custom video cameras that we have built, and we summarize our experiences using this array in a range of imaging applications. Our goal was to explore the capabilities of a system that would be inexpensive to produce in the future. With this in mind, we used simple cameras, lenses, and mountings, and we assumed that processing large numbers of images would eventually be easy and cheap. The applications we have explored include approximating a conventional single center of projection video camera with high performance along one or more axes, such as resolution, dynamic range, frame rate, and/or large aperture, and using multiple cameras to approximate a video camera with a large synthetic aperture. This permits us to capture a video light field, to which we can apply spatiotemporal view interpolation algorithms in order to digitally simulate time dilation and camera motion. It also permits us to create video sequences using custom non-uniform synthetic apertures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Levoy, M., & Hanrahan, P. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237199 · Cited by 3,755
Self-citationGortler, S. J., Grzeszczuk, R., Szeliski, R., & Cohen, M. F. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237200 · Cited by 2,458
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401174 · Cited by 2,399
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (1997) · Proceedings of the 24th annual conference on Computer graphics and interactive techniques - SIGGRAPH '97 · doi:10.1145/258734.258884 · Cited by 1,775
High-quality video view interpolation using a layered representation
Zitnick, C. L., Kang, S. B., Uyttendaele, M., Winder, S., & Szeliski, R. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015766 · Cited by 1,385
Brown, & Lowe (2003) · Proceedings Ninth IEEE International Conference on Computer Vision · doi:10.1109/iccv.2003.1238630 · Cited by 934
Matusik, W., Buehler, C., Raskar, R., Gortler, S. J., & McMillan, L. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344951 · Cited by 890
Virtualized reality: constructing virtual worlds from real scenes
Kanade, T., Rander, P., & Narayanan, P. J. (1997) · IEEE Multimedia · doi:10.1109/93.580394 · Cited by 624
Proceedings of IEEE Visualization '99
Ebert, D. S., Groß, M. H., & Hamann, B. (1999) · eScholarship (California Digital Library) · Cited by 585
Dynamically reparameterized light fields
Isaksen, A., McMillan, L., & Gortler, S. J. (2000) · ACM SIGGRAPH Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH) · doi:10.1145/344779.344929 · Cited by 507
Cited by
Local light field fusion: practical view synthesis with prescriptive sampling guidelines
Mildenhall, B., Srinivasan, P. P., Ortiz-Cayon, R., Kalantari, N. K., Ramamoorthi, R., Ng, R., & Kar, A. (2019) · ACM Transactions on Graphics · doi:10.1145/3306346.3322980 · Cited by 1,175
Levoy, M., Ng, R., Adams, A., Footer, M., & Horowitz, M. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141976 · Cited by 730
Self-citationLearning-based view synthesis for light field cameras
Kalantari, N. K., Wang, T.-C., & Ramamoorthi, R. (2016) · ACM Transactions on Graphics · doi:10.1145/2980179.2980251 · Cited by 726
Achromatic metalens array for full-colour light-field imaging
Lin, R. J., Su, V.-C., Wang, S., Chen, M. K., Chung, T. L., Chen, Y. H., Kuo, H. Y., Chen, J.-W., Chen, J., Huang, Y.-T., et al. (2019) · Nature Nanotechnology · doi:10.1038/s41565-018-0347-0 · Cited by 674
A Dataset and Evaluation Methodology for Depth Estimation on 4D Light Fields
Honauer, K., Johannsen, O., Kondermann, D., & Goldluecke, B. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-54187-7_2 · Cited by 642
Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard
Vetro, A., Wiegand, T., & Sullivan, G. J. (2011) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2098830 · Cited by 591
Light Field Image Processing: An Overview
Wu, G., Masia, B., Jarabo, A., Zhang, Y., Wang, L., Dai, Q., Chai, T., & Liu, Y. (2017) · IEEE Journal of Selected Topics in Signal Processing · doi:10.1109/jstsp.2017.2747126 · Cited by 586
Performance capture from sparse multi-view video
de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., & Thrun, S. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360697 · Cited by 535
Decoding, Calibration and Rectification for Lenselet-Based Plenoptic Cameras
Dansereau, D. G., Pizarro, O., & Williams, S. B. (2013) · 2013 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2013.137 · Cited by 533
Coded exposure photography: motion deblurring using fluttered shutter
Raskar, R., Agrawal, A., & Tumblin, J. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141957 · Cited by 485
Burst photography for high dynamic range and low-light imaging on mobile cameras
Hasinoff, S. W., Sharlet, D., Geiss, R., Adams, A., Barron, J. T., Kainz, F., Chen, J., & Levoy, M. (2016) · ACM Transactions on Graphics · doi:10.1145/2980179.2980254 · Cited by 483
Self-citationVeeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., & Tumblin, J. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276463 · Cited by 469
Veeraraghavan, A., Raskar, R., Agrawal, A., Mohan, A., & Tumblin, J. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276463 · Cited by 444
Scene reconstruction from high spatio-angular resolution light fields
Kim, C., Zimmer, H., Pritch, Y., Sorkine-Hornung, A., & Gross, M. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2461926 · Cited by 439
Compressive light field photography using overcomplete dictionaries and optimized projections
Marwah, K., Wetzstein, G., Bando, Y., & Raskar, R. (2013) · ACM Transactions on Graphics · doi:10.1145/2461912.2461914 · Cited by 398
Shin, C., Jeon, H.-G., Yoon, Y., Kweon, I. S., & Kim, S. J. (2018) · 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2018.00499 · Cited by 319
FlexISP: a flexible camera image processing framework
Heide, F., Steinberger, M., Tsai, Y.-T., Rouf, M., Pająk, D., Reddy, D., Gallo, O., Liu, J., Heidrich, W., Egiazarian, K., et al. (2014) · ACM Transactions on Graphics · doi:10.1145/2661229.2661260 · Cited by 298
Lu, H., Li, Y., Uemura, T., Kim, H., & Serikawa, S. (2018) · Future Generation Computer Systems · doi:10.1016/j.future.2018.01.001 · Cited by 290
Mait, J. N., Euliss, G. W., & Athale, R. A. (2018) · Advances in Optics and Photonics · doi:10.1364/aop.10.000409 · Cited by 289
Stereo for Image-Based Rendering using Image Over-Segmentation
Zitnick, C. L., & Kang, S. B. (2007) · International Journal of Computer Vision · doi:10.1007/s11263-006-0018-8 · Cited by 282
Immersive light field video with a layered mesh representation
Broxton, M., Flynn, J., Overbeck, R., Erickson, D., Hedman, P., Duvall, M., Dourgarian, J., Busch, J., Whalen, M., & Debevec, P. (2020) · ACM Transactions on Graphics · doi:10.1145/3386569.3392485 · Cited by 266
Programmable aperture photography: multiplexed light field acquisition
Liang, C.-K., Lin, T.-H., Wong, B.-Y., Liu, C., & Chen, H. H. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360654 · Cited by 261
Light field video stabilization
Smith, B. M., Zhang, L., Jin, H., & Agarwala, A. (2009) · 2009 IEEE 12th International Conference on Computer Vision · doi:10.1109/iccv.2009.5459270 · Cited by 107
Light field image denoising using a linear 4D frequency-hyperfan all-in-focus filter
Dansereau, D. G., Bongiorno, D. L., Pizarro, O., & Williams, S. B. (2013) · SPIE Proceedings · doi:10.1117/12.2002239 · Cited by 63
Metadata
- Authors
- Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., Antunez, E., Barth, A., Adams, A., Horowitz, M., & Levoy, M.
- Venue
- ACM Transactions on Graphics
- Published
- 2005-07
- Volume
- 24
- Issue
- 3
- Pages
- 765-776
- ISSN
- 0730-0301 (ISSN-L)
- 1557-7368
- OpenAlex
- W2116361875
- Cited by
- 1,042
- References
- 20
- FWCI
- 45.87
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.