Image-based modeling and photo editing
The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.
Abstract
We present an image-based modeling and editing system that takes a single photo as input. We represent a scene as a layered collection of depth images, where each pixel encodes both color and depth. Starting from an input image, we employ a suite of user-assisted techniques, based on a painting metaphor, to assign depths and extract layers. We introduce two specific editing operations. The first, a “clone brushing tool,” permits the distortion-free copying of parts of a picture, by using a parameterization optimization technique. The second, a “texture-illuminance decoupling filter,” discounts the effect of illumination on uniformly textured areas, by decoupling large- and small-scale features via bilateral filtering. Our system enables editing from different viewpoints, extracting and grouping of image-based objects, and modifying the shape, color, and illumination of these objects.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scale-space and edge detection using anisotropic diffusion
Perona, P., & Malik, J. (1990) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.56205 · Cited by 12,119
Bilateral Filtering for Gray and Color Images
Tomasi, C., & Manduchi, R. (2002) · Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271) · doi:10.1109/iccv.1998.710815 · Cited by 8,177
A morphable model for the synthesis of 3D faces
Blanz, V., & Vetter, T. (1999) · Proceedings of the 26th annual conference on Computer graphics and interactive techniques - SIGGRAPH '99 · doi:10.1145/311535.311556 · Cited by 4,710
Levoy, M., & Hanrahan, P. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237199 · Cited by 3,755
Level Set Methods and Fast Marching Methods
Sethian, J. A. (1999) · Medical Entomology and Zoology · Cited by 3,616
Bertalmio, M., Sapiro, G., Caselles, V., & Ballester, C. (2000) · Proceedings of the 27th annual conference on Computer graphics and interactive techniques - SIGGRAPH '00 · doi:10.1145/344779.344972 · Cited by 3,580
A multiscale retinex for bridging the gap between color images and the human observation of scenes
Jobson, D. J., Rahman, Z., & Woodell, G. A. (1997) · IEEE Transactions on Image Processing · doi:10.1109/83.597272 · Cited by 3,036
Gortler, S. J., Grzeszczuk, R., Szeliski, R., & Cohen, M. F. (1996) · Proceedings of the 23rd annual conference on Computer graphics and interactive techniques · doi:10.1145/237170.237200 · Cited by 2,458
Recovering high dynamic range radiance maps from photographs
Debevec, P. E., & Malik, J. (2008) · ACM SIGGRAPH 2008 classes · doi:10.1145/1401132.1401174 · Cited by 2,399
(1999) · Cited by 2,243
Cited by
Fast bilateral filtering for the display of high-dynamic-range images
Durand, F., & Dorsey, J. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566574 · Cited by 1,547
Self-citationEdge-preserving decompositions for multi-scale tone and detail manipulation
Farbman, Z., Fattal, R., Lischinski, D., & Szeliski, R. (2008) · ACM Transactions on Graphics · doi:10.1145/1360612.1360666 · Cited by 1,443
Digital photography with flash and no-flash image pairs
Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M., Hoppe, H., & Toyama, K. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015777 · Cited by 1,056
A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach
Paris, S., & Durand, F. (2009) · International Journal of Computer Vision · doi:10.1007/s11263-007-0110-8 · Cited by 797
Self-citationImagic: Text-Based Real Image Editing with Diffusion Models
Kawar, B., Zada, S., Lang, O., Tov, O., Chang, H., Dekel, T., Mosseri, I., & Irani, M. (2023) · 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr52729.2023.00582 · Cited by 767
Deep photo: model-based photograph enhancement and viewing
Kopf, J., Neubert, B., Chen, B., Cohen, M., Cohen-Or, D., Deussen, O., Uyttendaele, M., & Lischinski, D. (2008) · ACM Transactions on Graphics · doi:10.1145/1409060.1409069 · Cited by 713
Hoiem, D., Efros, A. A., & Hebert, M. (2005) · ACM Transactions on Graphics · doi:10.1145/1073204.1073232 · Cited by 616
Flash photography enhancement via intrinsic relighting
Eisemann, E., & Durand, F. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015778 · Cited by 593
Self-citationBilateral Filtering: Theory and Applications
Paris, S., Kornprobst, P., Tumblin, J., & Durand, F. (2009) · Foundations and Trends in Computer Graphics and Vision · doi:10.1561/0600000020 · Cited by 586
Self-citationView Synthesis by Appearance Flow
Zhou, T., Tulsiani, S., Sun, W., Malik, J., & Efros, A. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_18 · Cited by 579
Fragment-based image completion
Drori, I., Cohen-Or, D., & Yeshurun, H. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882267 · Cited by 492
A Fast Approximation of the Bilateral Filter Using a Signal Processing Approach
Paris, S., & Durand, F. (2006) · Lecture Notes in Computer Science · doi:10.1007/11744085_44 · Cited by 481
Self-citationDepth Transfer: Depth Extraction from Video Using Non-Parametric Sampling
Karsch, K., Liu, C., & Kang, S. B. (2014) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/tpami.2014.2316835 · Cited by 453
LabelMe: Online Image Annotation and Applications
Torralba, A., Russell, B. C., & Yuen, J. (2010) · Proceedings of the IEEE · doi:10.1109/jproc.2010.2050290 · Cited by 431
A Survey of Urban Reconstruction
Musialski, P., Wonka, P., Aliaga, D. G., Wimmer, M., van Gool, L., & Purgathofer, W. (2013) · Computer Graphics Forum · doi:10.1111/cgf.12077 · Cited by 429
Real-time edge-aware image processing with the bilateral grid
Chen, J., Paris, S., & Durand, F. (2007) · ACM Transactions on Graphics · doi:10.1145/1276377.1276506 · Cited by 395
Self-citationReal-time edge-aware image processing with the bilateral grid
Chen, J., Paris, S., & Durand, F. (2007) · ACM SIGGRAPH 2007 papers · doi:10.1145/1275808.1276506 · Cited by 394
Self-citationBell, S., Bala, K., & Snavely, N. (2014) · ACM Transactions on Graphics · doi:10.1145/2601097.2601206 · Cited by 380
Real-time O(1) bilateral filtering
Yang, Q., Tan, K.-H., & Ahuja, N. (2009) · 2009 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2009.5206542 · Cited by 378
Fragment-based image completion
Drori, I., Cohen-Or, D., & Yeshurun, H. (2003) · ACM Transactions on Graphics · doi:10.1145/882262.882267 · Cited by 343
Edge-preserving multiscale image decomposition based on local extrema
Subr, K., Soler, C., & Durand, F. (2009) · ACM Transactions on Graphics · doi:10.1145/1618452.1618493 · Cited by 306
Self-citationPointshop 3D: an interactive system for point-based surface editing
Zwicker, M., Pauly, M., Knoll, O., & Gross, M. (2002) · Proceedings of the 29th annual conference on Computer graphics and interactive techniques · doi:10.1145/566570.566584 · Cited by 294
Near-regular texture analysis and manipulation
Liu, Y., Lin, W.-C., & Hays, J. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015731 · Cited by 260
Rendering synthetic objects into legacy photographs
Karsch, K., Hedau, V., Forsyth, D., & Hoiem, D. (2011) · Proceedings of the 2011 SIGGRAPH Asia Conference · doi:10.1145/2024156.2024191 · Cited by 192
Hoiem, D., Efros, A. A., & Hebert, M. (2005) · ACM SIGGRAPH 2005 Papers · doi:10.1145/1186822.1073232 · Cited by 180
“2001] and [Oh et al. 2001], but at the cost of a less intuitive interface.”
BackgroundAutomatic Scene Inference for 3D Object Compositing
Karsch, K., Sunkavalli, K., Hadap, S., Carr, N., Jin, H., Fonte, R., Sittig, M., & Forsyth, D. (2014) · ACM Transactions on Graphics · doi:10.1145/2602146 · Cited by 180
“User-guided approaches to single image modeling [Horry et al. 1997; Criminisi et al. 2000; Oh et al. 2001] have been successfully used to create 3D reconstructions that allow for viewpoint variation.”
MethodCharacter animation from 2D pictures and 3D motion data
Hornung, A., Dekkers, E., & Kobbelt, L. (2007) · ACM Transactions on Graphics · doi:10.1145/1189762.1189763 · Cited by 180
Metadata
- Authors
- Oh, B. M., Chen, M., Dorsey, J., & Durand, F.
- Venue
- Proceedings of the 28th annual conference on Computer graphics and interactive techniques
- Publisher
- ACM
- Published
- 2001-08
- Pages
- 433-442
- OpenAlex
- W2157070558
- Cited by
- 348
- References
- 59
- FWCI
- 8.29
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.