Transferring color to greyscale images
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
We introduce a general technique for "colorizing" greyscale images by transferring color between a source, color image and a destination, greyscale image. Although the general problem of adding chromatic values to a greyscale image has no exact, objective solution, the current approach attempts to provide a method to help minimize the amount of human labor required for this task. Rather than choosing RGB colors from a palette to color individual components, we transfer the entire color "mood" of the source to the target image by matching luminance and texture information between the images. We choose to transfer only chromatic information and retain the original luminance values of the target image. Further, the procedure is enhanced by allowing the user to match areas of the two images with rectangular swatches. We show that this simple technique can be successfully applied to a variety of images and video, provided that texture and luminance are sufficiently distinct. The images generated demonstrate the potential and utility of our technique in a diverse set of application domains.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Texture synthesis by non-parametric sampling
Efros, A. A., & Leung, T. K. (1999) · Proceedings of the Seventh IEEE International Conference on Computer Vision · doi:10.1109/iccv.1999.790383 · Cited by 3,023
Reinhard, E., Adhikhmin, M., Gooch, B., & Shirley, P. (2001) · IEEE Computer Graphics and Applications · doi:10.1109/38.946629 · Cited by 2,937
Gomarasca, M. A. (2009) · Basics of Geomatics · doi:10.1007/978-1-4020-9014-1_8 · Cited by 2,614
Image quilting for texture synthesis and transfer
Efros, A. A., & Freeman, W. T. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383296 · Cited by 2,347
Digital image processing (2nd ed.)
(1992) · CVGIP: Image Understanding · doi:10.1016/1049-9660(92)90019-y · Cited by 1,780
Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., & Salesin, D. H. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383295 · Cited by 1,518
Digital image processing (2nd ed.)
Pratt, W. K. (1991) · John Wiley & Sons, Inc. eBooks · Cited by 1,151
Statistics of cone responses to natural images: implications for visual coding
Ruderman, D. L., Cronin, T. W., & Chiao, C.-C. (1998) · Journal of the Optical Society of America A · doi:10.1364/josaa.15.002036 · Cited by 715
Digital image processing algorithms
(1994) · Choice Reviews Online · doi:10.5860/choice.31-4964 · Cited by 381
Cited by
Zhang, R., Isola, P., & Efros, A. A. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46487-9_40 · Cited by 3,178
Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., & Salesin, D. H. (2001) · Proceedings of the 28th annual conference on Computer graphics and interactive techniques · doi:10.1145/383259.383295 · Cited by 1,518
Colorization using optimization
Levin, A., Lischinski, D., & Weiss, Y. (2004) · ACM Transactions on Graphics · doi:10.1145/1015706.1015780 · Cited by 1,411
Learning Representations for Automatic Colorization
Larsson, G., Maire, M., & Shakhnarovich, G. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46493-0_35 · Cited by 946
“This can be seen as an extension of patch-matching techniques [41], adding interaction terms for spatial consistency.”
MethodInfluentialIizuka, S., Simo-Serra, E., & Ishikawa, H. (2016) · ACM Transactions on Graphics · doi:10.1145/2897824.2925974 · Cited by 814
Real-time user-guided image colorization with learned deep priors
Zhang, R., Zhu, J.-Y., Isola, P., Geng, X., Lin, A. S., Yu, T., & Efros, A. A. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073703 · Cited by 569
Cheng, Z., Yang, Q., & Sheng, B. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.55 · Cited by 557
Fast image and video colorization using chrominance blending
Yatziv, L., & Sapiro, G. (2006) · IEEE Transactions on Image Processing · doi:10.1109/tip.2005.864231 · Cited by 529
Fragment-based image completion
Drori, I., Cohen-Or, D., & Yeshurun, H. (2003) · ACM SIGGRAPH 2003 Papers · doi:10.1145/1201775.882267 · Cited by 492
Visual attribute transfer through deep image analogy
Liao, J., Yao, Y., Yuan, L., Hua, G., & Kang, S. B. (2017) · ACM Transactions on Graphics · doi:10.1145/3072959.3073683 · Cited by 487
Automated colour grading using colour distribution transfer
Pitié, F., Kokaram, A. C., & Dahyot, R. (2007) · Computer Vision and Image Understanding · doi:10.1016/j.cviu.2006.11.011 · Cited by 395
Cohen-Or, D., Sorkine, O., Gal, R., Leyvand, T., & Xu, Y.-Q. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1141933 · Cited by 341
Local Color Transfer via Probabilistic Segmentation by Expectation-Maximization
Tai, Y.-W., Jia, J., & Tang, C.-K. (2005) · 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) · doi:10.1109/cvpr.2005.215 · Cited by 332
N-dimensional probability density function transfer and its application to color transfer
Pitie, F., Kokaram, A. C., & Dahyot, R. (2005) · Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 · doi:10.1109/iccv.2005.166 · Cited by 331
Qu, Y., Wong, T.-T., & Heng, P.-A. (2006) · ACM Transactions on Graphics · doi:10.1145/1141911.1142017 · Cited by 297
Image colorization using similar images
Gupta, R. K., Chia, A. Y.-S., Rajan, D., Ng, E. S., & Zhiyong, H. (2012) · Proceedings of the 20th ACM international conference on Multimedia · doi:10.1145/2393347.2393402 · Cited by 256
Deep Exemplar-Based Video Colorization
Zhang, B., He, M., Liao, J., Sander, P. V., Yuan, L., Bermak, A., & Chen, D. (2019) · 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2019.00824 · Cited by 204
“Early image colorization methods relied on user-guided scribbles [1, 2, 3, 4, 5] or a sample reference [6, 7, 8, 9, 10, 11, 12, 13] to address this ill-posed problem, and more recent deep-learning works [14, 15, 16, 17, 18, 19, 20] directly predict colors by learning color-semantic relationships…”
BackgroundMethodChromaGAN: Adversarial Picture Colorization with Semantic Class Distribution
Vitoria, P., Raad, L., & Ballester, C. (2020) · 2020 IEEE Winter Conference on Applications of Computer Vision (WACV) · doi:10.1109/wacv45572.2020.9093389 · Cited by 189
“[36], pro-pose to match the luminance values and texture information between images.”
BackgroundSemantic colorization with internet images
Chia, A. Y.-S., Zhuo, S., Gupta, R. K., Tai, Y.-W., Cho, S.-Y., Tan, P., & Lin, S. (2011) · ACM Transactions on Graphics · doi:10.1145/2070781.2024190 · Cited by 177
The linear Monge-Kantorovitch linear colour mapping for example-based colour transfer
Pitie, F., & Kokaram, A. (2007) · IET 4th European Conference on Visual Media Production (CVMP 2007) · doi:10.1049/cp:20070055 · Cited by 159
“It favourably compares theoretically and experimentally with other techniques for various images and under various colour spaces.”
Background(2014) · doi:10.1145/2669024.2669037 · Cited by 44
Rybnikova, N., Portnov, B. A., Mirkes, E. M., Zinovyev, A., Brook, A., & Gorban, A. N. (2022) · IEEE Transactions on Geoscience and Remote Sensing · doi:10.1109/tgrs.2021.3076011 · Cited by 10
“We should emphasize that this task is different from the gray-scale image or movie colorization task, which is based on the analysis of semantically similar images with matching the luminance and texture information and selecting the best color among a set of color candidates (see for example [55]–[59]).”
Metadata
- Authors
- Welsh, T., Ashikhmin, M., & Mueller, K.
- Venue
- Proceedings of the 29th annual conference on Computer graphics and interactive techniques
- Publisher
- ACM
- Published
- 2002-07
- Pages
- 277-280
- OpenAlex
- W2240798854
- Cited by
- 713
- References
- 9
- FWCI
- 11.86
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.