Cited by 152Advanced Steganography and Watermarking TechniquesAdversarial Robustness in Machine LearningPhysical Unclonable Functions (PUFs) and Hardware Security

Digital watermarking for deep neural networks

Open access
Nagai, Yuki, Uchida, Yusuke, Sakazawa, Shigeyuki, Satoh, Shin’ichi·2018·International Journal of Multimedia Information Retrieval

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s13735-018-0147-1

Cites

4 of 4 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Digital watermarking provides additional layers of protection through both visible and invisible markers that identify Indigenous data and its consent status.

    “Another possible tool is digital watermarking, which provides additional layers of protection through both visible and invisible markers that identify Indigenous data and its consent status (see how watermarking could be applied in neural networks in Nagai et al. 2018).”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 45

  1. [1]1. S. Amari. A theory of adaptive pattern classifiers. IEEE Trans. on Electronic Computers , EC-16(3):299-307, June 1967.
  2. [2]2. X. Anguera, A. Garzon, and T. Adamek. Mask: Robust local features for audio fingerprinting. In Proc. of ICME , 2012.
  3. [3]3. L. J. Ba and R. Caruana. Do deep nets really need to be deep? In Proc. of NIPS , pages 2654-2662, 2014.
  4. [4]4. A. Babenko, A. Slesarev, A. Chigorin, and V. Lempitsky. Neural codes for image retrieval. In D. Fleet, T. Pajdla, B. Schiele, and T. Tuytelaars, editors, Proc. of ECCV , pages 584-599, 2014.
  5. [5]5. J. Barr, B. Bradley, and B. T. Hannigan. Using digital watermarks with image signatures to mitigate the threat of the copy attack. In Proc. of ICASSP , pages 69-72, 2003.
  6. [6]6. Y. Bengio, A. Courville, and P. Vincent. Representation learning: A review and new perspectives. IEEE Trans. on Pattern Analysis and Machine Intelligence , 35(8):1798-1828, Aug 2013.
  7. [7]7. J. Bergstra, O. Breuleux, F. Bastien, P. Lamblin, R. Pascanu, G. Desjardins, J. Turian, D. Warde-Farley, and Y. Bengio. Theano: a CPU and GPU math expression compiler. In Proc. of the Python for Scientific Computing Conference (SciPy) , 2010.
  8. [8]8. T. Chen, I. Goodfellow, and J. Shlens. Net2net: Accelerating learning via knowledge transfer. In Proc. of ICLR , 2016.
  9. [10]10. A. Choromanska, M. Henaff, M. Mathieu, G. Arous, and Y. LeCun. The loss surfaces of multilayer networks. In Proc. of AISTATS , 2015.
  10. [11]11. R. Collobert, K. Kavukcuoglu, and C. Farabet. Torch7: A matlablike environment for machine learning. In Proc. of NIPS Workshop on BigLearn , 2011.
  11. [12]12. I. Cox, M. Miller, J. Bloom, J. Fridrich, and T. Kalker. Digital Watermarking and Steganography . Morgan Kaufmann Publishers Inc., 2 edition, 2008.
  12. [13]13. Y. Dauphin, R. Pascanu, C. Gulcehre, K. Cho, S. Ganguli, and Y. Bengio. Identifying and attacking the saddle point problem in high-dimensional non-convex optimization. In Proc. of NIPS , 2014.
  13. [16]16. L. Fei-Fei, R. Fergus, and P. Perona. Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. In Proc. of CVPR Workshop on Generative-Model Based Vision , 2004.
  14. [17]17. J. Haitsma and T. Kalker. A highly robust audio fingerprinting system. In Proc. of ISMIR , pages 107-115, 2002.
  15. [18]18. S. Han, X. Liu, H. Mao, J. Pu, A. Pedram, M. A. Horowitz, and W. J. Dally. Eie: Efficient inference engine on compressed deep neural network. In Proc. of ISCA , 2016.
  16. [19]19. S. Han, H. Mao, and W. J. Dally. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. In Proc. of ICLR , 2016.
  17. [20]20. S. Han, J. Pool, J. Tran, and W. J. Dally. Learning both weights and connections for efficient neural networks. In Proc. of NIPS , 2015.
  18. [21]21. F. Hartung and M. Kutter. Multimedia watermarking techniques. In Proc. of the IEEE , volume 87, pages 1079-1107, 1999.
  19. [23]23. G. Hinton, O. Vinyals, and J. Dean. Distilling the knowledge in a neural network. In Proc. of NIPS Workshop on Deep Learning and Representation Learning , 2014.
  20. [24]24. G. E. Hinton and R. R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science , 313(5786):504-507, 2006.
  21. [25]25. S. Hochreiter and J. Schmidhuber. Long short-term memory. Neural Computation , 9(8):1735-1780, 1997.
  22. [26]26. Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell. Caffe: Convolutional architecture for fast feature embedding. In Proc. of MM , 2014.
  23. [27]27. N. Johnson, Z. Duric, and S. Jajodia. Information Hiding: Steganography and Watermarking -Attacks and Countermeasures . Springer, 2000.
  24. [28]28. A. Joly, C. Frelicot, and O. Buisson. Content-based video copy detection in large databases: a local fingerprints statistical similarity search approach. In Proc. of ICIP , pages 505-508, 2005.
  25. [30]30. J. Kodovsky, J. Fridrich, and V. Holub. Ensemble classifiers for steganalysis of digital media. IEEE Trans. on Information Forensics and Security , 7(2):432-444, 2012.
  26. [32]32. A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Proc. of NIPS , 2012.
  27. [33]33. A. Krogh and J. A. Hertz. A simple weight decay can improve generalization. In Proc. of NIPS , 1992.
  28. [34]34. Y. LeCun, Y. Bengio, and G. Hinton. Deep learning. Nature , 521(7553):436-444, 05 2015.
  29. [35]35. Y. Lecun, L. Bottou, Y. Bengio, and P. Haffner. Gradient-based learning applied to document recognition. In Proc. of the IEEE , volume 86, pages 2278-2324, 1998.
  30. [36]36. S. Lee, J. Kim, J. Jun, J. Ha, and B. Zhang. Overcoming catastrophic forgetting by incremental mome. In Proc. of NIPS , 2017.
  31. [37]37. M. Abadi, et al. Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv:1603.04467 , 2016. · arXiv
  32. [38]38. E. L. Merrer, P. Perez, and G. Tr´ edan. Adversarial frontier stitching for remote neural network watermarking. arXiv:1711.01894 , 2017. · arXiv
  33. [39]39. Y. Nesterov. A method of solving a convex programming problem with convergence rate o(1/k2). Soviet Mathematics Doklady , 27(2):372-376, 2 1983.
  34. [40]40. L. Pang, S. Zhu, and C. W. Ngo. Deep multimodal learning for affective analysis and retrieval. IEEE Trans. on Multimedia , 17(11):2008-2020, Nov 2015.
  35. [41]41. L. Shaohui, Y. Hongxun, and G. Wen. Neural network based steganalysis in still images. In Proc. of ICME , 2003.
  36. [42]42. K. Simonyan and A. Zisserman. Very deep convolutional networks for large-scale image recognition. In Proc. of ICLR , 2015.
  37. [43]43. I. Sutskever, J. Martens, G. Dahl, and G. Hinton. On the importance of initialization and momentum in deep learning. In Proc. of ICML , volume 28, pages III-1139-III-1147, 2013.
  38. [44]44. C. Szegedy, W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, D. Erhan, V. Vanhoucke, and A. Rabinovich. Going deeper with convolutions. In Proc. of CVPR , 2015.
  39. [45]45. S. Tokui, K. Oono, S. Hido, and J. Clayton. Chainer: a nextgeneration open source framework for deep learning. In Proc. of NIPS Workshop on Machine Learning Systems , 2015.
  40. [46]46. M. Tom´ aˇ s, K. Martin, B. Luk´ aˇ s, ˇ C. Jan, and K. Sanjeev. Recurrent neural network based language model. In Proc. of INTERSPEECH , 2010.
  41. [47]47. Y. Uchida, M. Agrawal, and S. Sakazawa. Accurate content-based video copy detection with efficient feature indexing. In Proc. of ICMR , 2011.
  42. [48]48. Y. Uchida, Y. Nagai, S. Sakazawa, and S. Satoh. Embedding watermarks into deep neural networks. In Proc. of ICMR , 2017.
  43. [49]49. A. van den Oord, S. Dieleman, and B. Schrauwen. Deep contentbased music recommendation. In C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, and K. Q. Weinberger, editors, Proc. of NIPS , pages 2643-2651. Curran Associates, Inc., 2013.
  44. [50]50. J. Wan, D. Wang, S. C. H. Hoi, P. Wu, J. Zhu, Y. Zhang, and J. Li. Deep learning for content-based image retrieval: A comprehensive study. In Proc. of MM , pages 157-166, 2014.
  45. [51]51. T. Wei, C. Wang, Y. Rui, and C. W. Chen. Network morphism. In Proc. of ICML , 2016.

Cited by

Sorted by citations

Authors
Nagai, Y., Uchida, Y., Sakazawa, S., & Satoh, S.
Affiliations
  • KDDI Research (Japan) (JP)
  • Osaka Institute of Technology (JP)
  • National Institute of Informatics (JP)
Corresponding author
Nagai, Yuki
Venue
International Journal of Multimedia Information Retrieval
Published
2018-02-02
Volume
7
Issue
1
Pages
3-16
ISSN
  • 2192-6611 (ISSN-L)
  • 2192-662X
OpenAlex
W2787075213
Cited by
152
References
4
Citations by year
2026: 6 · 2025: 23 · 2024: 25 · 2023: 13 · 2022: 22 · 2021: 28 · 2020: 15 · 2019: 14 · 2018: 6
FWCI
7.88
Type
journal article
Language
en
Open access
Locations
  • International Journal of Multimedia Information Retrieval (publishedVersion)
  • arXiv (Cornell University) (publishedVersion)
  • arXiv (Cornell University)
Topics
  • Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Advanced Steganography and Watermarking Techniques
  • Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
  • Physical Sciences › Computer Science › Hardware and Architecture › Physical Unclonable Functions (PUFs) and Hardware Security
Keywords
digital watermarking, deep neural network, intellectual property protection, parameter regularization, watermark embedding, fine-tuning, knowledge distillation, parameter pruning, watermark robustness

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review