The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Learning features for offline handwritten signature verification using deep convolutional neural networks
Open accessAbstract
We propose formulations for learning features for Offline Signature Verification.A novel method that uses knowledge of forgeries from a subset of users is proposed.Learned features are used to train classifiers for other users (without forgeries).Experiments on GPDS-960 show a large improvement in state-of-the-art.Results in other 3 datasets show that the features generalize without fine-tuning. Verifying the identity of a person using handwritten signatures is challenging in the presence of skilled forgeries, where a forger has access to a persons signature and deliberately attempt to imitate it. In offline (static) signature verification, the dynamic information of the signature writing process is lost, and it is difficult to design good feature extractors that can distinguish genuine signatures and skilled forgeries. This reflects in a relatively poor performance, with verification errors around 7% in the best systems in the literature. To address both the difficulty of obtaining good features, as well as improve system performance, we propose learning the representations from signature images, in a Writer-Independent format, using Convolutional Neural Networks. In particular, we propose a novel formulation of the problem that includes knowledge of skilled forgeries from a subset of users in the feature learning process, that aims to capture visual cues that distinguish genuine signatures and forgeries regardless of the user. Extensive experiments were conducted on four datasets: GPDS, MCYT, CEDAR and Brazilian PUC-PR datasets. On GPDS-160, we obtained a large improvement in state-of-the-art performance, achieving 1.72% Equal Error Rate, compared to 6.97% in the literature. We also verified that the features generalize beyond the GPDS dataset, surpassing the state-of-the-art performance in the other datasets, without requiring the representation to be fine-tuned to each particular dataset.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Going deeper with convolutions
Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., & Rabinovich, A. (2015) · 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2015.7298594 · Cited by 48,562
A Threshold Selection Method from Gray-Level Histograms
Otsu, N. (1979) · IEEE Transactions on Systems, Man, and Cybernetics · doi:10.1109/tsmc.1979.4310076 · Cited by 43,398
(2008) · Journal of Machine Learning Research · Cited by 33,051
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S., & Szegedy, C. (2015) · arXiv · doi:10.48550/arxiv.1502.03167 · Cited by 27,818
Advances in Neural Information Processing Systems 19
(2007) · The MIT Press eBooks · doi:10.52202/085713 · Cited by 15,539
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
Ioffe, S. (2024) · arXiv (Cornell University) · doi:10.57702/o9raffed · Cited by 14,214
Advances in Neural Information Processing Systems 25
Zhang, Y., Sutton, C. A., Storkey, A., & Zoubin Ghahramani, A. (2012) · Cited by 12,653
Backpropagation Applied to Handwritten Zip Code Recognition
LeCun, Y., Boser, B., Denker, J. S., Henderson, D., Howard, R. E., Hubbard, W., & Jackel, L. D. (1989) · Neural Computation · doi:10.1162/neco.1989.1.4.541 · Cited by 11,891
Learning Deep Architectures for AI
Bengio, Y. (2009) · Foundations and Trends® in Machine Learning · doi:10.1561/2200000006 · Cited by 9,239
Learning Deep Architectures for AI
Bengio, Y. (2009) · now publishers, Inc. eBooks · doi:10.1561/9781601982957 · Cited by 4,941
Greedy layer-wise training of deep networks
Bengio, Y., Lamblin, P., Popovici, D., & Larochelle, H. (2007) · Advances in Neural Information Processing Systems 19 · doi:10.7551/mitpress/7503.003.0024 · Cited by 4,841 · cited 1×
“With small datasets, other strategies have been used successfully, such as unsupervised pre-training (e.g. in a greedy layer-wise fashion [27]), and more recently with transfer learning [28], [29], [30].”
MethodCNN Features Off-the-Shelf: An Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops · doi:10.1109/cvprw.2014.131 · Cited by 4,451
DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
Donahue, J., Jia, Y., Vinyals, O., Hoffman, J., Zhang, N., Tzeng, E., & Darrell, T. (2013) · arXiv · doi:10.48550/arxiv.1310.1531 · Cited by 4,019 · cited 2×
“ropagation until the last layer before softmax (obtaining ˚(X)), and use the activations at that layer as the feature vector for the image. This can be seen as a form of transfer learning (similar to [28]) between the two sets of users. For each user, we build a training set consisting of genuine signatures from the u…”
BackgroundMethod2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)
(2015) · doi:10.1109/cvpr31182.2015 · Cited by 3,737
Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks
Oquab, M., Bottou, L., Laptev, I., & Sivic, J. (2014) · 2014 IEEE Conference on Computer Vision and Pattern Recognition · doi:10.1109/cvpr.2014.222 · Cited by 3,150 · cited 1×
“iteria. With small datasets, other strategies have been used successfully, such as unsupervised pre-training (e.g. in a greedy layer-wise fashion [27]), and more recently with transfer learning [28], [29], [30]. CNNs have been used to transfer learning of representations, by first training a model in a large dataset, a…”
MethodOnline and off-line handwriting recognition: a comprehensive survey
Plamondon, R., & Srihari, S. N. (2000) · IEEE Transactions on Pattern Analysis and Machine Intelligence · doi:10.1109/34.824821 · Cited by 2,498
Proceedings of The 32nd International Conference on Machine Learning
Germain, M., Gregor, K., Murray, I., & Larochelle, H. (2015) · Cited by 2,020
Automatic signature verification and writer identification — the state of the art
Plamondon, R., & Lorette, G. (1989) · Pattern Recognition · doi:10.1016/0031-3203(89)90059-9 · Cited by 937
ImageNet classification with deep convolutional neural networks
Krizhevsky (2012) · Medical Entomology and Zoology · Cited by 799
MCYT baseline corpus: a bimodal biometric database
Ortega-Garcia, J., Fierrez-Aguilar, J., Simon, D., Gonzalez, J., Faundez-Zanuy, M., Espinosa, V., Satue, A., Hernaez, I., Igarza, J.-J., Vivaracho, C., et al. (2003) · IEE Proceedings - Vision, Image, and Signal Processing · doi:10.1049/ip-vis:20031078 · Cited by 757
Support Vector Machines: Training and Applications
Osuna, E., Freund, R. M., & Girosi, F. (1997) · DSpace@MIT (Massachusetts Institute of Technology) · Cited by 697
Automatic Signature Verification: The State of the Art
Impedovo, D., & Pirlo, G. (2008) · IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews) · doi:10.1109/tsmcc.2008.923866 · Cited by 679
CNN Features off-the-shelf: an Astounding Baseline for Recognition
Razavian, A. S., Azizpour, H., Sullivan, J., & Carlsson, S. (2014) · arXiv · doi:10.48550/arxiv.1403.6382 · Cited by 607
Deep Learning of Representations: Looking Forward
Bengio, Y. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-39593-2_1 · Cited by 513
AUTOMATIC SIGNATURE VERIFICATION: THE STATE OF THE ART—1989–1993
LECLERC, F., & PLAMONDON, R. (1994) · International Journal of Pattern Recognition and Artificial Intelligence · doi:10.1142/s0218001494000346 · Cited by 437
2015 International Joint Conference on Neural Networks (IJCNN)
(2015) · doi:10.1109/ijcnn34689.2015 · Cited by 397
HMM-based on-line signature verification: Feature extraction and signature modeling
Fierrez, J., Ortega-Garcia, J., Ramos, D., & Gonzalez-Rodriguez, J. (2007) · Pattern Recognition Letters · doi:10.1016/j.patrec.2007.07.012 · Cited by 309
18th International Conference on Pattern Recognition (ICPR'06)
(2006) · doi:10.1109/icpr11944.2006 · Cited by 280
Offline handwritten signature verification — Literature review
Hafemann, L. G., Sabourin, R., & Oliveira, L. S. (2017) · 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA) · doi:10.1109/ipta.2017.8310112 · Cited by 231
Self-citationGuerbai, Y., Chibani, Y., & Hadjadji, B. (2015) · Pattern Recognition · doi:10.1016/j.patcog.2014.07.016 · Cited by 227
Off-line signature verification based on grey level information using texture features
Vargas, J. F., Ferrer, M. A., Travieso, C. M., & Alonso, J. B. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2010.07.028 · Cited by 221
Writer-independent off-line signature verification using surroundedness feature
Kumar, R., Sharma, J. D., & Chanda, B. (2011) · Pattern Recognition Letters · doi:10.1016/j.patrec.2011.10.009 · Cited by 217
Bertolini, D. S., Oliveira, L. S., Justino, E. J. R., & Sabourin, R. (2009) · Pattern Recognition · doi:10.1016/j.patcog.2009.05.009 · Cited by 205
Self-citationDeep Learning of Representations: Looking ForwardPreprint
Bengio, Y. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1305.0445 · Cited by 195
Hafemann, L. G., Sabourin, R., & Oliveira, L. S. (2016) · International Joint Conference on Neural Networks (IJCNN) · doi:10.1109/ijcnn.2016.7727521 · Cited by 173
Self-citationDeep Multitask Metric Learning for Offline Signature Verification
Soleimani, A., Araabi, B. N., & Fouladi, K. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.05.023 · Cited by 173
Score level fusion of classifiers in off-line signature verification
Yılmaz, M. B., & Yanikoglu, B. A. (2016) · Information Fusion · doi:10.1016/j.inffus.2016.02.003 · Cited by 113
Dynamic selection of generative–discriminative ensembles for off-line signature verification
Batista, L., Granger, É., & Sabourin, R. (2011) · Pattern Recognition · doi:10.1016/j.patcog.2011.10.011 · Cited by 106
Self-citationMulti-feature extraction and selection in writer-independent off-line signature verification
Rivard, D., Granger, É., & Sabourin, R. (2011) · International Journal on Document Analysis and Recognition (IJDAR) · doi:10.1007/s10032-011-0180-6 · Cited by 106
Self-citationYin, O. S., Teoh, A. B. J., Pang, Y. H., & Hiew, B. Y. (2015) · Applied Soft Computing · doi:10.1016/j.asoc.2015.11.039 · Cited by 104
Analyzing features learned for Offline Signature Verification using Deep CNNs
Hafemann, L. G., Sabourin, R., & Oliveira, L. S. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7900092 · Cited by 76
Self-citationOffline Signature Verification Using Real Adaboost Classifier Combination of Pseudo-dynamic Features
Hu, J., & Chen, Y. (2013) · Proceedings of the International Conference on Document Analysis and Recognition · doi:10.1109/icdar.2013.272 · Cited by 71
Isabelle Bloch, A., & Junior, R. M. C. (2010) · Lecture notes in computer science · doi:10.1007/978-3-642-16687-7 · Cited by 70
Online Signature Verification Based on Generative Models
Rúa, E. A., & Alba‐Castro, J. L. (2012) · IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · doi:10.1109/tsmcb.2012.2188508 · Cited by 65
Deep Learning Networks for Off-Line Handwritten Signature Recognition
Ribeiro, B., Gonçalves, I., dos Santos, S. R. B., & Kovačec, A. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-25085-9_62 · Cited by 58
Off-line signature verification using directional PDF and neural networks
Sabourin, R., & Drouhard, J.-P. (2003) · IAPR International Conference on Pattern Recognition (ICPR) · doi:10.1109/icpr.1992.201782 · Cited by 56
Self-citationPersian Signature Verification using Convolutional Neural Networks
Khalajzadeh, H., Mansouri, M., & Teshnehlab, M. (2012) · Cited by 48
Nanni, L., & Ghidoni, S. (2016) · Pattern Recognition Letters · doi:10.1016/j.patrec.2016.11.011 · Cited by 22
Cited by
A Perspective Analysis of Handwritten Signature Technology
Diaz, M., Ferrer, M. A., Impedovo, D., Malik, M. I., Pirlo, G., & Plamondon, R. (2019) · ACM Computing Surveys · doi:10.1145/3274658 · Cited by 255
Loh, H. W., Ooi, C. P., Palmer, E., Barua, P. D., Dogan, S., Tuncer, T., Baygin, M., & Acharya, U. R. (2021) · Electronics · doi:10.3390/electronics10141740 · Cited by 144
“The operation of the sigmoid and softmax activation functions are shown in Equations (6) and (7), respectively [48].”
BackgroundDeep Fisher discriminant learning for mobile hand gesture recognition
Li, C., Xie, C., Zhang, B., Chen, C., & Han, J. (2018) · Pattern Recognition · doi:10.1016/j.patcog.2017.12.023 · Cited by 72
Masoudnia, S., Mersa, O., Araabi, B. N., Vahabie, A.-H., Sadeghi, M. A., & Ahmadabadi, M. N. (2019) · Expert Systems with Applications · doi:10.1016/j.eswa.2019.03.040 · Cited by 57
Metadata
- Authors
- Hafemann, L. G., Sabourin, R., & Oliveira, L. S.
- Venue
- Pattern Recognition
- Publisher
- Elsevier BV
- Published
- 2017-10
- Volume
- 70
- Pages
- 163-176
- ISSN
- 0031-3203 (ISSN-L)
- OpenAlex
- W2614376571
- Cited by
- 391
- References
- 53
- FWCI
- 13.59
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.