Region-Based Convolutional Neural Network for Segmenting Text in Epigraphical Images
Open accessThe DOI matches its Crossref record; 17 of the 17 references it cites were found in a registry or an index.
Abstract
Indian history is derived from ancient writings on the inscriptions, palm leaves, copper plates, coins, and many more mediums.Epigraphers read these inscriptions and produce meaningful interpretations. Automating the process of reading is the interest of our study, and in this paper, segmentation to detect text on digitized inscriptional images is dealt in detail. Character segmentation from epigraphical images helps in optical character recognizer in training and recognition of old regional scripts. Epigraphical images are drawn from estampages containing scripts from various periods starting from Brahmi in the 3rd century BC to the medieval period of the 15th century AD. The scripts or characters present in digitized epigraphical images are illegible and have complex noisy background textures. To achieve script/text segmentation, region-based convolutional neural network (CNN) is employed to detect characters in the images. Proposed method uses selective search to identify text regions and forwards them to trained CNN models for drawing feature vectors. These feature vectors are fed to support vector machine classifiers for classification and recognize text by drawing a bounding box based on confidence score. Alexnet, VGG16, Resnet50, and InceptionV3 are used as CNN models for experimentation, and InceptionV3 performed well with good results. A total of 197 images are used for experimentation, out of which 70 samples are of printed denoised epigraphical images, 40 denoised estampage images, and 87 noisy estampage images. The segmentation result of 74.79% for printed denoised epigraphical images, 71.53 % for denoised estampage epigraphical images, and 18.11% for noisy estampage images are recorded by InceptionV3. The segmented characters are used for epigraphical applications like period/era prediction and recognition of characters. FAST and FASTER region-based design approach was also tested and illustrated in this paper. Received: 1 July 2022 | Revised: 31 August 2022 | Accepted: 6 September 2022 Conflicts of Interest The authors declare that they have no conflicts of interest to this work.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Very Deep Convolutional Networks for Large-Scale Image Recognition
Simonyan, K., & Zisserman, A. (2014) · arXiv · doi:10.48550/arxiv.1409.1556 · Cited by 114,148
ImageNet classification with deep convolutional neural networks
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017) · Communications of the ACM · doi:10.1145/3065386 · Cited by 112,155
Rethinking the Inception Architecture for Computer Vision
Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., & Wojna, Z. (2016) · 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) · doi:10.1109/cvpr.2016.308 · Cited by 32,138
Efficient Graph-Based Image Segmentation
Felzenszwalb, P. F., & Huttenlocher, D. P. (2004) · International Journal of Computer Vision · doi:10.1023/b:visi.0000022288.19776.77 · Cited by 6,176
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning
Szegedy, C., Ioffe, S., Vanhoucke, V., & Alemi, A. (2017) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v31i1.11231 · Cited by 4,636
Confusion Matrix Visualization
Susmaga, R. (2004) · Springer eBooks · doi:10.1007/978-3-540-39985-8_12 · Cited by 180
Attention-Based Neural Text Segmentation
Badjatiya, P., Kurisinkel, L. J., Gupta, M., & Varma, V. (2018) · Lecture notes in computer science · doi:10.1007/978-3-319-76941-7_14 · Cited by 72
Handwritten Text Segmentation via End-to-End Learning of Convolutional Neural Networks
Jo, J., Koo, H. I., Soh, J. W., et al. (2020) · Multimedia Tools and Applications · doi:10.1007/s11042-020-09624-9 · Cited by 39
Chen, K., Liu, C., Seuret, M., Liwicki, M., Hennebert, J., & Ingold, R. (2016) · IAPR International Workshop on Document Analysis Systems (DAS) · doi:10.1109/das.2016.13 · Cited by 34
Historical Document Image Segmentation with LDA-Initialized Deep Neural Networks
Alberti, M., Seuret, M., Pondenkandath, V., Ingold, R., & Liwicki, M. (2017) · International Workshop on Historical Document Imaging and Processing (HIP) · doi:10.1145/3151509.3151519 · Cited by 28
A deep reinforcement learning approach to character segmentation of license plate images
Abtahi, F., Zhu, Z., & Burry, A. (2015) · Machine Vision Applications · doi:10.1109/mva.2015.7153249 · Cited by 23
Table Localization and Segmentation using GAN and CNN
Reza, M. M., Bukhari, S. S., Jenckel, M., et al. (2019) · doi:10.1109/icdarw.2019.40097 · Cited by 13
Deep Convolutional Neural Networks for Recognition of Historical Handwritten Kannada Characters
Chandrakala, H. T., & Thippeswamy, G. (2019) · Advances in intelligent systems and computing · doi:10.1007/978-981-13-9920-6_7 · Cited by 10
Extracting Maya Glyphs from Degraded Ancient Documents via Image Segmentation
Hu, R., Odobez, J., & Gática-Pérez, D. (2017) · Journal on Computing and Cultural Heritage · doi:10.1145/2996859 · Cited by 10
Interactive segmentation for character extraction in stone inscriptions
Mohana, H. S., Navya, K., Rajithkumar, B. K., et al. (2014) · doi:10.1109/icctet.2014.6966309 · Cited by 6
Character segmentation in text line via convolutional neural network
Li, X., Zhang, X., Yang, B., & Xia, S. (2017) · International Conference on Systems and Informatics (ICSAI) · doi:10.1109/icsai.2017.8248463 · Cited by 5
Can Generative Adversarial Networks Teach Themselves Text Segmentation?
Al-Rawi, M. S., Bazazian, D., & Valveny, E. (2019) · IEEE International Conference on Computer Vision Workshops · doi:10.1109/iccvw.2019.00416 · Cited by 4
Metadata
- Authors
- Preethi, P., & Mamatha, H. R.
- Venue
- Artificial Intelligence and Applications
- Publisher
- BON VIEW PUBLISHING PTE
- Published
- 2022-09-06
- Volume
- 1
- Issue
- 2
- Pages
- 103-111
- ISSN
- 2811-0854 (ISSN-L)
- OpenAlex
- W4297624503
- Cited by
- 190
- References
- 17
- FWCI
- 13.19
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.