Toponym-assisted map georeferencing: Evaluating the use of toponyms for the digitization of map collections
Open accessThe DOI matches its Crossref record; 84 of the 85 references it cites were found in a registry or an index; none of the 45 sources its claims cite is checked for support yet.
Abstract
A great deal of information is contained within archival maps—ranging from historic political boundaries, to mineral resources, to the locations of cultural landmarks. There are many ongoing efforts to preserve and digitize historic maps so that the information contained within them can be stored and analyzed efficiently. A major barrier to such map digitizing efforts is that the geographic location of each map is typically unknown and must be determined through an often slow and manual process known as georeferencing. To mitigate the time costs associated with the georeferencing process, this paper introduces a fully automated method based on map toponym (place name) labels. It is the first study to demonstrate these methods across a wide range of both simulated and real-world maps. We find that toponym-based georeferencing is sufficiently accurate to be used for data extraction purposes in nearly half of all cases. We make our implementation available to the wider research community through fully open-source replication code, as well as an online georeferencing tool, and highlight areas of improvement for future research. It is hoped that the practical implications of this research will allow for larger and more efficient processing and digitizing of map information for researchers, institutions, and the general public.
Overview
CoChat Summary
TL;DR
This paper presents and evaluates a fully automated toponym-based method for georeferencing maps by extracting place-name labels, matching them to gazetteers, and estimating a transform. Across simulated and real-world maps, it finds the approach can georeference many maps accurately enough for data extraction, though success depends on toponym count and image resolution.
Key findings
- Automated toponym-based georeferencing achieved high accuracy (<5% normalized maximum error) for 26.9% of 6,430 simulated maps and low accuracy (<100% error) for 77.7%; for a realistic simulated subset (n = 4,390), 36.7% were high accuracy and 86.7% low accuracy, and for a high-resolution realistic subset (n = 3,512), 40.1% were high accuracy and 91.4% low accuracy.
- On 333 real-world country maps, the modelMaxLOO metric indicated 67% within <5% error, 44% within <1% error, 82% within <100% error, and 15.3% failed.
- Fewer toponyms and coarse resolution most affected low-accuracy success: maps with only 10 toponyms dropped from about 80% success to 40%, and 1000-pixel resolution dropped success from over 80% to 60%. Toponym uncertainty up to 10 km and map extents as small as 25 km remained workable.
- Model selection favored lower-order polynomials: 1st order was used in 69% of georeferenced maps, 2nd order in 24%, and 3rd order in 7%.
Methods
- The pipeline extracts toponym labels using CIELab Delta E 2000 color thresholding (ΔE < 25 from black), Tesseract sparse text recognition, rules-based grouping of words within approximately 1.5 font-height, and contour-based detection of toponym marker symbols; toponyms are geocoded against USGS GNS, GeoNames, CIESIN GRUMP, OSMNames, and Natural Earth gazetteers.
- Toponym disambiguation uses normalized point pattern matching and combinatorial optimization over triplets, expanding candidate result sets; transform estimation compares 1st, 2nd, and 3rd order polynomial transforms and selects among control-point sets using leave-one-out maximum residual (modelMaxLOO) with automated outlier removal.
- Evaluation used 7,580 simulated maps generated from 379 scenes with varied extent, projection, toponym count, toponym uncertainty, resolution, and pixel noise, plus 333 real-world country maps from the University of Texas at Austin Map Collection (average width approximately 1300 pixels); simulated accuracy used trueMax, while real-world accuracy used modelMaxLOO.
Limitations
- The paper states the algorithm is not guaranteed to find all matching sets, unlike an exhaustive search, and may produce spurious matches; it cautions against use for maps smaller than 25 km due to sparse meaningful toponyms, and notes projection testing was limited to common projections, so results should not be generalized to less common source projections.
- The paper states that text recognition, geocoding/matching, and transform selection remain areas for improvement; false matched toponyms and distorted transformations occurred, and real-world maps lack true coordinates, so accuracy was measured by modelMaxLOO rather than trueMax.
- Evident from the text: the full simulated sample excluded edge-case parameter combinations, and 1000-pixel jpg maps were dropped because labels were illegible; the real-world sample was limited to country maps from one collection at low-to-medium resolution, so generalization to other map types or collections is not established.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures








Verification
Claims the paper makes
0 Valid · 0 Not valid · 17 Not checked · 60 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Our results showed no noticeable difference between several widely used map projections for low-accuracy georeferencing (less than 100% error of map radius), and only minor differences for high-accuracy georeferencing (less than 5% error).”
§ Toponym-assisted map georeferencing: Evaluating the use of toponyms for the digitization of map collections > Discussion > Capabilities & limitations
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As few as 10 toponyms was shown to be sufficient in order to achieve a generally acceptable level of georeferencing accuracy.”
§ Toponym-assisted map georeferencing: Evaluating the use of toponyms for the digitization of map collections > Discussion > Capabilities & limitations
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This is reflected in our results, in which an image resolution of 1000 pixels was equivalent to approximately 1 pixel-per-point (or 75% of the standard size); in these cases, only 60% of maps were succesfully georeferenced, down from over 80% in cases where text resolution was at least 1.33 pixels-per-point (our 2000 and 3000 pixel resolution cases).”
§ Toponym-assisted map georeferencing: Evaluating the use of toponyms for the digitization of map collections > Discussion > Capabilities & limitations
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In terms of overall success rates, approximately one-fourth (26.9%) of the 6,430 simulated maps could be used for high-accuracy georeferencing (less than 5% error), while about three-fourths of maps (77.7%) could be used for low-accuracy georeferencing (less than 100% error).”
§ Toponym-assisted map georeferencing: Evaluating the use of toponyms for the digitization of map collections > Results > Simulated map georeferencing results
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“In terms of the share of simulated maps that can be georeferenced to within 1% error, the traditionally applied model residual calculation (modelMax) suggests a success rate of 51%, while the calculation based on leave-one-out residuals (modelMaxLOO) suggests a success rate of 33%.”
§ Toponym-assisted map georeferencing: Evaluating the use of toponyms for the digitization of map collections > Results > Simulated map georeferencing results
hedged- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
39 more claims
Create a free account to see all 77 claims and to verify the 39 references still open.
- Probably not a substantial claim. 18
- It may state two separate claims as one. 22
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“| Not. (>100%) | 2.4% | 84.7% | 0.0% | 100% |”
§ Toponym-assisted map georeferencing: Evaluating the use of toponyms for the digitization of map collections > Results > Real world georeferencing results
Reported 100 · recomputed 84.7
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Toponym-assisted map georeferencing: Evaluating the use of toponyms for the digitization of map collections > Materials and methods > 2) Toponym geocoding & disambiguation
“construct a set C made up of all possible combinations of three non-repeating toponyms”
§ Toponym-assisted map georeferencing: Evaluating the use of toponyms for the digitization of map collections > Materials and methods > 2) Toponym geocoding & disambiguation
“For instance, in the case of four toponyms, set C would contain three possible combinations: (3) C={{θ1,θ2,θ3},{θ1,θ2,θ4},{θ2,θ3,θ4}}”
Citations
Cites
An Overview of the Tesseract OCR Engine
Smith, R. (2007) · Ninth International Conference on Document Analysis and Recognition (ICDAR 2007) Vol 2 · doi:10.1109/icdar.2007.4376991 · Cited by 2,376
Sharma, G., Wu, W., & Dalal, E. N. (2005) · Color Research & Application · doi:10.1002/col.20070 · Cited by 2,175
geoBoundaries: A global database of political administrative boundaries
Runfola, D., Anderson, A., Baier, H., Crittenden, M., Dowker, E., Fuhrig, S., Goodman, S., Grimsley, G., Layko, R., Melville, G., et al. (2020) · PLOS ONE · doi:10.1371/journal.pone.0231866 · Cited by 380
Self-citationHistorical Shoreline Mapping (I): Improving Techniques and Reducing Positioning Errors
Thieler, E. R., & Danforth, W. W. (1994) · Journal of Coastal Research · Cited by 322
Conflation Automated map compilation
Saalfeld, A. (1988) · International Journal of Geographical Information Systems · doi:10.1080/02693798808927897 · Cited by 298
Politically Relevant Ethnic Groups across Space and Time: Introducing the GeoEPR Dataset
Wucherpfennig, J., Weidmann, N. B., Girardin, L., Cederman, L.-E., & Wimmer, A. (2011) · Conflict Management and Peace Science · doi:10.1177/0738894210393217 · Cited by 286
Past time, past place: GIS for history
(2003) · Choice Reviews Online · doi:10.5860/choice.40-5338 · Cited by 221
Studying cartographic heritage: Analysis and visualization of geometric distortions
Jenny, B., & Hurni, L. (2011) · Computers & Graphics · doi:10.1016/j.cag.2011.01.005 · Cited by 192
Panagos, P., Jones, A., Bosco, C., & Kumar, P. S. S. (2011) · International Journal of Digital Earth · doi:10.1080/17538947.2011.596580 · Cited by 147
A Review of Point Set Registration: From Pairwise Registration to Groupwise Registration
Zhu, H., Guo, B., Zou, K., Li, Y., Yuen, K., Mihaylova, L. S., & Leung, H. (2019) · Sensors · doi:10.3390/s19051191 · Cited by 116
Research works printed but not linked: 8
- MJ Jackson, 1991, Geographical Information Systems: Principles and Applications—Volume 1: Principles, 239
- P Bolstad, 2014, GIS Fundamentals: a first text on Geographic Information Systems
- G Kurt Menke, 2016, Mastering QGIS
- MJ Goodchild, 1991, Geographical Information Systems: Principles and Applications—Volume 1: Principles, 40
- Herold H, Roehm P, Hecht R, Meinel G. Automatically georeferenced maps as a source for high resolution urban growth analyses. In: Proceedings of the ICA 25th International Cartographic Conference. 1; 2011. p. 1–5.
- M Rusiñol, 2011, Automatic index generation of digitized map series by coordinate extraction and interpretation, e-Perimetron, 6, 219
- Leyk S, Chiang YY. Information extraction based on the concept of geographic context. In: Proc. AutoCarto; 2016. p. 100–110.
- Inoue R, Wako M, Shimizu E. A new map transformation method for highly deformed maps by creating homeomorphic triangulated irregular network. In: XXIII International Cartographic Conference. Moscow, Russia. DVD; 2007.
Cited by
Fields Touched by Digitalization: Analysis of Scientific Activity in Scopus
Espina-Romero, L. C., & Alcedo, J. M. G. (2022) · Sustainability · doi:10.3390/su142114425 · Cited by 44
Mitxelena-Hoyos, O., & Amaro-Mellado, J.-L. (2023) · ISPRS International Journal of Geo-Information · doi:10.3390/ijgi12020070 · Cited by 10
Semantic segmentation of historical maps using Self-Constructing Graph Convolutional Networks
Arzoumanidis, L., Knechtel, J., Haunert, J., & Dehbi, Y. (2025) · Cartography and Geographic Information Science · doi:10.1080/15230406.2025.2468304 · Cited by 9
Fine-grained extraction of geospatial and temporal information from Chinese historical newspapers
Sun, S., & Qin, X. (2025) · Digital Scholarship in the Humanities · doi:10.1093/llc/fqaf025 · Cited by 7
Georeferencing historical maps using local feature matching and Delaunay consistency
Vaienti, B., di Lenardo, I., & Kaplan, F. (2025) · Cartography and Geographic Information Science · doi:10.1080/15230406.2025.2566789 · Cited by 6
Metadata
- Authors
- Bahgat, K., & Runfola, D.
- Affiliations
- William & Mary (US)
- ORCID
- Bahgat, Karim
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2021-11-18
- Volume
- 16
- Issue
- 11
- Pages
- e0260039
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC8601528
- OpenAlex
- W3212834916
- Cited by
- 16
- References
- 85
- Citations by year
- 2026: 9 · 2025: 4 · 2024: 1 · 2023: 1 · 2022: 1
- FWCI
- 1.24
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- W&M Publish (College of William & Mary) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Funders
- Bill and Melinda Gates Foundation
- Topics
- Social Sciences › Geography, Planning and Development › Historical Geography and Cartography
- Social Sciences › Arts and Humanities › Literature and Literary Theory › Digital Humanities and Scholarship
- Social Sciences › Geography, Planning and Development › Geographic Information Systems Studies
- Keywords
- place names, map digitization, archival maps, historical cartography
- MeSH terms
- Data Collection, Humans, Image Processing, Computer-Assisted, Maps as Topic, Pilot Projects, Software, Information Storage and Retrieval, Geographic Mapping
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-19, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-19 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Toponym-assisted map georeferencing: Evaluating the use of toponyms for the digitization of map collections. https://app.cochat.ai/papers/10.1371/journal.pone.0260039
- The paper
- Bahgat, K., & Runfola, D. (2021). Toponym-assisted map georeferencing: Evaluating the use of toponyms for the digitization of map collections. PLOS ONE. https://doi.org/10.1371/journal.pone.0260039
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.