The DOI matches its Crossref record; 53 of the 54 references it cites were found in a registry or an index; none of the 42 sources its claims cite is checked for support yet.
The world’s user-generated road map is more than 80% complete
Open accessAbstract
OpenStreetMap, a crowdsourced geographic database, provides the only global-level, openly licensed source of geospatial road data, and the only national-level source in many countries. However, researchers, policy makers, and citizens who want to make use of OpenStreetMap (OSM) have little information about whether it can be relied upon in a particular geographic setting. In this paper, we use two complementary, independent methods to assess the completeness of OSM road data in each country in the world. First, we undertake a visual assessment of OSM data against satellite imagery, which provides the input for estimates based on a multilevel regression and poststratification model. Second, we fit sigmoid curves to the cumulative length of contributions, and use them to estimate the saturation level for each country. Both techniques may have more general use for assessing the development and saturation of crowd-sourced data. Our results show that in many places, researchers and policymakers can rely on the completeness of OSM, or will soon be able to do so. We find (i) that globally, OSM is ∼83% complete, and more than 40% of countries-including several in the developing world-have a fully mapped street network; (ii) that well-governed countries with good Internet access tend to be more complete, and that completeness has a U-shaped relationship with population density-both sparsely populated areas and dense cities are the best mapped; and (iii) that existing global datasets used by the World Bank undercount roads by more than 30%.
Overview
CoChat Summary
TL;DR
Using visual comparison with satellite imagery and sigmoid saturation fits to OpenStreetMap contribution history, the authors estimate that the global OSM road network was ∼83% complete in January 2016 (95% CI 81–84%). They also estimate a global road stock of ∼39.7×10⁶ km and find that IRF/World Bank road-length data substantially undercount roads.
Key findings
- Globally, OSM roads were ∼83% complete in January 2016 (95% CI 81–84%) by the multilevel model; country-level parametric fits gave 87% when weighted by estimated road length, while a global sigmoid fit suggested 97% but was not preferred because recent global growth appeared linear. About 42% of countries were more than 95% complete; of 185 countries with both estimates, 77 were more than 95% complete, and 47 had the highest confidence because multilevel, country-level, and sub-national fits all indicated >95%.
- Completeness was higher in well-governed countries with good Internet access and in small countries; it had a ∪-shaped relationship with population density, with both sparsely populated areas and dense cities best mapped, while smaller towns and villages were most likely to have missing streets. GDP had no clear independent effect except at the lowest densities. Countries such as Kiribati, Afghanistan, Egypt, and China were less than one-third complete, while Cuba, Ecuador, Syria, and most European and North American countries were more than 95% complete.
- The estimated global road stock was ∼39.7×10⁶ km, or ∼5.6 m per person, with the United States accounting for ∼23.0% of the world’s roads. OSM-based estimates exceeded IRF estimates in the majority of countries; globally they were 134% of the IRF estimate, and in 94 of 190 countries they were more than 150% of IRF. In the poorest countries, road supply was nearly 40% larger than suggested by IRF, and existing global datasets used by the World Bank undercount roads by more than 30%.
Methods
- Visual assessment: a stratified, probability-weighted sample of 45 points per country—25 points selected proportional to log population density and 20 points restricted to densely populated areas above a country-specific density threshold—yielded 8,370 observations. OSM street edges were overlaid on Google/Bing aerial imagery at 1:5000, missing and present edges were counted, and February 2015 estimates were updated to January 2016. A multilevel regression and poststratification model used local population density and country-level GDP per capita, Internet penetration, population size, and World Bank “voice and accountability,” estimated in PyStan.
- Saturation method: using OSM full-history data, the authors extracted every version of every node and way tagged “highway,” calculated road lengths, and built cumulative road-length time series by country. They fit flexible sigmoid functional forms with up to four jumps, plus a linear growth model, using nonlinear least squares and selecting the best form by mean-squared error; they also fit sub-national administrative units and country-specific density quintiles.
- Combining estimates and road length: where the parametric estimate fell within the 95% confidence interval of the multilevel estimate or differed by ≤0.05, the parametric fit was used (61 countries); otherwise the multilevel estimate was used (124 countries). The parametric fit was also used for 68 countries without a multilevel estimate. Total road length was estimated as OSM 2016 road length divided by estimated fraction complete, excluding countries with completeness <0.05 (five small-island states).
Limitations
- Stated: OSM contributions are not deterministic, so the parametric functional forms are heuristic and have limited predictive power for future contributions in individual countries, which may occur in jumps. The authors also assume urban growth is slow and that additions represent previously missing streets, whereas the street network is physically growing. The relatively small sample size per country means visual-assessment confidence intervals are often wide, though this is partly mitigated by using two independent methods.
- Stated: the completeness measure considers only the presence of geographic features, not attribute information such as street names, nor other quality measures such as positional accuracy. Country-level factors have only limited predictive power, and wide confidence intervals plus endogeneity concerns mean the results should not necessarily be given a causal interpretation.
- Evident from the text: possible double-counting of dual carriageways in OSM is noted, though the authors say it is unlikely to account for more than a small part of the difference (one-way streets were only 2.0% of ways as of May 2017). The visual assessment relies partly on Google Maps imagery even though the authors note Google Maps data themselves are not complete in many parts of the world, and manual counting involved some judgment.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures









Verification
Claims the paper makes
0 Valid · 1 Not valid · 25 Not checked · 89 Own results and interpretations
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“that well-governed countries with good Internet access tend to be more complete”
§ The world’s user-generated road map is more than 80% complete > Abstract
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“existing global datasets used by the World Bank undercount roads by more than 30%”
§ The world’s user-generated road map is more than 80% complete > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The world’s user-generated road map is more than 80% complete”
- Also stated in: § Abstract · plain
“We find (i) that globally, OSM is ∼83% complete”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
- Also stated in: § Abstract · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“completeness has a U-shaped relationship with population density”
§ The world’s user-generated road map is more than 80% complete > Abstract
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“more than 40% of countries—including several in the developing world—have a fully mapped street network”
§ The world’s user-generated road map is more than 80% complete > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on 2 assumptions not shown here.
43 more claims
Create a free account to see all 115 claims and to verify the 41 references still open.
- It may state two separate claims as one. 25
- Probably not a substantial claim. 52
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“using values of 5–25 kg CO2e year−1 km−1 [58] for life cycle emissions from petroleum-based and cementatious road surfaces, global annual emissions associated with the construction and maintenance of roads amortized over the lifetime of the road is on the order of 100–500 MT CO2e year−1.”
§ The world’s user-generated road map is more than 80% complete > Discussion and conclusions
Reported 100 · recomputed 198.5
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ The world’s user-generated road map is more than 80% complete > Methods > Visual assessment
“where βj, α are vectors of length 6 (given that there are six grid-cell coefficients for each country j, βj1 … βj6); γ, Zj are m×6 matrices of coefficients and country-level covariates; and Ω is the variance-covariance matrix.”
§ The world’s user-generated road map is more than 80% complete > Methods > Visual assessment
“βj∼N(α+γZj,Ω)”
Citations
Cites
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Stan : A Probabilistic Programming Language
Carpenter, B., Gelman, A., Hoffman, M. D., Lee, D., Goodrich, B., Betancourt, M., Brubaker, M., Guo, J., Li, P., & Riddell, A. (2017) · Journal of Statistical Software · doi:10.18637/jss.v076.i01 · Cited by 7,754 · cited 1×
“The model is estimated in a Bayesian framework using the open-source PyStan software [46].”
MethodHaklay, M. (2010) · Environment and Planning B: Planning and Design · doi:10.1068/b35097 · Cited by 1,632
arm: Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Su, Y.-S. (2007) · CRAN: Contributed Packages · doi:10.32614/cran.package.arm · Cited by 955
What Drives Deforestation in the Brazilian Amazon?
Pfaff, A. S. P. (1999) · Journal of Environmental Economics and Management · doi:10.1006/jeem.1998.1056 · Cited by 571
Quality Assessment of the French OpenStreetMap Dataset
Girres, J., & Touya, G. (2010) · Transactions in GIS · doi:10.1111/j.1467-9671.2010.01203.x · Cited by 531
How Should We Estimate Public Opinion in The States?
Lax, J. R., & Phillips, J. H. (2009) · American Journal of Political Science · doi:10.1111/j.1540-5907.2008.00360.x · Cited by 513
A review of volunteered geographic information quality assessment methods
Senaratne, H., Mobasheri, A., Ali, A. L., Capineri, C., & Haklay, M. (. (2017) · International Journal of Geographical Information Science · doi:10.1080/13658816.2016.1189556 · Cited by 493
Quality assessment for building footprints data on OpenStreetMap
Fan, H., Zipf, A., Fu, Q., & Neis, P. (2014) · International Journal of Geographical Information Science · doi:10.1080/13658816.2013.867495 · Cited by 421
A Comprehensive Framework for Intrinsic OpenStreetMap Quality Analysis
Barron, C., Neis, P., & Zipf, A. (2014) · Transactions in GIS · doi:10.1111/tgis.12073 · Cited by 411
Research works printed but not linked: 1
- 2002, A World Bank Urban Transport Strategy Review
Cited by
Street view imagery in urban analytics and GIS: A review
Biljecki, F., & Ito, K. (2021) · Landscape and Urban Planning · doi:10.1016/j.landurbplan.2021.104217 · Cited by 925
Global patterns of current and future road infrastructure
Meijer, J. R., Huijbregts, M. A. J., Schotten, K. C. G. J., & Schipper, A. M. (2018) · Environmental Research Letters · doi:10.1088/1748-9326/aabd42 · Cited by 807
Kennedy, C. M., Oakleaf, J. R., Theobald, D. M., Baruch‐Mordo, S., & Kiesecker, J. (2019) · Global Change Biology · doi:10.1111/gcb.14549 · Cited by 722
Degrading permafrost puts Arctic infrastructure at risk by mid-century
Hjort, J., Karjalainen, O., Aalto, J., Westermann, S., Romanovsky, V. E., Nelson, F. E., Etzelmüller, B., & Luoto, M. (2018) · Nature Communications · doi:10.1038/s41467-018-07557-4 · Cited by 610
A global multi-hazard risk analysis of road and railway infrastructure assets
Koks, E. E., Rozenberg, J., Zorn, C., Tariverdi, M., Vousdoukas, M., Fraser, S. A., Hall, J. W., & Hallegatte, S. (2019) · Nature Communications · doi:10.1038/s41467-019-10442-3 · Cited by 603
Metadata
- Authors
- Barrington-Leigh, C., & Millard-Ball, A.
- Affiliations
- McGill University (CA)
- Corresponding author
- Barrington-Leigh, Christopher
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2017-08-10
- Volume
- 12
- Issue
- 8
- Pages
- e0180698
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC5552279
- OpenAlex
- W2744637967
- Semantic Scholar
- f276a051441930e3c59cfc8fe67c38df02a86aea
- Cited by
- 553
- References
- 54
- Citations by year
- 2026: 117 · 2025: 74 · 2024: 66 · 2023: 49 · 2022: 71 · 2021: 61 · 2020: 49 · 2019: 46 · 2018: 19 · 2017: 1
- FWCI
- 94.56
- Type
- journal article
- Language
- en
- Update notices
- correction (2019-10-29)
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS ONE (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- eScholarship@McGill (McGill) (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- eScholarship@McGill (McGill) (submittedVersion, cc-by)
- Funders
- Social Sciences and Humanities Research Council of Canada (435-2016-0531)
- Hellman Fellows Program
- UC Santa Cruz Committee on Research
- Topics
- Social Sciences › Geography, Planning and Development › Geographic Information Systems Studies
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Automated Road and Building Extraction
- Physical Sciences › Computer Science › Computer Science Applications › Mobile Crowdsensing and Crowdsourcing
- Keywords
- OpenStreetMap, crowdsourced geospatial data, roadmapping, data saturation, population density, internet access, satellite imagery validation, developing countries
- MeSH terms
- Transportation Facilities, Cities, Humans, Maps as Topic, Databases, Factual, Motor Vehicles, Geographic Information Systems, Geographic Mapping, Satellite Imagery
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-19, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-19 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.